Abstract
Point spread function (PSF) estimation plays an important role in blind image deconvolution. This paper proposes two novel criteria for parametric PSF estimation, based on Stein’s unbiased risk estimate (SURE), namely, prediction-SURE and its variant. We theoretically prove the SURE-type functionals incorporating exact (complementary) smoother filtering as the valid criteria for PSF estimation. We also provide the theoretical error analysis for the regularizer approximations, by which we show that the proposed frequency-adaptive regularization term yields more accurate PSF estimate than others. In particular, the proposed SURE-variant enables us to avoid estimation of noise variance, which is a key advantage over the traditional SURE-like functional. Finally, we propose an efficient algorithm for the minimizations of the criteria. Not limited to the examples we show in this paper, the proposed SURE-based framework has a great potential for other imaging applications, provided the parametric PSF form is available.
Similar content being viewed by others
Notes
The last term \(\Vert \mathbf {x}\Vert ^2\) of (3) is a constant irrelevant to the optimization of function \(\mathbf {f}\).
Oracle means that this criterion is not accessible in practice, due to the unknown \(\mathbf {x}\) in (4).
Oracle means that this criterion is not accessible in practice, due to the unknown \(\mathbf {H}_0\mathbf {x}\) in (7).
Following the convention of [14], we refer to estimation of \(\mathbf {x}\) as estimation, and to estimation of \(\mu =\mathbf {H}_0\mathbf {x}\) as prediction.
The optimal solution \(\mathbf {s}^\star \) may not be unique. The uniqueness of the solution depends on the parametric form of PSF.
The practical computation can be fully performed in Fourier domain. The introduction of matrix \(\mathbf {Q}\) is for sake of concise expression by linear algebra language.
The last term \(\sigma ^2\), though unknown, is a constant irrelevant to the minimization procedure.
The terminology jinc is due to the structural similarity to sinc function [6].
References
Allen, D.M.: Mean square error of prediction as a criterion for selecting variables. Technometrics 13(3), 469–475 (1971)
Babacan, S., Molina, R., Katsaggelos, A.: Variational Bayesian blind deconvolution using a total variation prior. IEEE Trans. Image Process. 18(1), 12–26 (2009)
Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2(1), 183–202 (2009)
Bishop, T., Babacan, S., Amizic, B., Katsaggelos, A., Chan, T., Molina, R.: Blind image deconvolution: problem formulation and existing approaches. In: Blind image deconvolution: theory and applications, pp. 1–23. CRC Press (2007)
Born, M., Wolf, E., Bhatia, A.: Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light. Cambridge University Press, Cambridge (1999)
Cao, Q.: Generalized Jinc functions and their application to focusing and diffraction of circular apertures. J. Opt. Soc. Am. A 20(4), 661–667 (2003)
Carasso, A.: Linear and nonlinear image deblurring: a documented study. SIAM J. Numer. Anal. 36, 1659–1689 (1999)
Carasso, A.: The APEX method in image sharpening and the use of low exponent Lévy stable laws. SIAM J. Appl. Math. 63, 593–618 (2002)
Chan, T., Wong, C.: Total variation blind deconvolution. IEEE Trans. Image Process. 7(3), 370–375 (1998)
Chen, F., Ma, J.: An empirical identification method of Gaussian blur parameter for image deblurring. IEEE Trans. Signal Process. 57(7), 2467–2478 (2009)
Danielyan, A., Katkovnik, V., Egiazarian, K.: BM3D frames and variational image deblurring. IEEE Trans. Image Process. 21(4), 1715–1728 (2012)
Donoho, D., Johnstone, J.: Ideal spatial adaptation by wavelet shrinkage. Biometrika 81(3), 425–455 (1994)
Eldar, Y.: Generalized SURE for exponential families: applications to regularization. IEEE Trans. Signal Process. 57(2), 471–481 (2009)
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning, vol. 2. Springer, New York (2009)
Kundur, D., Hatzinakos, D.: Blind image deconvolution. IEEE Signal Process. Mag. 13(3), 43–64 (1996)
Liao, H., Ng, M.K.: Blind deconvolution using generalized cross-validation approach to regularization parameter estimation. IEEE Trans. Image Process. 20(3), 3005–3019 (2011)
Li, D., Simske, S.: Atmospheric turbulence degraded-image restoration by kurtosis minimization. IEEE Geosci. Remote Sens. Lett. 6(2), 244–247 (2009)
Luisier, F.: The SURE-LET approach to image denoising. Ph.D. Thesis, École Polytechnique Fédérale de Lausanne (2010)
Michailovich, O., Tannenbaum, A.: Blind deconvolution of medical ultrasound images: a parametric inverse filtering approach. IEEE Trans. Image Process. 16(12), 3005–3019 (2007)
Moffat, A.: A theoretical investigation of focal stellar images in the photographic emulsion and application to photographic photometry. Astron. Astrophys. 3, 455–461 (1969)
Molina, R., Núñez, J., Cortijo, F., Mateos, J.: Image restoration in astronomy: a Bayesian perspective. IEEE Signal Process. Mag. 18(2), 11–29 (2001)
Molina, R., Mateos, J., Katsaggelos, A.: Blind deconvolution using a variational approach to parameter, image, and blur estimation. IEEE Trans. Image Process. 15(12), 3715–3727 (2006)
Oliveira, J., Figueiredo, M., Bioucas-Dias, J.: Parametric blur estimation for blind restoration of natural images: linear motion and out-of-focus. IEEE Trans. Image Process. 23(1), 466–477 (2014)
Pan, H., Blu, T.: An iterative linear expansion of thresholds for \(\ell _1\)-based image restoration. IEEE Trans. Image Process. 22(9), 3715–3728 (2013)
Pesquet, J., Benazza-Benyahia, A., Chaux, C.: A SURE approach for digital signal/image deconvolution problems. IEEE Trans. Signal Process. 57(12), 4616–4632 (2009)
Poropat, G.: Effect of system point spread function, apparent size, and detector instantaneous field of view on the infrared image contrast of small objects. Opt. Eng. 32(10), 2598–2607 (1993)
Reeves, S.J., Mersereau, R.M.: Blur identification by the method of generalized cross-validation. IEEE Trans. Image Process. 1(3), 301–311 (1992)
Sarder, P., Nehorai, A.: Deconvolution methods for 3-D fluorescence microscopy images. IEEE Signal Process. Mag. 23(3), 32–45 (2006)
Stein, C.: Estimation of the mean of a multivariate normal distribution. Ann. Stat. 9(6), 1135–1151 (1981)
Vaiter, S., Deledalle, C., Peyré, G., Fadili, J., Dossal, C.: Local behavior of sparse analysis regularization: applications to risk estimation. Appl. Comput. Harmon. Anal. 35(3), 433–451 (2012)
Vonesch, C., Ramani, S., Unser, M.: Recursive risk estimation for non-linear image deconvolution with a wavelet-domain sparsity constraint. In: 15th IEEE International Conference on Image Processing, pp. 665–668 (2008)
Xue, F., Blu, T.: SURE-based blind Gaussian deconvolution. In: 2012 IEEE Statistical Signal Processing Workshop (SSP), pp. 452–455. Ann Arbor, MI, USA, Aug 2012
Xue, F., Blu, T.: SURE-based motion estimation. In: 2012 IEEE International Conference on Signal Processing, Communications and Computing, pp. 373–377. Hong Kong, Aug 2012
Xue, F., Blu, T.: A novel SURE-based criterion for parametric PSF estimation. IEEE Trans. Image Process. 24(2), 595–607 (2015)
Xue, F., Yagola, A.G.: Analysis of point-target detection performance based on ATF and TSF. Infrared Phys. Technol. 52(5), 166–173 (2009)
Acknowledgments
This work was supported by the National Natural Science Foundation of China (No. 61401013). The authors would like to thank the coordinating editor and anonymous reviewers for their insightful comments, and also obliged to Hanjie PAN for many useful discussions on this paper.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1: Proof of Theorem 3
Proof
Based on Lemma 1, the prediction-SURE can be written as
We omit the subscript \(\mathbf {U}_{\mathbf {H},\lambda }\) as \(\mathbf {U}\) for brevity in this proof.
Now, we are going to compute the divergence term—\({\mathrm {div}}_{\mathbf {y}}\big (\mathbf {U}\mathbf {y}\big )\). Notice that the matrix \(\mathbf {U}\) is the function of \(\mathbf {y}\), hence, \({\mathrm {div}}_{\mathbf {y}}\big (\mathbf {U}\mathbf {y}\big )\ne {\mathrm {Tr}}(\mathbf {U})\).
First, by definition of divergence term, we have
where the vector \(\mathrm {diag}(\mathbf {U})\in \mathbf {R}^N\) consists of the diagonal element \(U_{n,n}\) of matrix \(\mathbf {U}\):
Notice that under periodic boundary condition, \(\mathbf {U}\) is circulant matrix, whose diagonal element is a constant given by
The second equality is from inverse Fourier transform. Now, we consider the n-th element of \(\alpha \):
where
and for any fixed n:
where the two terms are
and
Hence, \(\alpha _n\) becomes
where g(n) is the inverse Fourier transform of \(G(k)=V(k)Y(k)\): \(g(n)=\frac{1}{N}\sum _{k=0}^{N-1} G(k)e^{j\frac{2\pi nk}{N}}\). Since V(k) is real-valued, and Y(k) is Hermitian symmetric, g(n) is real-valued. Thus, we have \(\alpha _n=2{\mathcal {R}}\{g(n)\}=2g(n)\).
Finally, the second term of (28) becomes
where \(\mathbf {F}\) is 1-D DFT matrix. The proof is completed. \(\square \)
Appendix 2: Proof of Corollary 1
Proof
The proof is very similar to that of Theorem 3 (see Appendix 1). The only difference from one-dimensional case is how to compute \(\frac{\partial |Y(k_1,k_2)|^2}{\partial y(n_1,n_2)}\):
The numerator is
The derivatives of both the terms of (29) are
and
Hence, \(\alpha _{n_1,n_2}\) is
where \(g(n_1,n_2)\) is the inverse Fourier transform of \(G(k_1,k_2)=V(k_1,k_2)Y(k_1,k_2)\): \(g(n_1,n_2)=\frac{1}{MN}\sum _{k_1=0}^{M-1}\sum _{k_2=0}^{N-1} G(k_1,k_2)e^{j\frac{2\pi n_1k_1}{M}} e^{j\frac{2\pi n_2k_2}{N}}\). Since \(V(k_1,k_2)\) is real-valued, and \(Y(k_1,k_2)\) is Hermitian symmetric, \(g(n_1,n_2)\) is real-valued. Thus, we have \(\alpha _{n_1,n_2}=2{\mathcal {R}}\{g(n_1,n_2)\} =2g(n_1,n_2)\).
Finally, the second term of (28) becomes
where \(\mathbf {F}\) is 2-D DFT matrix. The proof is completed. \(\square \)
Rights and permissions
About this article
Cite this article
Xue, F., Liu, J., Jiao, S. et al. SURE-Type Functionals as Criteria for Parametric PSF Estimation. J Math Imaging Vis 54, 78–105 (2016). https://doi.org/10.1007/s10851-015-0590-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-015-0590-z