Specific embodiment
The present invention will be further explained below with reference to the attached drawings:
In Fig. 1, adaptive weighted double blind Super-resolution Reconstructions of norm remote sensing images based on local and non local joint priori
Method can specifically be divided into following steps:
(1) in fuzzy kernel estimates subprocess, using adaptive weighted double norm priori, with the fuzzy core estimated and just
Beginning high-definition picture;
(2) using the fuzzy core of estimation and initial high-resolution image as the non-blind input for rebuilding subprocess;
(3) in non-blind reconstruction subprocess, the fuzzy core and initial high-resolution image of estimation utilize office as known conditions
Portion and non local joint priori and maximum a posteriori probability reconstruction model estimate high-definition picture.
(4) using the reconstructed results of step (3) as new input high-definition picture, step (3) and step are repeated
(4), number is built until reaching maximum, finally output is final reconstructed results.
Specifically, in the step (1), we input low resolution blurred picture first, and building is general based on maximum a posteriori
The reconstruction framework of rate, using adaptive weighted double norm priori and convolution consistency priori as constraint condition in the frame,
In the fuzzy core of adaptive weighted double norm priori difference restrained split-flows and the high-definition picture of estimation, convolution consistency priori
The high-definition picture of restrained split-flow.As shown in formula (1):
λ indicates the parameter of first item de-blurred image convolution output;H is that the matrix of fuzzy core k indicates;D is that reduction is original
The down-sampling matrix of high-definition picture resolution ratio;X is original high-resolution image, and y is the low resolution fuzzy graph observed
Picture;αx, βx, αk, βkIt is regularization parameter;η is convolution consistency constraint parameter;It is convolution consistency constraint item, uses
In reduction pathosis, high-definition pictureIt can rebuild to obtain by existing super-resolution algorithms;By lpNorm and l2Norm building
Image prior itemWith fuzzy core priori itemAdaptive double norm weightings are collectively constituted
Priori, wherein weighting matrix W is for adaptively determining that image current region is non-edge or fringe region, and weighs according to this
L is emphasized again2Norm is for the smooth and noise suppressed effect of image non-edge and lpSharpening of the norm to fringe region
It acts on, wherein each w in WiIt is defined as formula (2):
It represents the local Non-smooth surface of a 5*5 image block centered on ith pixel.XiIt is the image block
Center pixel, ΩiIt is all pixels indexed set, X in the image blockijIt is XiNeighbor pixel in the position j.
By step (1), the fuzzy core k and initial high-resolution image x that can be estimated.
In the step (2), we rebuild high-definition picture by the non-blind reconstruction subprocess of super-resolution.Wherein in step
Suddenly the fuzzy core k and initial high-resolution image x of estimation obtained in (1) are as known input item, thus by former and later two
Subprocess combines, such as Fig. 1.
In the step (3), we construct the reconstruction framework based on maximum a posteriori probability, local and non local using joint
Priori as image prior, see formula (3):
Wherein JAHNLTVIt is non local image prior, JAGDIt is local image prior, ζ and θ are the above-mentioned two elder generations of balance
The regularization parameter tested.In this step, fuzzy core is known and initial high-resolution image is as iteration starting point, to reconstruct
High-definition picture.
In the step (4), we repeat step using the result of step (3) as new initial high-resolution image
Suddenly (3) and step (4).Number is rebuild until reaching the maximum of setting, reconstructed results are final output.
Validity in order to better illustrate the present invention has carried out initial high-resolution image comparative experiments respectively, obscures
Kernel estimates comparative experiments, and carried out on common test image " mobilehomepark " reconstruction of final high-definition picture
Comparative experiments.
Initial high-resolution image comparative experiments is as shown in Figure 2.Fig. 2 (a) and Fig. 2 (c) is by the fuzzy kernel estimates of the present invention
2 times of subprocess are rebuild obtained initial high-resolution image, and Fig. 2 (b) and Fig. 2 (d) are used to the low resolution of raw observation
The high-definition picture of 2 times of bicubic reconstructions.
Fuzzy kernel estimates comparative experiments is as shown in Figure 3.(a) (e) (i) is realistic blur core image, and (b) (f) (j) is this hair
The fuzzy core of bright estimation, (c) (g) (k) is the fuzzy core that deblurring control methods 1 is estimated, (d) (h) (l) is deblurring to analogy
The fuzzy core that method 2 is estimated.The algorithm of two kinds of comparisons are as follows:
The method that deblurring control methods 1:Xu et al. is proposed, bibliography " Xu L, Zheng S, Jia J.
“Unnatural l0 sparse representation for natural image deblurring,”Proceedings
of the IEEE conference on computer vision and pattern recognition.2013:1107-
1114.”。
The method that deblurring control methods 2:Shao et al. is proposed, bibliography " Shao W Z, Li H B, Elad M,
“Bi-l0-l2-norm regularization for blind motion deblurring,”Journal ofVisual
Communication and Image Representation,2015,33:42-59.”。
The reconstruction comparative experiments of final high-definition picture is as shown in Figure 4.(a) it is input low-resolution image, is (i) original
Beginning high-definition picture, (b) (c) (d) (e) (f) (g) (h) is respectively control methods 1, control methods 2, control methods 3, comparison
Method 4, control methods 5, Bicubic and reconstructed results of the invention.
The method that control methods 1:Shao et al. is proposed, bibliography " Shao W Z, Elad M, " Simple,
accurate,and robust nonparametric blind super-resolution,”International
Conference on Image and Graphics.Springer,Cham,2015:333-348.”。
Control methods 2: fuzzy kernel estimates subprocess uses deblurring control methods 2, non-blind reconstruction subprocess: Buades etc.
The method that people proposes, bibliography " Buades A, Coll B, Morel J M, " Image enhancement by non-
local reverse heat equation,”Preprint CMLA,2006,22:2006.”。
Control methods 3: fuzzy kernel estimates subprocess uses deblurring control methods 2, non-blind reconstruction subprocess: Ren et al.
The method of proposition, bibliography " Ren C, He X, Nguyen T Q, " Single image super-resolution via
adaptive high-dimensional non-local total variation and adaptive geometric
feature,”IEEE Transactions on Image Processing,2017,26(1):90-106.”。
Control methods 4: fuzzy kernel estimates subprocess uses deblurring control methods 1, non-blind reconstruction subprocess: Dong et al.
The method of proposition, bibliography " Dong W, Zhang L, Shi G, et al, " Nonlocally centralized sparse
representation for image restoration,”IEEE Transactions on Image Processing,
2013,22(4):1620-1630.”。
Control methods 5: fuzzy kernel estimates subprocess uses deblurring control methods 1, non-blind reconstruction subprocess: Buades etc.
The method that people proposes, bibliography " Buades A, Coll B, Morel J M, " Image enhancement by non-
local reverse heat equation,”Preprint CMLA,2006,22:2006.”。
The content of the reconstruction comparative experiments of final high-definition picture is as follows:
Bicubic is used respectively, and method 1, method 2, method 3, method 4, method 5 and the present invention are to by remote sensing test image
The low resolution blurred picture that library " UCMerced " simulation generates carries out 2 times of reconstructions.The fuzzy of low-resolution image degrades by eight
Kind fuzzy core is realized.Super-resolution rebuilding result to objectively evaluate parameter as shown in Table 1.Wherein objectively evaluate parameter PSNR
(Peak Signal to Noise Ratio), SSIM (Structure Similarity Index) are that value is bigger, are represented
Picture quality is better.Test of heuristics platform: the desk-top calculating of processor Inter Core i5CPU (3.3GHz) and memory 16G
Machine.
Table one
In the objective parameter shown in the table one, for eight kinds of different fuzzy cores present invention on remote sensing images test library
Highest PSNR, SSIM value is all achieved, the better quality of reconstructed results of the present invention is represent.
In conclusion reconstructed results of the invention have some superiority on subjective evaluation compared to control methods.Cause
This, the present invention is a kind of high performance single image super resolution ratio reconstruction method.