[go: up one dir, main page]

CN104601906A - Automatic suppression method for on-orbit noise of image detector - Google Patents

Automatic suppression method for on-orbit noise of image detector Download PDF

Info

Publication number
CN104601906A
CN104601906A CN201410809483.XA CN201410809483A CN104601906A CN 104601906 A CN104601906 A CN 104601906A CN 201410809483 A CN201410809483 A CN 201410809483A CN 104601906 A CN104601906 A CN 104601906A
Authority
CN
China
Prior art keywords
image
noise
pixels
correction amount
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410809483.XA
Other languages
Chinese (zh)
Inventor
闫荣华
胡永明
彭进业
马冬梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northwestern Polytechnical University
XiAn Institute of Optics and Precision Mechanics of CAS
Xian Janssen Pharmaceutical Ltd
Original Assignee
Northwestern Polytechnical University
XiAn Institute of Optics and Precision Mechanics of CAS
Xian Janssen Pharmaceutical Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northwestern Polytechnical University, XiAn Institute of Optics and Precision Mechanics of CAS, Xian Janssen Pharmaceutical Ltd filed Critical Northwestern Polytechnical University
Priority to CN201410809483.XA priority Critical patent/CN104601906A/en
Publication of CN104601906A publication Critical patent/CN104601906A/en
Pending legal-status Critical Current

Links

Landscapes

  • Image Processing (AREA)

Abstract

本发明涉及一种图像探测器在轨噪声自动抑制方法,包括以下步骤:1】开始读取图像探测器的输出的新一帧图像;2】在输出的图像进行目标检测:3】对整帧图像的所有像素进行IIR自适应滤波处理,计算像素灰度的噪声修正量并进行存储;4】将整帧图像的所有像素的原始灰度与相应的像素灰度的噪声修正量做差,得到修正后的整帧图像灰度。本发明解决了现有技术中星上软件去除白噪点、暗电流非均匀一致性和固定模式噪声中计算量大、存储资源浪费和需要不断上传标定数据的技术问题,本发明能够最大程度上实时去除固定模式噪声、暗电流非均匀一致性和白噪点的影响。

The present invention relates to an image detector on-orbit automatic noise suppression method, comprising the following steps: 1] starting to read a new frame of image output by the image detector; 2) performing target detection on the output image; 3] performing the entire frame All pixels of the image are processed by IIR adaptive filtering, and the noise correction amount of pixel grayscale is calculated and stored; 4] The original grayscale of all pixels in the entire frame of image is compared with the noise correction amount of corresponding pixel grayscale to obtain The corrected gray scale of the whole frame image. The present invention solves the technical problems of large amount of calculation, waste of storage resources, and the need to continuously upload calibration data in the prior art for on-board software to remove white noise points, dark current non-uniformity, and fixed pattern noise. The present invention can maximize real-time Remove the effects of fixed pattern noise, dark current non-uniformity and white noise.

Description

图像探测器在轨噪声自动抑制方法On-orbit noise automatic suppression method for image detector

技术领域technical field

本发明涉及一种图像探测器在轨噪声自动抑制方法,可以在星上实现图像探测器噪声的自动补偿。The invention relates to an image detector on-orbit automatic noise suppression method, which can realize automatic compensation of the image detector noise on the satellite.

背景技术Background technique

图像探测器,又叫图像传感器,是星载相机的核心部分。根据元件的不同,可分为CCD(Charge Coupled Device,电荷耦合元件)和CMOS(ComplementaryMetal-Oxide Semiconductor,金属氧化物半导体元件)两大类。The image detector, also called the image sensor, is the core part of the spaceborne camera. According to the different components, it can be divided into two categories: CCD (Charge Coupled Device, charge coupled device) and CMOS (Complementary Metal-Oxide Semiconductor, metal oxide semiconductor component).

CCD和CMOS尽管在技术上有较大的不同,但CCD和CMOS两者性能差距不是很大。目前CCD和CMOS图像探测器广泛应用于天文观测、可见光成像和空间光学等领域。Although CCD and CMOS are quite different in technology, the performance gap between CCD and CMOS is not very large. At present, CCD and CMOS image detectors are widely used in fields such as astronomical observation, visible light imaging and space optics.

CCD和CMOS图像探测器的输出信号中夹杂着各种噪声和干扰,主要有热噪声、暗电流噪声、散粒噪声、复位噪声和读出电路引入的噪声等。这些噪声会对图像质量产生严重影响,在图像上表现为白噪点、暗电流非均匀一致性和固定模式噪声。虽然在硬件电路中会对这些噪声进行抑制,但是并不能完全消除这些噪声的影响,一般需要进行星上软件处理。The output signals of CCD and CMOS image detectors are mixed with various noises and interferences, mainly including thermal noise, dark current noise, shot noise, reset noise and noise introduced by the readout circuit. These noises will have a serious impact on image quality, manifested as white noise, dark current non-uniformity and fixed pattern noise on the image. Although these noises are suppressed in the hardware circuit, the influence of these noises cannot be completely eliminated, and on-board software processing is generally required.

对图像中的白噪点进行处理的方法是在存储器中事先存储白噪点的位置信息,当图像探测器输出到该噪点时,用前一个或后一个像元的灰度作为该噪点的灰度输出。The method of processing the white noise in the image is to store the position information of the white noise in the memory in advance, and when the image detector outputs to the noise, the grayscale of the previous or next pixel is used as the grayscale output of the noise .

对于暗电流非均匀一致性的处理方法是存储每个像元的校正系数,在图像探测器输出像元灰度时,给每个像元乘上对应的校正系数后进行输出。The processing method for the non-uniformity of dark current is to store the correction coefficient of each pixel, and when the image detector outputs the gray level of the pixel, multiply each pixel by the corresponding correction coefficient and then output it.

由于CMOS图像探测器所特有的固定模式噪声与温度有关,因此需要存储不同温度下的标定图像,每帧图像需要减去相应温度的标定图像。Since the fixed pattern noise unique to the CMOS image detector is related to temperature, calibration images at different temperatures need to be stored, and calibration images at corresponding temperatures need to be subtracted from each frame of image.

以上的星上软件处理方法需要耗费大量的卫星存储资源和运算资源;当图像传感器在轨性能下降时,还需要重新上传标定数据;但是这样仅能维持一段时间,随着星载相机图像探测器性能的进一步下降,需要不断地上传标定数据。The above-mentioned on-board software processing method needs to consume a lot of satellite storage resources and computing resources; when the performance of the image sensor in orbit degrades, the calibration data needs to be uploaded again; but this can only be maintained for a period of time. Further performance degradation requires continuous uploading of calibration data.

发明内容Contents of the invention

为了解决现有技术中星上软件去除白噪点、暗电流非均匀一致性和固定模式噪声中计算量大、存储资源浪费和需要不断上传标定数据的技术问题,本发明提供一种图像探测器在轨噪声自动抑制方法。In order to solve the technical problems of large amount of calculation, waste of storage resources, and the need to upload calibration data continuously in the prior art for on-board software to remove white noise points, dark current non-uniformity, and fixed pattern noise, the present invention provides an image detector in Automatic rail noise suppression method.

本发明的技术解决方案:Technical solution of the present invention:

一种图像探测器在轨噪声自动抑制方法,其特殊之处在于:包括以下步骤:An image detector on-orbit automatic noise suppression method is special in that it includes the following steps:

1】开始读取图像探测器的输出的新一帧图像;1] Start to read a new frame of image output by the image detector;

2】在输出的图像进行目标检测:2] Perform target detection on the output image:

若未检测到目标,则转入步骤3】;若检测到一个或多个目标,则转入步骤4】;If no target is detected, proceed to step 3]; if one or more targets are detected, proceed to step 4];

3】对整帧图像的所有像素进行IIR自适应滤波处理,计算像素灰度的噪声修正量并进行存储,转步骤5】;3] Perform IIR adaptive filter processing on all pixels of the entire frame image, calculate and store the noise correction amount of the pixel grayscale, and go to step 5];

4】对除目标所占区域外的所有像素进行IIR自适应滤波处理,计算像素灰度的噪声修正量并进行存储;目标所在区域内的像素灰度的噪声修正量取上一帧图像的相应区域的像素灰度的修正量,并存储;4] Perform IIR adaptive filter processing on all pixels except the area occupied by the target, calculate and store the noise correction amount of the pixel grayscale; the noise correction amount of the pixel grayscale in the target area is taken from the corresponding value of the previous frame image The correction amount of the pixel gray level of the area, and store it;

5】将整帧图像的所有像素的原始灰度与相应的像素灰度的噪声修正量做差,得到修正后的整帧图像灰度,回到步骤1】。5] Make the difference between the original grayscale of all pixels in the entire frame image and the noise correction amount of the corresponding pixel grayscale to obtain the corrected entire frame image grayscale, and return to step 1].

本发明所具有的优点:The advantages that the present invention has:

1、本发明能够最大程度上实时去除固定模式噪声、暗电流非均匀一致性和白噪点的影响。1. The present invention can remove the influence of fixed pattern noise, dark current inhomogeneity and white noise to the greatest extent in real time.

2、本发明最大限度的减少了星上存储资源的浪费,只需一帧图像的存储资源。2. The present invention minimizes the waste of on-board storage resources, and only needs one frame of image storage resources.

3、本发明能自适应固定模式噪声、暗电流非均匀一致性和白噪点的特征变化。3. The present invention can self-adapt to the characteristic changes of fixed pattern noise, dark current non-uniformity and white noise point.

4、本发明不需地面不断地上传标定数据,具备自主性的优点。4. The present invention does not need to continuously upload calibration data on the ground, and has the advantage of autonomy.

5、本发明可以保证星载图像探测器在较高温度下工作。5. The present invention can ensure that the spaceborne image detector works at relatively high temperature.

附图说明Description of drawings

图1为本发明的流程图;Fig. 1 is a flowchart of the present invention;

图2为IIR自适应滤波流程图;Fig. 2 is the flowchart of IIR adaptive filtering;

图3为本发明实施例示意图。Fig. 3 is a schematic diagram of an embodiment of the present invention.

具体实施方式Detailed ways

图像探测器在轨噪声自动抑制方法,包括以下步骤:An image detector on-orbit automatic noise suppression method includes the following steps:

1】开始读取图像探测器的输出的新的一帧图像;1] Start to read a new frame of image output by the image detector;

2】在输出图像上进行目标检测:2] Perform target detection on the output image:

若未检测到目标,则转入步骤3】;若检测到一个或多个目标,则转入步骤4】;If no target is detected, proceed to step 3]; if one or more targets are detected, proceed to step 4];

3】对整帧图像的所有像素进行IIR自适应滤波处理,计算像素灰度的固定模式噪声修正量并进行存储,转步骤5】;IIR自适应滤波处理的过程如图2所示,其中S为平滑因子,可取2,4,8,16,32。3] Perform IIR adaptive filtering processing on all pixels of the entire frame image, calculate the fixed pattern noise correction amount of the pixel grayscale and store it, go to step 5]; the process of IIR adaptive filtering processing is shown in Figure 2, where S It is a smoothing factor, which can be 2, 4, 8, 16, 32.

4】对除一个或多个目标所占区域外的所有像素进行IIR自适应滤波处理,计算像素灰度的固定模式噪声修正量并进行存储,目标区域的像素不做处理,其相应像素的噪声修正量与上一帧相应区域的噪声修正量相同;4] Perform IIR adaptive filter processing on all pixels except the area occupied by one or more targets, calculate the fixed mode noise correction amount of the pixel gray level and store it, the pixels in the target area are not processed, and the noise of the corresponding pixels The correction amount is the same as the noise correction amount of the corresponding area in the previous frame;

5】将整帧图像的所有像素的原始灰度与相应的修正量做差,得到修正后的整帧图像灰度,转步骤1】。5] Make a difference between the original grayscale of all pixels of the entire frame image and the corresponding correction amount to obtain the corrected entire frame image grayscale, and go to step 1].

实施例:Example:

图像探测器在轨噪声自动抑制方法,包括以下步骤:An image detector on-orbit automatic noise suppression method includes the following steps:

1】开始读取图像探测器的输出的新的一帧图像;1] Start to read a new frame of image output by the image detector;

2】在输出图像上进行目标检测:2] Perform target detection on the output image:

若未检测到目标,则转入步骤3】;若检测到一个或多个目标,则转入步骤4】;If no target is detected, proceed to step 3]; if one or more targets are detected, proceed to step 4];

3】对整帧图像的所有像素进行IIR自适应滤波处理,计算像素灰度的固定模式噪声修正量并进行存储,转步骤5】;IIR自适应滤波处理的过程如图2所示,其中S为平滑因子,可取2,4,8,16,32。3] Perform IIR adaptive filtering processing on all pixels of the entire frame of image, calculate and store the fixed pattern noise correction amount of the pixel grayscale, go to step 5]; the process of IIR adaptive filtering processing is shown in Figure 2, where S It is a smoothing factor, which can be 2, 4, 8, 16, 32.

4】对除一个或多个目标所占区域外的所有像素进行IIR自适应滤波处理,计算像素灰度的固定模式噪声修正量并进行存储,目标区域的像素不做处理,其相应像素的噪声修正量与上一帧相应区域的噪声修正量相同;4] Perform IIR adaptive filter processing on all pixels except the area occupied by one or more targets, calculate the fixed mode noise correction amount of the pixel gray level and store it, the pixels in the target area are not processed, and the noise of the corresponding pixels The correction amount is the same as the noise correction amount of the corresponding area in the previous frame;

5】将整帧图像的所有像素的原始灰度与相应的修正量做差,得到修正后的整帧图像灰度,转步骤1】。5] Make a difference between the original grayscale of all pixels of the entire frame image and the corresponding correction amount to obtain the corrected entire frame image grayscale, and go to step 1].

实施例:Example:

a:图像探测器开始工作,尚未在图像探测器上检测到目标,对整帧图像的所有像素进行IIR自适应滤波处理,计算像素灰度的噪声修正量;a: The image detector starts to work, and the target has not been detected on the image detector, and IIR adaptive filtering is performed on all pixels of the entire frame image, and the noise correction amount of the pixel gray scale is calculated;

b:在图像探测器上检测到目标(如卫星),对目标所占区域内的像素不计算噪声修正量,对目标所占区域外的像素计算噪声修正量;b: When the target (such as a satellite) is detected on the image detector, the noise correction amount is not calculated for the pixels in the area occupied by the target, and the noise correction amount is calculated for the pixels outside the area occupied by the target;

c:目标移到图像探测器靶面的其它位置,同样对目标所占区域内的像素不计算噪声修正量,对目标所占区域外的像素计算噪声修正量;c: The target moves to other positions on the target surface of the image detector, and the noise correction amount is not calculated for the pixels in the area occupied by the target, and the noise correction amount is calculated for the pixels outside the area occupied by the target;

d:目标移出图像探测器靶面,即图像探测器中无目标,对整帧图像的所有像素计算噪声修正量。d: The target moves out of the target surface of the image detector, that is, there is no target in the image detector, and the noise correction amount is calculated for all pixels of the entire frame image.

Claims (1)

1. the image detector automatic suppressing method of noise in-orbit, is characterized in that: comprise the following steps:
1] a new two field picture of the output of reading images detector is started;
2] target detection is carried out at the image exported:
If the target of not detecting, then proceed to step 3]; If one or more target detected, then proceed to step 4];
3] carry out the process of IIR adaptive-filtering to all pixels of whole two field picture, the noise correction amount of calculating pixel gray scale also stores, and goes to step 5];
4] carry out the process of IIR adaptive-filtering to except extra-regional all pixels shared by target, the noise correction amount of calculating pixel gray scale also stores; The noise correction of the pixel grey scale in target region measures the correction of the pixel grey scale of the respective regions of previous frame image, and stores;
5] original gradation of all pixels of whole two field picture and the noise correction amount of corresponding pixel grey scale are done difference, obtain revised whole two field picture gray scale, get back to step 1].
CN201410809483.XA 2014-12-20 2014-12-20 Automatic suppression method for on-orbit noise of image detector Pending CN104601906A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410809483.XA CN104601906A (en) 2014-12-20 2014-12-20 Automatic suppression method for on-orbit noise of image detector

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410809483.XA CN104601906A (en) 2014-12-20 2014-12-20 Automatic suppression method for on-orbit noise of image detector

Publications (1)

Publication Number Publication Date
CN104601906A true CN104601906A (en) 2015-05-06

Family

ID=53127370

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410809483.XA Pending CN104601906A (en) 2014-12-20 2014-12-20 Automatic suppression method for on-orbit noise of image detector

Country Status (1)

Country Link
CN (1) CN104601906A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111405176A (en) * 2020-03-09 2020-07-10 浙江大华技术股份有限公司 White point noise processing method and device and adjusting parameter function obtaining method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101246590A (en) * 2008-03-03 2008-08-20 北京航空航天大学 Geometric Correction Method for Spatial Distortion Image of Spaceborne Camera
US20090214129A1 (en) * 2008-02-25 2009-08-27 Micron Technology, Inc. Apparatuses and methods for noise reduction
CN102564457A (en) * 2011-12-29 2012-07-11 北京控制工程研究所 On-orbit noise autonomous restraint method for APS star sensor
CN103323026A (en) * 2013-05-30 2013-09-25 北京控制工程研究所 Attitude standard deviation estimation and correction method of star sensor and payload
CN103858432A (en) * 2011-10-14 2014-06-11 索尼公司 Image processing device, method, program and recording medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090214129A1 (en) * 2008-02-25 2009-08-27 Micron Technology, Inc. Apparatuses and methods for noise reduction
CN101246590A (en) * 2008-03-03 2008-08-20 北京航空航天大学 Geometric Correction Method for Spatial Distortion Image of Spaceborne Camera
CN103858432A (en) * 2011-10-14 2014-06-11 索尼公司 Image processing device, method, program and recording medium
CN102564457A (en) * 2011-12-29 2012-07-11 北京控制工程研究所 On-orbit noise autonomous restraint method for APS star sensor
CN103323026A (en) * 2013-05-30 2013-09-25 北京控制工程研究所 Attitude standard deviation estimation and correction method of star sensor and payload

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王琳,潘建寿,杨志刚: "《高阶统计量的背景估计法在运动目标检测中的应用》", 《计算机工程与应用》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111405176A (en) * 2020-03-09 2020-07-10 浙江大华技术股份有限公司 White point noise processing method and device and adjusting parameter function obtaining method and device

Similar Documents

Publication Publication Date Title
US8208026B2 (en) Systems and methods for processing infrared images
US20140347526A1 (en) Image processing apparatus, imaging device, image processing method, and computer-readable recording medium
CN102970464A (en) Information processing apparatus and information processing method
Wang Stripe noise removal for infrared image by minimizing difference between columns
CN113379636B (en) Infrared image non-uniformity correction method, device, equipment and storage medium
CN104978722A (en) Multi-exposure image fusion ghosting removing method based on background modeling
US10931901B2 (en) Method and apparatus for selectively correcting fixed pattern noise based on pixel difference values of infrared images
US10230912B2 (en) Fixed pattern noise mitigation for a thermal imaging system
RU2597882C1 (en) Method of moving objects detecting
JP2011250125A5 (en)
Cao et al. Strip non-uniformity correction in uncooled long-wave infrared focal plane array based on noise source characterization
US20150092075A1 (en) Method, apparatus, and system for generating high dynamic range image
US10867371B2 (en) Fixed pattern noise mitigation for a thermal imaging system
WO2015151087A1 (en) System and method for images distortion correction
US20110069204A1 (en) Method and apparatus for image correction
JP2016001855A5 (en)
JP2009010691A (en) Imaging apparatus, imaging method, image processing apparatus, image processing program, and image processing method
WO2017153410A1 (en) Method for generating a noise-reduced image based on a noise model of multiple images, as well as camera system and motor vehicle
CN104394334B (en) Intelligent suppression method for on-orbit noise of image sensor
CN104601906A (en) Automatic suppression method for on-orbit noise of image detector
JP4110044B2 (en) Imaging method
KR101989868B1 (en) Electronic device and controlling method thereof
CN104394335B (en) Image detector on-orbit noise autonomous inhibition method
JP6739955B2 (en) Image processing apparatus, image processing method, image processing program, and recording medium
US11252344B2 (en) Method and system for generating multiple synchronized thermal video streams for automotive safety and driving systems

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 710072 Xi'an friendship West Road, Shaanxi, No. 127

Applicant after: Northwestern Polytechnical University

Applicant after: XI'AN INSTITUTE OF OPTICS AND PRECISION MECHANICS OF CAS

Applicant after: Xian-Janssen Pharmaceutial Co.,Ltd.

Address before: 710119 Xi'an province high tech Zone New Industrial Park Information Avenue, No. 17

Applicant before: XI'AN INSTITUTE OF OPTICS AND PRECISION MECHANICS OF CAS

Applicant before: Northwestern Polytechnical University

Applicant before: Xian-Janssen Pharmaceutial Co.,Ltd.

COR Change of bibliographic data
RJ01 Rejection of invention patent application after publication

Application publication date: 20150506

RJ01 Rejection of invention patent application after publication