[go: up one dir, main page]

CN114815133A - An automatic confocal method for an optical multi-aperture imaging system - Google Patents

An automatic confocal method for an optical multi-aperture imaging system Download PDF

Info

Publication number
CN114815133A
CN114815133A CN202210402670.0A CN202210402670A CN114815133A CN 114815133 A CN114815133 A CN 114815133A CN 202210402670 A CN202210402670 A CN 202210402670A CN 114815133 A CN114815133 A CN 114815133A
Authority
CN
China
Prior art keywords
area
confocal
aperture
imaging system
aperture imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210402670.0A
Other languages
Chinese (zh)
Other versions
CN114815133B (en
Inventor
谢宗良
李鸣
马浩统
任戈
罗一涵
史建亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Optics and Electronics of CAS
Original Assignee
Institute of Optics and Electronics of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Optics and Electronics of CAS filed Critical Institute of Optics and Electronics of CAS
Priority to CN202210402670.0A priority Critical patent/CN114815133B/en
Publication of CN114815133A publication Critical patent/CN114815133A/en
Application granted granted Critical
Publication of CN114815133B publication Critical patent/CN114815133B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • G02B7/36Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0012Optical design, e.g. procedures, algorithms, optimisation routines
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/58Optics for apodization or superresolution; Optical synthetic aperture systems

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

The invention discloses an automatic confocal method of an optical multi-aperture imaging system, which can be used for pre-calibration of the sub-aperture pointing direction of the optical multi-aperture imaging system. The method utilizes a multi-connected region centroid extraction algorithm and a binarization area method to calculate the distances between multiple light spots and a confocal point and the total area of the light spots, constructs an evaluation function according to the distances and the total area, adaptively adjusts the weights of the distances and the areas by combining focal plane information at the current moment and the previous moment, and automatically controls a pointing actuator through an optimization algorithm to realize the automatic coincidence of the focal plane light spots of the multi-aperture system. The method can realize multi-aperture light spot confocal by one key aiming at a complex light spot initial state, does not need time sequence shutter modulation and additional optical elements, and is less limited by aperture arrangement, aperture number, light path structure, system parameters and the like.

Description

一种光学多孔径成像系统自动共焦方法An automatic confocal method for an optical multi-aperture imaging system

技术领域technical field

本发明属于光学多孔径成像领域,特别涉及一种光学多孔径成像系统自动共焦方法。The invention belongs to the field of optical multi-aperture imaging, in particular to an automatic confocal method for an optical multi-aperture imaging system.

背景技术Background technique

大型光电望远镜系统被广泛应用于环境监测、天文观测、遥感成像等诸多重要领域,在国家安全、宇宙研究及人类生活等领域展现出越来越重要的作用。高噪声抑制、高分辨精度、高探测效率的高质量探测需求与日俱增,理论上讲,望远镜口径越大,其集光能力就越强、分辨率就越高。而现有的技术工艺,单一主镜无法达到所需口径。直至20世纪70年代,随着光学多孔径成像理论的日渐成熟和望远镜制造技术的逐步积累,光学多孔径成像技术为突破系统口径的限制提供了新的思路。Large-scale optoelectronic telescope systems are widely used in many important fields such as environmental monitoring, astronomical observation, and remote sensing imaging, and are playing an increasingly important role in national security, space research, and human life. The demand for high-quality detection with high noise suppression, high resolution accuracy, and high detection efficiency is increasing day by day. In theory, the larger the telescope aperture, the stronger its light-gathering ability and the higher the resolution. However, with the existing technical process, a single primary mirror cannot achieve the required aperture. Until the 1970s, with the maturity of optical multi-aperture imaging theory and the gradual accumulation of telescope manufacturing technology, optical multi-aperture imaging technology provided new ideas for breaking through the limitation of system aperture.

光学多孔径需要通过各子孔径系统之间的共焦和共相来提升分辨率,否则不能产生作用。在多孔径成像过程中,共焦是前提。特别是在初始状态下,各子孔径之间存在明显的指向差异,导致各子孔径图像彼此交错,需要进行共焦标校。当多光斑彼此完全分离时,虽然可以提取子孔径光斑质心,但难以识别光斑与孔径的对应关系;当多光斑存在交叠时,连子孔径光斑质心的提取也变得困难。Optical multi-aperture needs to improve the resolution through confocal and co-phase between each sub-aperture system, otherwise it will not work. During multi-aperture imaging, confocality is a prerequisite. Especially in the initial state, there are obvious pointing differences between the sub-apertures, which causes the images of the sub-apertures to be interlaced with each other, and confocal calibration is required. When the multiple spots are completely separated from each other, although the centroid of the sub-aperture spot can be extracted, it is difficult to identify the correspondence between the spot and the aperture; when the multiple spots overlap, even the centroid of the sub-aperture spot becomes difficult to extract.

因此,在工程中常通过时序快门调制的方式或特殊的光斑分离模块实现各子孔径光斑的解耦,詹姆斯韦伯望远镜便是利用时序快门调制,通过两两标校遍历所有子镜实现主镜共焦;洛克希德·马丁公司研制的STAR-9望远镜阵列也是采用时序快门调制实现9孔径的共焦;国内中科院国家天文台研制的三孔望远镜阵列通过多个棱镜组成的光斑分离模块划分三个子孔径光斑。时序快门调制随着孔径数目增加会显著增加标校的复杂度,降低工程可靠性。特殊设计的光斑分离模块又无疑会增加系统的复杂度,且受到孔径排布、孔径数量、光路结构以及系统参数等的限制,普适性和可移植性较差。Therefore, in engineering, the decoupling of each sub-aperture light spot is often achieved by means of timing shutter modulation or a special spot separation module. James Webb Telescope uses timing shutter modulation to traverse all sub-mirrors through pairwise calibration to achieve confocal primary mirror. The STAR-9 telescope array developed by Lockheed Martin also uses timing shutter modulation to achieve 9-aperture confocality; the three-aperture telescope array developed by the National Astronomical Observatory of the Chinese Academy of Sciences in China divides three sub-aperture light spots through a spot separation module composed of multiple prisms . Timing shutter modulation significantly increases calibration complexity and reduces engineering reliability as the number of apertures increases. The specially designed spot separation module will undoubtedly increase the complexity of the system, and is limited by the arrangement of apertures, the number of apertures, the structure of the optical path, and the system parameters, resulting in poor universality and portability.

发明内容SUMMARY OF THE INVENTION

为克服现有方法的问题和局限,本发明提供一种光学多孔径成像系统自动共焦方法,无需复杂的光斑分离模块和繁琐的时序标校,适用于各种结构形式的光学多孔径成像系统。In order to overcome the problems and limitations of the existing methods, the present invention provides an automatic confocal method for an optical multi-aperture imaging system, which does not require a complex spot separation module and tedious timing calibration, and is suitable for optical multi-aperture imaging systems of various structural forms. .

本发明采用的技术方案是:一种光学多孔径成像系统自动共焦方法,在共焦过程中,采集焦面点扩散函数图像;利用多连通区域质心提取算法计算多光斑与共焦点的距离,利用二值化面积法计算光斑总面积,基于距离和面积构建评价函数;结合当前时刻和上一时刻的焦面信息自适应调节评价函数中距离与面积的权重;通过优化算法控制指向执行机构,使评价函数最优,从而实现多孔径成像系统的自动共焦。The technical scheme adopted in the present invention is: an automatic confocal method for an optical multi-aperture imaging system. During the confocal process, the point spread function image of the focal plane is collected; the multi-connected area centroid extraction algorithm is used to calculate the distance between the multi-spot and the confocal point, and the The binarized area method calculates the total area of the light spot, and builds an evaluation function based on the distance and area; adaptively adjusts the weight of the distance and area in the evaluation function based on the focal plane information at the current moment and the previous moment; controls the pointing actuator through an optimization algorithm to make the The evaluation function is optimized to realize the automatic confocal of the multi-aperture imaging system.

其中,通过多连通区域质心提取算法从探测器采集的图像中实时获取多光斑区域质心位置,无需各子孔径光斑处于分离或非相干状态。Among them, the centroid position of the multi-spot area is obtained in real time from the image collected by the detector through the multi-connected area centroid extraction algorithm, and it is not necessary for each sub-aperture spot to be in a separated or incoherent state.

其中,评价函数综合利用了距离和面积信息,避免了梯度消失问题。Among them, the evaluation function comprehensively utilizes the distance and area information to avoid the problem of gradient disappearance.

其中,评价函数同时利用了当前时刻和上一时刻的焦面信息,减少了优化过程中的局部极值。Among them, the evaluation function uses the focal plane information of the current moment and the previous moment at the same time, which reduces the local extreme value in the optimization process.

其中,初始状态要保证所有子孔径光斑都在探测器视场内。Among them, the initial state should ensure that all sub-aperture light spots are within the field of view of the detector.

其中,具体步骤如下:The specific steps are as follows:

步骤1)、对n孔望远镜阵列成像主镜后的汇聚光束进行成像探测,其中n≥2;Step 1), performing imaging detection on the convergent beam behind the imaging primary mirror of the n-hole telescope array, where n≥2;

步骤2)、将探测器置于光学多孔径成像焦平面,在焦面选择一个点(x0,y0)作为光斑共焦点;Step 2), placing the detector on the optical multi-aperture imaging focal plane, and selecting a point (x0, y0) on the focal plane as the confocal point of the light spot;

步骤3)、通过多连通区域质心提取算法提取多区域质心,质心数量m≥n,获得质心位置(x1,y1),…,(xm,ym),从而计算得到与共焦点的距离信息;Step 3), extract multi-region centroids through the multi-connected region centroid extraction algorithm, the number of centroids m≥n, obtain the centroid positions (x1, y1), ..., (xm, ym), thereby calculating the distance information from the confocal point;

步骤4)、通过二值化面积法获得光斑总面积S,Smax为光斑完全分离且无重合区域的时的面积;Step 4), obtain the total spot area S by the binarization area method, and Smax is the area when the spot is completely separated and there is no overlapping area;

步骤5)、利用距离和面积构建评价函数,进行优化迭代,通过伺服控制模块驱动高精度偏摆镜进行共焦,同时通过当前时刻和上一时刻的距离和面积信息自适应调节评价函数中面积与距离的权重,最终实现n孔望远镜阵列的自动共焦闭环,闭环后光斑重合于共焦点。Step 5), use the distance and area to construct an evaluation function, carry out optimization iteration, drive the high-precision deflection mirror to perform confocal through the servo control module, and at the same time adjust the area in the evaluation function adaptively through the distance and area information of the current moment and the previous moment. With the weight of distance, the automatic confocal closed loop of the n-hole telescope array is finally realized, and the light spot coincides with the confocal point after the loop is closed.

本发明与现有技术相比具有如下优点:Compared with the prior art, the present invention has the following advantages:

1)本发明利用焦面信息优化技术实现自动共焦,无需额外光学元件及繁琐的时序快门标校,提升了光学多孔径成像系统的工程适用性与可靠性。1) The present invention utilizes the focal plane information optimization technology to realize automatic confocal, without additional optical elements and complicated timing shutter calibration, which improves the engineering applicability and reliability of the optical multi-aperture imaging system.

2)本发明受孔径排布、孔径数量、光路结构以及系统参数等的限制较小,具有较强的普适性和可移植性,可用于各种结构形式的光学多孔径成像系统的自动共焦标校。2) The present invention is less restricted by aperture arrangement, aperture number, optical path structure and system parameters, etc., and has strong universality and portability, and can be used for automatic sharing of optical multi-aperture imaging systems of various structural forms. Focus calibration.

附图说明Description of drawings

图1为多连通区域质心提取算法在光斑重合时的质心提取效果示意图。FIG. 1 is a schematic diagram of the centroid extraction effect of the multi-connected region centroid extraction algorithm when the light spots overlap.

图2为二值化面积法获取光斑总面积的示意图。FIG. 2 is a schematic diagram of the total area of the light spot obtained by the binarization area method.

图3为八孔径成像系统采用本发明方法实现自动共焦的结果示意图。FIG. 3 is a schematic diagram of the result of the eight-aperture imaging system using the method of the present invention to realize automatic confocal.

具体实施方式Detailed ways

下面结合附图和具体实施例进一步说明本发明。The present invention will be further described below with reference to the accompanying drawings and specific embodiments.

本发明一种光学多孔径成像系统自动共焦方法,利用多连通区域质心提取算法和二值化面积法构建评价函数,根据当前时刻和上一时刻的焦面信息自适应调节评价函数里面积和距离的权重,消除局部极值,通过优化迭代控制指向执行结构完成共焦过程。The present invention is an automatic confocal method for an optical multi-aperture imaging system, which uses a multi-connected area centroid extraction algorithm and a binarized area method to construct an evaluation function, and adaptively adjusts the area and the area in the evaluation function according to the focal plane information at the current moment and the previous moment. The weight of the distance, eliminating the local extreme value, and completing the confocal process by optimizing the iterative control pointing to the execution structure.

本发明实施例为一个八孔径成像系统,具体实施步骤如下:The embodiment of the present invention is an eight-aperture imaging system, and the specific implementation steps are as follows:

1)八孔径成像系统汇聚光束;1) The eight-aperture imaging system converges the beam;

2)将探测器置于系统成像焦平面,选取焦面图像中心点(x0,y0)作为光斑共焦点;2) Place the detector on the system imaging focal plane, and select the center point (x0, y0) of the focal plane image as the confocal point of the light spot;

3)利用多连通区域质心提取算法提取多区域质心,如图2所示,m≥8;获得质心位置(x1,y1),...,(xm,ym),计算得到这些位置与共焦点的距离;3) Use the multi-connected region centroid extraction algorithm to extract the multi-region centroid, as shown in Figure 2, m ≥ 8; obtain the centroid positions (x1, y1), ..., (xm, ym), and calculate these positions and the confocal point. distance;

4)利用二值化面积法获得光斑总面积S,如图2所示,Smax为光斑全分离没有重合的时候的面积;4) Use the binarized area method to obtain the total spot area S, as shown in Figure 2, Smax is the area when the spots are completely separated and do not overlap;

5)将距离和面积作为评价指标,进行SPGD优化迭代,通过伺服控制模块驱动高精度偏摆镜进行共焦,同时结合当前时刻和上一时刻的信息,基于时序对两帧信息做比例和积分迭代运算得到自适应因子,调节评价函数中面积与距离的权重,评价函数自适应变化消除局部极值,实现八孔径成像系统的自动共焦闭环,闭环后光斑重合于光斑共焦点,如图3所示。5) Using the distance and area as the evaluation indicators, carry out the SPGD optimization iteration, drive the high-precision deflection mirror to perform confocal through the servo control module, and combine the information of the current moment and the previous moment to do the proportion and integration of the two frames of information based on the time series. The adaptive factor is obtained by iterative operation, the weight of the area and distance in the evaluation function is adjusted, the evaluation function is adaptively changed to eliminate the local extreme value, and the automatic confocal closed loop of the eight-aperture imaging system is realized. shown.

以上所述,仅为本发明中的具体实施方式,但本发明的保护范围并不局限于此。只要是采用时间变化的面积和距离信息构建评价函数,对光学多孔径系统焦面图像自适应优化的自动共焦方法、算法及装置,均属于本发明的保护范围。The above descriptions are merely specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. As long as the evaluation function is constructed using the time-varying area and distance information, the automatic confocal method, algorithm and device for adaptive optimization of the focal plane image of the optical multi-aperture system belong to the protection scope of the present invention.

Claims (6)

1. An automatic confocal method of an optical multi-aperture imaging system is characterized in that: collecting a focal plane point spread function image in a confocal process; calculating the distance between multiple light spots and a common focus by using a multi-connected region centroid extraction algorithm, calculating the total area of the light spots by using a binarization area method, and constructing an evaluation function based on the distance and the area; the focal plane information at the current moment and the previous moment is combined to adaptively adjust the weights of the distance and the area in the evaluation function; the pointing actuator is controlled by an optimization algorithm to optimize an evaluation function, so that automatic confocal of the multi-aperture imaging system is realized.
2. An optical multi-aperture imaging system auto-confocal method according to claim 1, wherein: the centroid position of the multi-spot area is obtained in real time from the image collected by the detector through a multi-connected area centroid extraction algorithm, and each sub-aperture spot is not required to be in a separated or incoherent state.
3. An optical multi-aperture imaging system auto-confocal method according to claim 1, wherein: the evaluation function comprehensively utilizes distance and area information, and avoids the problem of gradient disappearance.
4. An optical multi-aperture imaging system auto-confocal method according to claim 1, wherein: the evaluation function simultaneously utilizes the focal plane information of the current moment and the previous moment, and the local extreme value in the optimization process is reduced.
5. An optical multi-aperture imaging system auto-confocal method according to claim 1, wherein: the initial state is to ensure that all sub-aperture spots are in the detector field of view.
6. An optical multi-aperture imaging system auto-confocal method according to claim 1, wherein: the method comprises the following specific steps:
step 1), carrying out imaging detection on a converged light beam after an n-hole telescope array imaging main mirror, wherein n is more than or equal to 2;
step 2), placing the detector on an optical multi-aperture imaging focal plane, and selecting a point (x0, y0) on the focal plane as a light spot confocal point;
step 3), extracting multi-region centroids through a multi-connected region centroid extraction algorithm, wherein the number m of the centroids is more than or equal to n, and obtaining centroid positions (x1, y1), …, (xm, ym) so as to calculate and obtain distance information with a common focus;
step 4), obtaining the total area S of the light spots by a binarization area method, wherein Smax is the area of the light spots which are completely separated and have no overlapped area;
and 5) constructing an evaluation function by using the distance and the area, optimizing and iterating, driving the high-precision deflection mirror to perform confocal through the servo control module, and adaptively adjusting the weight of the area and the distance in the evaluation function according to the distance and the area information at the current moment and the previous moment to finally realize the automatic confocal closed loop of the n-hole telescope array, wherein the light spot is coincided with the light spot confocal point after the closed loop.
CN202210402670.0A 2022-04-18 2022-04-18 Automatic confocal method of optical multi-aperture imaging system Active CN114815133B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210402670.0A CN114815133B (en) 2022-04-18 2022-04-18 Automatic confocal method of optical multi-aperture imaging system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210402670.0A CN114815133B (en) 2022-04-18 2022-04-18 Automatic confocal method of optical multi-aperture imaging system

Publications (2)

Publication Number Publication Date
CN114815133A true CN114815133A (en) 2022-07-29
CN114815133B CN114815133B (en) 2023-02-14

Family

ID=82535849

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210402670.0A Active CN114815133B (en) 2022-04-18 2022-04-18 Automatic confocal method of optical multi-aperture imaging system

Country Status (1)

Country Link
CN (1) CN114815133B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117908219A (en) * 2024-03-06 2024-04-19 东莞市沃德普自动化科技有限公司 Focusing module, automatic focusing microscopic imaging system and method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5905591A (en) * 1997-02-18 1999-05-18 Lockheed Martin Corporation Multi-aperture imaging system
CN106768876A (en) * 2016-11-29 2017-05-31 中国科学院长春光学精密机械与物理研究所 Space solar telescope wavefront sensing methods based on asterism hot spot

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5905591A (en) * 1997-02-18 1999-05-18 Lockheed Martin Corporation Multi-aperture imaging system
CN106768876A (en) * 2016-11-29 2017-05-31 中国科学院长春光学精密机械与物理研究所 Space solar telescope wavefront sensing methods based on asterism hot spot

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117908219A (en) * 2024-03-06 2024-04-19 东莞市沃德普自动化科技有限公司 Focusing module, automatic focusing microscopic imaging system and method
CN117908219B (en) * 2024-03-06 2025-02-14 广东慧普光学科技有限公司 A focusing module, automatic focusing microscopic imaging system and method

Also Published As

Publication number Publication date
CN114815133B (en) 2023-02-14

Similar Documents

Publication Publication Date Title
US11867790B2 (en) Three dimensional LIDAR system with targeted field of view
US9759605B2 (en) Low-orbit satellite-borne image-spectrum associated detection method and payload
CN107977987B (en) An unmanned aerial vehicle-borne multi-target detection, tracking and indication system and method
US5270780A (en) Dual detector lidar system and method
CN104165626B (en) Bionic compound eyes imageable target positioning system
CN105676305B (en) A kind of many visual field collection of illustrative plates cooperative detection systems of Shared aperture and method
JP4773038B2 (en) Method and apparatus for aircraft protection against missile attacks
CN109313256A (en) Adaptive laser radar receiver
CN108415097A (en) A kind of the collection of illustrative plates cooperative detection system and method for multiband infrared imaging
CN110864587B (en) Seeker aiming and positioning method and aiming and positioning system
CN114815133A (en) An automatic confocal method for an optical multi-aperture imaging system
CN105954734B (en) Large-caliber laser radar optical axis monitoring device
CN109932974A (en) The embedded observation-well network of accurate measurement type extraterrestrial target telescope
CN103558684A (en) Synthetic aperture type high-resolution imaging telescope device based on bright source
CN113534436B (en) Sparse synthetic aperture imaging system based on seven apertures and phase correction method thereof
CN113391444A (en) Adaptive optical system
CN105466576B (en) Device and method for synchronously measuring height and angle non-isohalo wavefront errors of atmospheric turbulence
CN112009730A (en) Space debris ablation system and method
CN108955904B (en) Multifunctional wavefront detection device considering point-surface target
CN108305290B (en) A Precise Spectrum Measurement Method for Moving Targets
US10337857B2 (en) Multi-spectral boresight alignment methods and systems
CN214749806U (en) Microscope lock focus system
CN106773001B (en) Tip-tilt correction system and method suitable for astronomical telescope
CN114757987A (en) A method for centroid extraction of multiple sub-spots based on edge detection and target tracking
WO2022224111A1 (en) Method and system thereof for detecting objects in the field of view of an optical detection device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant