CN106371201B - Based on the Fourier's overlapping associations imaging system and method for calculating ghost imaging - Google Patents
Based on the Fourier's overlapping associations imaging system and method for calculating ghost imaging Download PDFInfo
- Publication number
- CN106371201B CN106371201B CN201610960008.1A CN201610960008A CN106371201B CN 106371201 B CN106371201 B CN 106371201B CN 201610960008 A CN201610960008 A CN 201610960008A CN 106371201 B CN106371201 B CN 106371201B
- Authority
- CN
- China
- Prior art keywords
- imaging
- resolution image
- fourier
- image
- low
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Image Analysis (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
本发明提出一种基于计算鬼成像的傅里叶重叠关联成像系统及方法,系统包括:空间滤波器;空间光调制器;成像模块;高速感光阵列;处理模块,计算每个单像素探测器对应位置的图像,并作为以该单像素探测器为光源的倾斜平面波照明的低分辨率图像;计算模块,用于对低分辨率图像进行傅里叶变换,得到对应于目标高分辨图像的频谱在该入射角度和物镜的数值孔径的搬移和低通滤波,将低分辨率图像的频谱重叠相关的部分进行拼接,得到目标高分辨率图像的频谱,并利用相位恢复算法得到目标高分辨率图像。本发明能够提高整个成像系统的图像采集效率,并实现比通常阵列式传感器更宽谱段的测量,以及实现图像的压缩重建,提高单次成像的速率。
The present invention proposes a Fourier overlap correlation imaging system and method based on computational ghost imaging. The system includes: a spatial filter; a spatial light modulator; an imaging module; a high-speed photosensitive array; The image of the position, and as the low-resolution image of the oblique plane wave illumination with the single-pixel detector as the light source; the calculation module is used to perform Fourier transform on the low-resolution image, and obtain the frequency spectrum corresponding to the high-resolution image of the target in The incident angle and the numerical aperture of the objective lens are shifted and low-pass filtered, and the relevant parts of the spectrum overlap of the low-resolution image are spliced to obtain the spectrum of the target high-resolution image, and the target high-resolution image is obtained by using the phase recovery algorithm. The invention can improve the image collection efficiency of the whole imaging system, realize the measurement of a wider spectrum than the usual array sensor, realize image compression and reconstruction, and increase the rate of a single imaging.
Description
技术领域technical field
本发明涉及光学工程技术领域,特别涉及一种基于计算鬼成像的傅里叶重叠关联成像系统及方法。The invention relates to the technical field of optical engineering, in particular to a Fourier overlapping correlation imaging system and method based on computational ghost imaging.
背景技术Background technique
常规成像系统(例如显微镜)的吞吐量通常受到其光学成像限定的空间带宽积的限制。空间带宽积指的是光学系统可从光学信号中提取的自由度的数量(通常指可分辨的像素数量)。因此,常规成像系统通常无法直接获得宽视场、高空间分辨率的图像。而目前在生命科学和生物医疗领域,清晰地观察单个细胞并且尽可能在同一个视野下观察更多的细胞已成为迫切需求,因此,提高成像系统的空间带宽积从而实现宽视场、高空间分辨率图像的采集成为其中关键技术瓶颈。The throughput of conventional imaging systems, such as microscopes, is often limited by the spatial bandwidth product defined by their optical imaging. The space-bandwidth product refers to the number of degrees of freedom an optical system can extract from an optical signal (usually the number of resolvable pixels). Therefore, conventional imaging systems usually cannot directly obtain images with wide field of view and high spatial resolution. At present, in the field of life science and biomedicine, it has become an urgent need to clearly observe a single cell and observe as many cells as possible in the same field of view. The collection of high-resolution images has become a key technical bottleneck.
提高成像系统的空间带宽积的通常思路包括基于合成孔径的机械扫描方法和无透镜方法。但是,基于合成孔径的机械扫描方法需要精密的机械结构保证系统的控制精度,从而达到预期的空间带宽积,并且光学对齐和运动跟踪使得成像过程变成复杂而缓慢;诸如数字同轴全息和接触成像显微的无透镜成像方法也存在一定局限性,例如,数字同轴全息无法对连续的样本进行很好地成像,接触成像显微要求样本足够接近传感器。Common ideas for improving the spatial bandwidth product of imaging systems include mechanical scanning methods based on synthetic apertures and lensless methods. However, the mechanical scanning method based on synthetic aperture requires a precise mechanical structure to ensure the control accuracy of the system, so as to achieve the expected space-bandwidth product, and the optical alignment and motion tracking make the imaging process complex and slow; such as digital coaxial holography and contact The lensless imaging method of imaging microscopy also has certain limitations. For example, digital coaxial holography cannot image continuous samples well, and contact imaging microscopy requires the sample to be close enough to the sensor.
发明内容Contents of the invention
本发明旨在至少解决上述技术问题之一。The present invention aims to solve at least one of the above-mentioned technical problems.
为此,本发明的一个目的在于提出一种基于计算鬼成像的傅里叶重叠关联成像系统,该系统能够提高整个成像系统的图像采集效率,并实现比通常阵列式传感器更宽谱段的测量,以及实现图像的压缩重建,提高单次成像的速率。To this end, an object of the present invention is to propose a Fourier overlap-correlation imaging system based on computational ghost imaging, which can improve the image acquisition efficiency of the entire imaging system and achieve measurement of a wider spectrum than the usual array sensor , and achieve image compression and reconstruction to increase the rate of single imaging.
本发明的另一个目的在于提出一种基于计算鬼成像的傅里叶重叠关联成像方法。Another object of the present invention is to propose a Fourier overlapping correlation imaging method based on computational ghost imaging.
为了实现上述目的,本发明的第一方面的实施例公开了一种基于计算鬼成像的傅里叶重叠关联成像系统,包括:空间滤波器,所述空间滤波器用于产生空间分布均匀的准直高斯光束;空间光调制器,所述空间光调制器用于对所述准直高斯光束进行空间调制,以得到空间编码的结构光照;成像模块,所述成像模块用于将所述空间编码的结构光照投射在成像面上,并与成像样本接触;高速感光阵列,所述高速感光阵列设置在成像样本的透射面或者反射面,用于接收不同方向成像样本后光场的场强;处理模块,所述处理模块用于根据计算鬼成像的原理计算出高速感光阵列的每个单像素探测器对应位置的图像,并作为以该单像素探测器为光源的倾斜平面波照明的低分辨率图像;计算模块,所述计算模块用于对不同方向倾斜平面波照明的低分辨率图像进行傅里叶变换,得到对应于目标高分辨图像的频谱在该入射角度和物镜的数值孔径的搬移和低通滤波,将所述低分辨率图像的频谱重叠相关的部分进行拼接,得到目标高分辨率图像的频谱,并利用相位恢复算法得到目标高分辨率图像。In order to achieve the above object, the embodiment of the first aspect of the present invention discloses a Fourier overlap-correlation imaging system based on computational ghost imaging, including: a spatial filter, which is used to generate a spatially uniform collimation a Gaussian beam; a spatial light modulator, which is used to spatially modulate the collimated Gaussian beam to obtain spatially encoded structured illumination; an imaging module, which is used to convert the spatially encoded structure The light is projected on the imaging surface and is in contact with the imaging sample; the high-speed photosensitive array is arranged on the transmission surface or the reflection surface of the imaging sample, and is used to receive the field strength of the light field after imaging the sample in different directions; the processing module, The processing module is used to calculate the image corresponding to each single-pixel detector of the high-speed photosensitive array according to the principle of computational ghost imaging, and use the single-pixel detector as a low-resolution image of oblique plane wave illumination as a light source; module, the calculation module is used to perform Fourier transform on low-resolution images illuminated by oblique plane waves in different directions, to obtain the shift and low-pass filtering of the frequency spectrum corresponding to the high-resolution image of the target at the incident angle and the numerical aperture of the objective lens, Stitching the overlapped and related parts of the frequency spectrum of the low-resolution image to obtain the frequency spectrum of the target high-resolution image, and using a phase recovery algorithm to obtain the target high-resolution image.
根据本发明实施例的基于计算鬼成像的傅里叶重叠关联成像系统,具有如下优点:The Fourier overlap correlation imaging system based on computational ghost imaging according to the embodiment of the present invention has the following advantages:
1、实现不同倾斜角照明的图像同时采集,避免了FPM系统中每次采集只能有一个或者少数几个发光二极管点亮的局限性,提高整个成像系统的图像采集效率;1. Simultaneous acquisition of images illuminated by different inclination angles, avoiding the limitation that only one or a few light-emitting diodes can be lit for each acquisition in the FPM system, and improving the image acquisition efficiency of the entire imaging system;
2、单像素探测器具有更宽的谱段,能够实现比通常阵列式传感器更宽谱段的测量;2. The single-pixel detector has a wider spectrum, which can realize the measurement of a wider spectrum than the usual array sensor;
3、采用计算鬼成像的思路,可对结构光进行特定编码,如正弦编码或哈达玛编码,可以实现图像的压缩重建,提高单次成像的速率。3. Using the idea of computational ghost imaging, specific encoding can be performed on structured light, such as sinusoidal encoding or Hadamard encoding, which can realize image compression and reconstruction and increase the rate of single imaging.
另外,根据本发明上述实施例的基于计算鬼成像的傅里叶重叠关联成像系统,还可以具有如下附加的技术特征:In addition, the Fourier overlap correlation imaging system based on computational ghost imaging according to the above-mentioned embodiments of the present invention may also have the following additional technical features:
在一些示例中,所述空间滤波器包括:物镜、针孔、准直透镜和光学调整架、平移台,其中,所述针孔位于所述物镜的焦点处,用于滤除高阶次不均匀杂散光,产生空间分布均匀的高斯光束,之后经过所述准直透镜,得到所述准直高斯光束,所述光学调整架用于固定所述物镜和准直透镜并调整器件角度,以使出射光束平直,所述平移台用于固定所述针孔,同时调整针孔与物镜之间的间距,以保证在合适的三维坐标内得到空间均匀分布的高斯光束。In some examples, the spatial filter includes: an objective lens, a pinhole, a collimator lens, an optical adjustment mount, and a translation stage, wherein the pinhole is located at the focal point of the objective lens and is used to filter out high-order Uniform stray light to generate Gaussian beams with uniform spatial distribution, and then pass through the collimating lens to obtain the collimated Gaussian beams, and the optical adjustment mount is used to fix the objective lens and collimating lens and adjust the angle of the device, so that The outgoing beam is straight, and the translation stage is used to fix the pinhole, and at the same time adjust the distance between the pinhole and the objective lens, so as to ensure a Gaussian beam with a uniform spatial distribution in a suitable three-dimensional coordinate.
在一些示例中,所述空间光调制器用于对所述准直高斯光束进行幅度或相位的调制,以得到空间编码的结构光照。In some examples, the spatial light modulator is used to modulate the amplitude or phase of the collimated Gaussian beam to obtain spatially encoded structured illumination.
在一些示例中,所述成像模块为透镜或者透镜组。In some examples, the imaging module is a lens or a lens group.
在一些示例中,所述不同方向成像样本后光场的场强对应于不同方向倾斜平面波照射到成像样本上,在成像样本前端拍摄的图像。In some examples, the field strengths of the light fields after imaging the sample in different directions correspond to images taken at the front of the imaging sample when inclined plane waves in different directions are irradiated onto the imaging sample.
为了实现上述目的,本发明第二方面的实施例提出了一种基于计算鬼成像的傅里叶重叠关联成像方法,包括以下步骤:构建空间滤波器,并通过所述空间滤波器产生空间分布均匀的准直高斯光束;对所述准直高斯光束进行空间调制,以得到空间编码的结构光照;将所述空间编码的结构光照投射在成像面上,并与成像样本接触;接收不同方向成像样本后光场的场强;根据计算鬼成像的原理计算出高速感光阵列的每个单像素探测器对应位置的图像,并作为以该单像素探测器为光源的倾斜平面波照明的低分辨率图像;对不同方向倾斜平面波照明的低分辨率图像进行傅里叶变换,得到对应于目标高分辨图像的频谱在该入射角度和物镜的数值孔径的搬移和低通滤波,将所述低分辨率图像的频谱重叠相关的部分进行拼接,得到目标高分辨率图像的频谱,并利用相位恢复算法得到目标高分辨率图像。In order to achieve the above object, the embodiment of the second aspect of the present invention proposes a Fourier overlap-correlation imaging method based on computational ghost imaging, which includes the following steps: constructing a spatial filter, and generating uniform spatial distribution through the spatial filter A collimated Gaussian beam; spatially modulate the collimated Gaussian beam to obtain spatially encoded structured illumination; project the spatially encoded structured illumination on the imaging surface and contact the imaging sample; receive imaging samples in different directions The field strength of the rear light field; according to the principle of computational ghost imaging, the image corresponding to each single-pixel detector of the high-speed photosensitive array is calculated, and it is used as a low-resolution image of oblique plane wave illumination with the single-pixel detector as the light source; Carry out Fourier transform to the low-resolution image of oblique plane wave illumination in different directions, obtain the shift and low-pass filtering of the frequency spectrum corresponding to the high-resolution image of the target at the incident angle and the numerical aperture of the objective lens, and convert the low-resolution image to The overlapping and related parts of the spectrum are spliced to obtain the spectrum of the target high-resolution image, and the target high-resolution image is obtained by using the phase recovery algorithm.
根据本发明实施例的基于计算鬼成像的傅里叶重叠关联成像方法,具有如下优点:The Fourier overlap correlation imaging method based on computational ghost imaging according to the embodiment of the present invention has the following advantages:
1、实现不同倾斜角照明的图像同时采集,避免了FPM系统中每次采集只能有一个或者少数几个发光二极管点亮的局限性,提高整个成像系统的图像采集效率;1. Simultaneous acquisition of images illuminated by different inclination angles, avoiding the limitation that only one or a few light-emitting diodes can be lit for each acquisition in the FPM system, and improving the image acquisition efficiency of the entire imaging system;
2、单像素探测器具有更宽的谱段,能够实现比通常阵列式传感器更宽谱段的测量;2. The single-pixel detector has a wider spectrum, which can realize the measurement of a wider spectrum than the usual array sensor;
3、采用计算鬼成像的思路,可对结构光进行特定编码,如正弦编码或哈达玛编码,可以实现图像的压缩重建,提高单次成像的速率。3. Using the idea of computational ghost imaging, specific encoding can be performed on structured light, such as sinusoidal encoding or Hadamard encoding, which can realize image compression and reconstruction and increase the rate of single imaging.
另外,根据本发明上述实施例的基于计算鬼成像的傅里叶重叠关联成像方法,还可以具有如下附加的技术特征:In addition, the Fourier overlap correlation imaging method based on computational ghost imaging according to the above-mentioned embodiments of the present invention may also have the following additional technical features:
在一些示例中,所述空间滤波器包括:物镜、针孔、准直透镜和光学调整架、平移台,其中,所述针孔位于所述物镜的焦点处,用于滤除高阶次不均匀杂散光,产生空间分布均匀的高斯光束,之后经过所述准直透镜,得到所述准直高斯光束,所述光学调整架用于固定所述物镜和准直透镜并调整器件角度,以使出射光束平直,所述平移台用于固定所述针孔,同时调整针孔与物镜之间的间距,以保证在合适的三维坐标内得到空间均匀分布的高斯光束。In some examples, the spatial filter includes: an objective lens, a pinhole, a collimator lens, an optical adjustment mount, and a translation stage, wherein the pinhole is located at the focal point of the objective lens and is used to filter out high-order Uniform stray light to generate Gaussian beams with uniform spatial distribution, and then pass through the collimating lens to obtain the collimated Gaussian beams, and the optical adjustment mount is used to fix the objective lens and collimating lens and adjust the angle of the device, so that The outgoing beam is straight, and the translation stage is used to fix the pinhole, and at the same time adjust the distance between the pinhole and the objective lens, so as to ensure a Gaussian beam with a uniform spatial distribution in a suitable three-dimensional coordinate.
在一些示例中,所述对所述准直高斯光束进行空间调制,进一步包括:对所述准直高斯光束进行幅度或相位的调制,以得到所述空间编码的结构光照。In some examples, the spatially modulating the collimated Gaussian beam further includes: performing amplitude or phase modulation on the collimated Gaussian beam to obtain the spatially encoded structured illumination.
在一些示例中,通过透镜或者透镜组将所述空间编码的结构光照投射在成像面上。In some examples, the spatially coded structured illumination is projected on the imaging surface through a lens or a lens group.
在一些示例中,所述不同方向成像样本后光场的场强对应于不同方向倾斜平面波照射到成像样本上,在成像样本前端拍摄的图像。In some examples, the field strengths of the light fields after imaging the sample in different directions correspond to images taken at the front of the imaging sample when inclined plane waves in different directions are irradiated onto the imaging sample.
本发明的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。Additional aspects and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
附图说明Description of drawings
本发明的上述和/或附加的方面和优点从结合下面附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present invention will become apparent and comprehensible from the description of the embodiments in conjunction with the following drawings, wherein:
图1是根据本发明实施例的基于计算鬼成像的傅里叶重叠关联成像系统的结构框图;Fig. 1 is a structural block diagram of a Fourier overlapping correlation imaging system based on computational ghost imaging according to an embodiment of the present invention;
图2是根据本发明另一个实施例的基于计算鬼成像的傅里叶重叠关联成像系统的实验原理图;2 is an experimental schematic diagram of a Fourier overlap-correlation imaging system based on computational ghost imaging according to another embodiment of the present invention;
图3是根据本发明一个实施例的空间滤波器的原理示意图;以及FIG. 3 is a schematic diagram of the principle of a spatial filter according to an embodiment of the present invention; and
图4是根据本发明实施例的基于计算鬼成像的傅里叶重叠关联成像方法的流程图。Fig. 4 is a flow chart of a Fourier overlap correlation imaging method based on computational ghost imaging according to an embodiment of the present invention.
具体实施方式Detailed ways
下面详细描述本发明的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,仅用于解释本发明,而不能理解为对本发明的限制。Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.
在本发明的描述中,需要理解的是,术语“中心”、“纵向”、“横向”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性。In describing the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "upper", "lower", "front", "rear", "left", "right", " The orientations or positional relationships indicated by "vertical", "horizontal", "top", "bottom", "inner" and "outer" are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and Simplified descriptions, rather than indicating or implying that the device or element referred to must have a particular orientation, be constructed and operate in a particular orientation, and thus should not be construed as limiting the invention. In addition, the terms "first" and "second" are used for descriptive purposes only, and should not be understood as indicating or implying relative importance.
在本发明的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一体地连接;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本发明中的具体含义。In the description of the present invention, it should be noted that unless otherwise specified and limited, the terms "installation", "connection" and "connection" should be understood in a broad sense, for example, it can be a fixed connection or a detachable connection. Connected, or integrally connected; it may be mechanically connected or electrically connected; it may be directly connected or indirectly connected through an intermediary, and it may be the internal communication of two components. Those of ordinary skill in the art can understand the specific meanings of the above terms in the present invention in specific situations.
以下结合附图描述根据本发明实施例的基于计算鬼成像的傅里叶重叠关联成像系统及方法。The Fourier overlap correlation imaging system and method based on computational ghost imaging according to embodiments of the present invention will be described below with reference to the accompanying drawings.
图1是根据本发明一个实施例的基于计算鬼成像的傅里叶重叠关联成像系统的结构框图。图2是根据本发明另一个实施例的基于计算鬼成像的傅里叶重叠关联成像系统的实验原理图。如图1所示,并结合图2,该基于计算鬼成像的傅里叶重叠关联成像系统100包括:空间滤波器110、空间光调制器120、成像模块130、高速感光阵列140、处理模块,150及计算模块160。Fig. 1 is a structural block diagram of a Fourier overlap correlation imaging system based on computational ghost imaging according to an embodiment of the present invention. Fig. 2 is an experimental schematic diagram of a Fourier overlap correlation imaging system based on computational ghost imaging according to another embodiment of the present invention. As shown in FIG. 1 , combined with FIG. 2 , the Fourier overlap correlation imaging system 100 based on computational ghost imaging includes: a spatial filter 110, a spatial light modulator 120, an imaging module 130, a high-speed photosensitive array 140, and a processing module, 150 and computing module 160.
其中,空间滤波器110用于产生干净、空间分布均匀的准直高斯光束。Wherein, the spatial filter 110 is used to generate a clean collimated Gaussian beam with uniform spatial distribution.
在本发明的一个实施例中,结合图3所示,空间滤波器110例如包括:物镜、针孔、准直透镜和光学调整架、平移台,其中,针孔位于物镜的焦点处,用于滤除高阶次不均匀杂散光,产生空间分布均匀的高斯光束,之后经过准直透镜,得到准直高斯光束,光学调整架用于固定物镜和准直透镜并调整器件角度,以使出射光束平直,平移台用于固定针孔,同时调整针孔与物镜之间的间距,以保证在合适的三维坐标内得到空间均匀分布的高斯光束。In one embodiment of the present invention, as shown in FIG. 3 , the spatial filter 110 includes, for example: an objective lens, a pinhole, a collimating lens, an optical adjustment mount, and a translation stage, wherein the pinhole is located at the focal point of the objective lens for Filter out high-order inhomogeneous stray light to generate a Gaussian beam with uniform spatial distribution, and then pass through a collimator lens to obtain a collimated Gaussian beam. The optical adjustment frame is used to fix the objective lens and collimator lens and adjust the angle of the device so that the outgoing beam Straight, the translation stage is used to fix the pinhole and adjust the distance between the pinhole and the objective lens to ensure a uniformly distributed Gaussian beam in the appropriate three-dimensional coordinates.
空间光调制器120用于对准直高斯光束进行空间调制,以得到空间编码的结构光照。具体地,在本发明的一个实施例中,空间光调制器120用于对准直高斯光束进行幅度或相位的调制,以得到空间编码的结构光照。换言之,即空间光调制器120用于对准直高斯光束进幅度或者相位的调制,从而得到所需要的照明模式。The spatial light modulator 120 is used for spatially modulating the collimated Gaussian beam to obtain spatially coded structured illumination. Specifically, in an embodiment of the present invention, the spatial light modulator 120 is used to modulate the amplitude or phase of the collimated Gaussian beam to obtain spatially coded structured illumination. In other words, the spatial light modulator 120 is used to modulate the amplitude or phase of the collimated Gaussian beam, so as to obtain the required illumination mode.
成像模块130用于将空间编码的结构光照投射在成像面上,并与成像样本接触。在本发明的一个实施例中,成像模块130例如为透镜或者透镜组。换言之,即成像模块130用于将入射的照明模式在样本平面上进行作用,其可以是透镜或者透镜组,也可以直接照射在样本上,此次成像系统空缺。The imaging module 130 is used for projecting the spatially coded structured illumination onto the imaging surface and contacting the imaging sample. In one embodiment of the present invention, the imaging module 130 is, for example, a lens or a lens group. In other words, the imaging module 130 is used to apply the incident illumination mode on the sample plane, which may be a lens or a lens group, or directly irradiate the sample, and the imaging system is vacant this time.
高速感光阵列140设置在成像样本的透射面或者反射面,用于接收不同方向成像样本后光场的场强。在本发明的一个实施例中,不同方向成像样本后光场的场强对应于不同方向倾斜平面波照射到成像样本上,在成像样本前端拍摄的图像。换言之,即高速感光阵列140用于经过样本透射或者反射之后接收不同角度的强度,根据单像素成像光路可逆的原理,其对应于不同方向倾斜平面波照射到样本上,在样本前端拍摄的图像。更为具体地,即对于每个感光元件的强度与照明模式的相关进行建模并且利用自然场景稀疏性的约束进行压缩感知成像,对应于该感光元件角度上产生的倾斜平面波照射在样本上,从样本前端所看到的图像。The high-speed photosensitive array 140 is arranged on the transmission surface or the reflection surface of the imaging sample, and is used to receive the field intensity of the light field after imaging the sample in different directions. In one embodiment of the present invention, the field strength of the light field after imaging the sample in different directions corresponds to the images taken at the front of the imaging sample when inclined plane waves in different directions are irradiated onto the imaging sample. In other words, the high-speed photosensitive array 140 is used to receive intensities at different angles after being transmitted or reflected by the sample. According to the principle of reversible single-pixel imaging optical path, it corresponds to images taken at the front end of the sample when oblique plane waves in different directions are irradiated on the sample. More specifically, model the correlation between the intensity of each photosensitive element and the illumination mode and use the constraint of natural scene sparsity to perform compressive sensing imaging, corresponding to the oblique plane wave generated at the angle of the photosensitive element irradiated on the sample, The image seen from the front of the sample.
处理模块150用于根据计算鬼成像的原理计算出高速感光阵列的每个单像素探测器对应位置的图像,并作为以该单像素探测器为光源的倾斜平面波照明的低分辨率图像。具体地说,空间光调制器120调制多组不同的结构光照,高速感光阵列140接收对应的光场强度,则对于阵列的每个单像素探测器,处理模块150根据计算鬼成像的原理计算出对应位置的图像,作为以该点单像素探测器为光源的倾斜平面波照明的低分辨率图像。换言之,即处理模块150用于通过多次不同照明模式与在每个感光元件上强度的相关得到每个不同角度的成像结果作为经变化照明倾斜角的、低分辨率的图像迭代更新在傅里叶频谱的重叠区域,从而以计算的方式重构样本的高分辨率图像。The processing module 150 is used to calculate the image corresponding to each single-pixel detector of the high-speed photosensitive array according to the principle of computational ghost imaging, and use the single-pixel detector as a low-resolution image illuminated by an oblique plane wave as a light source. Specifically, the spatial light modulator 120 modulates multiple groups of different structured illuminations, and the high-speed photosensitive array 140 receives the corresponding light field intensity. Then, for each single-pixel detector of the array, the processing module 150 calculates according to the principle of computational ghost imaging The image of the corresponding position is taken as a low-resolution image of the oblique plane wave illumination using the point single-pixel detector as the light source. In other words, the processing module 150 is used to obtain the imaging result of each different angle through multiple correlations between different illumination modes and the intensity on each photosensitive element as a low-resolution image iteratively updated in Fourier The overlapping regions of the leaf spectra are used to computationally reconstruct a high-resolution image of the sample.
计算模块160用于对不同方向倾斜平面波照明的低分辨率图像进行傅里叶变换,得到对应于目标高分辨图像的频谱在该入射角度和物镜的数值孔径的搬移和低通滤波,将低分辨率图像的频谱重叠相关的部分进行拼接,得到目标高分辨率图像的频谱,并利用相位恢复算法得到目标高分辨率图像。换言之,即傅里叶重叠关联成像过程,将不同方向倾斜平面波照明的、低分辨率的图像迭代更新在傅里叶频谱的重叠区域,得到频域拓宽之后高分辨率图像的频谱,最后以计算的方式用相位恢复的算法重构样本的高分辨率图像。The calculation module 160 is used to perform Fourier transform on the low-resolution images illuminated by oblique plane waves in different directions to obtain the shift and low-pass filtering of the frequency spectrum corresponding to the high-resolution image of the target at the incident angle and the numerical aperture of the objective lens, and convert the low-resolution The frequency spectrum overlapping related parts of the high-resolution image are spliced to obtain the frequency spectrum of the target high-resolution image, and the target high-resolution image is obtained by using the phase recovery algorithm. In other words, the Fourier overlap correlation imaging process, iteratively updates the low-resolution images illuminated by oblique plane waves in different directions in the overlapping area of the Fourier spectrum, and obtains the spectrum of the high-resolution image after the frequency domain is broadened, and finally calculates A high-resolution image of the sample is reconstructed using a phase recovery algorithm.
在一些示例中,本发明实施例的系统适用于宽尺度的成像系统,从微米级到米级,其中不同尺度的成像系统通过调整空间光调制器到样本之间的成像模块实现。In some examples, the system of the embodiment of the present invention is applicable to wide-scale imaging systems, from micron scale to meter scale, where imaging systems of different scales are realized by adjusting the imaging module between the spatial light modulator and the sample.
进一步地,本发明实施例的成像系统适用于宽谱段的成像系统,从太赫兹谱段、红外谱段、可见光谱段、紫外谱段到X射线谱段,其中不同谱段的成像系统通过替换适用于不同的高速感光元件实现。Further, the imaging system of the embodiment of the present invention is suitable for wide-spectrum imaging systems, from terahertz spectrum, infrared spectrum, visible spectrum, ultraviolet spectrum to X-ray spectrum, wherein imaging systems of different spectrums pass Substitutions are available for different high-speed sensor implementations.
也就是说,本发明实施例的系统包括通过对照明模式进行编码优化提高相关成像过程中的成像速率和成像质量的方法。更具体地,利用四步相移的不同空间频率的正弦模式照明,直接从不同的感光元件上获取不同空间角度的低分辨率图像的里叶频谱,再进行迭代更新在傅里叶频谱的重叠区域,从而得到频域拓宽之后的高分辨率图像的频谱。That is to say, the system of the embodiment of the present invention includes a method for improving the imaging rate and imaging quality in the relevant imaging process by encoding and optimizing the illumination mode. More specifically, four-step phase-shifted sinusoidal mode illumination with different spatial frequencies is used to directly obtain the Liier spectra of low-resolution images at different spatial angles from different photosensitive elements, and then iteratively update the overlapped Fourier spectra. region, so as to obtain the frequency spectrum of the high-resolution image after frequency domain widening.
综上,本发明上述实施例的基于计算鬼成像的傅里叶重叠关联成像系统的实现原理可概述为:本发明的系统根据不同方向倾斜平面波经过傅里叶变换在频域产生位移的特性以及单像素成像具有光路可逆的特性提出的,其特征在于搭建光强分布均匀的准直光束系统,并将准直光束入射至空间光调制器进行入射光场幅度或者相位的调制,得到调制后的光束经过成像光学系统或者直接照射在成像样本上,在其经过透射或者反射到高速感光阵列(单像素探测器阵列)进行同时采集。同一个样本经过多次已知调制模式的光束照射并采集每个感光元件(单像素探测器)对应的光强,利用调制模式与感光元件的光强的相关或者压缩感知的方法得到每一个感光元件所对应的角度的成像结果。根据单像素成像具有光路可逆的特性,每个单像素对同一个样本的成像结果对应于以这个单像素为点源产生的不同方向倾斜平面波照明在入射样本前端拍摄的结果。因此,对于每个单像素得到的低分辨率的图像在频谱相当于目标高分辨率图像在对应入射角度下某一个范围内的频谱。所有单像素的图像的频谱代表不同角度也就是频域不同平移位置处的频谱,最终相互重叠,相互关联构成整体范围更大的频谱。利用同步采集的所有单像素成像结果,进行傅里叶变换,进而根据每个感光元件对应的入射角度确定在目标高分辨率图像频谱中的位置,将重叠关联的频谱通过频域拼接,得到目标高分辨率图像的频谱,并通过傅里叶逆变换得到目标高分辨样本图像。由于相当于增加了不同角度的光照,拓宽了频谱,因此能够提供宽视场和高空间分辨率的特性。同时,感光阵列同步采集的特性避免了传统傅里叶重叠关联成像系统点源阵列分时点亮阻碍成像速率提高的局限,实现了高时间分辨率的特性,能够对动态场景进行实时成像。To sum up, the implementation principle of the Fourier overlapping correlation imaging system based on computational ghost imaging in the above embodiments of the present invention can be summarized as follows: the system of the present invention generates displacement in the frequency domain through Fourier transform according to the characteristics of tilted plane waves in different directions and Single-pixel imaging is proposed with the characteristic of reversible optical path, which is characterized in that a collimated beam system with uniform light intensity distribution is built, and the collimated beam is incident on a spatial light modulator to modulate the amplitude or phase of the incident light field to obtain the modulated The light beam passes through the imaging optical system or directly irradiates the imaging sample, and it is transmitted or reflected to the high-speed photosensitive array (single-pixel detector array) for simultaneous acquisition. The same sample is irradiated by light beams with known modulation modes multiple times and the light intensity corresponding to each photosensitive element (single-pixel detector) is collected, and the correlation between the modulation mode and the light intensity of the photosensitive element or compressed sensing method is used to obtain each photosensitive element. The imaging result of the angle corresponding to the component. According to the characteristic of single-pixel imaging with reversible optical path, the imaging result of each single pixel on the same sample corresponds to the result of shooting at the front of the incident sample by the oblique plane wave illumination in different directions generated by using this single pixel as a point source. Therefore, the frequency spectrum of the low-resolution image obtained for each single pixel is equivalent to the frequency spectrum of the target high-resolution image within a certain range under the corresponding incident angle. The spectra of all single-pixel images represent spectra at different angles, that is, at different translation positions in the frequency domain, and eventually overlap and correlate with each other to form a spectrum with a larger overall range. Use all the single-pixel imaging results collected synchronously to perform Fourier transform, and then determine the position in the high-resolution image spectrum of the target according to the incident angle corresponding to each photosensitive element, and splicing the overlapping and related spectra in the frequency domain to obtain the target Spectrum of the high-resolution image, and the target high-resolution sample image is obtained through inverse Fourier transform. Because it is equivalent to increasing the illumination at different angles and broadening the frequency spectrum, it can provide the characteristics of wide field of view and high spatial resolution. At the same time, the feature of synchronous acquisition of the photosensitive array avoids the limitations of the time-sharing lighting of the point source array in the traditional Fourier overlapping correlation imaging system that hinders the improvement of the imaging rate, realizes the characteristics of high time resolution, and can perform real-time imaging of dynamic scenes.
根据本发明实施例的基于计算鬼成像的傅里叶重叠关联成像系统,具有如下优点:The Fourier overlap correlation imaging system based on computational ghost imaging according to the embodiment of the present invention has the following advantages:
1、实现不同倾斜角照明的图像同时采集,避免了FPM系统中每次采集只能有一个或者少数几个发光二极管点亮的局限性,提高整个成像系统的图像采集效率;1. Simultaneous acquisition of images illuminated by different inclination angles, avoiding the limitation that only one or a few light-emitting diodes can be lit for each acquisition in the FPM system, and improving the image acquisition efficiency of the entire imaging system;
2、单像素探测器具有更宽的谱段,能够实现比通常阵列式传感器更宽谱段的测量;2. The single-pixel detector has a wider spectrum, which can realize the measurement of a wider spectrum than the usual array sensor;
3、采用计算鬼成像的思路,可对结构光进行特定编码,如正弦编码或哈达玛编码,可以实现图像的压缩重建,提高单次成像的速率。3. Using the idea of computational ghost imaging, specific encoding can be performed on structured light, such as sinusoidal encoding or Hadamard encoding, which can realize image compression and reconstruction and increase the rate of single imaging.
本发明的进一步实施例还提出了一种基于计算鬼成像的傅里叶重叠关联成像方法。A further embodiment of the present invention also proposes a Fourier overlap correlation imaging method based on computational ghost imaging.
图4是根据本发明一个实施例的基于计算鬼成像的傅里叶重叠关联成像方法的流程图。如图4所示,该方法包括以下步骤:Fig. 4 is a flowchart of a Fourier overlap-correlation imaging method based on computational ghost imaging according to an embodiment of the present invention. As shown in Figure 4, the method includes the following steps:
步骤S1:构建空间滤波器,并通过空间滤波器产生干净、空间分布均匀的准直高斯光束。Step S1: Construct a spatial filter, and generate a clean, uniformly distributed collimated Gaussian beam through the spatial filter.
在本发明的一个实施例中,构建的空间滤波器例如包括:物镜、针孔、准直透镜和光学调整架、平移台,其中,针孔位于物镜的焦点处,用于滤除高阶次不均匀杂散光,产生空间分布均匀的高斯光束,之后经过准直透镜,得到准直高斯光束,光学调整架用于固定物镜和准直透镜并调整器件角度,以使出射光束平直,平移台用于固定针孔,同时调整针孔与物镜之间的间距,以保证在合适的三维坐标内得到空间均匀分布的高斯光束。In one embodiment of the present invention, the constructed spatial filter includes, for example: an objective lens, a pinhole, a collimator lens, an optical adjustment mount, and a translation stage, wherein the pinhole is located at the focal point of the objective lens to filter out high-order Inhomogeneous stray light produces a Gaussian beam with uniform spatial distribution, and then passes through a collimator lens to obtain a collimated Gaussian beam. The optical adjustment frame is used to fix the objective lens and collimator lens and adjust the angle of the device to make the outgoing beam straight. The translation stage It is used to fix the pinhole and adjust the distance between the pinhole and the objective lens at the same time to ensure a Gaussian beam with uniform distribution in space in a suitable three-dimensional coordinate.
步骤S2:对准直高斯光束进行空间调制,以得到空间编码的结构光照。Step S2: spatially modulate the collimated Gaussian beam to obtain spatially encoded structured illumination.
具体地,在本发明的一个实施例中,对准直高斯光束进行空间调制,进一步包括:对准直高斯光束进行幅度或相位的调制,以得到空间编码的结构光照。换言之,对准直高斯光束进幅度或者相位的调制,从而得到所需要的照明模式。Specifically, in an embodiment of the present invention, performing spatial modulation on the collimated Gaussian beam further includes: performing amplitude or phase modulation on the collimated Gaussian beam to obtain spatially coded structured illumination. In other words, the amplitude or phase of the collimated Gaussian beam is modulated to obtain the desired illumination pattern.
步骤S3:将空间编码的结构光照投射在成像面上,并与成像样本接触。Step S3: Projecting the spatially encoded structured illumination onto the imaging surface and making contact with the imaging sample.
在发明的一个实施例中,例如通过透镜或者透镜组将空间编码的结构光照投射在成像面上。换言之,即将入射的照明模式在样本平面上进行作用,其可以是透镜或者透镜组,也可以直接照射在样本上,此次成像系统空缺。In one embodiment of the invention, the spatially encoded structured illumination is projected onto the imaging surface, for example by a lens or a lens group. In other words, the incident illumination mode acts on the sample plane, which can be a lens or a lens group, or directly irradiates the sample, and the imaging system is vacant this time.
步骤S4:接收不同方向成像样本后光场的场强。具体地,不同方向成像样本后光场的场强对应于不同方向倾斜平面波照射到成像样本上,在成像样本前端拍摄的图像。换言之,例如通过高速感光阵列经过样本透射或者反射之后接收不同角度的强度,根据单像素成像光路可逆的原理,其对应于不同方向倾斜平面波照射到样本上,在样本前端拍摄的图像。更为具体地,即对于每个感光元件的强度与照明模式的相关进行建模并且利用自然场景稀疏性的约束进行压缩感知成像,对应于该感光元件角度上产生的倾斜平面波照射在样本上,从样本前端所看到的图像。Step S4: receiving the field strength of the light field after imaging the sample in different directions. Specifically, the field strength of the light field after imaging the sample in different directions corresponds to the images taken at the front end of the imaging sample when inclined plane waves in different directions are irradiated onto the imaging sample. In other words, for example, the high-speed photosensitive array receives intensities at different angles after being transmitted or reflected by the sample. According to the principle of reversible single-pixel imaging optical path, it corresponds to the images taken at the front of the sample when oblique plane waves in different directions are irradiated on the sample. More specifically, model the correlation between the intensity of each photosensitive element and the illumination mode and use the constraint of natural scene sparsity to perform compressive sensing imaging, corresponding to the oblique plane wave generated at the angle of the photosensitive element irradiated on the sample, The image seen from the front of the sample.
步骤S5:根据计算鬼成像的原理计算出高速感光阵列的每个单像素探测器对应位置的图像,并作为以该单像素探测器为光源的倾斜平面波照明的低分辨率图像。具体地说,空间光调制器调制多组不同的结构光照,高速感光阵列接收对应的光场强度,则对于阵列的每个单像素探测器,根据计算鬼成像的原理计算出对应位置的图像,作为以该点单像素探测器为光源的倾斜平面波照明的低分辨率图像。换言之,即通过多次不同照明模式与在每个感光元件上强度的相关得到每个不同角度的成像结果作为经变化照明倾斜角的、低分辨率的图像迭代更新在傅里叶频谱的重叠区域,从而以计算的方式重构样本的高分辨率图像。Step S5: Calculate the image corresponding to each single-pixel detector of the high-speed photosensitive array according to the principle of computational ghost imaging, and use the single-pixel detector as a low-resolution image illuminated by an oblique plane wave as a light source. Specifically, the spatial light modulator modulates multiple sets of different structured illumination, and the high-speed photosensitive array receives the corresponding light field intensity. Then, for each single-pixel detector of the array, the image of the corresponding position is calculated according to the principle of computational ghost imaging. Low-resolution image as an oblique plane-wave illumination with the point single-pixel detector as the light source. In other words, the imaging result of each different angle is obtained by correlating the intensity of different illumination modes with each photosensitive element multiple times, as a low-resolution image with a changed illumination tilt angle, iteratively updating the overlapping area of the Fourier spectrum , to computationally reconstruct a high-resolution image of the sample.
步骤S6:对不同方向倾斜平面波照明的低分辨率图像进行傅里叶变换,得到对应于目标高分辨图像的频谱在该入射角度和物镜的数值孔径的搬移和低通滤波,将低分辨率图像的频谱重叠相关的部分进行拼接,得到目标高分辨率图像的频谱,并利用相位恢复算法得到目标高分辨率图像。换言之,该步骤即傅里叶重叠关联成像过程,将不同方向倾斜平面波照明的、低分辨率的图像迭代更新在傅里叶频谱的重叠区域,得到频域拓宽之后高分辨率图像的频谱,最后以计算的方式用相位恢复的算法重构样本的高分辨率图像。Step S6: Perform Fourier transform on the low-resolution images illuminated by oblique plane waves in different directions to obtain the shift and low-pass filtering of the frequency spectrum corresponding to the target high-resolution image at the incident angle and the numerical aperture of the objective lens, and convert the low-resolution image to The overlapping and related parts of the spectrum are spliced to obtain the spectrum of the target high-resolution image, and the target high-resolution image is obtained by using the phase recovery algorithm. In other words, this step is the process of Fourier overlap correlation imaging, which iteratively updates the low-resolution images illuminated by oblique plane waves in different directions in the overlapping area of the Fourier spectrum to obtain the spectrum of the high-resolution image after the frequency domain is broadened, and finally A high-resolution image of the sample is computationally reconstructed using a phase recovery algorithm.
在一些示例中,本发明实施例的成像方法适用于宽尺度的成像系统,从微米级到米级,其中不同尺度的成像系统通过调整空间光调制器到样本之间的成像模块实现。In some examples, the imaging method of the embodiment of the present invention is applicable to a wide-scale imaging system, from micrometer to meter, wherein imaging systems of different scales are realized by adjusting the imaging module between the spatial light modulator and the sample.
进一步地,本发明实施例的成像方法适用于宽谱段的成像系统,从太赫兹谱段、红外谱段、可见光谱段、紫外谱段到X射线谱段,其中不同谱段的成像系统通过替换适用于不同的高速感光元件实现。Further, the imaging method of the embodiment of the present invention is applicable to imaging systems of wide spectrum, from terahertz spectrum, infrared spectrum, visible spectrum, ultraviolet spectrum to X-ray spectrum, wherein imaging systems of different spectrums pass Substitutions are available for different high-speed sensor implementations.
也就是说,本发明实施例的方法为对照明模式进行编码优化提高相关成像过程中的成像速率和成像质量的方法。更具体地,利用四步相移的不同空间频率的正弦模式照明,直接从不同的感光元件上获取不同空间角度的低分辨率图像的里叶频谱,再进行迭代更新在傅里叶频谱的重叠区域,从而得到频域拓宽之后的高分辨率图像的频谱。That is to say, the method in the embodiment of the present invention is a method for encoding and optimizing the illumination mode to improve the imaging rate and imaging quality in the related imaging process. More specifically, four-step phase-shifted sinusoidal mode illumination with different spatial frequencies is used to directly obtain the Liier spectra of low-resolution images at different spatial angles from different photosensitive elements, and then iteratively update the overlapped Fourier spectra. region, so as to obtain the frequency spectrum of the high-resolution image after frequency domain widening.
综上,本发明上述实施例的基于计算鬼成像的傅里叶重叠关联成像方法的主要原理可概述为:该方法是基于不同方向倾斜平面波经过傅里叶变换在频域产生位移的特性以及单像素成像具有光路可逆的特性提出的,其特征在于搭建光强分布均匀的准直光束系统,并将准直光束入射至空间光调制器进行入射光场幅度或者相位的调制,得到调制后的光束经过成像光学系统或者直接照射在成像样本上,在其经过透射或者反射到高速感光阵列(单像素探测器阵列)进行同时采集。同一个样本经过多次已知调制模式的光束照射并采集每个感光元件(单像素探测器)对应的光强,利用调制模式与感光元件的光强的相关或者压缩感知的方法得到每一个感光元件所对应的角度的成像结果。根据单像素成像具有光路可逆的特性,每个单像素对同一个样本的成像结果对应于以这个单像素为点源产生的不同方向倾斜平面波照明在入射样本前端拍摄的结果。因此,对于每个单像素得到的低分辨率的图像在频谱相当于目标高分辨率图像在对应入射角度下某一个范围内的频谱。所有单像素的图像的频谱代表不同角度也就是频域不同平移位置处的频谱,最终相互重叠,相互关联构成整体范围更大的频谱。利用同步采集的所有单像素成像结果,进行傅里叶变换,进而根据每个感光元件对应的入射角度确定在目标高分辨率图像频谱中的位置,将重叠关联的频谱通过频域拼接,得到目标高分辨率图像的频谱,并通过傅里叶逆变换得到目标高分辨样本图像。由于相当于增加了不同角度的光照,拓宽了频谱,因此能够提供宽视场和高空间分辨率的特性。同时,感光阵列同步采集的特性避免了传统傅里叶重叠关联成像系统点源阵列分时点亮阻碍成像速率提高的局限,实现了高时间分辨率的特性,能够对动态场景进行实时成像。In summary, the main principle of the Fourier overlap-correlation imaging method based on computational ghost imaging in the above-mentioned embodiments of the present invention can be summarized as follows: the method is based on the characteristics of displacement in the frequency domain of plane waves inclined in different directions through Fourier transform and the single The pixel imaging has the characteristic of reversible optical path, which is characterized in that a collimated beam system with uniform light intensity distribution is built, and the collimated beam is incident on the spatial light modulator to modulate the amplitude or phase of the incident light field to obtain the modulated beam After passing through the imaging optical system or directly irradiating the imaging sample, it is transmitted or reflected to the high-speed photosensitive array (single-pixel detector array) for simultaneous acquisition. The same sample is irradiated by light beams with known modulation modes multiple times and the light intensity corresponding to each photosensitive element (single-pixel detector) is collected, and the correlation between the modulation mode and the light intensity of the photosensitive element or compressed sensing method is used to obtain each photosensitive element. The imaging result of the angle corresponding to the component. According to the characteristic of single-pixel imaging with reversible optical path, the imaging result of each single pixel on the same sample corresponds to the result of shooting at the front of the incident sample by the oblique plane wave illumination in different directions generated by using this single pixel as a point source. Therefore, the frequency spectrum of the low-resolution image obtained for each single pixel is equivalent to the frequency spectrum of the target high-resolution image within a certain range under the corresponding incident angle. The spectra of all single-pixel images represent spectra at different angles, that is, at different translation positions in the frequency domain, and eventually overlap and correlate with each other to form a spectrum with a larger overall range. Use all the single-pixel imaging results collected synchronously to perform Fourier transform, and then determine the position in the high-resolution image spectrum of the target according to the incident angle corresponding to each photosensitive element, and splicing the overlapping and related spectra in the frequency domain to obtain the target Spectrum of the high-resolution image, and the target high-resolution sample image is obtained through inverse Fourier transform. Because it is equivalent to increasing the illumination at different angles and broadening the frequency spectrum, it can provide the characteristics of wide field of view and high spatial resolution. At the same time, the feature of synchronous acquisition of the photosensitive array avoids the limitations of the time-sharing lighting of the point source array in the traditional Fourier overlapping correlation imaging system that hinders the improvement of the imaging rate, realizes the characteristics of high time resolution, and can perform real-time imaging of dynamic scenes.
根据本发明实施例的基于计算鬼成像的傅里叶重叠关联成像方法,具有如下优点:The Fourier overlap correlation imaging method based on computational ghost imaging according to the embodiment of the present invention has the following advantages:
1、实现不同倾斜角照明的图像同时采集,避免了FPM系统中每次采集只能有一个或者少数几个发光二极管点亮的局限性,提高整个成像系统的图像采集效率;1. Simultaneous acquisition of images illuminated by different inclination angles, avoiding the limitation that only one or a few light-emitting diodes can be lit for each acquisition in the FPM system, and improving the image acquisition efficiency of the entire imaging system;
2、单像素探测器具有更宽的谱段,能够实现比通常阵列式传感器更宽谱段的测量;2. The single-pixel detector has a wider spectrum, which can realize the measurement of a wider spectrum than the usual array sensor;
3、采用计算鬼成像的思路,可对结构光进行特定编码,如正弦编码或哈达玛编码,可以实现图像的压缩重建,提高单次成像的速率。3. Using the idea of computational ghost imaging, specific encoding can be performed on structured light, such as sinusoidal encoding or Hadamard encoding, which can realize image compression and reconstruction and increase the rate of single imaging.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
尽管已经示出和描述了本发明的实施例,本领域的普通技术人员可以理解:在不脱离本发明的原理和宗旨的情况下可以对这些实施例进行多种变化、修改、替换和变型,本发明的范围由权利要求及其等同限定。Although the embodiments of the present invention have been shown and described, those skilled in the art can understand that various changes, modifications, substitutions and modifications can be made to these embodiments without departing from the principle and spirit of the present invention. The scope of the invention is defined by the claims and their equivalents.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610960008.1A CN106371201B (en) | 2016-11-03 | 2016-11-03 | Based on the Fourier's overlapping associations imaging system and method for calculating ghost imaging |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610960008.1A CN106371201B (en) | 2016-11-03 | 2016-11-03 | Based on the Fourier's overlapping associations imaging system and method for calculating ghost imaging |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106371201A CN106371201A (en) | 2017-02-01 |
CN106371201B true CN106371201B (en) | 2018-11-09 |
Family
ID=57894002
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610960008.1A Expired - Fee Related CN106371201B (en) | 2016-11-03 | 2016-11-03 | Based on the Fourier's overlapping associations imaging system and method for calculating ghost imaging |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106371201B (en) |
Families Citing this family (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106950674B (en) * | 2017-05-04 | 2022-11-29 | 中国工程物理研究院激光聚变研究中心 | Device for small-angle inclination of transmission type optical system and using method |
CN107147829B (en) * | 2017-05-25 | 2019-07-23 | 青岛理工大学 | An underwater optical imaging device with axial multi-sensor |
CN107219638B (en) * | 2017-05-27 | 2019-05-10 | 辽宁大学 | Super-resolution correlation imaging system and imaging method based on low-pass filtering |
CN107241550B (en) * | 2017-06-26 | 2019-10-29 | 清华大学 | Based on time-multiplexed quick single pixel frequency domain imaging method |
CN109211790B (en) * | 2017-07-03 | 2023-12-08 | 南开大学 | Single-pixel phase imaging method based on Fourier power spectrum detection |
CN108550108B (en) * | 2017-09-28 | 2020-11-03 | 武汉大学 | Fourier laminated imaging image reconstruction method based on phase iteration minimization |
CN107909591B (en) * | 2017-09-29 | 2021-06-01 | 华北水利水电大学 | Boundary extraction method and system based on structured light illumination and single-pixel imaging |
CN107783149B (en) * | 2017-11-29 | 2024-03-19 | 苏州蛟视智能科技有限公司 | Compressed sensing imaging device and method |
CN108225561B (en) * | 2017-12-05 | 2020-05-22 | 深圳先进技术研究院 | Compressed spectrum imaging system, reconstruction method, device and terminal equipment |
CN108205191A (en) * | 2018-02-13 | 2018-06-26 | 成都筋斗云影视传媒有限公司 | Imaging system is laminated based on multi-angle illumination and the Fourier of Fourier domain coded modulation |
CN108827988A (en) * | 2018-06-12 | 2018-11-16 | 中国科学院上海光学精密机械研究所 | Non-local modulation of X-ray diffraction imaging device and method based on light field High order correletion |
CN110108358A (en) * | 2019-03-28 | 2019-08-09 | 浙江大学 | A kind of high spectrum imaging method and device |
CN110132175B (en) * | 2019-05-30 | 2021-04-20 | 北京理工大学 | Single-pixel phase imaging method and device based on amplitude modulation |
CN110208294A (en) * | 2019-06-18 | 2019-09-06 | 华东交通大学 | Single pixel micro imaging method and system based on Kohler illumination |
CN111474145A (en) * | 2020-03-19 | 2020-07-31 | 清华大学 | Single-pixel fluorescence and phase imaging system and method |
CN111708176B (en) * | 2020-03-19 | 2021-04-30 | 北京理工大学 | An adaptive heterogeneous resolution ghost imaging method and system |
TWI754921B (en) * | 2020-04-28 | 2022-02-11 | 國立中央大學 | Compressed sensing apparatus, system and method for processing signals in set function |
CN111833248B (en) * | 2020-06-19 | 2023-06-16 | 西北大学 | Super-resolution ghost imaging method and system based on partial Hadamard matrix |
CN112834431B (en) * | 2020-12-31 | 2024-03-19 | 之江实验室 | Single-pixel imaging method and device |
CN113509208B (en) * | 2021-09-14 | 2021-11-30 | 西南石油大学 | Ultrahigh-speed ultrasonic imaging reconstruction method based on phase constraint |
CN113890624B (en) * | 2021-11-12 | 2024-02-23 | 南京航空航天大学 | Frequency domain ghost imaging spectrum detection method and device |
CN114289879B (en) * | 2022-01-13 | 2023-02-17 | 北京理工大学 | Method for integrating multiple micro capacitors by single preparation of ultrafast laser |
CN114721006B (en) * | 2022-06-08 | 2022-09-02 | 中国人民解放军国防科技大学 | High-precision single-pixel imaging method and system |
CN115128633B (en) * | 2022-07-01 | 2024-04-05 | 合肥工业大学 | A polarization ghost imaging method based on Fourier light field |
CN115437143A (en) * | 2022-09-26 | 2022-12-06 | 浙江大学 | High-performance optical imaging system and method based on all-optical link inverse diffraction calculation |
CN116893429B (en) * | 2023-07-13 | 2024-01-30 | 中国人民解放军国防科技大学 | Single-pixel imaging method and target recognition method based on circular harmonic Fourier light field |
CN119136068A (en) * | 2024-08-02 | 2024-12-13 | 复旦大学 | A single-pixel ultraviolet optical imaging system based on quantum dot down-conversion |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2053441A1 (en) * | 2007-10-22 | 2009-04-29 | Jasco Corporation | Microscopic-measurement apparatus |
CN104885187A (en) * | 2012-10-30 | 2015-09-02 | 加州理工学院 | Fourier ptychographic imaging systems, devices, and methods |
CN105659143A (en) * | 2013-07-31 | 2016-06-08 | 加州理工学院 | Aperture scanning fourier ptychographic imaging |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4928894B2 (en) * | 2006-10-03 | 2012-05-09 | 株式会社キーエンス | Magnification observation apparatus, operation method of magnification observation apparatus, magnification observation apparatus operation program, computer-readable recording medium, and recorded apparatus |
-
2016
- 2016-11-03 CN CN201610960008.1A patent/CN106371201B/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2053441A1 (en) * | 2007-10-22 | 2009-04-29 | Jasco Corporation | Microscopic-measurement apparatus |
CN104885187A (en) * | 2012-10-30 | 2015-09-02 | 加州理工学院 | Fourier ptychographic imaging systems, devices, and methods |
CN105659143A (en) * | 2013-07-31 | 2016-06-08 | 加州理工学院 | Aperture scanning fourier ptychographic imaging |
Also Published As
Publication number | Publication date |
---|---|
CN106371201A (en) | 2017-02-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106371201B (en) | Based on the Fourier's overlapping associations imaging system and method for calculating ghost imaging | |
CN103257441B (en) | A kind of dynamic micro imaging system of incoherent digital holography three-dimensional and method | |
CN108594418A (en) | A kind of light field micro imaging system and its method based on array single pixel detector | |
US9194818B2 (en) | Distance measurement system and optical resolution improvement apparatus | |
EP3065001B1 (en) | Holographic microscope and data processing method for high-resolution hologram image | |
US10976532B2 (en) | Structured illumination microscopy system using digital micromirror device and time-complex structured illumination, and operation method therefor | |
CN107490562A (en) | Utilize the ultrahigh speed three-dimensional refractive index filming image and fluorescence structure optical illumination microscopic system and its application method of corrugated reshaper | |
JP2018504577A (en) | Epi-illumination Fourier typography imaging for thick film samples | |
Lu et al. | Modulation measuring profilometry with cross grating projection and single shot for dynamic 3D shape measurement | |
JP6228965B2 (en) | Three-dimensional refractive index measuring method and three-dimensional refractive index measuring apparatus | |
JPWO2019044336A1 (en) | Holographic imaging device and data processing method used for the device | |
CN108181235B (en) | STED parallel microscopic imaging system based on uniform structured light illumination | |
JPH07261125A (en) | Projection type image display device | |
CN103744172B (en) | A kind of confocal microscopic image method possessing spatial light modulation illumination | |
CN111474145A (en) | Single-pixel fluorescence and phase imaging system and method | |
CN114264370B (en) | Compressed sensing computed tomography spectrometer system and imaging method | |
CN109900356B (en) | Correlation imaging method and apparatus | |
CN109581643A (en) | Fourier laminated microscopic imaging device and method | |
CN107272218B (en) | High speed structured light imaging system | |
CN103148800A (en) | Label-free three-dimensional microscope method based on light filed propagation and device | |
CN108332684A (en) | A kind of measuring three-dimensional profile method based on Structured Illumination microtechnic | |
CN116183568B (en) | High-fidelity reconstruction method and device for three-dimensional structured light illumination super-resolution microscopic imaging | |
US20250013026A1 (en) | Multi-focal light-sheet structured illumination fluorescence microscopy system | |
CN106979758A (en) | A kind of three-dimensional measuring apparatus and method | |
KR101888924B1 (en) | Time-Multiplexed Structured Illumination with Digital Micromirror Device for Structured Illumination Microscopy and Method of Operating the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20181109 |
|
CF01 | Termination of patent right due to non-payment of annual fee |