CN107966801A - A kind of high speed Fourier lamination imaging device and reconstructing method based on ring illumination - Google Patents
A kind of high speed Fourier lamination imaging device and reconstructing method based on ring illumination Download PDFInfo
- Publication number
- CN107966801A CN107966801A CN201711484822.1A CN201711484822A CN107966801A CN 107966801 A CN107966801 A CN 107966801A CN 201711484822 A CN201711484822 A CN 201711484822A CN 107966801 A CN107966801 A CN 107966801A
- Authority
- CN
- China
- Prior art keywords
- led
- ring
- mrow
- msub
- sample
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 87
- 238000005286 illumination Methods 0.000 title claims abstract description 62
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000003475 lamination Methods 0.000 title abstract 2
- 238000012937 correction Methods 0.000 claims abstract description 18
- 238000001228 spectrum Methods 0.000 claims abstract description 7
- 239000000523 sample Substances 0.000 claims description 46
- 238000005516 engineering process Methods 0.000 claims description 13
- 230000003287 optical effect Effects 0.000 claims description 13
- 230000001678 irradiating effect Effects 0.000 claims description 11
- 238000004422 calculation algorithm Methods 0.000 claims description 9
- 238000013519 translation Methods 0.000 claims description 9
- 239000012496 blank sample Substances 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 2
- 238000012546 transfer Methods 0.000 abstract description 5
- 230000000007 visual effect Effects 0.000 abstract 1
- 238000011084 recovery Methods 0.000 description 14
- 238000000386 microscopy Methods 0.000 description 6
- 238000012360 testing method Methods 0.000 description 6
- 238000005305 interferometry Methods 0.000 description 5
- 238000005259 measurement Methods 0.000 description 5
- 230000001427 coherent effect Effects 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 239000013078 crystal Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000000691 measurement method Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000002003 electron diffraction Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000000399 optical microscopy Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
- G02B21/08—Condensers
- G02B21/082—Condensers for incident illumination only
- G02B21/084—Condensers for incident illumination only having annular illumination around the objective
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
Landscapes
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Microscoopes, Condenser (AREA)
Abstract
Description
技术领域technical field
本发明属于光学显微成像技术,特别是一种基于环形照明的高速傅立叶叠层成像装置及重构方法。The invention belongs to optical microscopic imaging technology, in particular to a ring-shaped lighting-based high-speed Fourier stack imaging device and a reconstruction method.
背景技术Background technique
相位恢复是光学测量与成像的一个重要技术,无论在生物医学还是工业检测领域,相位成像技术都在发挥着重要的作用。纵观光学测量技术近半个世纪的进展,最经典的相位测量方法为干涉测量方法。然而,干涉测量法的缺点也十分明显:(1)干涉测量一般需要高度相干性的光源(如激光),从而需要较为复杂的干涉装置;(2)额外的参考光路的引入导致对于测量环境的要求变得十分苛刻;(3)高相干性的光源引入的相干散斑噪声限制了成像系统的空间分辨率与测量精度。Phase recovery is an important technology in optical measurement and imaging. No matter in the field of biomedicine or industrial detection, phase imaging technology is playing an important role. Throughout the development of optical measurement technology for nearly half a century, the most classic phase measurement method is interferometry. However, the disadvantages of interferometry are also very obvious: (1) Interferometry generally requires a highly coherent light source (such as a laser), which requires a more complex interferometric device; (2) The introduction of an additional reference optical path leads to the measurement environment The requirements become very stringent; (3) The coherent speckle noise introduced by the highly coherent light source limits the spatial resolution and measurement accuracy of the imaging system.
不同于干涉测量方法,另一类非常重要的相位测量技术并不需要借助干涉,它们统称为相位恢复。由于直接测量光波场的相位分布非常困难,而测量光波场的振幅(强度)十分容易。因此,可以将利用强度分布来恢复(估算)相位这一过程视为一个数学上的“逆问题”,即相位恢复问题。相位恢复的方法还可细分为迭代法与直接法。一方面,直接法以光强传输方程法和差分相衬法为代表,二者都只需要拍摄最少2-4幅图就能根据各自的相位传递函数直接求解出物体的相位分布。但由于二者的相位传递函数值在低频区域都比较低,且在零频处都趋近于零,所以恢复的相位分布往往都存在一些低频误差,所以需要附加的正则化优化方法来去除这些低频重构误差,难以保证重构精度。Unlike the interferometry method, another very important phase measurement technique does not require interferometry, and they are collectively called phase recovery. Since it is very difficult to directly measure the phase distribution of the light wave field, it is very easy to measure the amplitude (intensity) of the light wave field. Therefore, the process of using the intensity distribution to recover (estimate) the phase can be regarded as a mathematical "inverse problem", that is, the phase recovery problem. The methods of phase recovery can be subdivided into iterative method and direct method. On the one hand, the direct method is represented by the light intensity transfer equation method and the differential phase contrast method, both of which only need to take at least 2-4 images to directly solve the phase distribution of the object according to their respective phase transfer functions. However, since the phase transfer function values of the two are relatively low in the low-frequency region and approach zero at zero frequency, there are often some low-frequency errors in the restored phase distribution, so additional regularization optimization methods are needed to remove these Low-frequency reconstruction errors make it difficult to guarantee reconstruction accuracy.
另一方面,迭代法以基于合成孔径成像原理的扫描成像方法为代表,最早由Hoppe为了研究晶体结构所提出(Hoppe W.Trace structure analysis,ptychography,phasetomography[J].Ultramicroscopy,1982,10(3):187-198.),并通过研究晶体和非晶体的扫描透射电子衍射显微成像,验证了此方法的有效性。Rodenburg和Faulkner等结合相位恢复算法将此方法多次改进(Rodenburg J M.Ptychography and related diffractiveimaging methods[J].Advances in Imaging and Electron Physics,2008,150:87-184.)。目前这种成像方法已在可见光域、X射线、电子显微镜等不同波段得到了实验证实,并发展出若干种技术以提高分辨率以及相位恢复精度,该技术显示出在大幅面成像、高分辨成像、定量相位恢复等方面的巨大潜力。2013年,郑国安将合成孔径成像术由空域引入了频域,提出了傅立叶叠层成像技术,也叫频域叠层孔径成像技术(Zheng G,Horstmeyer R,Yang C.Wide-field,high-resolution Fourier ptychographic microscopy[J].Naturephotonics,2013,7(9):739-745.)。该方法虽然能够实现大视场高分辨率显微成像,空间带宽积相比于传统光学显微技术得到了极大的提升。但是,该方法的相位恢复精度一直未得到验证,往往存在大量低频相位重构误差。此外,由于其需要采集大量低分辨率图像来重构一幅高分辨率图像,成像速度慢,难以适应当前各种高速定量相位显微成像的需求(例如活细胞无标记动态定量相位成像)。所以如何在只拍摄少量低分辨率图像的前提下实现高精度的大视场高速定量相位显微成像成为了傅立叶叠层成像技术必须克服的一个技术难题。On the other hand, the iterative method is represented by the scanning imaging method based on the principle of synthetic aperture imaging, which was first proposed by Hoppe for the study of crystal structure (Hoppe W. Trace structure analysis, ptychography, phasetomography [J]. Ultramicroscopy, 1982, 10 (3 ):187-198.), and verified the effectiveness of this method by studying scanning transmission electron diffraction microscopy imaging of crystals and amorphous. Rodenburg and Faulkner combined the phase recovery algorithm to improve this method several times (Rodenburg J M. Ptychography and related diffractive imaging methods [J]. Advances in Imaging and Electron Physics, 2008, 150: 87-184.). At present, this imaging method has been experimentally confirmed in different wavelength bands such as visible light domain, X-ray, and electron microscope, and several technologies have been developed to improve the resolution and phase recovery accuracy. , Quantitative phase recovery, etc. have great potential. In 2013, Zheng Guoan introduced synthetic aperture imaging from the space domain to the frequency domain, and proposed Fourier stack imaging technology, also called frequency domain stack aperture imaging technology (Zheng G, Horstmeyer R, Yang C. Wide-field, high- resolution Fourier ptychographic microscopy [J]. Naturephotonics, 2013, 7(9):739-745.). Although this method can achieve large-field-of-view and high-resolution microscopic imaging, the spatial bandwidth product has been greatly improved compared with traditional optical microscopy techniques. However, the phase recovery accuracy of this method has not been verified, and there are often a large number of low-frequency phase reconstruction errors. In addition, because it needs to collect a large number of low-resolution images to reconstruct a high-resolution image, the imaging speed is slow, and it is difficult to meet the current needs of various high-speed quantitative phase microscopy imaging (such as label-free dynamic quantitative phase imaging of living cells). Therefore, how to realize high-precision large-field-of-view high-speed quantitative phase microscopy imaging under the premise of only taking a small number of low-resolution images has become a technical problem that Fourier stack imaging technology must overcome.
发明内容Contents of the invention
本发明的目的在于提供一种基于环形照明的高速傅立叶叠层成像装置及重构方法,在只拍摄少量低分辨率图像的前提下实现高精度的大视场高速定量相位显微成像,极大提升傅立叶叠层成像技术的成像速度和相位重构精度。The purpose of the present invention is to provide a high-speed Fourier stack imaging device and reconstruction method based on ring illumination, which can realize high-precision large-field high-speed quantitative phase microscopic imaging on the premise of only taking a small number of low-resolution images, which greatly Improving the imaging speed and phase reconstruction accuracy of Fourier stack imaging technology.
实现本发明目的的技术解决方案为:The technical solution that realizes the object of the present invention is:
一种基于环形照明的高速傅立叶叠层成像装置,包括环形LED板、载物台、聚光镜、待测样品、显微物镜、成像筒镜、相机,其中环形LED板上第i个点亮的LED单元发出的光经过聚光镜汇聚变成平行光照射在待测样品上,该待测样品被放置在载物台上,透过待测样品的衍射光一部分被显微物镜收集,并经过成像筒镜汇聚照射相机的成像平面,形成的光强图由相机记录下来。A high-speed Fourier stack imaging device based on ring illumination, including a ring LED board, a stage, a condenser, a sample to be tested, a microscopic objective lens, an imaging tube lens, and a camera, wherein the i-th lighted LED on the ring LED board The light emitted by the unit is converged by the condenser lens into parallel light and irradiated on the sample to be tested. The sample to be tested is placed on the stage, and part of the diffracted light passing through the sample to be tested is collected by the microscope objective lens and passed through the imaging tube lens. Convergence illuminates the imaging plane of the camera, and the resulting light intensity map is recorded by the camera.
一种基于环形照明的高速傅立叶叠层成像重构方法,步骤如下:A high-speed Fourier stack imaging reconstruction method based on ring illumination, the steps are as follows:
步骤一,LED单元亮度标定:环形LED板作为显微镜的照明光源,顺次点亮其中每一个LED单元,照射空白待测样品后使用高倍物镜采集相对应的图像并计算每个LED单元在红绿蓝三个波段对应的归一化亮度校正系数;Step 1, LED unit brightness calibration: The ring-shaped LED board is used as the illumination source of the microscope, and each LED unit is lit in turn, and after irradiating a blank sample to be tested, use a high-power objective lens to collect corresponding images and calculate the red and green brightness of each LED unit. The normalized brightness correction coefficients corresponding to the three blue bands;
步骤二,LED位置标定与校正:分辨率板作为待测样品,环形LED板作为显微镜的照明光源,顺次点亮其中每一个LED单元,照射待测样品后分别采集聚焦下和离焦h距离下相对应的图像,然后通过亚像素配准算法计算每个LED单元在红绿蓝三个波段对应的照明角度,再通过非线性回归确定环形LED板位置;若存在圆环上LED单元所产生的倾斜平面波与物镜的数值孔径不内切,则通过调节微调平移台改变环形LED板的位置,重复步骤二,直到所有圆环上LED单元所产生的倾斜平面波都物镜的数值孔径内切;Step 2, LED position calibration and correction: the resolution board is used as the sample to be tested, and the ring-shaped LED board is used as the illumination source of the microscope. Each of the LED units is lit in sequence, and after irradiating the sample to be tested, the under-focus and defocus h distances are collected respectively. Download the corresponding image, and then calculate the illumination angle corresponding to each LED unit in the three bands of red, green and blue through the sub-pixel registration algorithm, and then determine the position of the ring-shaped LED board through nonlinear regression; if there is an LED unit on the ring If the inclined plane wave is not inscribed with the numerical aperture of the objective lens, then the position of the annular LED board is changed by adjusting the fine-tuning translation stage, and the second step is repeated until the inclined plane waves generated by the LED units on all rings are inscribed with the numerical aperture of the objective lens;
步骤三,原始图像采集:环形LED板作为显微镜的照明光源,顺次点亮其中每一个LED单元,照射待测样品后采集相对应的原始低分辨率明场图像;Step 3, original image acquisition: the ring-shaped LED board is used as the illumination source of the microscope, and each LED unit is sequentially lit, and the corresponding original low-resolution bright field image is collected after irradiating the sample to be tested;
步骤四,原始图像预处理,包括阈值去噪和亮度校正,首先根据相机的暗电流噪声平均值作为阈值,对拍摄的原始低分辨率图像进行阈值去噪,然后再将每一幅图除以步骤一中获得的归一化亮度校正系数;Step 4, original image preprocessing, including threshold denoising and brightness correction. Firstly, threshold denoising is performed on the original low-resolution images taken according to the average value of dark current noise of the camera, and then each image is divided by The normalized brightness correction coefficient obtained in step 1;
步骤五,高分辨率图像初始化:将所有拍摄到的低分辨率明场图像相加平均,然后再通过上采样来初始化高分辨率图像的振幅与相位;Step 5, high-resolution image initialization: average all captured low-resolution bright-field images, and then initialize the amplitude and phase of the high-resolution images by upsampling;
步骤六,迭代重构:采用基于像素合并的傅立叶叠层成像技术将所采集的每一幅图像在频域中逐一进行合成孔径运算,并逐步减小更新系数,以代价函数值为判据当其小于一个给定的阈值时,停止迭代,此时的高分辨率图像的振幅与相位就是最终得到的大视场高分辨率显微图像。Step 6, iterative reconstruction: use Fourier stack imaging technology based on pixel merging to perform synthetic aperture calculation on each image collected in the frequency domain one by one, and gradually reduce the update coefficient, and use the cost function value as the criterion. When it is less than a given threshold, the iteration is stopped, and the amplitude and phase of the high-resolution image at this time are the finally obtained large-field high-resolution microscopic image.
本发明与现有技术相比,其显著优点:(1)本装置既采用了环形LED板中圆环上各个LED的照明角度都与物镜的数值孔径内切,使得相位传递函数完全覆盖了相位频谱的所有低频部分,确保了相位重构精度,消除了低频重构误差。(2)由于圆环上LED的照明角度都与物镜的数值孔径内切,所以能够达到物镜数值孔径2倍的重构分辨率,而且拍摄的全部是明场图像,重构稳定性高,降低了对相机高动态范围的要求。(3)只需要在0.5秒以内拍摄最多13幅的明场低分辨率图片,就能够非常稳定并且准确地重建出物体大视场高分辨率的相位分布,极大的提高了傅立叶叠层成像技术的成像速度,达到了2帧每秒,非常适合用于活细胞的无标记高速定量相位显微成像。Compared with the prior art, the present invention has significant advantages: (1) the device has both adopted the illumination angle of each LED on the ring in the ring-shaped LED board and is inscribed with the numerical aperture of the objective lens, so that the phase transfer function completely covers the phase All low-frequency parts of the spectrum ensure phase reconstruction accuracy and eliminate low-frequency reconstruction errors. (2) Since the illumination angles of the LEDs on the ring are inscribed with the numerical aperture of the objective lens, the reconstruction resolution can reach twice the numerical aperture of the objective lens, and all images are taken in bright field, with high reconstruction stability and reduced The requirements for high dynamic range of the camera are met. (3) It only needs to take up to 13 low-resolution bright-field pictures within 0.5 seconds, and it can very stably and accurately reconstruct the phase distribution of the object with a large field of view and high resolution, which greatly improves Fourier stack imaging The imaging speed of the technology reaches 2 frames per second, which is very suitable for label-free high-speed quantitative phase microscopy imaging of living cells.
下面结合附图对本发明作进一步详细描述。The present invention will be described in further detail below in conjunction with the accompanying drawings.
附图说明Description of drawings
图1是基于环形照明的高速傅立叶叠层成像装置的光路示意图:(a)包含聚光镜的成像装置,(b)不包括聚光镜的成像装置。Figure 1 is a schematic diagram of the optical path of a high-speed Fourier stack imaging device based on ring illumination: (a) an imaging device that includes a condenser, and (b) an imaging device that does not include a condenser.
图2是环形LED板中每个LED单元的归一化亮度:图2(a)、图2(b)、图2(c)分别是在红色、绿色、蓝色三个波段所对应的归一化亮度。Figure 2 is the normalized brightness of each LED unit in the ring LED board: Figure 2(a), Figure 2(b), and Figure 2(c) are the normalized luminance corresponding to the three bands of red, green, and blue respectively. Normalized brightness.
图3为本发明迭代重构方法的流程示意图。Fig. 3 is a schematic flowchart of the iterative reconstruction method of the present invention.
图4是仿真的不同最大照明倾斜角下使用不同数量原始低分辨率图像进行超分辨率相位恢复的重构结果:图4(a)是仿真的待测物体的理想相位分布;图4(b1)、图4(b2)、图4(b3)分别是当明场LED单元的最大照明倾斜角与物镜的数值孔径内切时,由81幅、13幅、5幅明场低分辨率图像恢复的相位结果;图4(c1)、图4(c2)、图4(c3)分别是当明场LED单元的最大照明倾斜角与物镜的数值孔径不能内切时,由81幅、13幅、5幅明场低分辨率图像恢复的相位结果。Figure 4 is the reconstruction result of super-resolution phase recovery using different numbers of original low-resolution images under different maximum illumination tilt angles of simulation: Figure 4(a) is the ideal phase distribution of the simulated object under test; Figure 4(b1 ), Figure 4(b2), and Figure 4(b3) are respectively when the maximum illumination inclination angle of the bright field LED unit is inscribed with the numerical aperture of the objective lens, and are restored from 81, 13, and 5 bright field low-resolution images Figure 4(c1), Figure 4(c2), and Figure 4(c3) are respectively when the maximum illumination tilt angle of the bright field LED unit and the numerical aperture of the objective lens cannot be inscribed, from 81, 13, and Phase results of five brightfield low-resolution images recovered.
图5是利用本发明对微透镜阵列样品进行超分辨率相位恢复的重构结果:图5(a)是10倍物镜(数值孔径0.4)下点亮环形LED板中心的LED单元照射微透镜阵列样品所拍摄到的低分辨率图像;选取图5(a)方框中的图像区域,该区域在9个不同照明角度下的明场图像如图5(b)所示;图5(c)和图5(d)分别是该区域经过迭代重构后恢复的高分辨率光强分布和相位分布。Fig. 5 is the reconstruction result of using the present invention to carry out super-resolution phase recovery to the microlens array sample: Fig. 5 (a) is that the LED unit in the center of the ring-shaped LED plate illuminates the microlens array under the 10 times objective lens (numerical aperture 0.4) The low-resolution image taken by the sample; select the image area in the box in Figure 5(a), and the bright field images of this area under 9 different illumination angles are shown in Figure 5(b); Figure 5(c) and Fig. 5(d) are the high-resolution light intensity distribution and phase distribution recovered after iterative reconstruction in this region, respectively.
图6是利用本发明对Hela细胞进行动态定量相位成像的重构结果:图6(a)是对Hela细胞进行无标记动态定量相位的全视场高分辨率相位分布;选取图6(a)虚线框中的图像区域进行放大如图6(b)所示;图6(c1)-图6(c7)分别是所选区域在不同时刻下(0s、250s、500s、750s、1000s、1250s、1500s、)Hela细胞实时分裂的动态定量相位成像结果。Fig. 6 is the reconstructed result of dynamic quantitative phase imaging of Hela cells using the present invention: Fig. 6 (a) is a full-field high-resolution phase distribution of unlabeled dynamic quantitative phase of Hela cells; select Fig. 6 (a) The image area in the dotted frame is enlarged as shown in Figure 6(b); Figure 6(c1)-Figure 6(c7) are the selected areas at different times (0s, 250s, 500s, 750s, 1000s, 1250s, 1500s,) Dynamic quantitative phase imaging results of real-time division of Hela cells.
具体实施方式Detailed ways
本发明基于环形照明的高速傅立叶叠层成像装置及重构方法所依赖的实际硬件平台是基于环形照明的显微镜。The actual hardware platform on which the ring-illumination-based high-speed Fourier stack imaging device and the reconstruction method of the present invention depend is a ring-illumination-based microscope.
如图1所示,本发明基于环形照明的高速傅立叶叠层成像装置包括环形LED板1、载物台2、聚光镜3、待测样品4、显微物镜5、成像筒镜6、相机7,其中区别于已有傅立叶叠层成像系统的关键在于本系统只保留了照明倾斜角与物镜数值孔径相内切的LED单元和中心LED单元,极大减少了所需的明场图像数量,这样做不仅仅是为了减少原始图像采集数量,同时也是为了确保相位恢复的重构精度。环形LED板1安置在聚光镜3的前焦面位置,环形LED板的中心LED单元必须位于光轴上;显微物镜5的后焦面与成像筒镜6的前焦面重合,相机7的成像平面放置在成像筒镜6的后焦面位置,成像时载物台2上的待测样品4调节到显微物镜5的前焦面位置,构成无穷远校正成像系统。环形LED板1上第i个点亮的LED单元8发出的光经过聚光镜3汇聚变成平行光照射在待测样品4上,该待测样品4被放置在载物台2上,透过待测样品4的衍射光一部分被显微物镜5收集,并经过成像筒镜6汇聚照射相机7的成像平面,形成的光强图由相机7记录下来。As shown in Figure 1, the high-speed Fourier stack imaging device based on ring illumination of the present invention includes a ring LED plate 1, an object stage 2, a condenser lens 3, a sample to be tested 4, a microscopic objective lens 5, an imaging tube lens 6, and a camera 7, The key difference from the existing Fourier stack imaging system is that this system only retains the LED unit and the central LED unit whose illumination tilt angle is inscribed with the numerical aperture of the objective lens, which greatly reduces the number of bright field images required. Not only to reduce the number of raw image acquisitions, but also to ensure the reconstruction accuracy of phase recovery. The annular LED plate 1 is placed on the front focal plane position of the condenser lens 3, and the central LED unit of the annular LED plate must be positioned on the optical axis; The plane is placed on the rear focal plane of the imaging tube lens 6, and the sample 4 to be measured on the stage 2 is adjusted to the front focal plane of the microscope objective lens 5 during imaging, forming an infinity-corrected imaging system. The light emitted by the i-th lighted LED unit 8 on the annular LED board 1 is converged by the condenser lens 3 to become parallel light and irradiates on the sample 4 to be tested. The sample 4 to be tested is placed on the stage 2 and transmitted through the A part of the diffracted light from the test sample 4 is collected by the microscope objective lens 5, and converged by the imaging tube lens 6 to illuminate the imaging plane of the camera 7, and the formed light intensity map is recorded by the camera 7.
还有一种基于环形照明的高速傅立叶叠层成像装置,包括环形LED板1、载物台2、待测样品4、显微物镜5、成像筒镜6、相机7,其中环形LED板1上第i个点亮的LED单元8发出的光直接照射在待测样品4上对于局部视场而言可近似为平行光照射,该待测样品4被放置在载物台2上,透过待测样品4的衍射光一部分被显微物镜5收集,并经过成像筒镜6汇聚照射相机7的成像平面,形成的光强图由相机7记录下来。There is also a high-speed Fourier stack imaging device based on ring illumination, which includes a ring LED board 1, an object stage 2, a sample to be tested 4, a microscope objective lens 5, an imaging tube lens 6, and a camera 7, wherein the ring LED board 1 has the first The light emitted by i lighted LED units 8 is directly irradiated on the sample 4 to be measured, which can be approximated as parallel light irradiation for the local field of view. The sample 4 to be measured is placed on the stage 2, and through Part of the diffracted light from the sample 4 is collected by the microscope objective lens 5 , and converges through the imaging tube lens 6 to illuminate the imaging plane of the camera 7 , and the formed light intensity map is recorded by the camera 7 .
如图1所示,环形LED板1被安置在聚光镜3的前焦面位置,其中f为聚光镜3的焦距,一般在10-50mm之间。环形LED板1中包括若干个(最多13个)LED单元8,环形LED板的中心LED单元必须位于光轴上,其余的LED单元均匀排布在以中心LED单元为圆心半径为d的圆环上。其中每个LED单元均为红绿蓝三色LED单元,其典型波长为红光633nm、绿光525nm和蓝光465nm。每个LED单元到中心的间距d典型值为10-20mm。环形LED板1可以选择加工定制或其他商用的环形LED板,也可以选择使用商用方形LED阵列只点亮其中与物镜数值孔径内切的LED单元和位于光轴上的中心LED单元来实现环形照明。As shown in Figure 1, the annular LED board 1 is placed on the front focal plane of the condenser 3, where f is the focal length of the condenser 3, generally between 10-50mm. The annular LED board 1 includes several (up to 13) LED units 8, the central LED unit of the annular LED board must be located on the optical axis, and the rest of the LED units are evenly arranged in a circle with the central LED unit as the center and a radius of d superior. Each LED unit is a red, green and blue three-color LED unit, and its typical wavelengths are red light 633nm, green light 525nm and blue light 465nm. The distance d from each LED unit to the center is typically 10-20mm. Ring LED board 1 can choose to process customized or other commercial ring LED boards, or use a commercial square LED array to light up only the LED units inscribed with the numerical aperture of the objective lens and the center LED unit located on the optical axis to achieve ring lighting .
本发明为了满足圆环上所有LED单元的照明倾斜角都要与物镜的数值孔径内切,所述的显微物镜5数值孔径为NAobj,环形LED板1到样品的距离为f,环形LED板1中LED环的半径为d,LED单元8发出的光经过聚光镜3汇聚变成平行光关于光轴的夹角为θi,且必须满足同时,为了满足重构算法所需的最小空域采样率,所述的环形LED板1照明波长为λ,显微物镜5放大率为Mag,像元尺寸为Δxcam,且必须满足 In the present invention, in order to meet the illumination inclination angles of all LED units on the ring, they must be inscribed with the numerical aperture of the objective lens, the numerical aperture of the microscopic objective lens 5 is NA obj , the distance from the annular LED board 1 to the sample is f, and the annular LED The radius of the LED ring in the board 1 is d, and the light emitted by the LED unit 8 is converged by the condenser lens 3 to become parallel light, and the included angle with respect to the optical axis is θi , which must satisfy At the same time, in order to meet the minimum spatial sampling rate required by the reconstruction algorithm, the illumination wavelength of the annular LED panel 1 is λ, the magnification of the microscope objective lens 5 is Mag, and the pixel size is Δx cam , and must satisfy
本发明的相机7可以选择用彩色或单色相机,如果是单色相机,只需要在成像时让环形LED板1中每个LED单元8分别发出红或绿或蓝单色光,用单色相机7依次记录下所有单色图像即可;如果是彩色相机,在成像时可以让环形LED板1中每个LED单元8同时发出红绿蓝三色光,用彩色相机7记录下所有彩色图像。Camera 7 of the present invention can be selected to use color or monochromatic camera, if it is monochromatic camera, only need to allow each LED unit 8 in the annular LED board 1 to send red or green or blue monochromatic light respectively when imaging, with monochromatic The camera 7 can record all the monochrome images sequentially; if it is a color camera, each LED unit 8 in the annular LED board 1 can emit red, green and blue light at the same time when imaging, and record all the color images with the color camera 7.
本发明基于环形照明的高速傅立叶叠层成像重构方法的步骤如下:The steps of the high-speed Fourier stack imaging reconstruction method based on ring illumination in the present invention are as follows:
步骤一,LED单元亮度标定。环形LED板作为显微镜的照明光源,顺次点亮其中每一个LED单元,照射空白待测样品后使用高倍物镜采集相对应的图像并计算每个LED单元在红绿蓝三个波段对应的归一化亮度校正系数。实施流程为:环形LED板1作为显微镜的照明光源,顺次点亮其中每一个LED单元,照射空白待测样品后使用高倍物镜(典型值为40倍0.95数值孔径的显微物镜)采集相对应的图像。由于整个环形LED板中共包含N个LED单元(N≤13),每个LED单元分别发出红绿蓝三种颜色的单色光,共计拍摄3N幅低分辨率图像,则第i个LED单元在颜色c下对空白待测样品拍摄到的图像记作其中i=1,2,...,N,c=r,g,b,r为实空间的二维坐标r=(x,y)。然后计算每幅图像的平均光强成为每个LED单元在红绿蓝三个波段的平均亮度,其中Npixel为一幅图像中的像素总个数。环形LED板中心的LED单元所对应的平均亮度为则每个LED单元在红绿蓝三个波段对应的归一化亮度校正系数为Step 1, LED unit brightness calibration. The ring-shaped LED board is used as the illumination source of the microscope, and each of the LED units is sequentially lit. After irradiating the blank sample to be tested, a high-power objective lens is used to collect the corresponding image and calculate the normalization of each LED unit in the three bands of red, green and blue. luminance correction factor. The implementation process is as follows: the ring-shaped LED board 1 is used as the illumination source of the microscope, and each LED unit in it is sequentially lit, and after irradiating a blank sample to be tested, a high-power objective lens (a typical value of a microscope objective lens with a numerical aperture of 40 times 0.95) is used to collect the corresponding Image. Since the entire ring-shaped LED board contains N LED units (N≤13), each LED unit emits monochromatic light in three colors of red, green and blue, and a total of 3N low-resolution images are taken, then the i-th LED unit is in The image captured by the blank sample to be tested under the color c is recorded as Wherein i=1, 2,..., N, c=r, g, b, r is the two-dimensional coordinate r=(x, y) of the real space. Then calculate the average light intensity for each image Become the average brightness of each LED unit in the three bands of red, green and blue, where N pixel is an image The total number of pixels in . The average brightness corresponding to the LED unit in the center of the annular LED board is Then the normalized brightness correction coefficient corresponding to each LED unit in the three bands of red, green and blue for
步骤二,环形LED板位置标定。分辨率板作为待测样品,环形LED板作为显微镜的照明光源,顺次点亮其中每一个LED单元,照射待测样品后分别采集聚焦下和离焦h距离下相对应的图像,然后通过亚像素配准算法计算每个LED单元在红绿蓝三个波段对应的照明角度,再通过非线性回归确定环形LED板位置。Step 2, position calibration of the ring LED board. The resolution board is used as the sample to be tested, and the ring-shaped LED board is used as the illumination source of the microscope. Each of the LED units is lit up in sequence. The pixel registration algorithm calculates the illumination angle corresponding to each LED unit in the three bands of red, green and blue, and then determines the position of the annular LED board through nonlinear regression.
具体实施流程为:以分辨率板作为待测样品,环形LED板作为显微镜的照明光源,顺次点亮其中每一个LED单元,照射待测样品后分别采集聚焦下和离焦h距离(h典型值为10到30微米)下相对应的聚焦图像和离焦图像根据角谱衍射理论将中心LED单元对应的聚焦图像沿光轴数值传播h距离,得到数值离焦图像然后通过亚像素配准算法计算每个离焦图像相对于数值离焦图像的偏移量(PYx,PYy),则第i个LED单元所对应的照明光的空间频率矢量为The specific implementation process is as follows: the resolution board is used as the sample to be tested, and the ring-shaped LED board is used as the illumination source of the microscope, each of the LED units is sequentially lit, and after irradiating the sample to be tested, the under-focus and defocus h distances (h typical Values from 10 to 30 microns) correspond to in-focus images and defocused image According to the angular spectrum diffraction theory, the focused image corresponding to the central LED unit Propagate the h distance numerically along the optical axis to obtain a numerical defocused image Each out-of-focus image is then computed by a sub-pixel registration algorithm Relative to numerically defocused images offset (PY x , PY y ), then the spatial frequency vector of the illumination light corresponding to the i-th LED unit is
其中,(ux,uy)为沿xy方向的空间频率,λ为照明光的波长。Wherein, (u x , u y ) is the spatial frequency along the xy direction, and λ is the wavelength of the illuminating light.
最后再通过非线性回归确定环形LED板位置,公式为:Finally, determine the position of the annular LED board through nonlinear regression, the formula is:
xi=d[cos(θ)mi+sin(θ)ni]+Δxx i =d[cos(θ)m i +sin(θ)n i ]+Δx
yi=d[-sin(θ)mi+cos(θ)ni]+Δyy i =d[-sin(θ)m i +cos(θ)n i ]+Δy
其中,Q(...)为非线性回归法的目标函数,(θ,Δx,Δy,f)为更新后的环形LED板的四个位置参数,分别是旋转误差、x方向的平移误差、y方向的平移误差、焦距误差,(θ0,Δx0,Δy0,f0)为初始化的环形LED板位置参数,表示进行非线性回归运算,d为环形LED板相邻两个LED单元之间间距,(xi,yi)表示第i个LED单元的空间位置坐标,λ为照明光的波长,(mi,ni)为第i个的LED单元对应的行号和列号。Among them, Q(...) is the objective function of the nonlinear regression method, (θ,Δx,Δy,f) are the four position parameters of the updated circular LED board, which are the rotation error, the translation error in the x direction, The translation error and focus error in the y direction, (θ 0 ,Δx 0 ,Δy 0 ,f 0 ) are the initial position parameters of the ring LED board, Indicates the nonlinear regression operation, d is the distance between two adjacent LED units of the ring-shaped LED board, ( xi , y i ) indicates the spatial position coordinates of the i-th LED unit, λ is the wavelength of the illumination light, (m i ,n i ) is the row number and column number corresponding to the i-th LED unit.
步骤二中还要求:若更新后的环形LED板的四个位置参数分别为θ=0,Δx=0,Δy=0,则无需进行位置校正,否则需要通过调节微调平移台改变环形LED板的位置,重复步骤二,直到圆环上所有LED单元所产生的倾斜平面波都物镜的数值孔径内切,即实现若不调节微调平移台校正环形LED板的位置,则会导致相位恢复精度的严重下降。It is also required in step two: if the four position parameters of the updated circular LED board are respectively θ=0, Δx=0, Δy=0, There is no need to perform position correction, otherwise it is necessary to change the position of the ring-shaped LED board by adjusting the fine-tuning translation stage, and repeat step 2 until the inclined plane waves generated by all LED units on the ring are inscribed by the numerical aperture of the objective lens, that is, to achieve If the fine-tuning translation stage is not adjusted to correct the position of the ring-shaped LED board, it will lead to a serious decline in the accuracy of phase recovery.
步骤三,原始图像采集。环形LED板作为显微镜的照明光源,顺次点亮其中每一个LED单元,照射待测样品后采集相对应的低分辨率原始图像。Step three, original image acquisition. The ring-shaped LED board is used as the illumination source of the microscope, and each of the LED units is illuminated in sequence, and the corresponding low-resolution original image is collected after irradiating the sample to be tested.
步骤四,原始图像预处理。原始图像预处理包括阈值去噪和亮度校正。首先根据相机的暗电流噪声平均值作为阈值,对拍摄的原始低分辨率图像进行阈值去噪,然后再将每一幅图除以步骤一中获得的归一化亮度校正系数。实施流程为:顺次点亮其中每一个LED单元分别用红绿蓝单色光照明待测样品4拍摄到的原始低分辨率图像记作Ii,c,熄灭所有LED单元拍摄到一幅暗电流噪声图像Idark。然后根据相机的暗电流噪声平均值作为阈值,对拍摄的原始低分辨率图像进行阈值去噪,公式为Step 4, original image preprocessing. Raw image preprocessing includes threshold denoising and brightness correction. Firstly, threshold denoising is performed on the original low-resolution images taken according to the average value of dark current noise of the camera as the threshold value, and then each image is divided by the normalized brightness correction coefficient obtained in step 1. The implementation process is as follows: turn on each of the LED units in sequence and use red, green and blue monochromatic light to illuminate the original low-resolution image captured by the sample 4, which is denoted as I i,c , and turn off all the LED units to capture a dark image. Current noise image I dark . Then, according to the average value of the dark current noise of the camera as the threshold, the threshold denoising is performed on the original low-resolution image taken, and the formula is
其中表示阈值去噪后图像,mean(...)表示求图像平均灰度值。此后,再将每一幅图除以步骤一中获得的归一化亮度校正系数,完成图像亮度校正,公式为:in Indicates the image after threshold denoising, and mean(...) indicates the average gray value of the image. After that, divide each image by the normalized brightness correction coefficient obtained in step 1 to complete the image brightness correction. The formula is:
其中,为亮度校正后的图像,为阈值去噪后图像,为步骤一中获得的归一化亮度校正系数。in, is the brightness-corrected image, is the image after threshold denoising, is the normalized brightness correction coefficient obtained in step 1.
步骤五,高分辨率图像初始化。将所有亮度校正后的低分辨率明场图像相加平均,然后再通过上采样来初始化高分辨率图像的振幅与相位。高分辨率图像初始化的公式为:Step five, high-resolution image initialization. All intensity-corrected low-resolution brightfield images were averaged and then upsampled to initialize the amplitude and phase of the high-resolution image. The formula for high-resolution image initialization is:
其中,为初始化的高分辨率复振幅图像,UP[...]表示进行上采样最邻近插值,Nb为明场图像数量。in, is the initialized high-resolution complex amplitude image, UP[...] means to perform upsampling nearest neighbor interpolation, and N b is the number of bright field images.
步骤六,迭代重构。采用基于像素合并迭代算法的傅立叶叠层成像技术将所采集的每一幅图像在频域中逐一进行合成孔径运算,并逐步减小更新系数。以代价函数值为判据当其小于一个给定的阈值时,停止迭代。此时的高分辨率图像的振幅与相位就是最终得到的大视场高分辨率显微图像。基于像素合并迭代算法的公式为:Step six, iterative reconstruction. The Fourier stack imaging technology based on the iterative algorithm of pixel merging is used to perform synthetic aperture operation on each collected image one by one in the frequency domain, and gradually reduce the update coefficient. When the cost function value is less than a given threshold, the iteration is stopped. The amplitude and phase of the high-resolution image at this time are the finally obtained large-field high-resolution microscopic image. The formula based on the pixel binning iterative algorithm is:
其中,F{...}表示进行傅立叶变换,F-1{...}表示进行逆傅立叶变换,UP[...]表示进行上采样最邻近插值,DOWN[...]表示进行降采样像素合并。为待测样品的高分辨率频谱,k表示第k轮迭代,Pi k为显微物镜的频谱孔径函数,为更新后的待测样品的局域频谱,γ为常数用来确保分母不为零,典型值为0.001。|...|表示求二维复数矩阵的模,|...|max表示求二维复数矩阵的模中的最大值。αk为第k轮迭代待测样品频谱的更新系数,βk为第k轮迭代显微物镜孔径函数的更新系数,COSTk为代价函数,当第k轮迭代结束时代价函数COSTk小于某一固定阈值ε(ε的典型值为0.001),则认为迭代已收敛,停止迭代。此时的高分辨率图像的振幅与相位就是最终得到的大视场高分辨率显微图像。Among them, F{...} means to perform Fourier transform, F- 1 {...} means to perform inverse Fourier transform, UP[...] means to perform upsampling nearest neighbor interpolation, DOWN[...] means to perform downsampling Sample binning. is the high-resolution spectrum of the sample to be tested, k represents the kth iteration, P i k is the spectral aperture function of the microscope objective lens, is the updated local frequency spectrum of the sample to be tested, and γ is a constant used to ensure that the denominator is not zero, with a typical value of 0.001. |...| means to find the modulus of a two-dimensional complex matrix, and |...| max means to find the maximum value in the modulus of a two-dimensional complex matrix. α k is the update coefficient of the spectrum of the sample to be tested in the k-th iteration, β k is the update coefficient of the aperture function of the microscopic objective lens in the k-th iteration, and COST k is the cost function. When the k-th iteration ends, the cost function COST k is less than a certain A fixed threshold ε (the typical value of ε is 0.001), it is considered that the iteration has converged, and the iteration is stopped. The amplitude and phase of the high-resolution image at this time are the finally obtained large-field high-resolution microscopic image.
上述重构过程只适用于重构单色图像,若需重构真彩色图像,则每个LED单元分别采用红光、绿光、蓝光来照明物体。然后对于每种照明波长分别进行图像重构,重构的三组图像分别作为最终的真彩色图像的红、绿、蓝分量合成即可。The above reconstruction process is only suitable for reconstructing monochrome images. If a true color image needs to be reconstructed, each LED unit uses red light, green light, and blue light to illuminate the object respectively. Then image reconstruction is performed for each illumination wavelength, and the reconstructed three groups of images can be combined as the red, green, and blue components of the final true-color image.
为了测试基于环形照明的高速傅立叶叠层成像重构方法,首先进行了仿真测试。待测物体的理想相位分布如图4(a)所示,然后分别仿真了2种傅立叶叠层成像系统的相位恢复结果。首先当明场LED单元的最大照明倾斜角与物镜的数值孔径内切时,由81幅、13幅、5幅明场低分辨率图像恢复的相位结果如图4(b1)、图4(b2)、图4(b3)所示。重构结果看不到明显的重构误差,说明只要明场LED单元的最大照明倾斜角与物镜的数值孔径内切,则最多需要13幅图,最少需要5幅图,就能够非常精确的恢复出物体的相位分布。相反,在另一种情况下,即明场LED单元的最大照明倾斜角与物镜的数值孔径不能内切时,由81幅、13幅、5幅明场低分辨率图像恢复的相位结果如图4(c1)、图4(c2)、图4(c3)所示。图中可以看到明显的低频重构误差,说明当明场LED单元的最大照明倾斜角与物镜的数值孔径不能内切时,无论多少幅图都无法准确恢复出物体的相位分布。该仿真结果充分说明了本发明的创新性和有效性,首先,本装置使用照明角度与物镜数值孔径内切的环形LED板,不仅仅是为了减少原始图像拍摄数量,同时也是为了提高相位恢复精度。因为从图4中可以看出,当明场LED单元的最大照明倾斜角与物镜的数值孔径内切时,物体的相位分布能够得到非常精确的恢复,而且最多需要13幅图,极大提高了成像速度。反观传统FPM系统里明场LED单元的最大照明倾斜角与物镜的数值孔径假如不能内切时,则无论多少幅图都无法准确恢复出物体的相位分布。In order to test the high-speed Fourier stack imaging reconstruction method based on ring illumination, a simulation test was carried out first. The ideal phase distribution of the object to be measured is shown in Figure 4(a), and then the phase recovery results of the two Fourier stack imaging systems were simulated. First, when the maximum illumination tilt angle of the bright-field LED unit is inscribed with the numerical aperture of the objective lens, the phase results recovered from 81, 13, and 5 bright-field low-resolution images are shown in Figure 4(b1) and Figure 4(b2) ), as shown in Figure 4(b3). No obvious reconstruction error can be seen in the reconstruction results, which means that as long as the maximum illumination inclination angle of the bright field LED unit is inscribed with the numerical aperture of the objective lens, a maximum of 13 images and a minimum of 5 images are required to restore very accurately The phase distribution of the object. On the contrary, in another case, that is, when the maximum illumination tilt angle of the bright field LED unit and the numerical aperture of the objective lens cannot be inscribed, the phase results recovered from 81, 13, and 5 bright field low-resolution images are shown in Fig. 4(c1), Figure 4(c2), and Figure 4(c3). Obvious low-frequency reconstruction errors can be seen in the figure, indicating that when the maximum illumination tilt angle of the bright field LED unit cannot be inscribed with the numerical aperture of the objective lens, the phase distribution of the object cannot be accurately recovered no matter how many pictures are taken. The simulation results fully demonstrate the innovation and effectiveness of the present invention. Firstly, the device uses an annular LED plate whose illumination angle is inscribed with the numerical aperture of the objective lens, not only to reduce the number of original image captures, but also to improve the phase recovery accuracy . Because it can be seen from Figure 4 that when the maximum illumination tilt angle of the bright field LED unit is inscribed with the numerical aperture of the objective lens, the phase distribution of the object can be recovered very accurately, and a maximum of 13 images are required, which greatly improves the Imaging speed. In contrast, if the maximum illumination tilt angle of the bright field LED unit in the traditional FPM system and the numerical aperture of the objective lens cannot be inscribed, no matter how many images are taken, the phase distribution of the object cannot be accurately recovered.
为了进一步测试本发明的动态测量速度,还选取了微透镜阵列样品和Hela活细胞样品进行了实验测试。实验中,使用的环形LED板包含13个LED单元,并利用其产生13个不同角度的照明光,圆环半径为20mm,发出的红光中心波长为632.8nm,光谱带宽约为20nm。系统所采用的显微物镜的数值孔径为0.4,放大倍率为10x。点亮环形LED板中心的LED单元所拍摄到的低分辨率图像如图5(a)所示。选取图5(a)方框中的图像区域,该区域在9个不同照明角度下的明场图像如图5(b)所示。图5(c)和图5(d)分别展示了该区域经过迭代重构后恢复的高分辨率光强分布和相位分布,通过对比样品的标准参数和测得的相位而换算出的微透镜曲率半径可知本方法能够实现稳定的高精度定量相位成像。In order to further test the dynamic measurement speed of the present invention, microlens array samples and Hela living cell samples were also selected for experimental testing. In the experiment, the ring-shaped LED board used contains 13 LED units, and it is used to generate 13 different angles of illumination light. The radius of the ring is 20mm, and the central wavelength of the emitted red light is 632.8nm, and the spectral bandwidth is about 20nm. The numerical aperture of the microscope objective lens used in the system is 0.4, and the magnification is 10x. A low-resolution image captured by lighting up the LED unit in the center of the ring-shaped LED board is shown in Figure 5(a). Select the image area in the box in Figure 5(a), and the bright field images of this area under 9 different illumination angles are shown in Figure 5(b). Figure 5(c) and Figure 5(d) respectively show the high-resolution light intensity distribution and phase distribution recovered after iterative reconstruction in this area, and the microlens converted by comparing the standard parameters of the sample with the measured phase The radius of curvature shows that this method can achieve stable and high-precision quantitative phase imaging.
图6展示了利用本方法对Hela细胞进行无标记动态定量相位的成像结果。全视场恢复的高分辨率相位分布如图6(a)所示,选取图6(a)虚线框中的图像区域进行放大如图6(b)所示,细胞内的每个颗粒细胞质都清晰可见。图6(c1)-图6(c7)依次展示了所选区域在不同时刻下(0s、250s、500s、750s、1000s、1250s、1500s、)Hela细胞实时分裂的动态定量相位成像结果,从图中可以看出本发明方法只需要拍摄13幅的明场低分辨率图片,就能够非常稳定并且准确地重建出物体大视场高分辨率的相位分布,非常适合用于活细胞的无标记高速定量相位显微成像。Figure 6 shows the imaging results of label-free dynamic quantitative phase of Hela cells using this method. The high-resolution phase distribution restored by the full field of view is shown in Fig. 6(a). The image area in the dotted line box in Fig. 6(a) is selected and enlarged, as shown in Fig. 6(b). clear and distinct. Figure 6(c1)-Figure 6(c7) sequentially shows the dynamic quantitative phase imaging results of the real-time division of Hela cells in the selected area at different times (0s, 250s, 500s, 750s, 1000s, 1250s, 1500s,). It can be seen from the figure that the method of the present invention only needs to take 13 bright-field low-resolution pictures, and can very stably and accurately reconstruct the phase distribution of the object with a large field of view and high resolution, which is very suitable for label-free high-speed imaging of living cells. Quantitative Phase Microscopy.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711484822.1A CN107966801A (en) | 2017-12-29 | 2017-12-29 | A kind of high speed Fourier lamination imaging device and reconstructing method based on ring illumination |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711484822.1A CN107966801A (en) | 2017-12-29 | 2017-12-29 | A kind of high speed Fourier lamination imaging device and reconstructing method based on ring illumination |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107966801A true CN107966801A (en) | 2018-04-27 |
Family
ID=61993748
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711484822.1A Pending CN107966801A (en) | 2017-12-29 | 2017-12-29 | A kind of high speed Fourier lamination imaging device and reconstructing method based on ring illumination |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107966801A (en) |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018171381A1 (en) * | 2017-03-24 | 2018-09-27 | 南京理工大学 | Microimaging device and iterative reconstruction method |
CN109782432A (en) * | 2019-01-17 | 2019-05-21 | 哈尔滨工业大学 | Single-shot stacked phase recovery technology of converging lens based on spatial light modulator |
CN110085533A (en) * | 2019-04-30 | 2019-08-02 | 歌尔股份有限公司 | A kind of detection method and detection device of LED light spot symmetry |
CN110082350A (en) * | 2019-04-19 | 2019-08-02 | 中国科学院上海光学精密机械研究所 | The microscopic imaging device and measurement method adaptively illuminated based on high-power LED lighteness |
CN111062889A (en) * | 2019-12-17 | 2020-04-24 | 北京理工大学 | A light intensity correction method for Fourier stack microscopy imaging |
CN111158131A (en) * | 2019-12-31 | 2020-05-15 | 杭州电子科技大学 | An LED matrix calibration method based on Fourier stack imaging |
CN111289361A (en) * | 2020-02-17 | 2020-06-16 | 合肥工业大学 | Material mechanical property measuring device and method based on high-resolution digital image correlation |
CN111445554A (en) * | 2020-05-09 | 2020-07-24 | 南京大学 | Multi-convergence-angle hybrid scanning electron microscopy imaging method |
CN111610623A (en) * | 2020-04-29 | 2020-09-01 | 南京理工大学 | Microscopic imaging method based on Fourier stack |
CN111694016A (en) * | 2020-06-02 | 2020-09-22 | 南京理工大学 | Non-interference synthetic aperture super-resolution imaging reconstruction method |
CN112233040A (en) * | 2020-10-29 | 2021-01-15 | 南京理工大学智能计算成像研究院有限公司 | Fourier laminated microscopic imaging method for automatic defocusing correction |
CN112255776A (en) * | 2020-11-10 | 2021-01-22 | 四川欧瑞特光电科技有限公司 | Point light source scanning illumination method and detection device |
CN112540455A (en) * | 2020-12-23 | 2021-03-23 | 中国科学院长春应用化学研究所 | Reflective annular illumination Fourier laminated high-resolution microscopic imaging system |
WO2021143637A1 (en) * | 2020-01-18 | 2021-07-22 | 哈尔滨工业大学 | Annular array light source illumination-based three-dimensional total internal reflection microscopic imaging device and method |
CN113759535A (en) * | 2021-07-26 | 2021-12-07 | 南京理工大学智能计算成像研究院有限公司 | High-resolution microscopic imaging method based on multi-angle illumination deconvolution |
CN114022365A (en) * | 2021-11-25 | 2022-02-08 | 中国科学院光电技术研究所 | Gradient descent speckle illumination super-resolution target reconstruction method |
CN115774327A (en) * | 2022-11-22 | 2023-03-10 | 中国科学院光电技术研究所 | Quantitative differential phase contrast microscope integrating illumination modulation and pupil modulation |
CN118655714A (en) * | 2024-08-19 | 2024-09-17 | 浙江大学 | A fast frequency-shifting super-resolution microscopy imaging method based on annular illumination |
EP4492117A1 (en) * | 2023-07-12 | 2025-01-15 | Carl Zeiss Microscopy GmbH | Hybrid differential defocus phase contrast |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103210336A (en) * | 2010-10-20 | 2013-07-17 | 株式会社尼康 | Microscope system |
US20160320605A1 (en) * | 2013-08-22 | 2016-11-03 | California Institute Of Technology | Variable-illumination fourier ptychographic imaging devices, systems, and methods |
CN206074895U (en) * | 2016-08-30 | 2017-04-05 | 北京大学 | Micro- amplification system |
CN106842540A (en) * | 2017-03-24 | 2017-06-13 | 南京理工大学 | Annular optical illumination high-resolution quantitative phase micro imaging method based on light intensity transmission equation |
CN107065159A (en) * | 2017-03-24 | 2017-08-18 | 南京理工大学 | A kind of large visual field high resolution microscopic imaging device and iterative reconstruction method based on big illumination numerical aperture |
CN107290846A (en) * | 2017-08-04 | 2017-10-24 | 南京理工大学 | The quantitative phase micro imaging method of LED illumination is may be programmed based on ring-type |
CN107407799A (en) * | 2015-03-13 | 2017-11-28 | 加州理工学院 | Correcting Aberrations in Incoherent Imaging Systems Using Fourier Stack Imaging |
-
2017
- 2017-12-29 CN CN201711484822.1A patent/CN107966801A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103210336A (en) * | 2010-10-20 | 2013-07-17 | 株式会社尼康 | Microscope system |
US20160320605A1 (en) * | 2013-08-22 | 2016-11-03 | California Institute Of Technology | Variable-illumination fourier ptychographic imaging devices, systems, and methods |
CN107407799A (en) * | 2015-03-13 | 2017-11-28 | 加州理工学院 | Correcting Aberrations in Incoherent Imaging Systems Using Fourier Stack Imaging |
CN206074895U (en) * | 2016-08-30 | 2017-04-05 | 北京大学 | Micro- amplification system |
CN106842540A (en) * | 2017-03-24 | 2017-06-13 | 南京理工大学 | Annular optical illumination high-resolution quantitative phase micro imaging method based on light intensity transmission equation |
CN107065159A (en) * | 2017-03-24 | 2017-08-18 | 南京理工大学 | A kind of large visual field high resolution microscopic imaging device and iterative reconstruction method based on big illumination numerical aperture |
CN107290846A (en) * | 2017-08-04 | 2017-10-24 | 南京理工大学 | The quantitative phase micro imaging method of LED illumination is may be programmed based on ring-type |
Cited By (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018171381A1 (en) * | 2017-03-24 | 2018-09-27 | 南京理工大学 | Microimaging device and iterative reconstruction method |
US11156821B2 (en) | 2017-03-24 | 2021-10-26 | Nanjing University Of Science And Technology | High-illumination numerical aperture-based large field-of-view high-resolution microimaging device and a method for iterative reconstruction |
CN109782432A (en) * | 2019-01-17 | 2019-05-21 | 哈尔滨工业大学 | Single-shot stacked phase recovery technology of converging lens based on spatial light modulator |
CN110082350A (en) * | 2019-04-19 | 2019-08-02 | 中国科学院上海光学精密机械研究所 | The microscopic imaging device and measurement method adaptively illuminated based on high-power LED lighteness |
CN110085533A (en) * | 2019-04-30 | 2019-08-02 | 歌尔股份有限公司 | A kind of detection method and detection device of LED light spot symmetry |
CN111062889B (en) * | 2019-12-17 | 2023-10-24 | 北京理工大学 | Light intensity correction method for Fourier stacked microscopic imaging technology |
CN111062889A (en) * | 2019-12-17 | 2020-04-24 | 北京理工大学 | A light intensity correction method for Fourier stack microscopy imaging |
CN111158131A (en) * | 2019-12-31 | 2020-05-15 | 杭州电子科技大学 | An LED matrix calibration method based on Fourier stack imaging |
CN111158131B (en) * | 2019-12-31 | 2021-09-28 | 杭州电子科技大学 | LED matrix correction method based on Fourier laminated imaging |
WO2021143637A1 (en) * | 2020-01-18 | 2021-07-22 | 哈尔滨工业大学 | Annular array light source illumination-based three-dimensional total internal reflection microscopic imaging device and method |
CN111289361A (en) * | 2020-02-17 | 2020-06-16 | 合肥工业大学 | Material mechanical property measuring device and method based on high-resolution digital image correlation |
CN111610623A (en) * | 2020-04-29 | 2020-09-01 | 南京理工大学 | Microscopic imaging method based on Fourier stack |
CN111610623B (en) * | 2020-04-29 | 2022-05-27 | 南京理工大学 | Fourier stack-based microscopic imaging method |
CN111445554A (en) * | 2020-05-09 | 2020-07-24 | 南京大学 | Multi-convergence-angle hybrid scanning electron microscopy imaging method |
CN111445554B (en) * | 2020-05-09 | 2022-09-23 | 南京大学 | Multi-convergence-angle hybrid scanning electron microscopy imaging method |
CN111694016B (en) * | 2020-06-02 | 2023-10-20 | 南京理工大学 | Non-interference synthetic aperture super-resolution imaging reconstruction method |
CN111694016A (en) * | 2020-06-02 | 2020-09-22 | 南京理工大学 | Non-interference synthetic aperture super-resolution imaging reconstruction method |
CN112233040B (en) * | 2020-10-29 | 2024-02-20 | 南京理工大学智能计算成像研究院有限公司 | Fourier stacked microscopic imaging method with automatic defocus correction |
CN112233040A (en) * | 2020-10-29 | 2021-01-15 | 南京理工大学智能计算成像研究院有限公司 | Fourier laminated microscopic imaging method for automatic defocusing correction |
CN112255776A (en) * | 2020-11-10 | 2021-01-22 | 四川欧瑞特光电科技有限公司 | Point light source scanning illumination method and detection device |
CN112255776B (en) * | 2020-11-10 | 2022-08-02 | 四川欧瑞特光电科技有限公司 | Point light source scanning illumination method and detection device |
CN112540455A (en) * | 2020-12-23 | 2021-03-23 | 中国科学院长春应用化学研究所 | Reflective annular illumination Fourier laminated high-resolution microscopic imaging system |
CN113759535B (en) * | 2021-07-26 | 2024-05-31 | 南京理工大学智能计算成像研究院有限公司 | High-resolution microscopic imaging method based on multi-angle illumination deconvolution |
CN113759535A (en) * | 2021-07-26 | 2021-12-07 | 南京理工大学智能计算成像研究院有限公司 | High-resolution microscopic imaging method based on multi-angle illumination deconvolution |
CN114022365B (en) * | 2021-11-25 | 2023-05-26 | 中国科学院光电技术研究所 | Gradient-descent speckle illumination super-resolution target reconstruction method |
CN114022365A (en) * | 2021-11-25 | 2022-02-08 | 中国科学院光电技术研究所 | Gradient descent speckle illumination super-resolution target reconstruction method |
CN115774327A (en) * | 2022-11-22 | 2023-03-10 | 中国科学院光电技术研究所 | Quantitative differential phase contrast microscope integrating illumination modulation and pupil modulation |
EP4492117A1 (en) * | 2023-07-12 | 2025-01-15 | Carl Zeiss Microscopy GmbH | Hybrid differential defocus phase contrast |
EP4492118A1 (en) * | 2023-07-12 | 2025-01-15 | Carl Zeiss Microscopy GmbH | Hybrid differential defocus phase contrast |
CN118655714A (en) * | 2024-08-19 | 2024-09-17 | 浙江大学 | A fast frequency-shifting super-resolution microscopy imaging method based on annular illumination |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107966801A (en) | A kind of high speed Fourier lamination imaging device and reconstructing method based on ring illumination | |
CN107065159B (en) | A large field of view high resolution microscopic imaging device and iterative reconstruction method based on large illumination numerical aperture | |
US20210372916A1 (en) | 3d diffraction tomography microscopy imaging method based on led array coded illumination | |
CN108051930B (en) | Large-view-field super-resolution dynamic phase lens-free microscopic imaging device and reconstruction method | |
US11487096B2 (en) | Quantitative phase imaging method based on differential phase contrast with optimal lighting pattern design | |
CN110389119B (en) | Quick self-adaptive optical scanning microscopic imaging system and method based on machine learning | |
CN108508588A (en) | A kind of multiple constraint information without lens holographic microphotography phase recovery method and its device | |
CN108196357A (en) | A kind of multi-angle illumination light source and the Fourier stacking imaging system based on this light source | |
CN106204434A (en) | A kind of Image Iterative reconstructing method towards large visual field high resolution micro-imaging | |
CN110058392A (en) | A kind of speckle quantitative phase imaging system and its method based on light intensity transmission equation | |
CN105911692A (en) | Optimal system parameter selection method for Fourier laminated micro imaging system | |
CN106204466A (en) | A kind of self-adaptive solution method for Fourier lamination micro-imaging technique | |
CN114660060A (en) | A Macroscopic Fourier Stacked Super-Resolution Imaging Method Based on Matrix Scanning | |
Konda et al. | Multi-aperture Fourier ptychographic microscopy, theory and validation | |
CN118067001A (en) | A method for accurate correction of light source position combined with pupil function | |
US11893719B2 (en) | Single-shot differential phase contrast quantitative phase imaging method based on color multiplexed illumination | |
Chen et al. | Precise and independent position correction strategy for Fourier ptychographic microscopy | |
CN110388882B (en) | Quantized differential phase contrast microscope system with isotropic transfer function | |
US20250035903A1 (en) | System for quantitative differential phase contrast microscopy with isotropic transfer function | |
US12038569B2 (en) | High sensitivity phase microscopy imaging | |
TWI637166B (en) | System and mehtod for differential phase contrast microscopy | |
CN114355601A (en) | LED array light source pose deviation correction method and device of microscopic imaging system | |
WO2024055602A1 (en) | Lens-free single-frame phase recovery method based on partially coherent light-emitting diode illumination | |
WO2024113316A1 (en) | Portable quantitative differential phase contrast microscopic module and deep learning reconstruction method therefor | |
Gu et al. | Enhanced EUV mask imaging using Fourier ptychographic microscopy |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180427 |