CN104515759B - Nonlinear organization optical illumination micro imaging method and system - Google Patents
Nonlinear organization optical illumination micro imaging method and system Download PDFInfo
- Publication number
- CN104515759B CN104515759B CN201410783714.4A CN201410783714A CN104515759B CN 104515759 B CN104515759 B CN 104515759B CN 201410783714 A CN201410783714 A CN 201410783714A CN 104515759 B CN104515759 B CN 104515759B
- Authority
- CN
- China
- Prior art keywords
- light
- negative
- positive
- order diffracted
- light field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 75
- 238000005286 illumination Methods 0.000 title claims abstract description 32
- 230000003287 optical effect Effects 0.000 title claims description 14
- 230000008520 organization Effects 0.000 title 1
- 102000034287 fluorescent proteins Human genes 0.000 claims abstract description 21
- 108091006047 fluorescent proteins Proteins 0.000 claims abstract description 21
- 108090000623 proteins and genes Proteins 0.000 claims abstract description 15
- 102000004169 proteins and genes Human genes 0.000 claims abstract description 14
- 230000005284 excitation Effects 0.000 claims description 37
- 230000004913 activation Effects 0.000 claims description 16
- 239000000835 fiber Substances 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 13
- 238000000386 microscopy Methods 0.000 claims description 12
- 238000005188 flotation Methods 0.000 claims description 9
- 238000000034 method Methods 0.000 claims description 9
- 230000007935 neutral effect Effects 0.000 claims description 7
- 230000001133 acceleration Effects 0.000 claims description 6
- 230000003213 activating effect Effects 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 5
- 239000013307 optical fiber Substances 0.000 claims description 5
- 238000002834 transmittance Methods 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 4
- 230000001427 coherent effect Effects 0.000 claims description 4
- 230000001902 propagating effect Effects 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000008859 change Effects 0.000 claims description 2
- 238000001914 filtration Methods 0.000 claims description 2
- 230000001678 irradiating effect Effects 0.000 claims 1
- 206010034972 Photosensitivity reaction Diseases 0.000 abstract description 3
- 208000007578 phototoxic dermatitis Diseases 0.000 abstract description 3
- 231100000018 phototoxicity Toxicity 0.000 abstract description 3
- 239000000523 sample Substances 0.000 description 24
- 210000004027 cell Anatomy 0.000 description 13
- 230000006870 function Effects 0.000 description 5
- 230000006378 damage Effects 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 3
- 210000001519 tissue Anatomy 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000012472 biological sample Substances 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000001493 electron microscopy Methods 0.000 description 2
- 238000002073 fluorescence micrograph Methods 0.000 description 2
- 238000000799 fluorescence microscopy Methods 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000000399 optical microscopy Methods 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 229920006395 saturated elastomer Polymers 0.000 description 2
- 101710172711 Structural protein Proteins 0.000 description 1
- 230000008827 biological function Effects 0.000 description 1
- 238000012984 biological imaging Methods 0.000 description 1
- 238000004061 bleaching Methods 0.000 description 1
- 230000024245 cell differentiation Effects 0.000 description 1
- 230000004663 cell proliferation Effects 0.000 description 1
- 230000023549 cell-cell signaling Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005315 distribution function Methods 0.000 description 1
- 238000010894 electron beam technology Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006882 induction of apoptosis Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010859 live-cell imaging Methods 0.000 description 1
- 238000002493 microarray Methods 0.000 description 1
- 210000003470 mitochondria Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000003463 organelle Anatomy 0.000 description 1
- 238000010791 quenching Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000000451 tissue damage Effects 0.000 description 1
- 231100000827 tissue damage Toxicity 0.000 description 1
Landscapes
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
Abstract
本发明公开了一种非线性结构光照明显微成像方法,其包括以下步骤:1)在所述数字微镜阵列上加载计算全息图;2)产生满足正弦分布的用于激活荧光蛋白的第一空间结构光场,第一空间结构光场照射到样品表面,使部分蛋白从暗态转换到亮态;3)第二空间结构光场照射样品,使处于亮态的荧光蛋白发荧光,并收集荧光,在光电探测器中成像;4)重复第2)和3)步骤,采集多个空间频率,每个方向采集多个初始位相,得到多张原始图像,并根据GPU加速算法重构超分辨图像。同时,本发明还公开了一种非线性结构光照明显微成像系统。本发明具有系统成像分辨率较高、高抗荧光漂泊、低光毒性、成像速度快的优点。
The invention discloses a non-linear structured illumination microscopic imaging method, which comprises the following steps: 1) loading a computational hologram on the digital micromirror array; A spatially structured light field, the first spatially structured light field irradiates the surface of the sample, causing some proteins to switch from a dark state to a bright state; 3) the second spatially structured light field irradiates the sample, causing the fluorescent proteins in the bright state to fluoresce, and Collect fluorescence and image it in the photodetector; 4) Repeat steps 2) and 3) to collect multiple spatial frequencies, and collect multiple initial phases in each direction to obtain multiple original images, and reconstruct super Resolve images. At the same time, the invention also discloses a non-linear structured illumination microscopic imaging system. The invention has the advantages of high system imaging resolution, high resistance to fluorescent drift, low phototoxicity and fast imaging speed.
Description
技术领域technical field
本发明涉及生物成像领域,具体涉及一种非线性结构光照明显微成像方法及系统。The invention relates to the field of biological imaging, in particular to a non-linear structured illumination microscopic imaging method and system.
背景技术Background technique
生物成像是涉及多学科交叉的生命科学前沿领域,通过在分子-细胞-组织-活体等不同层次上实时、动态地“看”到活细胞的相互作用来研究生物学功能的各种成像尖端技术已成为当今生命科学重大成果产生的突破口。Bioimaging is a frontier field of life science involving multiple disciplines. It is a cutting-edge imaging technology for studying biological functions by "seeing" the interaction of living cells in real time and dynamically at different levels such as molecules, cells, tissues, and living bodies. It has become a breakthrough point for major achievements in life sciences today.
传统的光学显微镜受到光学衍射极限的限制,其衍射光斑(艾里斑)的大小约为光源波长与显微镜物镜数值孔径比值的一半,一般最高的成像分辨率在200-300nm左右,无法直接观察一些重要分子如基因、结构蛋白、免疫蛋白、RNA及其复合物、活性因子等是如何在细胞内得到表达、如何组成细胞的基本结构体系,如何调节细胞的主要生命活动,如细胞增殖、细胞分化、细胞凋亡与细胞信号传递等。反映这些体系性质的特征尺度都在纳米的量级。电子显微镜(EM)能够达到纳米数量级的分辨率,能够对细胞内部囊泡、线粒体等细胞器的定位,但是由于缺乏相应的探针标记,不适合定位单个蛋白质分子。电子显微镜样品需要固定,同时电子束的照射也会使生物样品受到辐照损伤,因此不适合进行活细胞动态变化的观察。The traditional optical microscope is limited by the optical diffraction limit. The size of the diffraction spot (Airy disk) is about half of the ratio of the wavelength of the light source to the numerical aperture of the microscope objective lens. Generally, the highest imaging resolution is around 200-300nm, and it is impossible to directly observe some How important molecules such as genes, structural proteins, immune proteins, RNA and their complexes, and active factors are expressed in cells, how to form the basic structural system of cells, and how to regulate the main life activities of cells, such as cell proliferation and cell differentiation , apoptosis and cell signaling. The characteristic scales reflecting the properties of these systems are all in the order of nanometers. Electron microscopy (EM) can achieve nanometer-level resolution and can locate organelles such as vesicles and mitochondria inside cells, but it is not suitable for locating individual protein molecules due to the lack of corresponding probe labels. Electron microscope samples need to be fixed, and the irradiation of electron beams will also damage biological samples, so it is not suitable for the observation of dynamic changes in living cells.
分辨率达到亚微米甚至纳米分辨率的超分辨光学显微技术能够克服传统光学显微镜和电子显微镜的缺陷,突破衍射极限,实现在细胞水平上的超分辨成像能力。Super-resolution optical microscopy with submicron or even nanometer resolution can overcome the defects of traditional optical microscopes and electron microscopes, break through the diffraction limit, and achieve super-resolution imaging capabilities at the cellular level.
超分辨光学显微技术主要包括三大类:1、基于荧光单分子定位的光敏定位显微技术(photo-activated localization microscopy,简称PALM)和随机光学重构显微技术(stochastic optical reconstructionmicroscopy,简称STORM);2、通过改变点扩散函数的受激发射损耗显微技术(stimulated emission depletion,简称STED);3、使用结构光照明激发荧光的结构照明显微技术(structured illumination microscopy,简称SIM)。Super-resolution optical microscopy mainly includes three categories: 1. Photo-activated localization microscopy (PALM for short) based on fluorescence single-molecule localization and stochastic optical reconstruction microscopy (STORM for short). ); 2. Stimulated emission depletion (STED) by changing the point spread function; 3. Structured illumination microscopy (SIM) using structured light illumination to excite fluorescence.
PALM/STORM的成像原理相同,都是利用荧光分子的随机逐个激发发射荧光光子,通过点扩散函数数字化获得其中心位置,从而突破光波衍射现象对成像分辨率的限制。尽管PALM/STORM采用面探测成像,但每次只对少量荧光分子成像,需要反复激活-淬灭荧光分子进行成像,要获得一幅完整的细胞超分辨图像,一般需要采集1万张图像,数据量大,成像时间很长,这使得实验大多数在固定的细胞上完成,无法进行活细胞研究。The imaging principles of PALM/STORM are the same, they both use the random excitation of fluorescent molecules to emit fluorescent photons one by one, and obtain their central positions through point spread function digitization, thus breaking through the limitation of imaging resolution by light wave diffraction. Although PALM/STORM uses surface detection imaging, only a small number of fluorescent molecules are imaged at a time, and it is necessary to repeatedly activate-quench fluorescent molecules for imaging. To obtain a complete cell super-resolution image, generally 10,000 images need to be collected. The amount of imaging is large and the imaging time is very long, which makes most experiments done on fixed cells and cannot be used for live cell research.
STED成像过程中,用一束激发光使荧光物质发光,同时用另外的高能量脉冲激光器发射一束重叠的、环型的、波长较长的激光将第一束光斑中大部分的荧光物质通过受激发射损耗过程淬灭,从而减少荧光光点的衍射面积,显著地提高了显微镜的分辨率。然而由于STED需要采用高强度激光(50-70纳米分辨率时所需峰值功率为400~800MW/cm2,5.8纳米分辨率时所需激光功率密度达到GW/cm2量级),高功率激光容易造成生物组织损伤,极大地制约了STED的应用范围。In the process of STED imaging, a beam of excitation light is used to make the fluorescent material emit light, and at the same time, another high-energy pulse laser is used to emit a beam of overlapping, ring-shaped, and longer-wavelength laser to pass most of the fluorescent material in the first beam spot. The stimulated emission depletion process is quenched, thereby reducing the diffraction area of the fluorescent spot and significantly improving the resolution of the microscope. However, since STED needs to use high-intensity lasers (the required peak power is 400-800 MW/cm2 at the resolution of 50-70 nanometers, and the required laser power density reaches the order of GW/cm2 at the resolution of 5.8 nanometers), high-power lasers are easy to cause Biological tissue damage greatly restricts the application range of STED.
SIM利用调制光源照明样品,照明光和荧光在频域发生混频、移频,将原本不可分辨的高分辨率信息编码入荧光图像中,结合计算解码快速傅立叶变换获取高分辨率信息。然而由于照明光场本身也同样受到系统衍射极限的限制,理论上SIM最大可将分辨率提高约一倍,横向分辨率达到约100-150nm。2005年Gustafsson.etal.[PNAS,102:13801(2005)]提出一种非线性结构光照明超分辨成像方法(NL-SIM),利用荧光分子的饱和非线性特性,可获取样品的高频信息,理论上可实现任意高分辨率的荧光成像,然而为了实现饱和非线性荧光发射,需要很高的激发光功率密度,容易造成生物组织损伤,同时由于NL-SIM需要采集数倍于SIM的数据才能重构出一张超分辨图像,成像速度慢,这些问题限制了NL-SIM在生物医学领域的实际应用。SIM uses a modulated light source to illuminate the sample, and the illumination light and fluorescence undergo frequency mixing and frequency shifting in the frequency domain, encoding the originally indistinguishable high-resolution information into the fluorescence image, and combining calculation and decoding fast Fourier transform to obtain high-resolution information. However, since the illumination light field itself is also limited by the diffraction limit of the system, theoretically SIM can increase the resolution by about one time at most, and the lateral resolution can reach about 100-150nm. In 2005, Gustafsson.etal. [PNAS, 102: 13801 (2005)] proposed a nonlinear structured light illumination super-resolution imaging method (NL-SIM), which can obtain high-frequency information of samples by using the saturated nonlinear characteristics of fluorescent molecules , in theory, any high-resolution fluorescence imaging can be achieved. However, in order to achieve saturated nonlinear fluorescence emission, a high excitation light power density is required, which is easy to cause damage to biological tissues. At the same time, NL-SIM needs to collect data that is several times that of SIM. Only by reconstructing a super-resolution image, the imaging speed is slow, these problems limit the practical application of NL-SIM in the field of biomedicine.
发明内容Contents of the invention
为了解决上述技术问题,本发明提供了一种非线性结构光照明显微成像方法及系统,其通过低功率密度的空间结构光场激活荧光标记样品,再使用与激活光场相位的空间结构光场激发荧光并采集成像,可使实现3倍光学截止频率成像,成像横向分辨率达到60纳米,系统具有良好的机械稳定,其中Z向漂移低于5纳米/小时,图像采集速度达到100Hz,能够实现对活细胞超分辨成像。In order to solve the above technical problems, the present invention provides a non-linear structured light microscopy imaging method and system, which activates fluorescently labeled samples through a spatially structured light field of low power density, and then uses spatially structured light that is in phase with the activated light field Field excitation of fluorescence and image acquisition can achieve 3 times the optical cut-off frequency imaging, the imaging lateral resolution can reach 60 nanometers, the system has good mechanical stability, and the Z-direction drift is less than 5 nanometers per hour, and the image acquisition speed can reach 100Hz. Realize super-resolution imaging of living cells.
为了达到上述目的,本发明的技术方案如下:In order to achieve the above object, technical scheme of the present invention is as follows:
非线性结构光照明显微成像方法,其包括以下步骤:A non-linear structured illumination microscopy imaging method, comprising the following steps:
1)令数字微镜阵列工作在锁定模式,在数字微镜阵列上加载计算全息图,计算全息图的透过率函数为:其中γ表示调制度,k0表示空间频率,表示初始相位;1) Let the digital micromirror array work in the locked mode, load the computational hologram on the digital micromirror array, and the transmittance function of the computational hologram is: where γ represents the degree of modulation, k 0 represents the spatial frequency, Indicates the initial phase;
2)令空间均匀分布的第一激光照射到数字微镜阵列上,第一激光被数字显微镜阵列上的全息光栅衍射到各个级次,各个级次的光在透镜构成的系统的傅立叶面滤波后,选择其中的一对正负一级衍射光,一对正负一级衍射光依次通过透镜和显微物镜,照射到样品表面,使正负一级衍射光在样品的蛋白表面发生干涉,产生满足正弦分布的用于激活荧光蛋白的第一空间结构光场,第一空间结构光场照射到样品表面,使部分蛋白从暗态转换到亮态;2) Let the first laser light with uniform spatial distribution shine on the digital micromirror array, the first laser light is diffracted by the holographic grating on the digital microscope array to each order, and the light of each order is filtered by the Fourier surface of the system composed of lenses , select a pair of positive and negative first-order diffracted lights, and a pair of positive and negative first-order diffracted lights sequentially pass through the lens and the microscope objective, and irradiate the surface of the sample, so that the positive and negative first-order diffracted lights interfere on the protein surface of the sample, resulting in The first spatially structured light field satisfying the sinusoidal distribution for activating the fluorescent protein, the first spatially structured light field irradiates the surface of the sample, so that part of the protein switches from a dark state to a bright state;
3)使用波长大于第2)步中的第一激光的第二激光来重复步骤2),得到满足正弦分布的用于激发荧光蛋白的第二空间结构光场,使用第二空间结构光场照射样品,使处于亮态的荧光蛋白发荧光,并收集荧光,在光电探测器中成像;3) Repeat step 2) using a second laser with a wavelength greater than that of the first laser in step 2), to obtain a second spatially structured light field that satisfies a sinusoidal distribution for exciting the fluorescent protein, and use the second spatially structured light field to irradiate the sample, causing the fluorescent protein in its bright state to fluoresce, and the fluorescence is collected and imaged in a photodetector;
4)改变数字微阵列上加载的计算全息图,重复第2)和3)步骤,采集多个空间频率,每个方向采集多个初始位相,得到多张原始图像,最后用GPU加速算法,根据的多张原始图像重构超分辨图像。4) Change the computational hologram loaded on the digital microarray, repeat steps 2) and 3), collect multiple spatial frequencies, collect multiple initial phases in each direction, and obtain multiple original images, and finally use the GPU acceleration algorithm, according to Super-resolution images are reconstructed from multiple original images.
优选地,在步骤4)中,在采用GPU加速算法根据多张原始图像重构超分辨图像之前还包括步骤:判断全部光栅是否均已加载并成像:若否,返回步骤2);若是,判断多个波长窗口是否均已成像:若否,仍然返回步骤2);若是,关闭数字显微镜阵列,停止采集图像,GPU加速重构图像。Preferably, in step 4), before adopting the GPU acceleration algorithm to reconstruct the super-resolution image according to multiple original images, a step is also included: judging whether all gratings have been loaded and imaged: if not, return to step 2); if so, judge Whether multiple wavelength windows have been imaged: if not, still return to step 2); if yes, turn off the digital microscope array, stop collecting images, and GPU accelerates image reconstruction.
优选地,在上述的步骤2)中,透镜构成的系统为4F系统,各个级次的光在4F系统的傅立叶面进行滤波。Preferably, in the above step 2), the system formed by the lens is a 4F system, and the light of each order is filtered on the Fourier plane of the 4F system.
优选地,上述的第一空间结构光场和第二空间结构光场具有相同的位相。Preferably, the aforementioned first spatially structured light field and the second spatially structured light field have the same phase.
优选地,上述的一对正负一级衍射光为一对相干光束对。Preferably, the aforementioned pair of positive and negative first-order diffracted lights is a pair of coherent light beams.
非线性结构光照明显微成像系统,其包括:Non-linear structured illumination microscope imaging system, which includes:
光源系统(1),其包括至少两个波长不同的激光器(11、12)、至少两个中性滤波片(15、16)、至少两个半波片(19、110)、至少两个二向色镜(113、114)、声光可调滤波器(117)、光纤耦合器(118)和高频振动台(119),激光器(11、12)中至少有一个作为激活光源,至少有另一个作为激发光源,作为激活光源的激光器发出的激光和从作为激发光源的激光器发出的激光,分别依次通过中性滤波片(15、16)、半波片(19、110)、二向色镜(113、114)、声光可调滤波器(117)、光纤耦合器(118)和高频振动台(119),最终得到在同一根光纤中传播的至少一束激活光束和至少一束激发光束;A light source system (1), comprising at least two lasers (11, 12) with different wavelengths, at least two neutral filters (15, 16), at least two half-wave plates (19, 110), at least two two Chromatic mirrors (113, 114), acousto-optic tunable filters (117), fiber couplers (118) and high-frequency vibrating tables (119), at least one of the lasers (11, 12) is used as an active light source, and at least The other is used as an excitation light source, and the laser light emitted by the laser as the excitation light source and the laser light emitted from the laser as the excitation light source pass through the neutral filter (15, 16), the half-wave plate (19, 110), the dichroic filter in sequence, respectively. Mirrors (113, 114), acousto-optic tunable filters (117), fiber couplers (118) and high-frequency vibrating tables (119), finally obtain at least one active beam and at least one beam propagating in the same optical fiber excitation beam;
衍射系统(2),至少一束激活光束和至少一束激发光束分别依次经过衍射系统中沿光路依次放置的光纤耦合器(21)、透镜(22)、反射镜(23)、数字微镜阵列(24)、透镜(25)、强度掩模(26)、透镜(27)、反射镜(28)和透镜(29),每束光均得到一对对应的正负一级衍射光;Diffraction system (2), at least one active light beam and at least one excitation light beam pass through the fiber coupler (21), lens (22), reflector (23), digital micromirror array sequentially placed along the optical path in the diffraction system respectively (24), lens (25), intensity mask (26), lens (27), reflector (28) and lens (29), each bundle of light all obtains a pair of corresponding positive and negative first-order diffracted light;
成像系统(3),衍射系统(2)产生的激活光束对应的第一正负一级衍射光和激发光束对应的第二正负一级衍射光依次通过成像系统(3)中的二向色镜(31)和显微物镜(32),并照射到样品表面,使第一正负一级衍射光和第二正负一级衍射光分别在样品蛋白表面发生干涉,产生空间结构光场,其中第一正负一级衍射光产生至少一个满足正弦分布的用于激活荧光蛋白的第一空间结构光场,第二正负一级衍射光产生至少一个满足正弦分布的用于激发荧光蛋白的第二空间结构光场,第一空间结构光场和第二空间结构光场使样品发射荧光,且发射的荧光被物镜(32)收集,通过二向色镜(31)、二向色镜(34)、干涉滤光片(35),经管透镜(36)在光电探测器的探测面上多次成像,最终通过成像系统(3)中的GPU加速数据处理子系统采用GPU加速算法,根据多张光电探测器采集的原始图像重构荧光样品的超分辨图像。The imaging system (3), the first positive and negative first-order diffracted light corresponding to the activation beam generated by the diffraction system (2) and the second positive and negative first-order diffracted light corresponding to the excitation beam pass through the dichroic light in the imaging system (3) in sequence mirror (31) and microscope objective lens (32), and irradiate the surface of the sample, so that the first positive and negative first-order diffracted light and the second positive and negative first-order diffracted light interfere on the surface of the sample protein respectively, generating a spatially structured light field, Wherein the first positive and negative first-order diffracted light generates at least one first spatially structured light field satisfying a sinusoidal distribution for activating the fluorescent protein, and the second positive and negative first-order diffracted light generates at least one first spatially structured light field satisfying a sinusoidal distribution for exciting the fluorescent protein The second spatially structured light field, the first spatially structured light field and the second spatially structured light field cause the sample to emit fluorescence, and the emitted fluorescence is collected by the objective lens (32), passed through the dichroic mirror (31), dichroic mirror ( 34), the interference filter (35), multiple imaging on the detection surface of the photodetector through the tube lens (36), finally adopts the GPU acceleration algorithm by the GPU acceleration data processing subsystem in the imaging system (3), according to multiple Super-resolution images of fluorescent samples are reconstructed from raw images collected by Zhang photodetectors.
优选地,上述的GPU加速数据处理子系统包括数据采集卡、图形工作站和图形处理显卡,GPU加速数据处理子系统从光电探测器采集的原始数据,通过GPU加速算法,重构出样品的超分辨显微图像。Preferably, the above-mentioned GPU accelerated data processing subsystem includes a data acquisition card, a graphics workstation and a graphics processing graphics card. The GPU accelerated data processing subsystem reconstructs the super-resolution of the sample from the raw data collected by the photodetector through the GPU accelerated algorithm. microscopic image.
优选地,上述的非线性结构光照明显微成像系统还包括电子看控制系统,用于实现声光可调滤波器(117)、数字微镜阵列(24)和光电探测器的同步触发。Preferably, the above-mentioned nonlinear structured illumination microscopic imaging system further includes an electronic viewing control system for realizing synchronous triggering of the acousto-optic tunable filter (117), the digital micromirror array (24) and the photodetector.
优选地,上述的光源系统(1)放置在一个气浮防震实验平台,衍射系统(2)和成像系统(3)放置在另一个气浮防震实验平台,两个气浮防震实验平台之间通过带标准FC转接口的多模光纤跳线连接,并将多模光纤跳线的一部分固定在震动台上,在成像过程中持续随机震动。Preferably, the above-mentioned light source system (1) is placed on an air flotation shockproof experimental platform, the diffraction system (2) and the imaging system (3) are placed on another air flotation shockproof experimental platform, and the two air flotation shockproof experimental platforms pass through A multimode fiber jumper with a standard FC interface is connected, and a part of the multimode fiber jumper is fixed on the vibration table, which continues to vibrate randomly during the imaging process.
优选地,上述的第一正负一级衍射光和第二正负一级衍射光为一对相干光束对。Preferably, the above-mentioned first positive and negative first-order diffracted light and second positive and negative first-order diffracted light are a pair of coherent light beams.
本发明的有益效果在于:The beneficial effects of the present invention are:
1)系统成像分辨率较传统SIM有显著提高;本发明通过第一步采用结构光激活荧光样品,第二步使用与激活光场同相位的结构光场激发荧光,这种两步结构光激活-激发成像方法,使得系统最大有效空间频率达到传统光学截止频率的三倍,理论上成像分辨率最大可提高三倍,而传统的SIM成像方法采用一步结构光激发直接成像,理论上最大有效空间频率仅能达到截止频率的两倍,成像分辨率也仅能提高两倍;1) The imaging resolution of the system is significantly improved compared with traditional SIM; the present invention uses structured light to activate fluorescent samples in the first step, and uses a structured light field in phase with the activation light field to excite fluorescence in the second step. This two-step structured light activation - The excitation imaging method makes the maximum effective spatial frequency of the system three times that of the traditional optical cutoff frequency, and theoretically the imaging resolution can be increased by up to three times, while the traditional SIM imaging method uses one-step structured light excitation for direct imaging, and the theoretical maximum effective space The frequency can only reach twice the cutoff frequency, and the imaging resolution can only be doubled;
2)高抗荧光漂泊、低光毒性,本发明使用的激活光场与激发光场均为低功率密度光场(典型值为W/cm2),远低于传统的NL-SIM以及STED(典型值为MW/cm2),较低的功率密度减弱激光对荧光分子的漂白作用,利于延长荧光发射时间,同时可避免对细胞或生物组织造成损伤,降低光毒性,这对于生物医学显微成像具有重要意义;2) High anti-fluorescence drift, low phototoxicity, the activation light field and the excitation light field used in the present invention are all low power density light fields (typical value W/cm2), far lower than traditional NL-SIM and STED (typical The value is MW/cm2), the lower power density weakens the bleaching effect of the laser on the fluorescent molecules, which is beneficial to prolong the fluorescence emission time, and at the same time avoids damage to cells or biological tissues and reduces phototoxicity, which is of great significance for biomedical microscopy imaging important meaning;
3)成像速度快,可实现对活细胞超分辨成像;本发明构建了基于数字微镜阵列(digital micro-mirror device,简称DMD)的结构光场产生光路,在DMD上显示计算全息图,其透过率函数可表示为:其中γ表示调制度,k0表示空间频率(决定衍射的方向和衍射角的大小),表示初始相位(决定结构光场的强度分布)t,设计一组具有不同空间频率和初始位相的计算全息图,可获得一组具有不同相对位相差的衍射光场。空间均匀分布的激光照射到DMD上,被全息光栅衍射到各个级次,通过4f系统,在傅立叶面滤波,选择其中的正负1级衍射光,并通过ITRF透镜和显微物镜的组合,使正负一级衍射光在样品表面发生干涉,产生满足正弦分布的空间结构光场;值得指出的是,在专利CN102540446A及其他相关专利中涉及采用DMD产生结构光场时,大都通过成像系统将DMD直接成像到样品表面,理论上其产生的条纹分布不是严格满足正弦分布,且有效空间频率较低。而本发明设置的基于DMD全息光栅衍射光干涉的方式产生的结构光场严格满足正弦分布,且可实现更高的空间频率,理论上可达到系统的光学截止频率(采用TIRF照明),DMD工作在像素锁定模式,切换速度高于1KHz,同时采用高速科研级SCOMS相机,其最高帧频同样达到1KHz,使得本发明系统总体采图速度高于100Hz,可满足活细胞成像需求。3) The imaging speed is fast, and super-resolution imaging of living cells can be realized; the present invention constructs an optical path based on a structured light field of a digital micro-mirror device (DMD for short), and displays a computational hologram on the DMD. The transmittance function can be expressed as: Among them, γ represents the degree of modulation, k 0 represents the spatial frequency (determines the direction of diffraction and the size of the diffraction angle), Represents the initial phase (determines the intensity distribution of the structured light field) t, and a set of computational holograms with different spatial frequencies and initial phases can be designed to obtain a set of diffracted light fields with different relative phase differences. The spatially evenly distributed laser light is irradiated on the DMD, and is diffracted to various orders by the holographic grating. After passing through the 4f system and filtering on the Fourier surface, the positive and negative first-order diffracted light is selected, and through the combination of the ITRF lens and the microscope objective lens, the The positive and negative first-order diffracted light interferes on the surface of the sample to produce a spatially structured light field that satisfies a sinusoidal distribution; it is worth pointing out that when the DMD is used to generate the structured light field in the patent CN102540446A and other related patents, most of the DMD is used by the imaging system. Direct imaging to the sample surface theoretically produces fringe distribution that does not strictly satisfy the sinusoidal distribution, and the effective spatial frequency is low. However, the structured light field produced by the DMD holographic grating diffraction light interference method set by the present invention strictly satisfies the sinusoidal distribution, and can achieve higher spatial frequencies. In the pixel locking mode, the switching speed is higher than 1KHz. At the same time, a high-speed scientific research-grade SCOMS camera is used, and its highest frame rate also reaches 1KHz, so that the overall image acquisition speed of the system of the present invention is higher than 100Hz, which can meet the needs of live cell imaging.
附图说明Description of drawings
图1为本发明的非线性结构光照明显微成像方法的流程示意图。FIG. 1 is a schematic flow chart of the non-linear structured illumination microscopy imaging method of the present invention.
图2为本发明的非线性结构光照明显微成像系统的结构示意图。Fig. 2 is a structural schematic diagram of the nonlinear structured illumination microscopy imaging system of the present invention.
图3为本发明的非线性结构光照明显微成像方法及系统中所涉及的图像重构算法的示意图。Fig. 3 is a schematic diagram of the image reconstruction algorithm involved in the nonlinear structured illumination microscopic imaging method and system of the present invention.
具体实施方式detailed description
下面结合附图详细说明本发明的优选实施方式。Preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.
图1为一种非线性结构光照明超分辨荧光成像方法的流程图。为了描述方便,在本实施例中,激活光特指波长为405nm的连续固体激光器,激发光特指波长为488nm连续固体激光器,两束激光的输出功率在0至100mW之间可调。Fig. 1 is a flowchart of a super-resolution fluorescence imaging method with nonlinear structured light illumination. For the convenience of description, in this embodiment, the activation light specifically refers to a continuous solid-state laser with a wavelength of 405 nm, and the excitation light specifically refers to a continuous solid-state laser with a wavelength of 488 nm. The output power of the two laser beams is adjustable between 0 and 100 mW.
为了达到本发明的目的,如图1和3所示,在本发明的非线性结构光照明显微成像方法的一些实施方式中,其包括步骤:In order to achieve the purpose of the present invention, as shown in Figures 1 and 3, in some embodiments of the non-linear structured illumination microscopic imaging method of the present invention, it includes steps:
步骤S101:用激发光均匀照明样品,通过SCOMS采集传统宽场照明成像图,通过移动载物台,选择需要超分辨成像的区域;Step S101: Uniformly illuminate the sample with excitation light, collect traditional wide-field illumination imaging images through SCOMS, and select the area requiring super-resolution imaging by moving the stage;
步骤S102:计算机自动锁焦;Step S102: the computer automatically locks the focus;
步骤S103:调高激发光功率,使荧光蛋白分子全部处于暗态,不发射荧光;Step S103: increasing the power of the excitation light so that all the fluorescent protein molecules are in a dark state and do not emit fluorescence;
步骤S104:控制系统修改AOTF的工作频率,只允许激活光透过AOTF,进而照射到DMD上,在DMD上加载一幅计算全息图,计算全息图的强度透过率函数为:其中γ表示调制度,k0表示空间频率(决定衍射的方向和衍射角的大小),表示初始相位(决定结构光场的强度分布);激活光首先被计算全息图衍射到各个级次,随后被放置在DMD之后的一个由两个透镜组成的4f系统收集,在4f系统的傅里叶面上,通过一个强度掩模选频,只允许正负一级衍射光通过,从这个4f系统出射之后,再经过一个由TIRF透镜和显微物镜组成的4f系统,样品表面发生干涉,产生余弦分布的周期照明光场,激活光照射2ms之后,令AOTF切断激活光;Step S104: The control system modifies the working frequency of the AOTF, only allowing the activation light to pass through the AOTF, and then irradiate the DMD, and load a computational hologram on the DMD. The intensity transmittance function of the computational hologram is: Among them, γ represents the degree of modulation, k 0 represents the spatial frequency (determines the direction of diffraction and the size of the diffraction angle), Represents the initial phase (determines the intensity distribution of the structured light field); the activation light is first diffracted by the calculated hologram to various orders, and then collected by a 4f system consisting of two lenses placed after the DMD, in the Fourier of the 4f system On the leaf surface, an intensity mask is used to select the frequency, and only the positive and negative first-order diffracted light is allowed to pass through. After exiting this 4f system, it passes through a 4f system composed of a TIRF lens and a microscope objective lens. The surface of the sample interferes and produces Periodic illumination light field with cosine distribution, after the activation light is irradiated for 2ms, the AOTF is cut off the activation light;
步骤S105,控制系统调整AOTF的工作频率,只允许激发光通过AOTF,并照射到DMD上,激发光经计算全息图衍射之后,在样品表面产生余弦分布的周期照明光场,使在步骤S104中被激活的荧光蛋白分子发射荧光,此时荧光光强分布表示为:In step S105, the control system adjusts the working frequency of the AOTF, allowing only the excitation light to pass through the AOTF and irradiate the DMD. After the excitation light is diffracted by the computational hologram, a periodic illumination light field with a cosine distribution is generated on the sample surface, so that in step S104 The activated fluorescent protein molecules emit fluorescence, and the fluorescence intensity distribution at this time is expressed as:
其中S(r)表示样品荧光蛋白分子空间分布函数,表示激活光的空间频率,表示激发光的空间频率,可以看出在I(r)中包含空间频率为的成分,在同一显微成像系统中其中kC表示系统的光学截至频率,因此该成像系统最大可以实现3倍光学截至频率的超分辨成像。同时触发SCOMS采集数据,并将数据存储在图形工作站的内存之中,激发光照射2ms之后结束数据采集,AOTF切断激发光;Among them, S(r) represents the spatial distribution function of sample fluorescent protein molecules, represents the spatial frequency of the activating light, Indicates the spatial frequency of the excitation light, it can be seen that the spatial frequency contained in I(r) is components, in the same microscopic imaging system Where k C represents the optical cut-off frequency of the system, so the imaging system can achieve super-resolution imaging with a maximum of 3 times the optical cut-off frequency. At the same time, trigger SCOMS to collect data and store the data in the memory of the graphics workstation. The data collection ends after the excitation light is irradiated for 2ms, and the AOTF cuts off the excitation light;
步骤S106:判断是否完成9个条纹方向的激发光的成像,9个条纹方向对应9个不同的k0取值,9个条纹方向的激发光的方位角与x轴方向的夹角分别为2Nπ/9,其中N=0,1,2,..,8,每个条纹方向的激发光的初始位相对应7个不同的取值,分别为Mπ/7,其中M=0,1,2,...,6,共采集63幅原始图像;如果未采集到63幅原始图像,则回到步骤S103;如果采集到63幅原始图像,则进行步骤S107;Step S106: Determine whether the imaging of the excitation light in the 9 stripe directions is completed, the 9 stripe directions correspond to 9 different k0 values, and the angles between the azimuth angles of the excitation light in the 9 stripe directions and the x-axis direction are respectively 2Nπ /9, where N=0, 1, 2, .., 8, the initial bit of excitation light in each stripe direction corresponds to 7 different The values are respectively Mπ/7, where M=0, 1, 2, ..., 6, and a total of 63 original images are collected; if 63 original images are not collected, then return to step S103; if 63 are collected original image, proceed to step S107;
步骤S107:在图形工作站上,通过GPU加速非线性结构光照明图像处理算法,通过所述63幅原始图像重构样品的超分辨荧光图像,算法结构如图3所示;所述激活光与激发光的波长可根据开关蛋白的吸收-发射光谱特性经行更换,也可以设置两束波长不同的激发光,对采用两种开关蛋白标记的生物样品经行双色成像。Step S107: On the graphics workstation, accelerate the non-linear structured light illumination image processing algorithm through the GPU, and reconstruct the super-resolution fluorescence image of the sample through the 63 original images, the algorithm structure is shown in Figure 3; the activation light and excitation The wavelength of the light can be changed according to the absorption-emission spectral characteristics of the switch protein, or two beams of excitation light with different wavelengths can be set to perform dual-color imaging on biological samples labeled with two switch proteins.
其中,步骤S103中,样品表面的部分蛋白从暗态转换到亮态,暗态即不能被激光激发并发射荧光的空间构型,亮态即可以被激光激发并发射荧光的空间构型。正负遗迹衍射光依次通过的透镜和显微物镜中,透镜可以采用ITRF透镜。Wherein, in step S103, part of the protein on the surface of the sample is converted from a dark state to a bright state, the dark state is a spatial configuration that cannot be excited by laser light and emits fluorescence, and the bright state is a spatial configuration that can be excited by laser light and emit fluorescence. Among the lenses through which the positive and negative relic diffracted light passes sequentially and the microscope objective lens, the lens can be an ITRF lens.
为了达到本发明的目的,如图2和3所示,在本发明的非线性结构光照明显微成像系统的一些实施方式中,其包括:In order to achieve the object of the present invention, as shown in Figures 2 and 3, in some embodiments of the nonlinear structured illumination microscopy imaging system of the present invention, it includes:
光源系统1,其包括两个或更多个波长不同的激光器11、12、两个或更多个中性滤波片15、16、两个或更多个半波片19、110、两个或更多个二向色镜113、114、声光可调滤波器(AOTF)117、光纤耦合器118和高频振动台119,高频振动台119在成像过程中以5KHz频率持续振动,消除激光的空间相干性,使照明光场空间均匀。不同波长的激光器11、12中有一个作为激活光源,另一个作为激发光源,从作为激活光源的激光器发出的激光和从作为激发光源的激光器发出的激光,分别依次通过中性滤波片15、16、半波片19、110、二向色镜113、114、声光可调滤波器(AOTF)117、光纤耦合器118和高频振动台119,最终得到在同一根光纤中传播的一束激活光束和一束激发光束;A light source system 1 comprising two or more lasers with different wavelengths 11, 12, two or more neutral filters 15, 16, two or more half-wave plates 19, 110, two or more More dichroic mirrors 113, 114, acousto-optic tunable filter (AOTF) 117, fiber coupler 118 and high-frequency vibrating table 119, high-frequency vibrating table 119 continuously vibrates at a frequency of 5KHz during the imaging process to eliminate laser The spatial coherence makes the illumination light field spatially uniform. One of the lasers 11 and 12 with different wavelengths is used as an active light source, and the other is used as an exciting light source. The laser light emitted from the laser used as the active light source and the laser light emitted from the laser used as the excited light source pass through the neutral filters 15 and 16 respectively. , half-wave plates 19, 110, dichroic mirrors 113, 114, acousto-optic tunable filter (AOTF) 117, fiber coupler 118 and high-frequency vibrating table 119, finally obtain a bundle of activation propagating in the same optical fiber beam and an excitation beam;
衍射系统2,光源系统1产生的一束激活光束和一束激发光束分别依次经过衍射系统2中沿光路依次放置的光纤耦合器21、透镜22、反射镜23、数字微镜阵列DMD 24、透镜25、强度掩模26、透镜27、反射镜28和TIRF透镜29,每束光均得到一对对应的正负一级衍射光,其中,正负一级衍射光均为一对相干光束对;Diffraction system 2, an activation beam and an excitation beam generated by light source system 1 respectively pass through the fiber coupler 21, lens 22, mirror 23, digital micromirror array DMD 24, and lens placed sequentially along the optical path in the diffraction system 2 25. Intensity mask 26, lens 27, mirror 28 and TIRF lens 29, each beam of light obtains a pair of corresponding positive and negative first-order diffracted lights, wherein the positive and negative first-order diffracted lights are a pair of coherent beams;
成像系统3,衍射系统2产生的激活光束对应的正负一级衍射光、激发光束对应的正负一级衍射光,依次通过成像系统3中的二向色镜31和显微物镜32(100x,NA1.49,oil),照射到样品表面,样品固定在三维精密电动载物台33,使正负一级衍射光分别在样品蛋白表面发生干涉,产生空间结构光场,其中,一束激活光束对应的正负一级衍射光产生一个满足正弦分布的用于激活荧光蛋白的空间结构光场,一束激发光束对应的正负一级衍射光产生一个满足正弦分布的用于激发荧光蛋白的空间结构光场,该空间结构光场结构光场使样品发射荧光,且发射的荧光被物镜32收集,通过二向色镜31,二向色镜34,干涉滤光片35,经管透镜36在光电探测器探测面上多次成像,最终通过成像系统3中的GPU加速数据处理子系统采用GPU加速算法,根据多张光电探测器采集的原始图像重构荧光样品的超分辨图像。The imaging system 3, the positive and negative first-order diffracted light corresponding to the activation beam generated by the diffraction system 2, and the positive and negative first-order diffracted light corresponding to the excitation beam pass through the dichroic mirror 31 and the microscopic objective lens 32 (100× , NA1.49, oil), irradiate the surface of the sample, and the sample is fixed on the three-dimensional precision motorized stage 33, so that the positive and negative first-order diffracted lights interfere on the surface of the sample protein respectively to generate a spatially structured light field, wherein one beam activates The positive and negative first-order diffracted light corresponding to the beam produces a spatially structured light field satisfying the sinusoidal distribution for activating the fluorescent protein, and the positive and negative first-order diffracted light corresponding to an excitation beam produces a sinusoidal distribution for exciting the fluorescent protein. Spatial structured light field, the structured light field causes the sample to emit fluorescence, and the emitted fluorescence is collected by the objective lens 32, passes through the dichroic mirror 31, the dichroic mirror 34, the interference filter 35, and passes through the tube lens 36. The photodetector detection surface is imaged multiple times, and finally the GPU-accelerated data processing subsystem in the imaging system 3 uses a GPU-accelerated algorithm to reconstruct the super-resolution image of the fluorescent sample based on the original images collected by multiple photodetectors.
其中,上述的GPU加速数据处理子系统包括数据采集卡、图形工作站和图形处理显卡,GPU加速数据处理子系统从光电探测器采集的原始数据,通过GPU加速算法,重构出样品的超分辨显微图像。Among them, the above-mentioned GPU-accelerated data processing subsystem includes a data acquisition card, a graphics workstation and a graphics processing graphics card. The GPU-accelerated data-processing subsystem reconstructs the super-resolution display of the sample from the original data collected by the photodetector through the GPU-accelerated algorithm. micro image.
优选地,上述的非线性结构光照明显微成像系统还包括电子看控制系统,该电子看控制系统可以包括单片机和开关电源用于实现声光可调滤波器(117)、数字微镜阵列(24)和光电探测器的同步触发。Preferably, the above-mentioned non-linear structured illumination microscopic imaging system also includes an electronic viewing control system, which can include a single-chip microcomputer and a switching power supply for realizing an acousto-optic tunable filter (117), a digital micromirror array ( 24) Synchronous triggering with photodetectors.
上述的光源系统(1)放置在一个气浮防震实验平台,衍射系统(2)和成像系统(3)放置在另一个气浮防震实验平台,两个气浮防震实验平台之间通过带标准FC转接口的多模光纤跳线连接,并将多模光纤跳线的一部分固定在5KHz震动台上,在成像过程中持续随机震动。The above-mentioned light source system (1) is placed on an air flotation shockproof experimental platform, the diffraction system (2) and imaging system (3) are placed on another air flotation shockproof experimental platform, and the two air flotation shockproof experimental platforms pass through a standard FC The multi-mode fiber jumper of the adapter is connected, and a part of the multi-mode fiber jumper is fixed on a 5KHz vibration table, which continues to vibrate randomly during the imaging process.
对于光源系统的光源子系统,其用于激活荧光蛋白的光源,可以是波长为405nm的连续固体激光器,也可以是其他波长的激光器或LED光源(波长选择取决于实验采用的荧光蛋白的类型)。For the light source subsystem of the light source system, the light source used to activate the fluorescent protein can be a continuous solid-state laser with a wavelength of 405nm, or a laser with other wavelengths or an LED light source (the wavelength selection depends on the type of fluorescent protein used in the experiment) .
本发明的系统用于激发荧光蛋白发射荧光的激发光源可以是488nm、514nm、561nm、647nm连续输出固体激光器,也可以是其他波长的激光器,如图2所示,系统中最多可以同时设置4路激光器11,12,13,14,每增加一路激光器,例如13,14,需相应地增加中性滤光片17,18,半波片111,112,二向色镜115,116。The excitation light source used in the system of the present invention to excite fluorescent proteins to emit fluorescence can be 488nm, 514nm, 561nm, 647nm continuous output solid-state lasers, or lasers of other wavelengths. As shown in Figure 2, up to 4 channels can be set in the system at the same time Lasers 11 , 12 , 13 , 14 , for each additional laser path, such as 13 , 14 , neutral filters 17 , 18 , half-wave plates 111 , 112 , and dichroic mirrors 115 , 116 need to be added accordingly.
如图2所示,成像系统至少包括1个SCMOS 1光电探测器,此处光电探测器也可以是EMCCD,并且根据荧光标记蛋白的不同,最多可以设置4个SCMOS光电探测器,每增加一路SCMOS探测光路,例如SCMOS2,需相应增加二向色镜38,干涉滤光片39,管透镜(Tube Lens)310。As shown in Figure 2, the imaging system includes at least one SCMOS 1 photodetector, where the photodetector can also be an EMCCD, and up to four SCMOS photodetectors can be set according to the different fluorescently labeled proteins, and each additional SCMOS For the detection optical path, such as SCMOS2, a dichroic mirror 38 , an interference filter 39 , and a tube lens (Tube Lens) 310 need to be added accordingly.
光源系统1中用于激活荧光蛋白的光源,可以是波长为405nm的连续固体激光器,也根据实验采用的荧光蛋白的类型选择其他波长的激光器。The light source used to activate the fluorescent protein in the light source system 1 can be a continuous solid-state laser with a wavelength of 405 nm, and lasers with other wavelengths can also be selected according to the type of fluorescent protein used in the experiment.
以上所述的仅是本发明的优选实施方式,应当指出,对于本领域的普通技术人员来说,在不脱离本发明创造构思的前提下,还可以做出若干变形和改进,这些都属于本发明的保护范围。The above is only the preferred embodiment of the present invention, it should be pointed out that for those skilled in the art, without departing from the inventive concept of the present invention, some modifications and improvements can also be made, and these all belong to the present invention. protection scope of the invention.
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410783714.4A CN104515759B (en) | 2014-12-16 | 2014-12-16 | Nonlinear organization optical illumination micro imaging method and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410783714.4A CN104515759B (en) | 2014-12-16 | 2014-12-16 | Nonlinear organization optical illumination micro imaging method and system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104515759A CN104515759A (en) | 2015-04-15 |
CN104515759B true CN104515759B (en) | 2017-05-31 |
Family
ID=52791383
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410783714.4A Active CN104515759B (en) | 2014-12-16 | 2014-12-16 | Nonlinear organization optical illumination micro imaging method and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104515759B (en) |
Families Citing this family (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105527704B (en) * | 2015-12-31 | 2018-03-02 | 中国科学院苏州生物医学工程技术研究所 | The micro- application in pathological section imaging system of Structured Illumination |
CN107227297A (en) * | 2016-03-23 | 2017-10-03 | 中国科学院沈阳自动化研究所 | A kind of quick maskless cell X-Y scheme preparation method |
KR101865624B1 (en) * | 2016-06-10 | 2018-06-11 | 주식회사 토모큐브 | 3D Refractive Index Tomogram and Structured Illumination Microscopy System using Wavefront Shaper and Method thereof |
CN106706577B (en) * | 2016-11-16 | 2019-08-16 | 深圳大学 | A kind of photoimaging systems and method |
CN106770095A (en) * | 2016-11-30 | 2017-05-31 | 浙江大学 | A kind of super-resolution micro imaging method and device based on the modulation of non-linear hot spot |
CN106768376A (en) * | 2016-12-29 | 2017-05-31 | 中科和光(天津)应用激光技术研究所有限公司 | A kind of method for improving thermal imagers resolution ratio and micro- sweep mechanism arrangement |
CN108333151B (en) * | 2017-01-19 | 2021-01-26 | 北京大学 | Super-resolution microscopic imaging system and method based on femtosecond pulse shaping |
CN107180411B (en) * | 2017-05-19 | 2021-05-18 | 中国科学院苏州生物医学工程技术研究所 | An image reconstruction method and system |
CN107167929B (en) * | 2017-06-12 | 2019-06-25 | 华南师范大学 | Double mode optical ultra-discrimination microscopic imaging device and method based on DMD |
CN107490568B (en) * | 2017-08-09 | 2020-08-18 | 四川大学 | Super-resolution microscopy imaging device and method based on stimulated emission loss characteristics |
US20220113671A1 (en) * | 2018-12-04 | 2022-04-14 | The Regents Of The University Of California | Portable uv holographic microscope for high-contrast protein crystal imaging |
CN110007453B (en) * | 2019-05-13 | 2023-11-21 | 中国科学院生物物理研究所 | Multi-illumination-mode fluorescent signal measuring device and measuring method and application thereof |
CN112444506B (en) * | 2019-09-04 | 2022-03-18 | 复旦大学 | Microscopic imaging method and device |
CN111308682B (en) * | 2019-11-18 | 2022-05-17 | 天津大学 | Super-resolution reconstruction method based on structured light illumination |
CN111077121B (en) * | 2019-12-06 | 2020-11-17 | 中国科学院西安光学精密机械研究所 | Rapid method and system for directly reconstructing structured light illumination super-resolution image in space domain |
CN110954523B (en) * | 2019-12-18 | 2022-07-08 | 深圳大学 | Two-photon scanning structure light microscopic imaging method and device |
CN110954524B (en) * | 2019-12-18 | 2022-07-08 | 深圳大学 | A non-linear structured light super-resolution microscopy imaging device and method |
CN110954522B (en) * | 2019-12-18 | 2022-07-08 | 深圳大学 | A kind of multi-focal super-resolution optical microscopy imaging method and device |
CN110954520B (en) * | 2019-12-18 | 2022-07-08 | 深圳大学 | A scanning structured light microscopy imaging method and device |
CN110954521B (en) * | 2019-12-18 | 2022-07-05 | 深圳大学 | Wide-field super-resolution microscopic imaging method and system thereof |
CN111258049A (en) * | 2020-02-20 | 2020-06-09 | 清华大学 | Miniaturized three-dimensional wide-field tomography device |
CN113391437A (en) * | 2020-03-12 | 2021-09-14 | 平湖莱顿光学仪器制造有限公司 | Fluorescence microscope imaging system and fluorescence imaging method thereof |
CN111461975B (en) * | 2020-03-17 | 2021-04-23 | 中国科学院苏州生物医学工程技术研究所 | Fiber bundle super-resolution imaging method, system, computer equipment and storage medium |
CN111650739B (en) * | 2020-05-21 | 2022-06-03 | 中国科学院苏州生物医学工程技术研究所 | Single-frame exposure fast three-dimensional fluorescence imaging system and method based on DMD |
CN112014318A (en) * | 2020-08-25 | 2020-12-01 | 深圳大学 | A Stochastic Optical Reconstruction Microscopic Imaging System |
CN112666135B (en) * | 2020-11-26 | 2023-04-21 | 中国科学技术大学 | A three-dimensional microscopic imaging device and method |
CN113112405B (en) * | 2021-04-12 | 2022-04-12 | 广州超视计生物科技有限公司 | Self-adaptive correction method of super-resolution microscope image and SIM-ODT (subscriber identity module-ODT) bimodal system |
DE102021114288A1 (en) * | 2021-06-02 | 2022-12-08 | Carl Zeiss Microscopy Gmbh | SYNTHETIC FLUORESCENCE IMAGES WITH SAMPLE-SPECIFIC REFERENCE |
CN115308184A (en) * | 2022-09-05 | 2022-11-08 | 中国科学院苏州生物医学工程技术研究所 | A method and system for super-resolution microscopy imaging with active structured light illumination |
CN117405636B (en) * | 2023-07-25 | 2025-04-04 | 中国科学院生物物理研究所 | Super-resolution light sheet fluorescence microscopy system and method |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102540446A (en) * | 2011-12-28 | 2012-07-04 | 中国科学院西安光学精密机械研究所 | High-speed structure illumination optical microscope system and method based on digital micromirror device |
CN103207449A (en) * | 2013-04-17 | 2013-07-17 | 华中科技大学 | Structured light quick scanning microscopic imaging method |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008216778A (en) * | 2007-03-06 | 2008-09-18 | Nikon Corp | Structured illuminating microscope |
DE102008049878A1 (en) * | 2008-09-30 | 2010-04-01 | Carl Zeiss Microlmaging Gmbh | Improved methods and devices for microscopy with structured illumination |
-
2014
- 2014-12-16 CN CN201410783714.4A patent/CN104515759B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102540446A (en) * | 2011-12-28 | 2012-07-04 | 中国科学院西安光学精密机械研究所 | High-speed structure illumination optical microscope system and method based on digital micromirror device |
CN103207449A (en) * | 2013-04-17 | 2013-07-17 | 华中科技大学 | Structured light quick scanning microscopic imaging method |
Non-Patent Citations (2)
Title |
---|
A method for super-resolved CARS microscopy with structured illumination in two dimensions;Joo Hyun Park et al.;《OPTICS EXPRESS》;20140421;第22卷(第8期);第9854-9870页 * |
Nonlinear structured illumination microscopy by surface plasmon enhanced stimulated emission depletion;Han Zhang et al.;《OPTICS EXPRESS》;20111121;第19卷(第24期);第24783-24794页 * |
Also Published As
Publication number | Publication date |
---|---|
CN104515759A (en) | 2015-04-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104515759B (en) | Nonlinear organization optical illumination micro imaging method and system | |
CN107389631B (en) | High-speed multicolor multi-modal structured light illumination super-resolution microscopic imaging system and method thereof | |
CN107167929B (en) | Double mode optical ultra-discrimination microscopic imaging device and method based on DMD | |
CN110954522B (en) | A kind of multi-focal super-resolution optical microscopy imaging method and device | |
CN106124468B (en) | A kind of super-resolution fluorescence microscopy method and device based on photoactivation and Structured Illumination | |
CN110954523B (en) | Two-photon scanning structure light microscopic imaging method and device | |
CN110954524B (en) | A non-linear structured light super-resolution microscopy imaging device and method | |
JP6302403B2 (en) | Beam shaping device | |
Isobe et al. | Enhancement of lateral resolution and optical sectioning capability of two-photon fluorescence microscopy by combining temporal-focusing with structured illumination | |
CN111077121A (en) | Fast method and system for direct reconstruction of structured light illumination super-resolution images in airspace | |
CN111458318B (en) | Super-resolution imaging method and system using square lattice structured light illumination | |
JP5085608B2 (en) | Wide-field super-resolution optical microscope using a spatial light modulator | |
CN108333151B (en) | Super-resolution microscopic imaging system and method based on femtosecond pulse shaping | |
Go et al. | Four-dimensional multi-site photolysis of caged neurotransmitters | |
CN114594588B (en) | Structured light illumination microscopic device and method based on grating projection and SLM phase shift | |
CN112986237A (en) | Super-resolution imaging device and method based on focus scanning structured light illumination | |
Fedosseev et al. | Structured light illumination for extended resolution in fluorescence microscopy | |
CN106706577A (en) | Optical imaging system and method | |
Wang et al. | Improvement in resolution of multiphoton scanning structured illumination microscopy via harmonics | |
CN112114422A (en) | Three-dimensional super-resolution microscopic imaging method and device based on parallel STED and 4Pi | |
CN108897126B (en) | Fluorescence imaging system | |
CN113568294A (en) | Holographic optical tweezers fusion structure light illumination microscopic system and method | |
CN117930487A (en) | Microscopic imaging system and method based on super-surface regulation light field | |
Egner et al. | STED nanoscopy | |
Watson et al. | Two-photon microscopy with diffractive optical elements and spatial light modulators |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |