CN105301794B - Super-resolution imaging device for fast moving objects - Google Patents
Super-resolution imaging device for fast moving objects Download PDFInfo
- Publication number
- CN105301794B CN105301794B CN201510727726.XA CN201510727726A CN105301794B CN 105301794 B CN105301794 B CN 105301794B CN 201510727726 A CN201510727726 A CN 201510727726A CN 105301794 B CN105301794 B CN 105301794B
- Authority
- CN
- China
- Prior art keywords
- imaging
- super
- resolution imaging
- resolution
- lens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/58—Optics for apodization or superresolution; Optical synthetic aperture systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Microscoopes, Condenser (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
Abstract
本发明涉及一种用于快速运动物体的超高分辨成像装置。该装置包括:常规分辨率显微成像模块,用于显示运动物体样品和超高分辨成像目标以提供两者的位置和运动信息;快速图像采集与处理模块,用于获取超高分辨成像目标的运动速度Vi、感兴趣区域ROI的运动速度Vr与位置以及成像拍摄区域Sp的尺寸,并提供给位置反馈控制模块和超高分辨成像模块;位置反馈控制模块,用于调整所述成像拍摄区域Sp或者拟成像区域Si的位置,以使得拟拍摄区域Si与成像拍摄区域Sp保持重合;超高分辨成像模块,用于根据超分辨成像速率要求调整成像拍摄区域Sp的尺寸,对运动物体样品上超高分辨成像目标进行超高分辨成像。本发明能够消除物体运动对超高分辨成像的影响。
The invention relates to a super high resolution imaging device for fast moving objects. The device includes: a conventional resolution microscopic imaging module, which is used to display moving object samples and super-high resolution imaging targets to provide both position and motion information; a fast image acquisition and processing module, which is used to obtain ultra-high resolution imaging targets The motion velocity V i , the motion velocity V r and the position of the region of interest ROI and the size of the imaging shooting area Sp are provided to the position feedback control module and the super-high resolution imaging module; the position feedback control module is used to adjust the imaging shooting The position of the area Sp or the proposed imaging area Si, so that the intended shooting area Si and the imaging shooting area Sp keep coincident; the super-resolution imaging module is used to adjust the size of the imaging shooting area Sp according to the requirements of the super-resolution imaging rate, for moving object samples Ultra-high-resolution imaging on the super-high-resolution imaging target. The invention can eliminate the influence of object movement on super-high resolution imaging.
Description
技术领域technical field
本发明涉及图像采集技术领域,尤其涉及一种用于快速运动物体的超高分辨成像装置。The invention relates to the field of image acquisition technology, in particular to a super-high-resolution imaging device for fast-moving objects.
背景技术Background technique
一般情况下,人眼能够分辨的最小物体的尺寸大约为0.1mm。若想看到更小的物体,则需要借助于显微技术。1873年,德国显微技术专家恩斯特.阿贝揭示了光学显微镜由于光的衍射效应和有限孔径分辨率存在极限的原理,正是该原理“束缚”了传统光学显微镜在纳米世界的运用。In general, the size of the smallest object that the human eye can distinguish is about 0.1 mm. If you want to see smaller objects, you need to use microscopy. In 1873, Ernst Abbe, a German microtechnical expert, revealed the principle that optical microscopes have limitations due to light diffraction effects and limited aperture resolution. It is this principle that "constrains" the application of traditional optical microscopes in the nanometer world.
当显微镜的物镜视野下仅有单个荧光分子,通过特定的算法拟合,很容易超过光学分辨率极限。为探索微观世界,突破光学显微镜的光学极限的超高分辨显微技术应运而生。1981年Barak和Webb首先将单分子跟踪技术引入到生命科学中。尽管单分子的定位精确可以达到纳米级,但它并不能提高光显微镜在分辨两个或者更多点光源时的分辨率。When there is only a single fluorescent molecule in the field of view of the objective lens of the microscope, it is easy to exceed the optical resolution limit through specific algorithm fitting. In order to explore the microscopic world, ultra-high-resolution microscopy technology, which breaks through the optical limit of optical microscopes, came into being. In 1981, Barak and Webb first introduced single-molecule tracking technology into life science. Although single-molecule localization can be achieved at the nanometer level, it does not improve the resolution of light microscopy when resolving two or more point sources of light.
2002年Patterson和Lippincott-Schwartz首次利用绿色荧光蛋白(GFP)的变种(PA-GFP)观察特定蛋白质在细胞内的运动轨迹。德国Eric Bezig敏锐地认识到:应用单分子荧光成像技术,结合这种荧光蛋白的发光特性,可以突破光学分辨率的极限---光激活定位显微技术(PALM)诞生了。PALM的成像方法只能用来观察外源表达蛋白,对细胞内源蛋白却无能为力。2006年,美国霍华德-休斯研究所华裔科学家庄晓薇实验组发现:不同的波长可以控制化学荧光分子Cy5在荧光激发态和暗态之间的切换。鉴于此开发了随机光学重构显微技术(STORM)。不管是PALM还是STORM超高分辨显微镜方法,其点扩散函数成像仍然与传统显微成像一致,需要反复激活-淬灭荧光分子,所以实验大多在固定的细胞上完成。In 2002, Patterson and Lippincott-Schwartz first used a variant of green fluorescent protein (GFP) (PA-GFP) to observe the trajectory of specific proteins in cells. Germany's Eric Bezig keenly realized that the application of single-molecule fluorescence imaging technology, combined with the luminescent properties of this fluorescent protein, can break through the limit of optical resolution—photoactivated localization microscopy (PALM) was born. The imaging method of PALM can only be used to observe exogenously expressed proteins, but it is powerless for endogenous proteins in cells. In 2006, the experimental group of Xiaowei Zhuang, a Chinese scientist at the Howard Hughes Institute in the United States, discovered that different wavelengths can control the switching of the chemical fluorescent molecule Cy5 between the fluorescent excited state and the dark state. In view of this, stochastic optical reconstruction microscopy (STORM) was developed. Regardless of the PALM or STORM super-resolution microscopy method, its point spread function imaging is still consistent with traditional microscopy imaging, requiring repeated activation-quenching of fluorescent molecules, so most experiments are done on fixed cells.
2000年,德国科学家Stefan Hell提出通过物理过程来减少激发光的光斑大小,直接减少点扩散函数的半高宽来提高分辨率,成功研制了受激发射损耗显微技术(STED)。改变点扩散函数实现突破光学衍射极限的另一种方法是饱和结构照明显微技术(SSIM)。2005年,Gustafsson首先将非线性结构性光学照明部件引入到传统的显微镜上,得到了分辨率达到50nm的图像。但是现有的超高分辨技术成像速度慢,并且难以拍摄运动(特别是快速运动)的样品。In 2000, German scientist Stefan Hell proposed to reduce the spot size of the excitation light through physical processes, directly reduce the FWHM of the point spread function to improve the resolution, and successfully developed the stimulated emission depletion microscopy (STED). Another way to change the point spread function to break through the optical diffraction limit is Saturated Structured Illumination Microscopy (SSIM). In 2005, Gustafsson first introduced nonlinear structural optical illumination components to traditional microscopes, and obtained images with a resolution of 50nm. However, the existing ultra-high-resolution technology has a slow imaging speed, and it is difficult to photograph moving (especially fast-moving) samples.
发明内容Contents of the invention
本发明的其中一个目的在于提供一种用于快速运动物体的超高分辨成像装置,以解决现有技术中成像速度慢难以拍摄运动物体,特别是生物活体的技术问题。One of the objectives of the present invention is to provide a super-high-resolution imaging device for fast-moving objects, so as to solve the technical problem in the prior art that the imaging speed is slow and it is difficult to photograph moving objects, especially living organisms.
为实现上述发明目的,本发明实施例提供了一种用于快速运动物体的超高分辨成像装置,包括:In order to achieve the purpose of the above invention, an embodiment of the present invention provides a super-high-resolution imaging device for fast-moving objects, including:
常规分辨率显微成像模块,用于显示运动物体样品和超高分辨成像目标以提供该运动物体样品和超高分辨成像目标的位置和运动信息;The conventional resolution microscopic imaging module is used to display the moving object sample and the super high resolution imaging target to provide the position and motion information of the moving object sample and the super high resolution imaging target;
快速图像采集与处理模块,用于获取超高分辨成像目标的运动速度Vi、感兴趣区域ROI的运动速度Vr与位置以及成像拍摄区域Sp的尺寸,并提供给位置反馈控制模块和超高分辨成像模块;The fast image acquisition and processing module is used to obtain the moving speed V i of the super-high resolution imaging target, the moving speed V r and the position of the region of interest ROI, and the size of the imaging shooting area Sp, and provide them to the position feedback control module and the super high-resolution resolution imaging module;
位置反馈控制模块,用于调整所述成像拍摄区域Sp或者拟成像区域Si的位置,以使得拟拍摄区域Si与成像拍摄区域Sp保持重合;A position feedback control module, configured to adjust the position of the imaging shooting area Sp or the proposed imaging area Si, so that the intended shooting area Si and the imaging shooting area Sp keep overlapping;
超高分辨成像模块,用于根据超分辨成像速率要求调整成像拍摄区域Sp的尺寸,对运动物体样品上超高分辨成像目标进行超高分辨成像。The ultra-high-resolution imaging module is used to adjust the size of the imaging shooting area Sp according to the super-resolution imaging rate requirement, and perform ultra-high-resolution imaging on the ultra-high-resolution imaging target on the moving object sample.
可选地,所述位置反馈控制模块包括电控样品台以及依次设置在第一成像光路上的第一透镜、第二透镜和电控转镜,其中:Optionally, the position feedback control module includes an electronically controlled sample stage and a first lens, a second lens, and an electronically controlled rotating mirror sequentially arranged on the first imaging optical path, wherein:
第一透镜的一侧设置有电控样品台,另一侧设置有第二透镜;One side of the first lens is provided with an electronically controlled sample stage, and the other side is provided with a second lens;
所述第二透镜远离该电控样品台的一侧设置所述电控转镜。The electric control rotating mirror is arranged on the side of the second lens away from the electric control sample stage.
可选地,通过设置所述第一透镜与所述第二透镜的位置以使电控转镜与常规分辨率显微成像模块中的成像物镜入瞳成共轭关系。Optionally, by setting the positions of the first lens and the second lens, the electronically controlled rotating mirror is in a conjugate relationship with the entrance pupil of the imaging objective lens in the conventional resolution microscopic imaging module.
可选地,所述快速图像采集与处理模块包括快速图像采集设备和计算设备,其中:Optionally, the fast image acquisition and processing module includes a fast image acquisition device and a computing device, wherein:
所述快速图像采集设备,用于采集运动物体样品和超高分辨成像目标以提供该运动物体样品和超高分辨成像目标的位置和运动信息;The fast image acquisition device is used to collect moving object samples and super-high-resolution imaging targets to provide position and motion information of the moving object samples and super-high-resolution imaging targets;
所述计算设备,用于根据运动物体样品和超高分辨成像目标的位置和运动信息以获取超高分辨成像目标的运动速度Vi、感兴趣区域ROI的运动速度Vr与位置以及成像拍摄区域Sp的尺寸。The computing device is used to obtain the moving velocity V i of the super-high-resolution imaging target, the moving velocity V r and the position of the region of interest ROI and the imaging shooting area according to the position and motion information of the moving object sample and the super-high-resolution imaging target The size of Sp.
可选地,所述快速图像采集设备采用图像传感器或者位置敏感探测器。Optionally, the fast image acquisition device uses an image sensor or a position sensitive detector.
可选地,所述计算设备根据以下公式获取成像帧频fs:Optionally, the computing device obtains the imaging frame rate f s according to the following formula:
|Vr-Vi|/PPIs≤fs。|V r −V i |/PPI s ≤ f s .
可选地,所述常规分辨率显微成像模块包括:照明单元和成像单元:Optionally, the conventional resolution microscopic imaging module includes: an illumination unit and an imaging unit:
所述照明单元包括依次设置在第二成像光路上的照明设备、第三透镜和聚光镜;所述第三透镜的一侧设置有所述照明设备,另一侧设置有所述聚光镜;在所述聚光镜的远离照明设备的一侧设置有电控样品台;The illumination unit includes an illumination device, a third lens, and a condenser lens arranged sequentially on the second imaging optical path; one side of the third lens is provided with the illumination device, and the other side is provided with the condenser lens; The side of the condenser far away from the lighting equipment is provided with an electronically controlled sample stage;
所述成像单元包括依次设置在第二成像光路上的成像物镜、分光器和第三成像光路上的成像透镜、滤光镜;所述成像物镜的一侧设置有电控样品台,另一侧设置有所述分光器;所述分光器改变第二成像光路上的光线形成第三成像光路;所述成像透镜设置在所述分光器的一侧,另一侧设置有所述滤光镜。The imaging unit includes an imaging objective lens, a beam splitter, and an imaging lens and a filter mirror arranged on the second imaging optical path in sequence; one side of the imaging objective lens is provided with an electronically controlled sample stage, and the other side The optical splitter is provided; the optical splitter changes the light on the second imaging optical path to form a third imaging optical path; the imaging lens is arranged on one side of the optical splitter, and the optical filter is arranged on the other side.
本发明实施例通过获取运动物体样品感兴趣区域以及超高分辨成像目标的位置与运动速度,并结合超高分辨成像模块的分辨率确定超分辨成像速率,以此为根据调整成像拍摄区域的面积,保证超高分辨成像速率;通过调整成像拍摄区域的位置或样品上拟拍摄区域的位置,以使成像拍摄区域与样品上拟拍摄区域的位置保持重合,从而消除运动物体样品的运动对超高分辨成像的影响。本发明可以快速、自动地对快速运动物体进行超高分辨成像,也可以自动分析运动物体的形态结构,尤其适用于精子细胞、活体组织等各种运动对象的快速超高分辨成像。In the embodiment of the present invention, the super-resolution imaging rate is determined by acquiring the region of interest of the moving object sample and the position and moving speed of the super-resolution imaging target, and combining the resolution of the super-resolution imaging module, and adjusting the area of the imaging shooting area based on this , to ensure the ultra-high resolution imaging rate; by adjusting the position of the imaging shooting area or the position of the intended shooting area on the sample, so that the imaging shooting area and the position of the intended shooting area on the sample keep coincident, thereby eliminating the impact of the movement of the moving object sample on the super high Resolve the effects of imaging. The invention can quickly and automatically perform ultra-high-resolution imaging on fast-moving objects, and can also automatically analyze the morphological structure of the moving objects, and is especially suitable for rapid ultra-high-resolution imaging of various moving objects such as sperm cells and living tissues.
附图说明Description of drawings
通过参考附图会更加清楚的理解本发明的特征和优点,附图是示意性的而不应理解为对本发明进行任何限制,在附图中:The features and advantages of the present invention will be more clearly understood by referring to the accompanying drawings, which are schematic and should not be construed as limiting the invention in any way. In the accompanying drawings:
图1是本发明一实施例提供的一种用于快速运动物体的超高分辨成像方法的流程示意图;Fig. 1 is a schematic flow chart of a super-high-resolution imaging method for fast-moving objects provided by an embodiment of the present invention;
图2是本发明一实施例提供的一种用于快速运动物体的超高分辨成像装置结构示意图;Fig. 2 is a schematic structural diagram of a super-high-resolution imaging device for fast-moving objects provided by an embodiment of the present invention;
图3是本发明一实施例中调整成像拍摄区域与拟拍摄区域调整重合过程示意图。FIG. 3 is a schematic diagram of the process of adjusting the overlapping of the imaging shooting area and the intended shooting area in an embodiment of the present invention.
具体实施方式detailed description
下面结合附图和实施例,对本发明的具体实施方式作进一步详细描述。以下实施例用于说明本发明,但不用来限制本发明的范围。The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.
第一方面,本发明实施例提供了一种用于快速运动物体的超高分辨成像方法,如图1所示,包括:In the first aspect, an embodiment of the present invention provides a super-resolution imaging method for fast-moving objects, as shown in FIG. 1 , including:
根据运动物体样品上超高分辨成像目标的位置设置包含所述超高分辨成像目标的感兴趣区域ROI;Setting a region of interest ROI containing the super-resolution imaging target according to the position of the super-resolution imaging target on the moving object sample;
获取所述超高分辨成像目标的运动速度Vi和所述感兴趣区域ROI的运动速度Vr与位置;Acquiring the motion velocity V i of the super-high resolution imaging target and the motion velocity V r and position of the region of interest ROI;
根据超高分辨成像模块的分辨率PPIs、所述感兴趣区域ROI的运动速度Vr以及所述超高分辨成像目标的运动速度Vi获取所述超高分辨成像模块的成像帧频fs;Obtain the imaging frame rate f s of the ultra-high resolution imaging module according to the resolution PPI s of the ultra-high resolution imaging module, the motion velocity V r of the region of interest ROI, and the motion speed V i of the ultra-high resolution imaging target ;
根据所述成像帧频fs与成像拍摄区域Sp的关系计算所述成像拍摄区域Sp的尺寸;定义一包含超分辨成像目标的拟拍摄区域Si,所述拟拍摄区域Si的尺寸与所述成像拍摄区域Sp的尺寸相同,且具有相同的运动速度Vr;Calculate the size of the imaging shooting area Sp according to the relationship between the imaging frame rate f s and the imaging shooting area Sp; define a proposed shooting area Si that includes a super-resolution imaging target, and the size of the intended shooting area Si is related to the imaging The shooting areas Sp have the same size and have the same moving speed V r ;
调整所述拟拍摄区域Si或者所述成像拍摄区域Sp的位置,以使所述拟拍摄区域Si与所述成像拍摄区域Sp保持重合;并根据所述拟拍摄区域Si对运动物体样品上超高分辨成像目标进行超高分辨成像。Adjust the position of the intended shooting area Si or the imaging shooting area Sp so that the intended shooting area Si and the imaging shooting area Sp keep overlapping; Resolve imaging targets for super-resolution imaging.
本发明实施例通过获取运动物体样品以及超高分辨成像目标的位置与运动速度,并结合超高分辨成像模块的分辨率获取成像拍摄区域的面积,保证超高分辨成像速率;通过调整成像拍摄区域或者样品的位置以使与成像拍摄区域拟拍摄区域的位置保持重合,从而消除运动物体样品的运动对超高分辨成像的影响。本发明可以快速、自动地对运动物体进行超高分辨成像,也可以自动分析运动物体的形态结构,尤其适用于精子细胞、活体组织等各种运动对象的快速超高分辨成像。In the embodiment of the present invention, the area of the imaging shooting area is obtained by obtaining the position and moving speed of the moving object sample and the ultra-high-resolution imaging target in combination with the resolution of the ultra-high-resolution imaging module, so as to ensure the ultra-high-resolution imaging rate; by adjusting the imaging shooting area Or the position of the sample is kept coincident with the position of the intended shooting area of the imaging shooting area, so as to eliminate the influence of the movement of the moving object sample on the super-resolution imaging. The invention can quickly and automatically perform ultra-high-resolution imaging on moving objects, and can also automatically analyze the morphological structure of the moving objects, and is especially suitable for rapid ultra-high-resolution imaging of various moving objects such as sperm cells and living tissues.
可选地,根据超高分辨成像模块的分辨率PPIs、所述感兴趣区域ROI的运动速度Vr以及所述超高分辨成像目标的运动速度Vi获取所述超高分辨成像模块的成像帧频fs的步骤中采用以下公式获取成像帧频fs:Optionally, the imaging of the super-high-resolution imaging module is acquired according to the resolution PPI s of the super-high-resolution imaging module, the moving velocity V r of the region of interest ROI, and the moving velocity V i of the super-high-resolution imaging target In the step of frame frequency f s , the following formula is used to obtain the imaging frame frequency f s :
|Vr-Vi|/PPIs≤fs。|V r −V i |/PPI s ≤ f s .
可选地,获取所述超高分辨成像目标的运动速度Vi和感兴趣区域ROI的运动速度Vr与位置通过以下方式获取:Optionally, acquiring the motion velocity V i of the super-high resolution imaging target and the motion velocity V r and the position of the region of interest ROI are acquired in the following manner:
获取至少两张图像中的运动物体样品和超高分辨成像目标的位置;Obtain the positions of moving object samples and super-resolution imaging targets in at least two images;
在预设时间内分别采集感兴趣区域ROI的至少两张图像;Acquiring at least two images of the ROI of the region of interest within a preset time;
对比至少两张图像中运动物体样品和超高分辨成像目标的位置,以获取运动物体样品和超高分辨成像目标的位移;Comparing the positions of the moving object sample and the super-high-resolution imaging target in at least two images to obtain the displacement of the moving object sample and the super-high-resolution imaging target;
根据运动物体样品和超高分辨成像目标的位移以及成像帧频获取所述感兴趣区域ROI的运动速度Vr以及所述超高分辨成像目标的运动速度Vi。The motion velocity V r of the region of interest ROI and the motion velocity V i of the super-resolution imaging target are acquired according to the displacement of the moving object sample and the super-resolution imaging target and the imaging frame rate.
可选地,获取感兴趣区域ROI的运动速度Vr与位置通过以下方式获取:Optionally, the motion velocity V r and position of the region of interest ROI are acquired in the following manner:
在感兴趣区域ROI内选定一个与能够代表其运动特征的第一代表点,在超高分辨成像目标上选定一个能够代表其运动特征的第二代表点;Select a first representative point that can represent its motion characteristics in the region of interest ROI, and select a second representative point that can represent its motion characteristics on the super-high resolution imaging target;
在不同的时刻分别采集第一代表点与第二代表点的光强;collecting the light intensities of the first representative point and the second representative point respectively at different times;
对比分析第一代表点与所述第二代表点的光强随时间的变化关系,以获取运动物体样品感兴趣区域ROI和超高分辨成像目标的位移和速度。Comparatively analyze the relationship between the light intensity of the first representative point and the second representative point over time, so as to obtain the ROI of the region of interest of the moving object sample and the displacement and velocity of the super-resolution imaging target.
实际应用中,本发明也可以通过位置探测器获取该点的运动速度与位置。In practical application, the present invention can also obtain the motion speed and position of the point through the position detector.
可选地,拟拍摄区域Si与成像拍摄区域Sp保持重合采用以下方法实现:Optionally, keeping the intended shooting area Si and the imaging shooting area Sp coincident can be achieved by the following methods:
根据感兴趣区域ROI的运动速度Vr调整成像拍摄区域Sp的位置,使成像拍摄区域Sp的运动与感兴趣区域ROI运动方向相同、速度大小相等。The position of the imaging shooting region Sp is adjusted according to the moving speed V r of the region of interest ROI, so that the movement direction of the imaging shooting region Sp is the same as that of the region of interest ROI, and the speed is equal.
或者,or,
成像拍摄区域Sp保持不变,根据感兴趣区域ROI的运动速度Vr调整样品池,以使样品产生与感兴趣区域ROI运动方向相反、速度大小相等的运动速度-Vr。The imaging shooting area Sp remains unchanged, and the sample cell is adjusted according to the moving speed V r of the region of interest ROI, so that the sample produces a moving speed -V r that is opposite to and equal to the moving direction of the ROI of the region of interest.
为体现本发明实施例提供的一种用于快速运动物体的超高分辨成像方法的优越性,本发明实施例还提供了一种用于快速运动物体的超高分辨成像方装置,如图2所示,包括:In order to reflect the superiority of a super-high-resolution imaging method for fast-moving objects provided by the embodiment of the present invention, the embodiment of the present invention also provides a super-high-resolution imaging device for fast-moving objects, as shown in Figure 2 shown, including:
常规分辨率显微成像模块10,用于显示运动物体样品和超高分辨成像目标以提供该运动物体样品和超高分辨成像目标的位置和运动信息;The conventional resolution microscopic imaging module 10 is used to display the moving object sample and the super high resolution imaging target to provide the position and motion information of the moving object sample and the super high resolution imaging target;
快速图像采集与处理模块20,用于获取运动物体样品的运动速度V、超高分辨成像目标的运动速度Vi、拟拍摄区域Si的运动速度Vr与位置以及成像拍摄区域Sp的尺寸,并提供给位置反馈控制模块40和超高分辨成像模块30;The fast image acquisition and processing module 20 is used to obtain the moving velocity V of the moving object sample, the moving velocity V i of the ultra-high-resolution imaging target, the moving velocity V r and the position of the intended shooting area Si, and the size of the imaging shooting area Sp, and Provided to the position feedback control module 40 and the super-resolution imaging module 30;
位置反馈控制模块40,用于调整所述成像拍摄区域Sp或者拟成像区域Si的位置,以使得拟拍摄区域Si与成像拍摄区域Sp保持重合;A position feedback control module 40, configured to adjust the position of the imaging shooting area Sp or the proposed imaging area Si, so that the intended shooting area Si and the imaging shooting area Sp keep overlapping;
超高分辨成像模块30,用于根据超分辨成像速率要求调整成像拍摄区域Sp的尺寸,对运动物体样品上超高分辨成像目标进行超高分辨成像。The ultra-high-resolution imaging module 30 is configured to adjust the size of the imaging shooting area Sp according to the super-resolution imaging rate requirement, and perform ultra-high-resolution imaging on the ultra-high-resolution imaging target on the moving object sample.
作为一种常规分辨率显微成像模块10的具体示例,如图2所示,本发明实施例提供的常规分辨率显微成像模块10包括照明单元和成像单元。照明单元包括依次设置在第二成像光路上的照明设备101、第三透镜102和聚光镜103,其中,第三透镜102的一侧设置有照明设备101,另一侧设置有聚光镜103;在该聚光镜103的远离照明设备101的一侧设置有电控样品台104。成像单元包括依次设置在第二成像光路上的成像物镜105、分光器106和第三成像光路上的成像透镜107、滤光镜108;成像物镜105的一侧设置有电控样品台104,另一侧设置有分光器106;106分光器改变第二成像光路上的光线形成第三成像光路;成像透镜107设置在分光器106的一侧,另一侧设置有滤光镜108。As a specific example of a conventional resolution microscopic imaging module 10 , as shown in FIG. 2 , the conventional resolution microscopic imaging module 10 provided by the embodiment of the present invention includes an illumination unit and an imaging unit. The illuminating unit comprises an illuminating device 101, a third lens 102 and a condenser lens 103 which are sequentially arranged on the second imaging optical path, wherein the illuminating device 101 is arranged on one side of the third lens 102, and the condenser lens 103 is arranged on the other side; An electrically controlled sample stage 104 is provided on the side of 103 away from the lighting device 101 . The imaging unit includes an imaging objective lens 105, a beam splitter 106, and an imaging lens 107 and a filter lens 108 arranged on the second imaging optical path in turn; one side of the imaging objective lens 105 is provided with an electronically controlled sample stage 104, and the other A beam splitter 106 is set on one side; the beam splitter 106 changes the light on the second imaging optical path to form a third imaging optical path; the imaging lens 107 is set on one side of the beam splitter 106, and a filter 108 is set on the other side.
实际应用中,本领域技术人员可以根据具体的使用场景,选择合适参数的常规分辨率显微成像模块以实现显示快速运动物体样品和超高分辨成像目标,本发明不作限定。In practical applications, those skilled in the art can select a conventional resolution microscopic imaging module with appropriate parameters according to specific usage scenarios to realize the display of fast-moving object samples and super-high-resolution imaging targets, which is not limited by the present invention.
作为一种快速图像采集与处理模块20的具体示例,如图2所示,本发明实施例提供的快速图像采集与处理模块20包括快速图像采集设备201和计算设备202,其中:As a specific example of a fast image acquisition and processing module 20, as shown in FIG. 2, the fast image acquisition and processing module 20 provided by the embodiment of the present invention includes a fast image acquisition device 201 and a computing device 202, wherein:
快速图像采集设备201,用于采集运动物体样品和超高分辨成像目标以提供该运动物体样品和超高分辨成像目标的位置和运动信息;The fast image acquisition device 201 is used to acquire the moving object sample and the super high resolution imaging target to provide the position and motion information of the moving object sample and the super high resolution imaging target;
计算设备202,用于根据运动物体样品和超高分辨成像目标的位置和运动信息以获取运动物体样品的运动速度V、超高分辨成像目标的运动速度Vi、拟拍摄区域Si的运动速度Vr与位置以及成像拍摄区域Sp的尺寸。The computing device 202 is used to obtain the moving velocity V of the moving object sample, the moving velocity V i of the super-high resolution imaging target, and the moving velocity V of the area Si to be photographed according to the position and movement information of the moving object sample and the super-high resolution imaging target r is related to the position and the size of the imaging shooting area Sp.
实际应用中,快速图像采集设备201可以采用例如电荷耦合元件(Charge-coupledDevice,CCD)或者互补金属氧化物半导体(Complementary Metal Oxide Semiconductor,CMOS)等图像传感器,亦可使用位置敏感探测器等,本领域技术人员可以根据具体的使用场景选择,本发明不作限定。In practical applications, the fast image acquisition device 201 may use an image sensor such as a charge-coupled device (Charge-coupled Device, CCD) or a complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor, CMOS), or a position-sensitive detector. Those skilled in the art can choose according to the specific usage scenario, which is not limited in the present invention.
实际应用中,计算设备202根据至少两张图像中的背景噪声、运动物体样品A形态结构、运动物体样品A与背景的相似性等,采取不同的背景建模、目标识别、轨迹生成等技术计算运动速度,本领域技术人员可以根据具体的使用场景选择合适的处理方法。In practical applications, the computing device 202 adopts different background modeling, target recognition, trajectory generation and other technologies to calculate For the speed of motion, those skilled in the art can select an appropriate processing method according to a specific usage scenario.
作为一种位置反馈控制模块40的具体示例,如图2所示,本发明实施例提供的位置反馈控制模块40包括依次设置在第一成像光路上的第一透镜403、第二透镜402和电控转镜401,其中:As a specific example of a position feedback control module 40, as shown in FIG. 2, the position feedback control module 40 provided by the embodiment of the present invention includes a first lens 403, a second lens 402 and an electric Control rotating mirror 401, wherein:
第一透镜403的一侧设置有电控样品台104,另一侧设置有第二透镜402;One side of the first lens 403 is provided with an electronically controlled sample stage 104, and the other side is provided with a second lens 402;
第二透镜402远离该电控样品台104的一侧设置电控转镜401。The side of the second lens 402 away from the electronically controlled sample stage 104 is provided with an electronically controlled rotating mirror 401 .
本发明实施例中,通过调整第一透镜403与第二透镜402的位置,使电控转镜401与成像物镜105的入瞳成共轭关系。及时调整电控转镜401使成像拍摄区域Sp在运动物体样品上快速移动,以使成像拍摄区域Sp与拟拍摄区域Si始终保持重合,从而消除运动物体样品的运动对超高分辨成像的影响。本发明实施例中也可以通过控制电控样品台快速改变拟拍摄区域Si的位置,从而达到成像拍摄区域Sp与拟拍摄区域Si位置重合的目的。本领域技术人员可以根据具体场合进行选择,本发明不作限定。In the embodiment of the present invention, by adjusting the positions of the first lens 403 and the second lens 402 , the electrically controlled rotating mirror 401 is in a conjugate relationship with the entrance pupil of the imaging objective lens 105 . Adjust the electronically controlled rotating mirror 401 in time to make the imaging shooting area Sp move rapidly on the moving object sample, so that the imaging shooting area Sp and the intended shooting area Si always keep coincident, thereby eliminating the influence of the movement of the moving object sample on super-resolution imaging. In the embodiment of the present invention, it is also possible to quickly change the position of the intended imaging area Si by controlling the electronically controlled sample stage, so as to achieve the purpose of overlapping the positions of the imaging imaging area Sp and the intended imaging area Si. Those skilled in the art can make selections according to specific occasions, which are not limited in the present invention.
作为一种超高分辨成像模块30的具体示例,如图2所示,本发明实施例提供的超高分辨成像模块30与位置反馈控制模块40相连接,通过调整电控转镜401的角度以调整第一成像光路改变超高分辨成像模块30的成像拍摄区域Sp;同时,还与计算设备202连接,接收来自计算设备202所传输的成像帧频fs,根据该成像帧频fs对拟成像拍摄区域Si进行超高分辨成像,从而可以拍摄运动物体样品移动过程中的清晰图像。As a specific example of a super-resolution imaging module 30, as shown in FIG. Adjust the first imaging optical path to change the imaging shooting area Sp of the super-high-resolution imaging module 30; meanwhile, it is also connected to the computing device 202 to receive the imaging frame rate f s transmitted from the computing device 202, and simulate the imaging frame rate f s according to the imaging frame rate f s The imaging shooting area Si performs ultra-high resolution imaging, so that clear images of moving objects and samples can be taken during the movement process.
实际应用中,超高分辨成像模块30可以从例如采用光激活定位显微技术(PALM)、随机光学重构显微技术(STORM)或者结构光照明显微技术(SIM)的设备,也可采用激光扫描光聚焦、双(多)光子荧光显微成像等高分辨成像设备,本领域技术人员可以根据具体的使用场景进行选择,本发明不作限定。In practical applications, the ultra-high-resolution imaging module 30 can be obtained from devices such as photoactivated localization microscopy (PALM), stochastic optical reconstruction microscopy (STORM) or structured illumination microscopy (SIM). High-resolution imaging equipment such as laser scanning light focusing, two (multi) photon fluorescence microscopy imaging, etc., can be selected by those skilled in the art according to specific usage scenarios, which are not limited by the present invention.
下面介绍本发明实施例提供的一种用于快速运动物体的超高分辨成像装置的工作过程。The working process of a super-high-resolution imaging device for a fast-moving object provided by an embodiment of the present invention is described below.
如图3所示,将运动物体样品A放置在样品台104中的样品池中。As shown in FIG. 3 , the moving object sample A is placed in the sample cell in the sample stage 104 .
照明设备101所发出的光线经过第三透镜102和聚光镜103后投射在样品池底部。运动物体样品A以及超高分辨成像目标B1、B2和B3所形成的图像经过成像物镜105以及分光器106后,再经过成像透镜107和滤光镜108后传输到快速图像采集设备201。The light emitted by the illuminating device 101 passes through the third lens 102 and the condenser lens 103 and then projects on the bottom of the sample pool. The images formed by the moving object sample A and the ultra-high resolution imaging targets B1, B2 and B3 pass through the imaging objective lens 105 and the beam splitter 106, then pass through the imaging lens 107 and the filter 108, and then are transmitted to the fast image acquisition device 201.
该快速图像采集设备201快速采集至少两张图像并传输到计算设备202,由该计算设备202根据运动物体样品上超高分辨成像目标B1、B2和B3的位置设置包含超高分辨成像目标B1、B2和B3的感兴趣区域ROI,并进行标定。The fast image acquisition device 201 quickly collects at least two images and transmits them to the computing device 202, and the computing device 202 includes super-resolution imaging targets B1, B2 and B3 according to the positions of the super-resolution imaging targets B1, B2 and B3 on the moving object sample. ROI of B2 and B3, and perform calibration.
该计算设备202获取至少两张图像中的运动物体样品和超高分辨成像目标的位置;分别对比至少两张图像中的运动物体样品和超高分辨成像目标的位置,以获取运动物体样品和超高分辨成像目标的位移;根据运动物体样品和超高分辨成像目标的位移以及获取至少两张图像时的成像帧频fs获取运动物体样品A的运动速度V、感兴趣区域ROI的运动速度Vr以及超高分辨成像目标的运动速度Vi。其中,成像帧频fs与运动物体样品A的运动速度V、拟拍摄区域Si的运动速度Vr、超高分辨成像目标的运动速度Vi和超高分辨成像模块的分辨率PPIs需要满足以下条件:The computing device 202 acquires the positions of the moving object sample and the super-high resolution imaging target in at least two images; respectively compares the positions of the moving object sample and the super high resolution imaging target in the at least two images to obtain the moving object sample and the super high resolution imaging target. The displacement of the high-resolution imaging target; according to the displacement of the moving object sample and the ultra-high resolution imaging target and the imaging frame rate f s when at least two images are acquired, the moving speed V of the moving object sample A and the moving speed V of the ROI of the region of interest are obtained r and the moving velocity V i of the ultra-high resolution imaging target. Among them, the imaging frame frequency f s and the moving speed V of the moving object sample A, the moving speed V r of the area Si to be photographed, the moving speed V i of the ultra-high resolution imaging target, and the resolution PPI s of the ultra-high resolution imaging module need to meet The following conditions:
|Vr-Vi|/fs≤PPIs |V r -V i |/f s ≤ PPI s
计算设备202根据上述公式获取成像速率并传输给超高分辨成像模块30,并根据获取运动物体样品A的运动速度V、拟拍摄区域Si的运动速度Vr、超高分辨成像目标的运动速度Vi获取电控转镜401的角度传输给位置反馈控制模块40。The computing device 202 obtains the imaging rate according to the above formula and transmits it to the super-high resolution imaging module 30, and obtains the moving speed V of the moving object sample A, the moving speed V r of the area Si to be photographed, and the moving speed V of the super-high resolution imaging target i Obtain the angle of the electronically controlled rotating mirror 401 and transmit it to the position feedback control module 40 .
位置反馈控制模块40根据所接收到的角度信息调整电控转镜401的角度,以及时调整电控转镜401使成像拍摄区域Sp在运动物体样品上快速移动,以使成像拍摄区域Sp与拟拍摄区域Si始终保持重合。The position feedback control module 40 adjusts the angle of the electronically controlled rotating mirror 401 according to the received angle information, and adjusts the electrically controlled rotating mirror 401 in time to make the imaging shooting area Sp move rapidly on the moving object sample, so that the imaging shooting area Sp is in line with the virtual object. The shooting areas Si always keep coincident.
本发明实施例中还可以通过将位置信息传输给电控样品台104调整样品的位置,使成像拍摄区域Sp与拟拍摄区域Si保持重合,从而消除拟拍摄区域Si的运动速度Vr的影响。In the embodiment of the present invention, the position of the sample can also be adjusted by transmitting the position information to the electronically controlled sample stage 104, so that the imaging shooting area Sp and the intended shooting area Si keep overlapping, thereby eliminating the influence of the moving speed V r of the intended shooting area Si.
高分辨成像模块30的成像速率通常与其成像拍摄区域Sp的尺寸大小相关;在分辨率不变时,成像拍摄区域Sp越大,成像帧频fs越小。超高分辨成像模块30根据超高分辨成像模块的分辨率PPIs、拟拍摄区域Si的运动速度Vr以及超高分辨成像目标的运动速度Vi获取超高分辨成像模块的成像帧频fs以及成像拍摄区域Sp,进而减小或者消除(Vi-Vr)的影响。然后高分辨成像模块30根据成像拍摄区域Sp的尺寸对运动物体样品A上超高分辨成像目标进行超高分辨成像。The imaging rate of the high-resolution imaging module 30 is usually related to the size of its imaging area Sp; when the resolution is constant, the larger the imaging area Sp is, the smaller the imaging frame rate f s is. The ultra-high-resolution imaging module 30 acquires the imaging frame rate f s of the ultra-high-resolution imaging module according to the resolution PPI s of the ultra-high-resolution imaging module, the motion velocity V r of the area Si to be photographed, and the motion velocity V i of the ultra-high-resolution imaging target And imaging the shooting area Sp, thereby reducing or eliminating the influence of (V i -V r ). Then the high-resolution imaging module 30 performs super-resolution imaging on the super-resolution imaging target on the moving object sample A according to the size of the imaging shooting area Sp.
综上所述,本发明实施例提供的用于快速运动物体的超高分辨成像装置,通过获取运动物体样品以及超高分辨成像目标的位置与运动速度,并结合超高分辨成像模块的分辨率获取成像拍摄区域的面积,保证超高分辨成像速率;通过调整成像拍摄区域的位置以使与样品上拟拍摄区域的位置保持重合,从而消除运动物体样品的运动对超高分辨成像的影响。本发明可以快速、自动地对运动物体进行超高分辨成像,也可以自动分析运动物体的形态结构,尤其适用于精子细胞、活体组织等各种运动对象的快速超高分辨成像。To sum up, the ultra-high-resolution imaging device for fast-moving objects provided by the embodiment of the present invention obtains the position and moving speed of the moving object sample and the ultra-high-resolution imaging target, and combines the resolution of the ultra-high-resolution imaging module Obtain the area of the imaging shooting area to ensure the super-high resolution imaging rate; adjust the position of the imaging shooting area to keep coincident with the position of the intended shooting area on the sample, thereby eliminating the influence of the movement of the moving object sample on the super-high resolution imaging. The invention can quickly and automatically perform ultra-high-resolution imaging on moving objects, and can also automatically analyze the morphological structure of the moving objects, and is especially suitable for rapid ultra-high-resolution imaging of various moving objects such as sperm cells and living tissues.
还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。It should also be noted that in this article, relational terms such as first and second etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or operations Any such actual relationship or order exists between. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device.
虽然结合附图描述了本发明的实施方式,但是本领域技术人员可以在不脱离本发明的精神和范围的情况下做出各种修改和变型,这样的修改和变型均落入由所附权利要求所限定的范围之内。Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention. within the bounds of the requirements.
Claims (7)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510727726.XA CN105301794B (en) | 2015-10-30 | 2015-10-30 | Super-resolution imaging device for fast moving objects |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510727726.XA CN105301794B (en) | 2015-10-30 | 2015-10-30 | Super-resolution imaging device for fast moving objects |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105301794A CN105301794A (en) | 2016-02-03 |
CN105301794B true CN105301794B (en) | 2017-08-25 |
Family
ID=55199243
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510727726.XA Active CN105301794B (en) | 2015-10-30 | 2015-10-30 | Super-resolution imaging device for fast moving objects |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105301794B (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003222801A (en) * | 2002-01-29 | 2003-08-08 | Olympus Optical Co Ltd | Microscopic image photographing device |
CN1975782A (en) * | 2005-11-30 | 2007-06-06 | 汤姆逊许可公司 | Method of emendation for attention trajectory in video content analysis |
EP1936422A1 (en) * | 2005-10-13 | 2008-06-25 | Nikon Corporation | Microscope |
CN102216827A (en) * | 2008-09-13 | 2011-10-12 | 独立行政法人科学技术振兴机构 | Microscope device and fluorescent observing method using same |
CN102687061A (en) * | 2009-10-19 | 2012-09-19 | 文塔纳医疗系统公司 | Imaging system and techniques |
WO2014127372A2 (en) * | 2013-02-18 | 2014-08-21 | Theranos, Inc. | Image analysis and measurement of biological samples |
-
2015
- 2015-10-30 CN CN201510727726.XA patent/CN105301794B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003222801A (en) * | 2002-01-29 | 2003-08-08 | Olympus Optical Co Ltd | Microscopic image photographing device |
EP1936422A1 (en) * | 2005-10-13 | 2008-06-25 | Nikon Corporation | Microscope |
CN1975782A (en) * | 2005-11-30 | 2007-06-06 | 汤姆逊许可公司 | Method of emendation for attention trajectory in video content analysis |
CN102216827A (en) * | 2008-09-13 | 2011-10-12 | 独立行政法人科学技术振兴机构 | Microscope device and fluorescent observing method using same |
CN102687061A (en) * | 2009-10-19 | 2012-09-19 | 文塔纳医疗系统公司 | Imaging system and techniques |
WO2014127372A2 (en) * | 2013-02-18 | 2014-08-21 | Theranos, Inc. | Image analysis and measurement of biological samples |
Non-Patent Citations (1)
Title |
---|
Recent Advances in Super-Resolution Fluorescence Imaging and Its Applications in Biology;Rongcheng Han,et al;《Journal of Genetics and Genomics》;20131123;第40卷(第12期);第583-595页 * |
Also Published As
Publication number | Publication date |
---|---|
CN105301794A (en) | 2016-02-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10352860B2 (en) | Super resolution microscopy | |
US10429628B2 (en) | Multifocal method and apparatus for stabilization of optical systems | |
JP6416887B2 (en) | Microscopic observation of tissue samples using structured illumination | |
JP5316161B2 (en) | Observation device | |
US20180191948A1 (en) | Single-Frame Autofocusing Using Multi-LED Illumination | |
JP6985506B2 (en) | Real-time autofocus focusing algorithm | |
EP2796917A1 (en) | A method for automated platform and/or reference object independent acquisition of positional information and localization of objects of interest in a microscope | |
US20130141561A1 (en) | Method of analyzing linearity of shot image, image obtaining method, and image obtaining apparatus | |
JP2015127738A (en) | Microscope system and control method | |
CN105319725B (en) | Super-resolution imaging method for fast moving objects | |
Ghezzi et al. | Computational based time-resolved multispectral fluorescence microscopy | |
CN109884052B (en) | Subtraction type harmonic microscopic imaging method based on CCD detection | |
JP6161399B2 (en) | Microscope system | |
CN116224560A (en) | Single-galvanometer scanning light field imaging system and method | |
JP5471715B2 (en) | Focusing device, focusing method, focusing program, and microscope | |
CN105301794B (en) | Super-resolution imaging device for fast moving objects | |
US10475198B2 (en) | Microscope system and specimen observation method | |
JP2005031664A (en) | Operating method of laser scanning microscope | |
US11256078B2 (en) | Continuous scanning for localization microscopy | |
CN211718616U (en) | Simple fluorescence microscope | |
JP6945737B2 (en) | Dual processor image processing | |
RU167351U1 (en) | Cathodoluminescence detector for scanning electron microscope | |
van den Broek et al. | A multifocal two-photon microscopy setup for parallel 3D tracking of gold nanorods | |
Hui et al. | Deep Learning-Enabled Transformation of Scanning Superlens Microscopy Images into Scanning Electron Microscopy-like Large Depth-of-Field Images | |
Nakatani et al. | BPS2025-Simplified whole-cell single-molecule super-resolution imaging in 3D with long axial-range double-helix point spread functions |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240115 Address after: Room 5051 and 5053, No. 101 West Fourth Ring South Road, Fengtai District, Beijing, 100071 (Park) Patentee after: Beijing Dahua Sanxin Technology Development Co.,Ltd. Address before: No. 2, No. 1, Beichen West Road, Beichen, Beijing Patentee before: INSTITUTE OF GENETICS AND DEVELOPMENTAL BIOLOGY, CHINESE ACADEMY OF SCIENCES |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20241218 Address after: Room 607-2, 5th Floor, Building 6, No. 26 Yongwang West Road, Daxing District, Beijing, 102609 (Cluster Registration) Patentee after: Beijing Jingzhe Biotechnology Co.,Ltd. Country or region after: China Address before: Room 5051 and 5053, No. 101 West Fourth Ring South Road, Fengtai District, Beijing, 100071 (Park) Patentee before: Beijing Dahua Sanxin Technology Development Co.,Ltd. Country or region before: China |
|
TR01 | Transfer of patent right |