CN115953319A - Fluorescent molecular space and angle distribution reconstruction method based on generalized Richardson-Lucy algorithm - Google Patents
Fluorescent molecular space and angle distribution reconstruction method based on generalized Richardson-Lucy algorithm Download PDFInfo
- Publication number
- CN115953319A CN115953319A CN202310013256.5A CN202310013256A CN115953319A CN 115953319 A CN115953319 A CN 115953319A CN 202310013256 A CN202310013256 A CN 202310013256A CN 115953319 A CN115953319 A CN 115953319A
- Authority
- CN
- China
- Prior art keywords
- spatial
- angular distribution
- viewing angle
- biological sample
- fluorescent molecules
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000004422 calculation algorithm Methods 0.000 title claims abstract description 32
- 230000005284 excitation Effects 0.000 claims abstract description 46
- 238000004364 calculation method Methods 0.000 claims abstract description 10
- 239000012472 biological sample Substances 0.000 claims description 38
- 230000010287 polarization Effects 0.000 claims description 36
- 230000004044 response Effects 0.000 claims description 8
- 238000003384 imaging method Methods 0.000 claims description 7
- 239000011159 matrix material Substances 0.000 claims description 5
- 230000009466 transformation Effects 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 3
- 238000004088 simulation Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 claims description 2
- 238000012804 iterative process Methods 0.000 claims description 2
- 238000013507 mapping Methods 0.000 claims description 2
- 238000010606 normalization Methods 0.000 claims description 2
- 238000000799 fluorescence microscopy Methods 0.000 abstract description 11
- 230000008569 process Effects 0.000 abstract description 7
- 230000001629 suppression Effects 0.000 abstract 1
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 8
- 239000000523 sample Substances 0.000 description 7
- 230000006872 improvement Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000000354 decomposition reaction Methods 0.000 description 3
- 102000034287 fluorescent proteins Human genes 0.000 description 3
- 108091006047 fluorescent proteins Proteins 0.000 description 3
- 239000012528 membrane Substances 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 2
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 2
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 2
- 238000001506 fluorescence spectroscopy Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 108090000623 proteins and genes Proteins 0.000 description 2
- 102000004169 proteins and genes Human genes 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 238000007476 Maximum Likelihood Methods 0.000 description 1
- 239000000654 additive Substances 0.000 description 1
- 230000000996 additive effect Effects 0.000 description 1
- 238000002306 biochemical method Methods 0.000 description 1
- 238000005460 biophysical method Methods 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000001678 irradiating effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 239000002691 unilamellar liposome Substances 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Microscoopes, Condenser (AREA)
Abstract
本发明公开了一种基于广义理查德森‑露西算法的荧光分子空间和角度分布重建方法,其通过在传统理查德森‑露西算法引入激发模式和角度分布两个维度,使得通过偏振荧光显微镜数据能够对荧光分子空间和角度分布进行更好的重建,无需为了抑制噪声而引入会带来估计偏差的正则化项。此外,本发明设计了基于球谐域的运算过程,大大减少了算法中前后投影和球面域乘除法的计算量。故本发明设计了从偏振荧光显微数据中重建分子空间角度分布的广义理查德森‑露西算法,以合理的计算代价,解决了现有方法噪声抑制能力差、手动调整参数繁琐、重建结果空间分辨率低、角度分布不准确的问题。
The invention discloses a method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm, which introduces two dimensions of excitation mode and angular distribution into the traditional Richardson-Lucy algorithm, so that through Polarized fluorescence microscopy data allow for better reconstruction of the spatial and angular distribution of fluorescent molecules without the need for regularization terms that would bias estimates in order to suppress noise. In addition, the present invention designs an operation process based on the spherical harmonic domain, which greatly reduces the calculation amount of the forward and backward projection and spherical domain multiplication and division in the algorithm. Therefore, the present invention designs the generalized Richardson-Lucy algorithm for reconstructing molecular spatial angle distribution from polarized fluorescence microscopic data, and solves the problem of poor noise suppression ability, cumbersome manual adjustment of parameters, and reconstruction problems in existing methods at a reasonable calculation cost. The result is a problem of low spatial resolution and inaccurate angular distribution.
Description
技术领域Technical Field
本发明属于偏振荧光显微成像技术领域,具体涉及一种基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法。The invention belongs to the technical field of polarized fluorescence microscopy imaging, and in particular relates to a method for reconstructing the spatial and angular distribution of fluorescent molecules based on a generalized Richardson-Lucy algorithm.
背景技术Background Art
绝大多数荧光分子可以看做偶极子,具有不同的朝向,同一位置数个任意朝向的荧光分子可以看做一个荧光团,对于荧光团来说,它具有空间位置、不同朝向强度等特性,即空间和角度分布。偏振荧光显微镜(Polarized fluorescence microscopy,PFM)是在生物领域中强有力的成像技术,使用荧光蛋白标记或者生物样本内部特定蛋白,生物样本可以在不同偏振光激发下发出不同强度的荧光,该强度与蛋白分子的空间和角度分布紧密相关,从而可以反映生物样本的特定属性,它的应用范围从单细胞成像延伸至大组织成像。偏振荧光显微镜具有亚微米空间分辨率、高对比度和分子方向敏感性,我们可以采集不同偏振激发模式下的显微图像进行间接观察,但为了直接探索生物样本的结构和功能,需要从这些图像中恢复荧光分子的三维空间和角度分布;此外,固有的模糊和噪声会降低荧光数据,这些都会影响研究者对真实生物样本的认知,但是只要该成像系统的前向投影过程能够被描述,那么可以通过线性逆问题求解算法对样品信息进行恢复,重建出样本的空间和角度分布。Most fluorescent molecules can be regarded as dipoles with different orientations. Several fluorescent molecules with arbitrary orientations at the same position can be regarded as a fluorophore. For a fluorophore, it has characteristics such as spatial position and intensity of different orientations, that is, spatial and angular distribution. Polarized fluorescence microscopy (PFM) is a powerful imaging technology in the biological field. Using fluorescent protein markers or specific proteins inside biological samples, biological samples can emit fluorescence of different intensities under the excitation of different polarized light. The intensity is closely related to the spatial and angular distribution of protein molecules, thus reflecting the specific properties of biological samples. Its application range extends from single-cell imaging to large tissue imaging. Polarized fluorescence microscopy has submicron spatial resolution, high contrast, and molecular orientation sensitivity. We can collect microscopic images under different polarization excitation modes for indirect observation, but in order to directly explore the structure and function of biological samples, it is necessary to restore the three-dimensional spatial and angular distribution of fluorescent molecules from these images; in addition, inherent blur and noise will reduce fluorescence data, which will affect researchers' understanding of real biological samples. However, as long as the forward projection process of the imaging system can be described, the sample information can be restored through a linear inverse problem solving algorithm to reconstruct the spatial and angular distribution of the sample.
目前,应用在偏振荧光显微镜中的荧光分子三维空间和角度分布重建算法主要是基于奇异值分解(SVD)的最小二乘法算法[Richard W.Hendler,RichardI.Shrager.Deconvolutions based on singular value decomposition and thepseudoinverse:a guide for beginners.Journal of Biochemical and BiophysicalMethods,Volume 28,Issue 1,1994],尽管该方法在统计上被证明是对不相关高斯噪声破坏的数据的最大似然估计量,但是奇异值分解得到的小特征值会在运算中将噪声放大到不可接受的水平,一般需要通过在优化问题中添加吉洪诺夫(Tikhonov)正则化项来抑制[Fuhry,M.,Reichel,L.A new Tikhonov regularization method.Numer Algor 59,433–445(2012)];这带来的问题是,会给最终的重建结果整体引入一个偏差,表现为在角度分布上朝某一方向偏移,在空间分布上分辨率降低,此外需要大量的尝试去手动挑选一个合理的正则化参数。At present, the reconstruction algorithm of the three-dimensional space and angular distribution of fluorescent molecules used in polarized fluorescence microscopy is mainly based on the least squares algorithm of singular value decomposition (SVD) [Richard W.Hendler, Richard I.Shrager.Deconvolutions based on singular value decomposition and the pseudoinverse: a guide for beginners.Journal of Biochemical and Biophysical Methods, Volume 28,
因此,如何在抑制噪声的情况下,提高重建结果在空间和角度分布的分辨率与准确性,并尽可能减少手动调整参数的次数,同时保持能够接受的运算成本,是本领域研究的热点。Therefore, how to improve the resolution and accuracy of the reconstruction results in terms of spatial and angular distribution while suppressing noise, and to minimize the number of manual parameter adjustments while maintaining an acceptable computing cost is a hot topic in this field.
发明内容Summary of the invention
鉴于上述,本发明提供了一种基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法,能够在抑制噪声的情况下,提高重建结果在空间的分辨率和角度分布的准确性,并且只需要预先粗略地设置一个迭代次数,无需另外多次手动调参,同时将角度分布原本在球面域的复杂运算转到简单的球谐域来实施,保证了合理的运算成本。In view of the above, the present invention provides a method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm, which can improve the spatial resolution and angular distribution accuracy of the reconstruction results while suppressing noise, and only requires a rough setting of the number of iterations in advance, without the need for multiple manual parameter adjustments. At the same time, the complex calculations of the angular distribution originally in the spherical domain are transferred to the simple spherical harmonic domain for implementation, thereby ensuring a reasonable computing cost.
一种基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法,包括如下步骤:A method for reconstructing the spatial and angular distribution of fluorescent molecules based on a generalized Richardson-Lucy algorithm comprises the following steps:
(1)在偏振荧光显微镜系统中,对于每个视角,利用数个不同偏振态的激发光对荧光标记的生物样本进行荧光激发,并通过探测物镜进行数据采集,得到每个视角下每个偏振激发模式对应的生物样本图像数据;(1) In a polarized fluorescence microscope system, for each viewing angle, a fluorescently labeled biological sample is excited by using excitation lights of several different polarization states, and data is collected through a detection objective lens to obtain biological sample image data corresponding to each polarization excitation mode at each viewing angle;
(2)通过模拟得到每个视角下每个偏振激发模式对应的偶极子点扩散函数,然后对偶极子点扩散函数进行整体归一化处理,并计算带有物空间敏感常数的反投影算子;(2) obtaining the dipole point spread function corresponding to each polarization excitation mode at each viewing angle through simulation, then performing overall normalization on the dipole point spread function and calculating the back-projection operator with object space sensitive constants;
(3)对采集得到的生物样本图像数据进行预处理;(3) preprocessing the collected biological sample image data;
(4)使表征激发模式的偏振态域与表征角度分布的球面域引入理查德森-露西算法,并将原本应在空域和球面域进行的运算转换到频域和球谐域来实施,从而迭代估计出生物样本的空间角度分布。(4) The Richardson-Lucy algorithm is introduced into the polarization state domain that characterizes the excitation mode and the spherical domain that characterizes the angular distribution, and the operations that should be performed in the spatial domain and spherical domain are converted to the frequency domain and spherical harmonic domain for implementation, thereby iteratively estimating the spatial angular distribution of the biological sample.
进一步地,所述视角数量以及偏振激发模式数量为单个或多个。Furthermore, the number of viewing angles and the number of polarization excitation modes are single or multiple.
进一步地,所述步骤(1)中采集得到的生物样本图像数据为体积图像,其由二维切片图像堆叠得到;每个视角及偏振激发模式对应的偶极子点扩展函数具有三个空间维度加上一个球面维度,共四维矩阵结构。Furthermore, the biological sample image data collected in step (1) is a volume image, which is obtained by stacking two-dimensional slice images; the dipole point spread function corresponding to each viewing angle and polarization excitation mode has three spatial dimensions plus one spherical dimension, a total of four-dimensional matrix structure.
进一步地,所述偏振荧光显微镜系统的成像方程如下:Furthermore, the imaging equation of the polarized fluorescence microscope system is as follows:
其中:gv,p(rd)表示视角v偏振激发模式p下采集到的生物样本图像数据中对应位置rd处的灰度,表示视角v偏振激发模式p下单位浓度距离为rd-ro朝向为的荧光分子响应即偶极子点扩散函数,表示生物样本在空间位置ro处角度朝向为的荧光分子浓度,表示三维空间,表示球面空间。Where: g v,p (r d ) represents the grayscale at the corresponding position r d in the biological sample image data collected under the polarization excitation mode p at the viewing angle v, Indicates that the unit concentration distance under the polarization excitation mode p is r d -r o and the direction is The fluorescence molecular response is the dipole point spread function, Indicates that the biological sample is oriented at the spatial position r o. The concentration of fluorescent molecules, represents three-dimensional space, Represents spherical space.
进一步地,所述步骤(2)中反投影算子的计算表达式如下:Furthermore, the calculation expression of the back-projection operator in step (2) is as follows:
其中:表示视角v偏振激发模式p下单位浓度距离为r朝向为的荧光分子响应,表示视角v偏振激发模式p下单位浓度距离为-r朝向为的荧光分子响应,对应为的反投影算子,表示三维空间。in: It represents the unit concentration distance r and the direction under the polarization excitation mode p at the viewing angle v. The fluorescent molecular response, Indicates the unit concentration distance under the viewing angle v polarization excitation mode p is -r and the direction is The fluorescent molecular response, Corresponding to The back-projection operator is Represents three-dimensional space.
进一步地,所述步骤(4)中对于某一视角v,则通过以下表达式迭代估计生物样本的空间角度分布;Furthermore, in step (4), for a certain viewing angle v, the spatial angle distribution of the biological sample is estimated iteratively by the following expression:
其中:ek和ek+1分别为第k次和k+1次迭代后生物样本的空间角度分布估计结果,k为自然数,hv和分别为视角v下的偶极子点扩散函数和反投影算子,iv为视角v下获得的预处理后的生物样本图像数据,和分别为前投影运算符和反投影运算符。Where: e k and e k+1 are the estimated results of the spatial angular distribution of biological samples after the kth and k+1th iterations, respectively; k is a natural number, h v and are the dipole point spread function and the back projection operator under the viewing angle v, respectively. i v is the preprocessed biological sample image data obtained under the viewing angle v. and They are the forward projection operator and the back projection operator respectively.
进一步地,前投影运算以及反投影运算的表达式如下:Furthermore, the forward projection operation And back projection operation The expression is as follows:
其中:表示视角v下单位浓度距离为rd-ro朝向为的荧光分子响应,表示估计结果ek中生物样本在空间位置ro处角度朝向为的荧光分子浓度,对应为的反投影算子,iv,p(rd)表示视角v偏振激发模式p下预处理后的生物样本图像数据中对应位置rd处的灰度。in: The unit concentration distance under the viewing angle v is r d -r o and the direction is The fluorescent molecular response, Indicates that the angle orientation of the biological sample at the spatial position r o in the estimation result e k is The concentration of fluorescent molecules, Corresponding to The back-projection operator, iv,p (r d ) represents the grayscale at the corresponding position r d in the preprocessed biological sample image data under the viewing angle v and polarization excitation mode p.
进一步地,为了减小计算代价,将所述步骤(4)迭代过程中涉及的四种运算包括前投影、反投影、球面域乘法、球面域除法分别改写为:Furthermore, in order to reduce the computational cost, the four operations involved in the iterative process of step (4), including forward projection, back projection, spherical domain multiplication, and spherical domain division, are rewritten as follows:
其中:和分别表示傅里叶变换和球谐变换,和对应表示和的逆变换,下标lm、l′m′以及l″m″表示球谐变换后得到的球谐分量的索引号,iv,p为视角v偏振激发模式p下预处理后的生物样本图像数据,为视角v偏振激发模式p下的反投影算子,为Gaunt系数。in: and denote Fourier transform and spherical harmonic transform respectively, and Corresponding representation and The inverse transformation of , the subscripts lm, l′m′ and l″m″ represent the index numbers of the spherical harmonic components obtained after the spherical harmonic transformation, iv ,p is the preprocessed biological sample image data under the polarization excitation mode p at the viewing angle v, is the back-projection operator for polarization excitation mode p at viewing angle v, is the Gaunt coefficient.
进一步地,所述Gaunt系数的表达式如下:Furthermore, the Gaunt coefficient The expression is as follows:
其中:为球谐函数即表示球面域上对应朝向为的某点与球谐分量lm的映射关系。in: is a spherical harmonic function, which means that the corresponding direction on the spherical domain is The mapping relationship between a certain point and the spherical harmonic component lm.
进一步地,对于生物样本的空间角度分布估计初值e0,则对每个空间位置设置相同的均匀角分布,即设置 Furthermore, for the estimated initial value e 0 of the spatial angular distribution of the biological sample, the same uniform angular distribution is set for each spatial position, that is,
本发明通过在传统理查德森-露西算法引入激发模式和角度分布两个维度,使得通过偏振荧光显微镜能够对荧光分子空间和角度分布进行更好的重建,无需为了抑制噪声而引入会带来估计偏差的正则化项。此外,改进后的查德森-露西算法本身的运算都是基于球面域,本发明设计了基于球谐域的运算过程,大大减少了前后投影和球面域乘除法的计算量。The present invention introduces two dimensions, namely, excitation mode and angular distribution, into the traditional Richardson-Lucy algorithm, so that the spatial and angular distribution of fluorescent molecules can be better reconstructed through polarized fluorescence microscopy, without the need to introduce regularization terms that will cause estimation bias in order to suppress noise. In addition, the operations of the improved Richardson-Lucy algorithm itself are all based on the spherical domain. The present invention designs an operation process based on the spherical harmonic domain, which greatly reduces the amount of calculation of front and back projections and spherical domain multiplication and division.
总的来说,本发明设计了从偏振荧光显微数据中重建荧光分子空间和角度分布的广义理查德森-露西算法,以合理的计算代价,更好地抑制了噪声,提高了重建结果的空间分辨率和角度分布准确性,并且解决了现有方法中多次手动调整参数繁琐的问题。In general, the present invention designs a generalized Richardson-Lucy algorithm for reconstructing the spatial and angular distribution of fluorescent molecules from polarized fluorescence microscopy data. At a reasonable computational cost, it better suppresses noise, improves the spatial resolution and angular distribution accuracy of the reconstruction results, and solves the problem of tedious multiple manual parameter adjustments in existing methods.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法的流程示意图。FIG1 is a schematic flow chart of a method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm of the present invention.
图2(a)为对仿真数据添加不同水平的泊松噪声后使用本发明重建时每次迭代结果的空间分布与真实值的结构相似度变化曲线图,同时与使用了最优正则化项参数的基于SVD的最小二乘法进行对比。FIG2(a) is a graph showing the change in structural similarity between the spatial distribution of each iteration result and the true value when the present invention is used to reconstruct the simulated data after adding different levels of Poisson noise, and is also compared with the SVD-based least squares method using the optimal regularization term parameter.
图2(b)为对仿真数据添加不同水平的泊松噪声后使用本发明重建时每次迭代结果的角度分布峰值方向与真实值的角度之差的平均余弦值变化曲线图,同时与使用了最优正则化项参数的基于SVD的最小二乘法进行对比。FIG2( b ) is a curve diagram showing the change in the average cosine value of the angle difference between the peak direction of the angular distribution of each iterative result and the true value when the present invention is used to reconstruct the simulated data after adding different levels of Poisson noise, and is compared with the SVD-based least squares method using the optimal regularization term parameter.
图3(a)为对巨型单层囊泡(GUV)样品偏振荧光显微数据部分区域三维重建结果的角分布峰值方向图,第1行和第2行分别是本发明进行10次迭代的重建结果和使用基于SVD的最小二乘法重建结果在不同视角的观察图,第1~4列对应4个观察视角。Figure 3(a) is an angular distribution peak direction diagram of the three-dimensional reconstruction results of a partial area of the polarized fluorescence microscopy data of a giant unilamellar vesicle (GUV) sample. The first row and the second row are the observation diagrams of the reconstruction results of 10 iterations of the present invention and the reconstruction results using the SVD-based least squares method at different viewing angles, respectively. The first to fourth columns correspond to four observation viewing angles.
图3(b)为对巨型单层囊泡样品偏振荧光显微数据部分区域三维重建结果的空间分布图,第1行和第2行分别是本发明进行10次迭代的重建结果和使用基于SVD的最小二乘法重建结果在z轴位置的切片图,第3行为两种方法重建结果沿着上图划线位置的轮廓图,第1~2列对应为两组切片。Figure 3(b) is a spatial distribution diagram of the three-dimensional reconstruction results of a partial area of the polarized fluorescence microscopy data of a giant unilamellar vesicle sample. The first and second rows are slice diagrams of the reconstruction results of 10 iterations of the present invention and the reconstruction results using the SVD-based least squares method at the z-axis position, respectively. The third row is a contour diagram of the reconstruction results of the two methods along the line position in the upper figure. The first to second columns correspond to two groups of slices.
具体实施方式DETAILED DESCRIPTION
为了更为具体地描述本发明,下面结合附图及具体实施方式对本发明的技术方案进行详细说明。In order to describe the present invention more specifically, the technical solution of the present invention is described in detail below in conjunction with the accompanying drawings and specific implementation methods.
偏振荧光显微镜的激发光路发出某一偏振态的激光,照射被荧光蛋白标记或者自身具有荧光蛋白的生物样本使其发出荧光,显微镜的信号采集光路进行荧光数据的采集,不断移动采集光路的焦平面,使整个生物样本的信号被遍历,将每次采集到的图像堆叠,形成三维的体积图像。对于多视角、多偏振激发模式的数据,调整荧光显微镜激发方向或者旋转样本以及激发光的偏振模式,采集多组体积数据,得到多视角、多偏振激发模式的生物样本数据。The excitation light path of the polarized fluorescence microscope emits a laser of a certain polarization state, irradiating the biological sample labeled with fluorescent protein or having fluorescent protein to make it emit fluorescence. The signal collection light path of the microscope collects fluorescence data, and the focal plane of the collection light path is continuously moved so that the signal of the entire biological sample is traversed. The images collected each time are stacked to form a three-dimensional volume image. For data in multi-viewing angle and multi-polarization excitation modes, the excitation direction of the fluorescence microscope is adjusted or the sample and the polarization mode of the excitation light are rotated, and multiple sets of volume data are collected to obtain biological sample data in multi-viewing angle and multi-polarization excitation modes.
如图1所示,本发明基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法,包括如下步骤:As shown in FIG1 , the method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm of the present invention comprises the following steps:
S1.计算系统矩阵,包括偶极子点扩散函数和反投影算子。通过模拟为每个视角v、偏振激发模式p生成偶极子点扩展函数hv,p,并计算带有物空间敏感常数的反投影算子 S1. Calculate the system matrix, including the dipole point spread function and the back-projection operator. Generate the dipole point spread function h v,p for each viewing angle v and polarization excitation mode p through simulation, and calculate the back-projection operator with object space sensitivity constants
将它们以多维矩阵形式保存,以备后续数据处理。Save them in the form of multidimensional matrices for subsequent data processing.
S2.由于采集得到的图像所参考的坐标系不一致,首先要进行预处理,选择一个视角、偏振激发模式作为参考,对其他视角、激发模式获得的数据进行线性插值并进行一定角度的旋转,使它们具有相应的坐标系。此时得到的是粗配准的图像,为了更准确的图像融合,采用基于强度的配准方法生成配准矩阵,将每个视角、激发模式的数据乘以相应的配准矩阵,得到配准好的多视角、多偏振激发模式图像数据。S2. Since the reference coordinate systems of the acquired images are inconsistent, preprocessing is first performed. Select a viewing angle and polarization excitation mode as a reference, and perform linear interpolation and rotation of a certain angle on the data obtained from other viewing angles and excitation modes so that they have corresponding coordinate systems. At this time, a roughly registered image is obtained. For more accurate image fusion, an intensity-based registration method is used to generate a registration matrix. The data of each viewing angle and excitation mode are multiplied by the corresponding registration matrix to obtain the registered multi-view and multi-polarization excitation mode image data.
S3.使用引入表征激发模式的偏振态域与表征角度分布的球面域的广义理查德森-露西算法进行迭代计算,在每次迭代中的得到相应的荧光分子空间角度分布重建估计结果:S3. Use the generalized Richardson-Lucy algorithm that introduces the polarization state domain that characterizes the excitation mode and the spherical domain that characterizes the angular distribution to perform iterative calculations, and obtain the corresponding reconstruction estimation result of the spatial angular distribution of the fluorescent molecules in each iteration:
将原本定义在空域和球面域进行的运算,转换到频域和球谐域来实施计算,将前投影、后投影、球面域乘法、球面域除法变为:The operations originally defined in the spatial domain and spherical domain are converted to the frequency domain and spherical harmonic domain for calculation, and the front projection, back projection, spherical domain multiplication, and spherical domain division are transformed into:
迭代估计出生物样本的空间和角度分布。The spatial and angular distribution of biological samples are estimated iteratively.
S4.判断是否满足迭代停止条件,即是否达到了预计的迭代次数,不满足该条件则执行步骤S3,满足则迭代停止,将最后一次迭代得到的空间角度分布估计结果作为最后的重建结果。S4. Determine whether the iteration stop condition is met, that is, whether the expected number of iterations has been reached. If the condition is not met, execute step S3. If the condition is met, the iteration stops and the spatial angle distribution estimation result obtained from the last iteration is used as the final reconstruction result.
我们以单视角、多个偏振激发模式下获得的数据重建为例,对引入表征激发模式的偏振态域与表征角度分布的球面域的广义理查德森-露西算法进行具体介绍。传统的单视角理查德森-露西算法具有以下迭代结构:We take the reconstruction of data obtained under single-view and multiple polarization excitation modes as an example to introduce the generalized Richardson-Lucy algorithm that introduces the polarization state domain that characterizes the excitation mode and the spherical domain that characterizes the angle distribution. The traditional single-view Richardson-Lucy algorithm has the following iterative structure:
e0=ie 0 = i
for k=0,1,2,...,Nfor k = 0, 1, 2, ..., N
endend
本发明将表征激发模式的偏振态域与表征角度分布的球面域引入上式中,提出了以下新的迭代公式:The present invention introduces the polarization state domain characterizing the excitation mode and the spherical domain characterizing the angle distribution into the above formula, and proposes the following new iterative formula:
e0=1e 0 = 1
for k=0,1,2,...,Nfor k = 0, 1, 2, ..., N
endend
前、后向投影操作定义为:The forward and backward projection operations are defined as:
关于反投影算子,传统理查德森-露西算法中是将点扩散函数进行翻转生成的,但是这里引入了更多的维度,前、后向投影过程中两侧的域空间是不一致的,这将导致迭代的迅速发散,因此在反投影算子中引入了物空间敏感常数,最终的反投影算子如下:Regarding the back-projection operator, the traditional Richardson-Lucy algorithm generates the point spread function by flipping it, but this introduces more dimensions. The domain spaces on both sides of the forward and backward projection processes are inconsistent, which will lead to rapid divergence of iterations. Therefore, an object space sensitive constant is introduced in the back-projection operator, and the final back-projection operator is as follows:
由于在计算过程中,球面域维度通常需要离散为数千个方向值,导致了巨大的计算量,因此可以使用球谐变换转到球谐域;在球谐域中,通常只需要数10个lm值就能表示原本在球面域中需要数千个值才能描述的分布。此外,在频域做乘积的计算成本也远远小于在空间域做卷积运算。Since in the calculation process, the spherical domain dimension Usually it needs to be discretized into thousands of directional values, which leads to a huge amount of calculation. Therefore, spherical harmonic transformation can be used to transfer to the spherical harmonic domain. In the spherical harmonic domain, usually only a few dozen lm values are needed to represent the distribution that originally required thousands of values in the spherical domain. In addition, the computational cost of doing products in the frequency domain is much lower than doing convolution operations in the spatial domain.
因此,本发明将迭代结构中各运算符的定义改写成:Therefore, the present invention rewrites the definition of each operator in the iteration structure as follows:
类似的,对于多视角、每个视角下有数个偏振激发模式获得的数据,反投影算子为:Similarly, for data obtained from multiple views with several polarization excitation modes at each view, the back-projection operator is:
加法迭代重建公式为:The additive iterative reconstruction formula is:
e0=1e 0 = 1
for k=0,1,2,...,Nfor k = 0, 1, 2, ..., N
………
endend
乘法迭代重建公式为:The multiplication iterative reconstruction formula is:
for k=0,1,2,...,Nfor k = 0, 1, 2, ..., N
………
endend
以下我们采用模拟数据来验证本发明的有效性,随机生成了一个具有一定空间和角度分布的体模,使用偶极子点扩散函数进行前向投影来模拟偏振荧光显微镜的激发和采集过程,获得了一组仿真数据。对仿真数据添加不同水平(SNR=30dB和5dB)的泊松噪声后,使用本发明进行重建,记录每次迭代后的结果,并且均与使用了最优正则化项参数的基于SVD的最小二乘法进行对比;图2(a)绘制的是重建结果空间分布与真值的差距,用结构相似度指标表征,图2(b)绘制的是重建结果角度分布峰值方向与真值之间的差距,用角度之差的平均余弦值表征;它们共同说明了本发明的重建结果远远好于使用手动对基于SVD的最小二乘法调参能获得的最佳结果,尤其是重建结果角度分布峰值方向,有着非常大的准确性提升,并且对噪声是不敏感的。In the following, we use simulated data to verify the effectiveness of the present invention. We randomly generate a phantom with a certain spatial and angular distribution, and use the dipole point spread function to perform forward projection to simulate the excitation and acquisition process of the polarized fluorescence microscope, and obtain a set of simulated data. After adding different levels of Poisson noise (SNR = 30dB and 5dB) to the simulated data, the present invention is used to reconstruct, and the results after each iteration are recorded, and compared with the SVD-based least squares method using the optimal regularization term parameter; Figure 2 (a) plots the gap between the spatial distribution of the reconstruction result and the true value, represented by the structural similarity index, and Figure 2 (b) plots the gap between the peak direction of the angular distribution of the reconstruction result and the true value, represented by the average cosine value of the angle difference; they together illustrate that the reconstruction result of the present invention is far better than the best result that can be obtained by manually adjusting the parameters of the SVD-based least squares method, especially the peak direction of the angular distribution of the reconstruction result, which has a very large accuracy improvement and is insensitive to noise.
此外,我们使用巨型单层囊泡样品实验数据来进一步验证本发明的有效性,巨型单层囊泡是生物偏振荧光成像中常用的生物样本,根据目前的生物学认知,其囊泡膜上的荧光分子角分布峰值方向为垂直于膜表面切向,数据通过偏振双视角倒置光片荧光显微镜(pol-diSPIM)采集得到。In addition, we use the experimental data of giant unilamellar vesicle samples to further verify the effectiveness of the present invention. Giant unilamellar vesicles are commonly used biological samples in biological polarized fluorescence imaging. According to current biological knowledge, the peak direction of the angular distribution of fluorescent molecules on the vesicle membrane is perpendicular to the tangent direction of the membrane surface. The data is collected by polarized dual-view inverted light sheet fluorescence microscopy (pol-diSPIM).
将使用本发明基于广义理查德森-露西算法的荧光分子空间角度分布重建方法与传统的基于SVD的最小二乘算法重建结果做比较,前者的迭代次数设为10次,后者的正则化项参数经过多次尝试后设定为1,二者对相同数据进行处理,并展示处理结果的角度分布峰值方向在不同视角下的观察图,以及处理结果的空间分布在不同深度处的切片图。The reconstruction results of the fluorescent molecule spatial angular distribution reconstruction method based on the generalized Richardson-Lucy algorithm of the present invention are compared with those of the traditional least squares algorithm based on SVD. The number of iterations of the former is set to 10 times, and the regularization term parameter of the latter is set to 1 after many attempts. The two process the same data and display the observation diagrams of the angular distribution peak direction of the processing results at different viewing angles, as well as the slice diagrams of the spatial distribution of the processing results at different depths.
从图3(a)可以直观地看出,在荧光分子角度分布方面,基于本发明基于广义理查德森-露西算法的重建算法与传统基于SVD的最小二乘算法的结果相比,我们的改进方法可以得到更加准确、符合生物学认知的样本荧光分子角度分布,具体的提升在于,角度分布峰值方向都近乎垂直于囊泡膜,整体变化更加连续,并且在感兴趣区域有着更高的信噪和更好的区分度。It can be seen intuitively from Figure 3(a) that in terms of the angular distribution of fluorescent molecules, compared with the results of the traditional least squares algorithm based on SVD, the reconstruction algorithm based on the generalized Richardson-Lucy algorithm of the present invention can obtain a more accurate angular distribution of sample fluorescent molecules that conforms to biological cognition. The specific improvement is that the peak direction of the angular distribution is almost perpendicular to the vesicle membrane, the overall change is more continuous, and there is a higher signal-to-noise and better discrimination in the region of interest.
从图3(b)可以直观地看出,在荧光分子空间分布方面,基于本发明基于广义理查德森-露西算法的重建算法与传统基于SVD的最小二乘算法的结果相比,我们的改进方法可以获得更高分辨率和噪声的荧光分子空间分布,具体的提升在于,降低了空间分布的模糊程度,使得样本一些固有结构能够清晰可辨,整体提高了分辨率和信噪比。It can be seen intuitively from Figure 3(b) that in terms of the spatial distribution of fluorescent molecules, compared with the results of the traditional least squares algorithm based on SVD, the reconstruction algorithm based on the generalized Richardson-Lucy algorithm of the present invention can obtain a higher resolution and noise spatial distribution of fluorescent molecules. The specific improvement is that the blurring degree of the spatial distribution is reduced, so that some inherent structures of the sample can be clearly distinguished, and the overall resolution and signal-to-noise ratio are improved.
上述对实施例的描述是为便于本技术领域的普通技术人员能理解和应用本发明。熟悉本领域技术的人员显然可以容易地对上述实施例做出各种修改,并把在此说明的一般原理应用到其他实施例中而不必经过创造性的劳动。因此,本发明不限于上述实施例,本领域技术人员根据本发明的揭示,对于本发明做出的改进和修改都应该在本发明的保护范围之内。The above description of the embodiments is to facilitate the understanding and application of the present invention by those skilled in the art. It is obvious that those skilled in the art can easily make various modifications to the above embodiments and apply the general principles described herein to other embodiments without creative work. Therefore, the present invention is not limited to the above embodiments, and improvements and modifications made to the present invention by those skilled in the art based on the disclosure of the present invention should be within the scope of protection of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310013256.5A CN115953319B (en) | 2023-01-05 | 2023-01-05 | A method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310013256.5A CN115953319B (en) | 2023-01-05 | 2023-01-05 | A method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115953319A true CN115953319A (en) | 2023-04-11 |
CN115953319B CN115953319B (en) | 2025-04-29 |
Family
ID=87290515
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202310013256.5A Active CN115953319B (en) | 2023-01-05 | 2023-01-05 | A method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115953319B (en) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170023786A1 (en) * | 2015-07-24 | 2017-01-26 | General Electric Company | Systems and Methods for Image Processing in Optical Microscopes |
CN111476733A (en) * | 2020-04-07 | 2020-07-31 | 浙江大学 | An acceleration algorithm for microscope image deconvolution based on mismatch operator |
-
2023
- 2023-01-05 CN CN202310013256.5A patent/CN115953319B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170023786A1 (en) * | 2015-07-24 | 2017-01-26 | General Electric Company | Systems and Methods for Image Processing in Optical Microscopes |
CN111476733A (en) * | 2020-04-07 | 2020-07-31 | 浙江大学 | An acceleration algorithm for microscope image deconvolution based on mismatch operator |
Non-Patent Citations (1)
Title |
---|
郭敏: "倒置型光片荧光显微成像及图像分析技术研究", 全国优秀博士学位论文数据库, 15 February 2017 (2017-02-15) * |
Also Published As
Publication number | Publication date |
---|---|
CN115953319B (en) | 2025-04-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Thiele et al. | 2D and 3D MALDI-imaging: conceptual strategies for visualization and data mining | |
Sarder et al. | Deconvolution methods for 3-D fluorescence microscopy images | |
CN102288589B (en) | Method and device for positioning single fluorescent probe, and super-resolution imaging method and system | |
Temerinac-Ott et al. | Multiview deblurring for 3-D images from light-sheet-based fluorescence microscopy | |
US8126247B2 (en) | Image preprocessing system for 3D image database construction | |
CN111476733B (en) | An acceleration algorithm for microscope image deconvolution based on mismatch operator | |
TW200945245A (en) | Registration of 3D point cloud data by creation of filtered density images | |
Winkler et al. | Focus gradient correction applied to tilt series image data used in electron tomography | |
Guo et al. | An image super-resolution reconstruction method with single frame character based on wavelet neural network in internet of things | |
Conte et al. | A kalman filter approach for denoising and deblurring 3-d microscopy images | |
CN108520507B (en) | A multi-view light sheet microscope image fusion method with improved deconvolution efficiency | |
Yin et al. | Restoring DIC microscopy images from multiple shear directions | |
JP2010117175A (en) | Image processing system, image processing method, program, and recording medium | |
Verveer et al. | Acceleration of the ICTM image restoration algorithm | |
CN115953319A (en) | Fluorescent molecular space and angle distribution reconstruction method based on generalized Richardson-Lucy algorithm | |
Preza et al. | Image reconstruction for 3D light microscopy with a regularized linear method incorporating a smoothness prior | |
Mallick et al. | Structure and view estimation for tomographic reconstruction: A Bayesian approach | |
CN111524078A (en) | Dense network-based microscopic image deblurring method | |
CN117670711A (en) | Fluorescent molecule space and angle distribution reconstruction method | |
CN108038824B (en) | A Fluorescence Dipole Orientation Method Based on Structured Light Illumination | |
WO2020051764A1 (en) | Noise reduction method and apparatus for molecular localization super-resolution imaging, and terminal device | |
Speiser et al. | Teaching deep neural networks to localize single molecules for super-resolution microscopy | |
Le Saux et al. | Isotropic high-resolution three-dimensional confocal micro-rotation imaging for non-adherent living cells | |
CN114913065A (en) | A Super-Resolution SIM-FRET Image Reconstruction Method Based on Spatial Colocalization Mask Filtering | |
Wan et al. | Iterative methods in large field electron microscope tomography |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |