[go: up one dir, main page]

CN115953319A - Fluorescent molecular space and angle distribution reconstruction method based on generalized Richardson-Lucy algorithm - Google Patents

Fluorescent molecular space and angle distribution reconstruction method based on generalized Richardson-Lucy algorithm Download PDF

Info

Publication number
CN115953319A
CN115953319A CN202310013256.5A CN202310013256A CN115953319A CN 115953319 A CN115953319 A CN 115953319A CN 202310013256 A CN202310013256 A CN 202310013256A CN 115953319 A CN115953319 A CN 115953319A
Authority
CN
China
Prior art keywords
spatial
angular distribution
viewing angle
biological sample
fluorescent molecules
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310013256.5A
Other languages
Chinese (zh)
Other versions
CN115953319B (en
Inventor
刘华锋
郭敏
刘钧宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN202310013256.5A priority Critical patent/CN115953319B/en
Publication of CN115953319A publication Critical patent/CN115953319A/en
Application granted granted Critical
Publication of CN115953319B publication Critical patent/CN115953319B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Landscapes

  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

本发明公开了一种基于广义理查德森‑露西算法的荧光分子空间和角度分布重建方法,其通过在传统理查德森‑露西算法引入激发模式和角度分布两个维度,使得通过偏振荧光显微镜数据能够对荧光分子空间和角度分布进行更好的重建,无需为了抑制噪声而引入会带来估计偏差的正则化项。此外,本发明设计了基于球谐域的运算过程,大大减少了算法中前后投影和球面域乘除法的计算量。故本发明设计了从偏振荧光显微数据中重建分子空间角度分布的广义理查德森‑露西算法,以合理的计算代价,解决了现有方法噪声抑制能力差、手动调整参数繁琐、重建结果空间分辨率低、角度分布不准确的问题。

Figure 202310013256

The invention discloses a method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm, which introduces two dimensions of excitation mode and angular distribution into the traditional Richardson-Lucy algorithm, so that through Polarized fluorescence microscopy data allow for better reconstruction of the spatial and angular distribution of fluorescent molecules without the need for regularization terms that would bias estimates in order to suppress noise. In addition, the present invention designs an operation process based on the spherical harmonic domain, which greatly reduces the calculation amount of the forward and backward projection and spherical domain multiplication and division in the algorithm. Therefore, the present invention designs the generalized Richardson-Lucy algorithm for reconstructing molecular spatial angle distribution from polarized fluorescence microscopic data, and solves the problem of poor noise suppression ability, cumbersome manual adjustment of parameters, and reconstruction problems in existing methods at a reasonable calculation cost. The result is a problem of low spatial resolution and inaccurate angular distribution.

Figure 202310013256

Description

基于广义理查德森-露西算法的荧光分子空间和角度分布重 建方法A method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm

技术领域Technical Field

本发明属于偏振荧光显微成像技术领域,具体涉及一种基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法。The invention belongs to the technical field of polarized fluorescence microscopy imaging, and in particular relates to a method for reconstructing the spatial and angular distribution of fluorescent molecules based on a generalized Richardson-Lucy algorithm.

背景技术Background Art

绝大多数荧光分子可以看做偶极子,具有不同的朝向,同一位置数个任意朝向的荧光分子可以看做一个荧光团,对于荧光团来说,它具有空间位置、不同朝向强度等特性,即空间和角度分布。偏振荧光显微镜(Polarized fluorescence microscopy,PFM)是在生物领域中强有力的成像技术,使用荧光蛋白标记或者生物样本内部特定蛋白,生物样本可以在不同偏振光激发下发出不同强度的荧光,该强度与蛋白分子的空间和角度分布紧密相关,从而可以反映生物样本的特定属性,它的应用范围从单细胞成像延伸至大组织成像。偏振荧光显微镜具有亚微米空间分辨率、高对比度和分子方向敏感性,我们可以采集不同偏振激发模式下的显微图像进行间接观察,但为了直接探索生物样本的结构和功能,需要从这些图像中恢复荧光分子的三维空间和角度分布;此外,固有的模糊和噪声会降低荧光数据,这些都会影响研究者对真实生物样本的认知,但是只要该成像系统的前向投影过程能够被描述,那么可以通过线性逆问题求解算法对样品信息进行恢复,重建出样本的空间和角度分布。Most fluorescent molecules can be regarded as dipoles with different orientations. Several fluorescent molecules with arbitrary orientations at the same position can be regarded as a fluorophore. For a fluorophore, it has characteristics such as spatial position and intensity of different orientations, that is, spatial and angular distribution. Polarized fluorescence microscopy (PFM) is a powerful imaging technology in the biological field. Using fluorescent protein markers or specific proteins inside biological samples, biological samples can emit fluorescence of different intensities under the excitation of different polarized light. The intensity is closely related to the spatial and angular distribution of protein molecules, thus reflecting the specific properties of biological samples. Its application range extends from single-cell imaging to large tissue imaging. Polarized fluorescence microscopy has submicron spatial resolution, high contrast, and molecular orientation sensitivity. We can collect microscopic images under different polarization excitation modes for indirect observation, but in order to directly explore the structure and function of biological samples, it is necessary to restore the three-dimensional spatial and angular distribution of fluorescent molecules from these images; in addition, inherent blur and noise will reduce fluorescence data, which will affect researchers' understanding of real biological samples. However, as long as the forward projection process of the imaging system can be described, the sample information can be restored through a linear inverse problem solving algorithm to reconstruct the spatial and angular distribution of the sample.

目前,应用在偏振荧光显微镜中的荧光分子三维空间和角度分布重建算法主要是基于奇异值分解(SVD)的最小二乘法算法[Richard W.Hendler,RichardI.Shrager.Deconvolutions based on singular value decomposition and thepseudoinverse:a guide for beginners.Journal of Biochemical and BiophysicalMethods,Volume 28,Issue 1,1994],尽管该方法在统计上被证明是对不相关高斯噪声破坏的数据的最大似然估计量,但是奇异值分解得到的小特征值会在运算中将噪声放大到不可接受的水平,一般需要通过在优化问题中添加吉洪诺夫(Tikhonov)正则化项来抑制[Fuhry,M.,Reichel,L.A new Tikhonov regularization method.Numer Algor 59,433–445(2012)];这带来的问题是,会给最终的重建结果整体引入一个偏差,表现为在角度分布上朝某一方向偏移,在空间分布上分辨率降低,此外需要大量的尝试去手动挑选一个合理的正则化参数。At present, the reconstruction algorithm of the three-dimensional space and angular distribution of fluorescent molecules used in polarized fluorescence microscopy is mainly based on the least squares algorithm of singular value decomposition (SVD) [Richard W.Hendler, Richard I.Shrager.Deconvolutions based on singular value decomposition and the pseudoinverse: a guide for beginners.Journal of Biochemical and Biophysical Methods, Volume 28, Issue 1, 1994]. Although this method has been statistically proven to be the maximum likelihood estimator of data corrupted by uncorrelated Gaussian noise, the small eigenvalues obtained by singular value decomposition will amplify the noise to an unacceptable level during the operation, which generally needs to be suppressed by adding a Tikhonov regularization term to the optimization problem [Fuhry, M., Reichel, L. A new Tikhonov regularization method. Numer Algorithm 59,433–445(2012)]; the problem is that it will introduce a bias to the final reconstruction result as a whole, which is manifested as a shift in a certain direction in the angle distribution and a reduction in the resolution in the spatial distribution. In addition, a lot of attempts are required to manually select a reasonable regularization parameter.

因此,如何在抑制噪声的情况下,提高重建结果在空间和角度分布的分辨率与准确性,并尽可能减少手动调整参数的次数,同时保持能够接受的运算成本,是本领域研究的热点。Therefore, how to improve the resolution and accuracy of the reconstruction results in terms of spatial and angular distribution while suppressing noise, and to minimize the number of manual parameter adjustments while maintaining an acceptable computing cost is a hot topic in this field.

发明内容Summary of the invention

鉴于上述,本发明提供了一种基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法,能够在抑制噪声的情况下,提高重建结果在空间的分辨率和角度分布的准确性,并且只需要预先粗略地设置一个迭代次数,无需另外多次手动调参,同时将角度分布原本在球面域的复杂运算转到简单的球谐域来实施,保证了合理的运算成本。In view of the above, the present invention provides a method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm, which can improve the spatial resolution and angular distribution accuracy of the reconstruction results while suppressing noise, and only requires a rough setting of the number of iterations in advance, without the need for multiple manual parameter adjustments. At the same time, the complex calculations of the angular distribution originally in the spherical domain are transferred to the simple spherical harmonic domain for implementation, thereby ensuring a reasonable computing cost.

一种基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法,包括如下步骤:A method for reconstructing the spatial and angular distribution of fluorescent molecules based on a generalized Richardson-Lucy algorithm comprises the following steps:

(1)在偏振荧光显微镜系统中,对于每个视角,利用数个不同偏振态的激发光对荧光标记的生物样本进行荧光激发,并通过探测物镜进行数据采集,得到每个视角下每个偏振激发模式对应的生物样本图像数据;(1) In a polarized fluorescence microscope system, for each viewing angle, a fluorescently labeled biological sample is excited by using excitation lights of several different polarization states, and data is collected through a detection objective lens to obtain biological sample image data corresponding to each polarization excitation mode at each viewing angle;

(2)通过模拟得到每个视角下每个偏振激发模式对应的偶极子点扩散函数,然后对偶极子点扩散函数进行整体归一化处理,并计算带有物空间敏感常数的反投影算子;(2) obtaining the dipole point spread function corresponding to each polarization excitation mode at each viewing angle through simulation, then performing overall normalization on the dipole point spread function and calculating the back-projection operator with object space sensitive constants;

(3)对采集得到的生物样本图像数据进行预处理;(3) preprocessing the collected biological sample image data;

(4)使表征激发模式的偏振态域与表征角度分布的球面域引入理查德森-露西算法,并将原本应在空域和球面域进行的运算转换到频域和球谐域来实施,从而迭代估计出生物样本的空间角度分布。(4) The Richardson-Lucy algorithm is introduced into the polarization state domain that characterizes the excitation mode and the spherical domain that characterizes the angular distribution, and the operations that should be performed in the spatial domain and spherical domain are converted to the frequency domain and spherical harmonic domain for implementation, thereby iteratively estimating the spatial angular distribution of the biological sample.

进一步地,所述视角数量以及偏振激发模式数量为单个或多个。Furthermore, the number of viewing angles and the number of polarization excitation modes are single or multiple.

进一步地,所述步骤(1)中采集得到的生物样本图像数据为体积图像,其由二维切片图像堆叠得到;每个视角及偏振激发模式对应的偶极子点扩展函数具有三个空间维度加上一个球面维度,共四维矩阵结构。Furthermore, the biological sample image data collected in step (1) is a volume image, which is obtained by stacking two-dimensional slice images; the dipole point spread function corresponding to each viewing angle and polarization excitation mode has three spatial dimensions plus one spherical dimension, a total of four-dimensional matrix structure.

进一步地,所述偏振荧光显微镜系统的成像方程如下:Furthermore, the imaging equation of the polarized fluorescence microscope system is as follows:

Figure BDA0004038407450000031
Figure BDA0004038407450000031

其中:gv,p(rd)表示视角v偏振激发模式p下采集到的生物样本图像数据中对应位置rd处的灰度,

Figure BDA0004038407450000032
表示视角v偏振激发模式p下单位浓度距离为rd-ro朝向为
Figure BDA0004038407450000033
的荧光分子响应即偶极子点扩散函数,
Figure BDA0004038407450000034
表示生物样本在空间位置ro处角度朝向为
Figure BDA0004038407450000035
的荧光分子浓度,
Figure BDA0004038407450000036
表示三维空间,
Figure BDA0004038407450000037
表示球面空间。Where: g v,p (r d ) represents the grayscale at the corresponding position r d in the biological sample image data collected under the polarization excitation mode p at the viewing angle v,
Figure BDA0004038407450000032
Indicates that the unit concentration distance under the polarization excitation mode p is r d -r o and the direction is
Figure BDA0004038407450000033
The fluorescence molecular response is the dipole point spread function,
Figure BDA0004038407450000034
Indicates that the biological sample is oriented at the spatial position r o.
Figure BDA0004038407450000035
The concentration of fluorescent molecules,
Figure BDA0004038407450000036
represents three-dimensional space,
Figure BDA0004038407450000037
Represents spherical space.

进一步地,所述步骤(2)中反投影算子的计算表达式如下:Furthermore, the calculation expression of the back-projection operator in step (2) is as follows:

Figure BDA0004038407450000038
Figure BDA0004038407450000038

其中:

Figure BDA0004038407450000039
表示视角v偏振激发模式p下单位浓度距离为r朝向为
Figure BDA00040384074500000310
的荧光分子响应,
Figure BDA00040384074500000311
表示视角v偏振激发模式p下单位浓度距离为-r朝向为
Figure BDA00040384074500000312
的荧光分子响应,
Figure BDA00040384074500000313
对应为
Figure BDA00040384074500000314
的反投影算子,
Figure BDA00040384074500000315
表示三维空间。in:
Figure BDA0004038407450000039
It represents the unit concentration distance r and the direction under the polarization excitation mode p at the viewing angle v.
Figure BDA00040384074500000310
The fluorescent molecular response,
Figure BDA00040384074500000311
Indicates the unit concentration distance under the viewing angle v polarization excitation mode p is -r and the direction is
Figure BDA00040384074500000312
The fluorescent molecular response,
Figure BDA00040384074500000313
Corresponding to
Figure BDA00040384074500000314
The back-projection operator is
Figure BDA00040384074500000315
Represents three-dimensional space.

进一步地,所述步骤(4)中对于某一视角v,则通过以下表达式迭代估计生物样本的空间角度分布;Furthermore, in step (4), for a certain viewing angle v, the spatial angle distribution of the biological sample is estimated iteratively by the following expression:

Figure BDA00040384074500000316
Figure BDA00040384074500000316

其中:ek和ek+1分别为第k次和k+1次迭代后生物样本的空间角度分布估计结果,k为自然数,hv

Figure BDA00040384074500000317
分别为视角v下的偶极子点扩散函数和反投影算子,iv为视角v下获得的预处理后的生物样本图像数据,
Figure BDA00040384074500000318
Figure BDA00040384074500000319
分别为前投影运算符和反投影运算符。Where: e k and e k+1 are the estimated results of the spatial angular distribution of biological samples after the kth and k+1th iterations, respectively; k is a natural number, h v and
Figure BDA00040384074500000317
are the dipole point spread function and the back projection operator under the viewing angle v, respectively. i v is the preprocessed biological sample image data obtained under the viewing angle v.
Figure BDA00040384074500000318
and
Figure BDA00040384074500000319
They are the forward projection operator and the back projection operator respectively.

进一步地,前投影运算

Figure BDA00040384074500000320
以及反投影运算
Figure BDA00040384074500000321
的表达式如下:Furthermore, the forward projection operation
Figure BDA00040384074500000320
And back projection operation
Figure BDA00040384074500000321
The expression is as follows:

Figure BDA00040384074500000322
Figure BDA00040384074500000322

Figure BDA00040384074500000323
Figure BDA00040384074500000323

其中:

Figure BDA00040384074500000324
表示视角v下单位浓度距离为rd-ro朝向为
Figure BDA00040384074500000325
的荧光分子响应,
Figure BDA0004038407450000041
表示估计结果ek中生物样本在空间位置ro处角度朝向为
Figure BDA0004038407450000042
的荧光分子浓度,
Figure BDA0004038407450000043
对应为
Figure BDA0004038407450000044
的反投影算子,iv,p(rd)表示视角v偏振激发模式p下预处理后的生物样本图像数据中对应位置rd处的灰度。in:
Figure BDA00040384074500000324
The unit concentration distance under the viewing angle v is r d -r o and the direction is
Figure BDA00040384074500000325
The fluorescent molecular response,
Figure BDA0004038407450000041
Indicates that the angle orientation of the biological sample at the spatial position r o in the estimation result e k is
Figure BDA0004038407450000042
The concentration of fluorescent molecules,
Figure BDA0004038407450000043
Corresponding to
Figure BDA0004038407450000044
The back-projection operator, iv,p (r d ) represents the grayscale at the corresponding position r d in the preprocessed biological sample image data under the viewing angle v and polarization excitation mode p.

进一步地,为了减小计算代价,将所述步骤(4)迭代过程中涉及的四种运算包括前投影、反投影、球面域乘法、球面域除法分别改写为:Furthermore, in order to reduce the computational cost, the four operations involved in the iterative process of step (4), including forward projection, back projection, spherical domain multiplication, and spherical domain division, are rewritten as follows:

Figure BDA0004038407450000045
Figure BDA0004038407450000045

Figure BDA0004038407450000046
Figure BDA0004038407450000046

Figure BDA0004038407450000047
Figure BDA0004038407450000047

Figure BDA0004038407450000048
Figure BDA0004038407450000048

其中:

Figure BDA0004038407450000049
Figure BDA00040384074500000410
分别表示傅里叶变换和球谐变换,
Figure BDA00040384074500000411
Figure BDA00040384074500000412
对应表示
Figure BDA00040384074500000413
Figure BDA00040384074500000414
的逆变换,下标lm、l′m′以及l″m″表示球谐变换后得到的球谐分量的索引号,iv,p为视角v偏振激发模式p下预处理后的生物样本图像数据,
Figure BDA00040384074500000415
为视角v偏振激发模式p下的反投影算子,
Figure BDA00040384074500000416
为Gaunt系数。in:
Figure BDA0004038407450000049
and
Figure BDA00040384074500000410
denote Fourier transform and spherical harmonic transform respectively,
Figure BDA00040384074500000411
and
Figure BDA00040384074500000412
Corresponding representation
Figure BDA00040384074500000413
and
Figure BDA00040384074500000414
The inverse transformation of , the subscripts lm, l′m′ and l″m″ represent the index numbers of the spherical harmonic components obtained after the spherical harmonic transformation, iv ,p is the preprocessed biological sample image data under the polarization excitation mode p at the viewing angle v,
Figure BDA00040384074500000415
is the back-projection operator for polarization excitation mode p at viewing angle v,
Figure BDA00040384074500000416
is the Gaunt coefficient.

进一步地,所述Gaunt系数

Figure BDA00040384074500000417
的表达式如下:Furthermore, the Gaunt coefficient
Figure BDA00040384074500000417
The expression is as follows:

Figure BDA00040384074500000418
Figure BDA00040384074500000418

其中:

Figure BDA00040384074500000419
为球谐函数即表示球面域上对应朝向为
Figure BDA00040384074500000420
的某点与球谐分量lm的映射关系。in:
Figure BDA00040384074500000419
is a spherical harmonic function, which means that the corresponding direction on the spherical domain is
Figure BDA00040384074500000420
The mapping relationship between a certain point and the spherical harmonic component lm.

进一步地,对于生物样本的空间角度分布估计初值e0,则对每个空间位置设置相同的均匀角分布,即设置

Figure BDA00040384074500000421
Furthermore, for the estimated initial value e 0 of the spatial angular distribution of the biological sample, the same uniform angular distribution is set for each spatial position, that is,
Figure BDA00040384074500000421

本发明通过在传统理查德森-露西算法引入激发模式和角度分布两个维度,使得通过偏振荧光显微镜能够对荧光分子空间和角度分布进行更好的重建,无需为了抑制噪声而引入会带来估计偏差的正则化项。此外,改进后的查德森-露西算法本身的运算都是基于球面域,本发明设计了基于球谐域的运算过程,大大减少了前后投影和球面域乘除法的计算量。The present invention introduces two dimensions, namely, excitation mode and angular distribution, into the traditional Richardson-Lucy algorithm, so that the spatial and angular distribution of fluorescent molecules can be better reconstructed through polarized fluorescence microscopy, without the need to introduce regularization terms that will cause estimation bias in order to suppress noise. In addition, the operations of the improved Richardson-Lucy algorithm itself are all based on the spherical domain. The present invention designs an operation process based on the spherical harmonic domain, which greatly reduces the amount of calculation of front and back projections and spherical domain multiplication and division.

总的来说,本发明设计了从偏振荧光显微数据中重建荧光分子空间和角度分布的广义理查德森-露西算法,以合理的计算代价,更好地抑制了噪声,提高了重建结果的空间分辨率和角度分布准确性,并且解决了现有方法中多次手动调整参数繁琐的问题。In general, the present invention designs a generalized Richardson-Lucy algorithm for reconstructing the spatial and angular distribution of fluorescent molecules from polarized fluorescence microscopy data. At a reasonable computational cost, it better suppresses noise, improves the spatial resolution and angular distribution accuracy of the reconstruction results, and solves the problem of tedious multiple manual parameter adjustments in existing methods.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1为本发明基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法的流程示意图。FIG1 is a schematic flow chart of a method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm of the present invention.

图2(a)为对仿真数据添加不同水平的泊松噪声后使用本发明重建时每次迭代结果的空间分布与真实值的结构相似度变化曲线图,同时与使用了最优正则化项参数的基于SVD的最小二乘法进行对比。FIG2(a) is a graph showing the change in structural similarity between the spatial distribution of each iteration result and the true value when the present invention is used to reconstruct the simulated data after adding different levels of Poisson noise, and is also compared with the SVD-based least squares method using the optimal regularization term parameter.

图2(b)为对仿真数据添加不同水平的泊松噪声后使用本发明重建时每次迭代结果的角度分布峰值方向与真实值的角度之差的平均余弦值变化曲线图,同时与使用了最优正则化项参数的基于SVD的最小二乘法进行对比。FIG2( b ) is a curve diagram showing the change in the average cosine value of the angle difference between the peak direction of the angular distribution of each iterative result and the true value when the present invention is used to reconstruct the simulated data after adding different levels of Poisson noise, and is compared with the SVD-based least squares method using the optimal regularization term parameter.

图3(a)为对巨型单层囊泡(GUV)样品偏振荧光显微数据部分区域三维重建结果的角分布峰值方向图,第1行和第2行分别是本发明进行10次迭代的重建结果和使用基于SVD的最小二乘法重建结果在不同视角的观察图,第1~4列对应4个观察视角。Figure 3(a) is an angular distribution peak direction diagram of the three-dimensional reconstruction results of a partial area of the polarized fluorescence microscopy data of a giant unilamellar vesicle (GUV) sample. The first row and the second row are the observation diagrams of the reconstruction results of 10 iterations of the present invention and the reconstruction results using the SVD-based least squares method at different viewing angles, respectively. The first to fourth columns correspond to four observation viewing angles.

图3(b)为对巨型单层囊泡样品偏振荧光显微数据部分区域三维重建结果的空间分布图,第1行和第2行分别是本发明进行10次迭代的重建结果和使用基于SVD的最小二乘法重建结果在z轴位置的切片图,第3行为两种方法重建结果沿着上图划线位置的轮廓图,第1~2列对应为两组切片。Figure 3(b) is a spatial distribution diagram of the three-dimensional reconstruction results of a partial area of the polarized fluorescence microscopy data of a giant unilamellar vesicle sample. The first and second rows are slice diagrams of the reconstruction results of 10 iterations of the present invention and the reconstruction results using the SVD-based least squares method at the z-axis position, respectively. The third row is a contour diagram of the reconstruction results of the two methods along the line position in the upper figure. The first to second columns correspond to two groups of slices.

具体实施方式DETAILED DESCRIPTION

为了更为具体地描述本发明,下面结合附图及具体实施方式对本发明的技术方案进行详细说明。In order to describe the present invention more specifically, the technical solution of the present invention is described in detail below in conjunction with the accompanying drawings and specific implementation methods.

偏振荧光显微镜的激发光路发出某一偏振态的激光,照射被荧光蛋白标记或者自身具有荧光蛋白的生物样本使其发出荧光,显微镜的信号采集光路进行荧光数据的采集,不断移动采集光路的焦平面,使整个生物样本的信号被遍历,将每次采集到的图像堆叠,形成三维的体积图像。对于多视角、多偏振激发模式的数据,调整荧光显微镜激发方向或者旋转样本以及激发光的偏振模式,采集多组体积数据,得到多视角、多偏振激发模式的生物样本数据。The excitation light path of the polarized fluorescence microscope emits a laser of a certain polarization state, irradiating the biological sample labeled with fluorescent protein or having fluorescent protein to make it emit fluorescence. The signal collection light path of the microscope collects fluorescence data, and the focal plane of the collection light path is continuously moved so that the signal of the entire biological sample is traversed. The images collected each time are stacked to form a three-dimensional volume image. For data in multi-viewing angle and multi-polarization excitation modes, the excitation direction of the fluorescence microscope is adjusted or the sample and the polarization mode of the excitation light are rotated, and multiple sets of volume data are collected to obtain biological sample data in multi-viewing angle and multi-polarization excitation modes.

如图1所示,本发明基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法,包括如下步骤:As shown in FIG1 , the method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm of the present invention comprises the following steps:

S1.计算系统矩阵,包括偶极子点扩散函数和反投影算子。通过模拟为每个视角v、偏振激发模式p生成偶极子点扩展函数hv,p,并计算带有物空间敏感常数的反投影算子

Figure BDA0004038407450000061
S1. Calculate the system matrix, including the dipole point spread function and the back-projection operator. Generate the dipole point spread function h v,p for each viewing angle v and polarization excitation mode p through simulation, and calculate the back-projection operator with object space sensitivity constants
Figure BDA0004038407450000061

Figure BDA0004038407450000062
Figure BDA0004038407450000062

将它们以多维矩阵形式保存,以备后续数据处理。Save them in the form of multidimensional matrices for subsequent data processing.

S2.由于采集得到的图像所参考的坐标系不一致,首先要进行预处理,选择一个视角、偏振激发模式作为参考,对其他视角、激发模式获得的数据进行线性插值并进行一定角度的旋转,使它们具有相应的坐标系。此时得到的是粗配准的图像,为了更准确的图像融合,采用基于强度的配准方法生成配准矩阵,将每个视角、激发模式的数据乘以相应的配准矩阵,得到配准好的多视角、多偏振激发模式图像数据。S2. Since the reference coordinate systems of the acquired images are inconsistent, preprocessing is first performed. Select a viewing angle and polarization excitation mode as a reference, and perform linear interpolation and rotation of a certain angle on the data obtained from other viewing angles and excitation modes so that they have corresponding coordinate systems. At this time, a roughly registered image is obtained. For more accurate image fusion, an intensity-based registration method is used to generate a registration matrix. The data of each viewing angle and excitation mode are multiplied by the corresponding registration matrix to obtain the registered multi-view and multi-polarization excitation mode image data.

S3.使用引入表征激发模式的偏振态域与表征角度分布的球面域的广义理查德森-露西算法进行迭代计算,在每次迭代中的得到相应的荧光分子空间角度分布重建估计结果:S3. Use the generalized Richardson-Lucy algorithm that introduces the polarization state domain that characterizes the excitation mode and the spherical domain that characterizes the angular distribution to perform iterative calculations, and obtain the corresponding reconstruction estimation result of the spatial angular distribution of the fluorescent molecules in each iteration:

Figure BDA0004038407450000063
Figure BDA0004038407450000063

将原本定义在空域和球面域进行的运算,转换到频域和球谐域来实施计算,将前投影、后投影、球面域乘法、球面域除法变为:The operations originally defined in the spatial domain and spherical domain are converted to the frequency domain and spherical harmonic domain for calculation, and the front projection, back projection, spherical domain multiplication, and spherical domain division are transformed into:

Figure BDA0004038407450000064
Figure BDA0004038407450000064

Figure BDA0004038407450000071
Figure BDA0004038407450000071

Figure BDA0004038407450000072
Figure BDA0004038407450000072

Figure BDA0004038407450000073
Figure BDA0004038407450000073

迭代估计出生物样本的空间和角度分布。The spatial and angular distribution of biological samples are estimated iteratively.

S4.判断是否满足迭代停止条件,即是否达到了预计的迭代次数,不满足该条件则执行步骤S3,满足则迭代停止,将最后一次迭代得到的空间角度分布估计结果作为最后的重建结果。S4. Determine whether the iteration stop condition is met, that is, whether the expected number of iterations has been reached. If the condition is not met, execute step S3. If the condition is met, the iteration stops and the spatial angle distribution estimation result obtained from the last iteration is used as the final reconstruction result.

我们以单视角、多个偏振激发模式下获得的数据重建为例,对引入表征激发模式的偏振态域与表征角度分布的球面域的广义理查德森-露西算法进行具体介绍。传统的单视角理查德森-露西算法具有以下迭代结构:We take the reconstruction of data obtained under single-view and multiple polarization excitation modes as an example to introduce the generalized Richardson-Lucy algorithm that introduces the polarization state domain that characterizes the excitation mode and the spherical domain that characterizes the angle distribution. The traditional single-view Richardson-Lucy algorithm has the following iterative structure:

e0=ie 0 = i

for k=0,1,2,...,Nfor k = 0, 1, 2, ..., N

Figure BDA0004038407450000074
Figure BDA0004038407450000074

endend

本发明将表征激发模式的偏振态域与表征角度分布的球面域引入上式中,提出了以下新的迭代公式:The present invention introduces the polarization state domain characterizing the excitation mode and the spherical domain characterizing the angle distribution into the above formula, and proposes the following new iterative formula:

e0=1e 0 = 1

for k=0,1,2,...,Nfor k = 0, 1, 2, ..., N

Figure BDA0004038407450000075
Figure BDA0004038407450000075

endend

前、后向投影操作定义为:The forward and backward projection operations are defined as:

Figure BDA0004038407450000081
Figure BDA0004038407450000081

Figure BDA0004038407450000082
Figure BDA0004038407450000082

关于反投影算子,传统理查德森-露西算法中是将点扩散函数进行翻转生成的,但是这里引入了更多的维度,前、后向投影过程中两侧的域空间是不一致的,这将导致迭代的迅速发散,因此在反投影算子中引入了物空间敏感常数,最终的反投影算子

Figure BDA0004038407450000083
如下:Regarding the back-projection operator, the traditional Richardson-Lucy algorithm generates the point spread function by flipping it, but this introduces more dimensions. The domain spaces on both sides of the forward and backward projection processes are inconsistent, which will lead to rapid divergence of iterations. Therefore, an object space sensitive constant is introduced in the back-projection operator, and the final back-projection operator is
Figure BDA0004038407450000083
as follows:

Figure BDA0004038407450000084
Figure BDA0004038407450000084

由于在计算过程中,球面域维度

Figure BDA0004038407450000085
通常需要离散为数千个方向值,导致了巨大的计算量,因此可以使用球谐变换转到球谐域;在球谐域中,通常只需要数10个lm值就能表示原本在球面域中需要数千个值才能描述的分布。此外,在频域做乘积的计算成本也远远小于在空间域做卷积运算。Since in the calculation process, the spherical domain dimension
Figure BDA0004038407450000085
Usually it needs to be discretized into thousands of directional values, which leads to a huge amount of calculation. Therefore, spherical harmonic transformation can be used to transfer to the spherical harmonic domain. In the spherical harmonic domain, usually only a few dozen lm values are needed to represent the distribution that originally required thousands of values in the spherical domain. In addition, the computational cost of doing products in the frequency domain is much lower than doing convolution operations in the spatial domain.

因此,本发明将迭代结构中各运算符的定义改写成:Therefore, the present invention rewrites the definition of each operator in the iteration structure as follows:

Figure BDA0004038407450000086
Figure BDA0004038407450000086

Figure BDA0004038407450000087
Figure BDA0004038407450000087

Figure BDA0004038407450000088
Figure BDA0004038407450000088

Figure BDA0004038407450000089
Figure BDA0004038407450000089

类似的,对于多视角、每个视角下有数个偏振激发模式获得的数据,反投影算子为:Similarly, for data obtained from multiple views with several polarization excitation modes at each view, the back-projection operator is:

Figure BDA00040384074500000810
Figure BDA00040384074500000810

加法迭代重建公式为:The additive iterative reconstruction formula is:

e0=1e 0 = 1

for k=0,1,2,...,Nfor k = 0, 1, 2, ..., N

Figure BDA0004038407450000091
Figure BDA0004038407450000091

……

Figure BDA0004038407450000092
Figure BDA0004038407450000092

Figure BDA0004038407450000093
Figure BDA0004038407450000093

endend

乘法迭代重建公式为:The multiplication iterative reconstruction formula is:

Figure BDA0004038407450000094
Figure BDA0004038407450000094

for k=0,1,2,...,Nfor k = 0, 1, 2, ..., N

Figure BDA0004038407450000095
Figure BDA0004038407450000095

……

Figure BDA0004038407450000096
Figure BDA0004038407450000096

endend

以下我们采用模拟数据来验证本发明的有效性,随机生成了一个具有一定空间和角度分布的体模,使用偶极子点扩散函数进行前向投影来模拟偏振荧光显微镜的激发和采集过程,获得了一组仿真数据。对仿真数据添加不同水平(SNR=30dB和5dB)的泊松噪声后,使用本发明进行重建,记录每次迭代后的结果,并且均与使用了最优正则化项参数的基于SVD的最小二乘法进行对比;图2(a)绘制的是重建结果空间分布与真值的差距,用结构相似度指标表征,图2(b)绘制的是重建结果角度分布峰值方向与真值之间的差距,用角度之差的平均余弦值表征;它们共同说明了本发明的重建结果远远好于使用手动对基于SVD的最小二乘法调参能获得的最佳结果,尤其是重建结果角度分布峰值方向,有着非常大的准确性提升,并且对噪声是不敏感的。In the following, we use simulated data to verify the effectiveness of the present invention. We randomly generate a phantom with a certain spatial and angular distribution, and use the dipole point spread function to perform forward projection to simulate the excitation and acquisition process of the polarized fluorescence microscope, and obtain a set of simulated data. After adding different levels of Poisson noise (SNR = 30dB and 5dB) to the simulated data, the present invention is used to reconstruct, and the results after each iteration are recorded, and compared with the SVD-based least squares method using the optimal regularization term parameter; Figure 2 (a) plots the gap between the spatial distribution of the reconstruction result and the true value, represented by the structural similarity index, and Figure 2 (b) plots the gap between the peak direction of the angular distribution of the reconstruction result and the true value, represented by the average cosine value of the angle difference; they together illustrate that the reconstruction result of the present invention is far better than the best result that can be obtained by manually adjusting the parameters of the SVD-based least squares method, especially the peak direction of the angular distribution of the reconstruction result, which has a very large accuracy improvement and is insensitive to noise.

此外,我们使用巨型单层囊泡样品实验数据来进一步验证本发明的有效性,巨型单层囊泡是生物偏振荧光成像中常用的生物样本,根据目前的生物学认知,其囊泡膜上的荧光分子角分布峰值方向为垂直于膜表面切向,数据通过偏振双视角倒置光片荧光显微镜(pol-diSPIM)采集得到。In addition, we use the experimental data of giant unilamellar vesicle samples to further verify the effectiveness of the present invention. Giant unilamellar vesicles are commonly used biological samples in biological polarized fluorescence imaging. According to current biological knowledge, the peak direction of the angular distribution of fluorescent molecules on the vesicle membrane is perpendicular to the tangent direction of the membrane surface. The data is collected by polarized dual-view inverted light sheet fluorescence microscopy (pol-diSPIM).

将使用本发明基于广义理查德森-露西算法的荧光分子空间角度分布重建方法与传统的基于SVD的最小二乘算法重建结果做比较,前者的迭代次数设为10次,后者的正则化项参数经过多次尝试后设定为1,二者对相同数据进行处理,并展示处理结果的角度分布峰值方向在不同视角下的观察图,以及处理结果的空间分布在不同深度处的切片图。The reconstruction results of the fluorescent molecule spatial angular distribution reconstruction method based on the generalized Richardson-Lucy algorithm of the present invention are compared with those of the traditional least squares algorithm based on SVD. The number of iterations of the former is set to 10 times, and the regularization term parameter of the latter is set to 1 after many attempts. The two process the same data and display the observation diagrams of the angular distribution peak direction of the processing results at different viewing angles, as well as the slice diagrams of the spatial distribution of the processing results at different depths.

从图3(a)可以直观地看出,在荧光分子角度分布方面,基于本发明基于广义理查德森-露西算法的重建算法与传统基于SVD的最小二乘算法的结果相比,我们的改进方法可以得到更加准确、符合生物学认知的样本荧光分子角度分布,具体的提升在于,角度分布峰值方向都近乎垂直于囊泡膜,整体变化更加连续,并且在感兴趣区域有着更高的信噪和更好的区分度。It can be seen intuitively from Figure 3(a) that in terms of the angular distribution of fluorescent molecules, compared with the results of the traditional least squares algorithm based on SVD, the reconstruction algorithm based on the generalized Richardson-Lucy algorithm of the present invention can obtain a more accurate angular distribution of sample fluorescent molecules that conforms to biological cognition. The specific improvement is that the peak direction of the angular distribution is almost perpendicular to the vesicle membrane, the overall change is more continuous, and there is a higher signal-to-noise and better discrimination in the region of interest.

从图3(b)可以直观地看出,在荧光分子空间分布方面,基于本发明基于广义理查德森-露西算法的重建算法与传统基于SVD的最小二乘算法的结果相比,我们的改进方法可以获得更高分辨率和噪声的荧光分子空间分布,具体的提升在于,降低了空间分布的模糊程度,使得样本一些固有结构能够清晰可辨,整体提高了分辨率和信噪比。It can be seen intuitively from Figure 3(b) that in terms of the spatial distribution of fluorescent molecules, compared with the results of the traditional least squares algorithm based on SVD, the reconstruction algorithm based on the generalized Richardson-Lucy algorithm of the present invention can obtain a higher resolution and noise spatial distribution of fluorescent molecules. The specific improvement is that the blurring degree of the spatial distribution is reduced, so that some inherent structures of the sample can be clearly distinguished, and the overall resolution and signal-to-noise ratio are improved.

上述对实施例的描述是为便于本技术领域的普通技术人员能理解和应用本发明。熟悉本领域技术的人员显然可以容易地对上述实施例做出各种修改,并把在此说明的一般原理应用到其他实施例中而不必经过创造性的劳动。因此,本发明不限于上述实施例,本领域技术人员根据本发明的揭示,对于本发明做出的改进和修改都应该在本发明的保护范围之内。The above description of the embodiments is to facilitate the understanding and application of the present invention by those skilled in the art. It is obvious that those skilled in the art can easily make various modifications to the above embodiments and apply the general principles described herein to other embodiments without creative work. Therefore, the present invention is not limited to the above embodiments, and improvements and modifications made to the present invention by those skilled in the art based on the disclosure of the present invention should be within the scope of protection of the present invention.

Claims (10)

1.一种基于广义理查德森-露西算法的荧光分子空间和角度分布重建方法,包括如下步骤:1. A method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm, comprising the following steps: (1)在偏振荧光显微镜系统中,对于每个视角,利用数个不同偏振态的激发光对荧光标记的生物样本进行荧光激发,并通过探测物镜进行数据采集,得到每个视角下每个偏振激发模式对应的生物样本图像数据;(1) In a polarized fluorescence microscope system, for each viewing angle, a fluorescently labeled biological sample is excited by using excitation lights of several different polarization states, and data is collected through a detection objective lens to obtain biological sample image data corresponding to each polarization excitation mode at each viewing angle; (2)通过模拟得到每个视角下每个偏振激发模式对应的偶极子点扩散函数,然后对偶极子点扩散函数进行整体归一化处理,并计算带有物空间敏感常数的反投影算子;(2) obtaining the dipole point spread function corresponding to each polarization excitation mode at each viewing angle through simulation, then performing overall normalization on the dipole point spread function and calculating the back-projection operator with object space sensitive constants; (3)对采集得到的生物样本图像数据进行预处理;(3) preprocessing the collected biological sample image data; (4)使表征激发模式的偏振态域与表征角度分布的球面域引入理查德森-露西算法,并将原本应在空域和球面域进行的运算转换到频域和球谐域来实施,从而迭代估计出生物样本的空间角度分布。(4) The Richardson-Lucy algorithm is introduced into the polarization state domain that characterizes the excitation mode and the spherical domain that characterizes the angular distribution, and the operations that should be performed in the spatial domain and spherical domain are converted to the frequency domain and spherical harmonic domain for implementation, thereby iteratively estimating the spatial angular distribution of the biological sample. 2.根据权利要求1所述的荧光分子空间和角度分布重建方法,其特征在于:所述视角数量以及偏振激发模式数量为单个或多个。2. The method for reconstructing the spatial and angular distribution of fluorescent molecules according to claim 1, wherein the number of viewing angles and the number of polarization excitation modes are single or multiple. 3.根据权利要求1所述的荧光分子空间和角度分布重建方法,其特征在于:所述步骤(1)中采集得到的生物样本图像数据为体积图像,其由二维切片图像堆叠得到;每个视角及偏振激发模式对应的偶极子点扩展函数具有三个空间维度加上一个球面维度,共四维矩阵结构。3. The method for reconstructing the spatial and angular distribution of fluorescent molecules according to claim 1 is characterized in that: the biological sample image data collected in the step (1) is a volume image, which is obtained by stacking two-dimensional slice images; the dipole point spread function corresponding to each viewing angle and polarization excitation mode has three spatial dimensions plus one spherical dimension, a total of a four-dimensional matrix structure. 4.根据权利要求1所述的荧光分子空间和角度分布重建方法,其特征在于:所述偏振荧光显微镜系统的成像方程如下:4. The method for reconstructing the spatial and angular distribution of fluorescent molecules according to claim 1, wherein the imaging equation of the polarized fluorescence microscope system is as follows:
Figure FDA0004038407440000011
Figure FDA0004038407440000011
其中:gv,p(rd)表示视角v偏振激发模式p下采集到的生物样本图像数据中对应位置rd处的灰度,
Figure FDA0004038407440000012
表示视角v偏振激发模式p下单位浓度距离为rd-ro朝向为
Figure FDA0004038407440000013
的荧光分子响应即偶极子点扩散函数,
Figure FDA0004038407440000014
表示生物样本在空间位置ro处角度朝向为
Figure FDA0004038407440000015
的荧光分子浓度,
Figure FDA0004038407440000016
表示三维空间,
Figure FDA0004038407440000017
表示球面空间。
Where: g v,p (r d ) represents the grayscale at the corresponding position r d in the biological sample image data collected under the polarization excitation mode p at the viewing angle v,
Figure FDA0004038407440000012
Indicates that the unit concentration distance under the polarization excitation mode p is r d -r o and the direction is
Figure FDA0004038407440000013
The fluorescence molecular response is the dipole point spread function,
Figure FDA0004038407440000014
Indicates that the biological sample is oriented at the spatial position r o.
Figure FDA0004038407440000015
The concentration of fluorescent molecules,
Figure FDA0004038407440000016
represents three-dimensional space,
Figure FDA0004038407440000017
Represents spherical space.
5.根据权利要求1所述的荧光分子空间和角度分布重建方法,其特征在于:所述步骤(2)中反投影算子的计算表达式如下:5. The method for reconstructing the spatial and angular distribution of fluorescent molecules according to claim 1, wherein the calculation expression of the back-projection operator in step (2) is as follows:
Figure FDA0004038407440000021
Figure FDA0004038407440000021
其中:
Figure FDA0004038407440000022
表示视角v偏振激发模式p下单位浓度距离为r朝向为
Figure FDA0004038407440000023
的荧光分子响应,
Figure FDA0004038407440000024
表示视角v偏振激发模式p下单位浓度距离为-r朝向为
Figure FDA0004038407440000025
的荧光分子响应,
Figure FDA0004038407440000026
对应为
Figure FDA0004038407440000027
的反投影算子,
Figure FDA0004038407440000028
表示三维空间。
in:
Figure FDA0004038407440000022
It represents the unit concentration distance r and the direction under the polarization excitation mode p at the viewing angle v.
Figure FDA0004038407440000023
The fluorescent molecular response,
Figure FDA0004038407440000024
Indicates the unit concentration distance under the viewing angle v polarization excitation mode p is -r and the direction is
Figure FDA0004038407440000025
The fluorescent molecular response,
Figure FDA0004038407440000026
Corresponding to
Figure FDA0004038407440000027
The back-projection operator is
Figure FDA0004038407440000028
Represents three-dimensional space.
6.根据权利要求4所述的荧光分子空间和角度分布重建方法,其特征在于:所述步骤(4)中对于某一视角v,则通过以下表达式迭代估计生物样本的空间角度分布;6. The method for reconstructing the spatial and angular distribution of fluorescent molecules according to claim 4, characterized in that: in the step (4), for a certain viewing angle v, the spatial angular distribution of the biological sample is estimated iteratively by the following expression;
Figure FDA0004038407440000029
Figure FDA0004038407440000029
其中:ek和ek+1分别为第k次和k+1次迭代后生物样本的空间角度分布估计结果,k为自然数,hv
Figure FDA00040384074400000210
分别为视角v下的偶极子点扩散函数和反投影算子,iv为视角v下获得的预处理后的生物样本图像数据,
Figure FDA00040384074400000211
Figure FDA00040384074400000212
分别为前投影运算符和反投影运算符。
Where: e k and e k+1 are the estimated results of the spatial angular distribution of biological samples after the kth and k+1th iterations, respectively; k is a natural number, h v and
Figure FDA00040384074400000210
are the dipole point spread function and the back projection operator under the viewing angle v, respectively. i v is the preprocessed biological sample image data obtained under the viewing angle v.
Figure FDA00040384074400000211
and
Figure FDA00040384074400000212
They are the forward projection operator and the back projection operator respectively.
7.根据权利要求6所述的荧光分子空间和角度分布重建方法,其特征在于:前投影运算
Figure FDA00040384074400000213
以及反投影运算
Figure FDA00040384074400000214
的表达式如下:
7. The method for reconstructing the spatial and angular distribution of fluorescent molecules according to claim 6, characterized in that: the front projection operation
Figure FDA00040384074400000213
And back projection operation
Figure FDA00040384074400000214
The expression is as follows:
Figure FDA00040384074400000215
Figure FDA00040384074400000215
Figure FDA00040384074400000216
Figure FDA00040384074400000216
其中:
Figure FDA00040384074400000217
表示视角v下单位浓度距离为rd-ro朝向为
Figure FDA00040384074400000218
的荧光分子响应,
Figure FDA00040384074400000219
表示估计结果ek中生物样本在空间位置ro处角度朝向为
Figure FDA00040384074400000220
的荧光分子浓度,
Figure FDA00040384074400000221
对应为
Figure FDA00040384074400000222
的反投影算子,iv,p(rd)表示视角v偏振激发模式p下预处理后的生物样本图像数据中对应位置rd处的灰度。
in:
Figure FDA00040384074400000217
The unit concentration distance under the viewing angle v is r d -r o and the direction is
Figure FDA00040384074400000218
The fluorescent molecular response,
Figure FDA00040384074400000219
Indicates that the angle orientation of the biological sample at the spatial position r o in the estimation result e k is
Figure FDA00040384074400000220
The concentration of fluorescent molecules,
Figure FDA00040384074400000221
Corresponding to
Figure FDA00040384074400000222
The back-projection operator iv,p (r d ) represents the grayscale at the corresponding position rd in the preprocessed biological sample image data under the viewing angle v and polarization excitation mode p.
8.根据权利要求7所述的荧光分子空间和角度分布重建方法,其特征在于:为了减小计算代价,将所述步骤(4)迭代过程中涉及的四种运算包括前投影、反投影、球面域乘法、球面域除法分别改写为:8. The method for reconstructing the spatial and angular distribution of fluorescent molecules according to claim 7, characterized in that: in order to reduce the computational cost, the four operations involved in the iterative process of step (4) including forward projection, back projection, spherical domain multiplication, and spherical domain division are rewritten as follows:
Figure FDA0004038407440000031
Figure FDA0004038407440000031
Figure FDA0004038407440000032
Figure FDA0004038407440000032
Figure FDA0004038407440000033
Figure FDA0004038407440000033
Figure FDA0004038407440000034
Figure FDA0004038407440000034
其中:
Figure FDA0004038407440000035
Figure FDA0004038407440000036
分别表示傅里叶变换和球谐变换,
Figure FDA0004038407440000037
Figure FDA0004038407440000038
对应表示
Figure FDA0004038407440000039
Figure FDA00040384074400000310
的逆变换,下标lm、l′m′以及l″m″表示球谐变换后得到的球谐分量的索引号,iv,p为视角v偏振激发模式p下预处理后的生物样本图像数据,
Figure FDA00040384074400000311
为视角v偏振激发模式p下的反投影算子,
Figure FDA00040384074400000312
为Gaunt系数。
in:
Figure FDA0004038407440000035
and
Figure FDA0004038407440000036
denote Fourier transform and spherical harmonic transform respectively,
Figure FDA0004038407440000037
and
Figure FDA0004038407440000038
Corresponding representation
Figure FDA0004038407440000039
and
Figure FDA00040384074400000310
The inverse transformation of , the subscripts lm, l′m′ and l″m″ represent the index numbers of the spherical harmonic components obtained after the spherical harmonic transformation, iv ,p is the preprocessed biological sample image data under the polarization excitation mode p at the viewing angle v,
Figure FDA00040384074400000311
is the back-projection operator for polarization excitation mode p at viewing angle v,
Figure FDA00040384074400000312
is the Gaunt coefficient.
9.根据权利要求8所述的荧光分子空间和角度分布重建方法,其特征在于:所述Gaunt系数
Figure FDA00040384074400000313
的表达式如下:
9. The method for reconstructing the spatial and angular distribution of fluorescent molecules according to claim 8, characterized in that: the Gaunt coefficient
Figure FDA00040384074400000313
The expression is as follows:
Figure FDA00040384074400000314
Figure FDA00040384074400000314
其中:
Figure FDA00040384074400000315
为球谐函数即表示球面域上对应朝向为
Figure FDA00040384074400000316
的某点与球谐分量lm的映射关系。
in:
Figure FDA00040384074400000315
is a spherical harmonic function, which means that the corresponding direction on the spherical domain is
Figure FDA00040384074400000316
The mapping relationship between a certain point and the spherical harmonic component lm.
10.根据权利要求6所述的荧光分子空间和角度分布重建方法,其特征在于:对于生物样本的空间角度分布估计初值e0,则对每个空间位置设置相同的均匀角分布,即设置
Figure FDA00040384074400000317
10. The method for reconstructing the spatial and angular distribution of fluorescent molecules according to claim 6, characterized in that: for the estimated initial value e 0 of the spatial angular distribution of the biological sample, the same uniform angular distribution is set for each spatial position, that is,
Figure FDA00040384074400000317
CN202310013256.5A 2023-01-05 2023-01-05 A method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm Active CN115953319B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310013256.5A CN115953319B (en) 2023-01-05 2023-01-05 A method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310013256.5A CN115953319B (en) 2023-01-05 2023-01-05 A method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm

Publications (2)

Publication Number Publication Date
CN115953319A true CN115953319A (en) 2023-04-11
CN115953319B CN115953319B (en) 2025-04-29

Family

ID=87290515

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310013256.5A Active CN115953319B (en) 2023-01-05 2023-01-05 A method for reconstructing the spatial and angular distribution of fluorescent molecules based on the generalized Richardson-Lucy algorithm

Country Status (1)

Country Link
CN (1) CN115953319B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170023786A1 (en) * 2015-07-24 2017-01-26 General Electric Company Systems and Methods for Image Processing in Optical Microscopes
CN111476733A (en) * 2020-04-07 2020-07-31 浙江大学 An acceleration algorithm for microscope image deconvolution based on mismatch operator

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170023786A1 (en) * 2015-07-24 2017-01-26 General Electric Company Systems and Methods for Image Processing in Optical Microscopes
CN111476733A (en) * 2020-04-07 2020-07-31 浙江大学 An acceleration algorithm for microscope image deconvolution based on mismatch operator

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
郭敏: "倒置型光片荧光显微成像及图像分析技术研究", 全国优秀博士学位论文数据库, 15 February 2017 (2017-02-15) *

Also Published As

Publication number Publication date
CN115953319B (en) 2025-04-29

Similar Documents

Publication Publication Date Title
Thiele et al. 2D and 3D MALDI-imaging: conceptual strategies for visualization and data mining
Sarder et al. Deconvolution methods for 3-D fluorescence microscopy images
CN102288589B (en) Method and device for positioning single fluorescent probe, and super-resolution imaging method and system
Temerinac-Ott et al. Multiview deblurring for 3-D images from light-sheet-based fluorescence microscopy
US8126247B2 (en) Image preprocessing system for 3D image database construction
CN111476733B (en) An acceleration algorithm for microscope image deconvolution based on mismatch operator
TW200945245A (en) Registration of 3D point cloud data by creation of filtered density images
Winkler et al. Focus gradient correction applied to tilt series image data used in electron tomography
Guo et al. An image super-resolution reconstruction method with single frame character based on wavelet neural network in internet of things
Conte et al. A kalman filter approach for denoising and deblurring 3-d microscopy images
CN108520507B (en) A multi-view light sheet microscope image fusion method with improved deconvolution efficiency
Yin et al. Restoring DIC microscopy images from multiple shear directions
JP2010117175A (en) Image processing system, image processing method, program, and recording medium
Verveer et al. Acceleration of the ICTM image restoration algorithm
CN115953319A (en) Fluorescent molecular space and angle distribution reconstruction method based on generalized Richardson-Lucy algorithm
Preza et al. Image reconstruction for 3D light microscopy with a regularized linear method incorporating a smoothness prior
Mallick et al. Structure and view estimation for tomographic reconstruction: A Bayesian approach
CN111524078A (en) Dense network-based microscopic image deblurring method
CN117670711A (en) Fluorescent molecule space and angle distribution reconstruction method
CN108038824B (en) A Fluorescence Dipole Orientation Method Based on Structured Light Illumination
WO2020051764A1 (en) Noise reduction method and apparatus for molecular localization super-resolution imaging, and terminal device
Speiser et al. Teaching deep neural networks to localize single molecules for super-resolution microscopy
Le Saux et al. Isotropic high-resolution three-dimensional confocal micro-rotation imaging for non-adherent living cells
CN114913065A (en) A Super-Resolution SIM-FRET Image Reconstruction Method Based on Spatial Colocalization Mask Filtering
Wan et al. Iterative methods in large field electron microscope tomography

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant