CN110610147A - Blood vessel image extraction method, related device and storage device - Google Patents
Blood vessel image extraction method, related device and storage device Download PDFInfo
- Publication number
- CN110610147A CN110610147A CN201910816037.4A CN201910816037A CN110610147A CN 110610147 A CN110610147 A CN 110610147A CN 201910816037 A CN201910816037 A CN 201910816037A CN 110610147 A CN110610147 A CN 110610147A
- Authority
- CN
- China
- Prior art keywords
- blood vessel
- image
- vessel image
- dimensional
- dimensional blood
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/14—Vascular patterns
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
Abstract
Description
技术领域technical field
本发明属于光学成像技术领域,尤其涉及一种血管图像提取方法、相关装置及存储设备。The invention belongs to the technical field of optical imaging, and in particular relates to a blood vessel image extraction method, a related device and a storage device.
背景技术Background technique
光声成像是国际上最新发展的,兼具光学与超声成像优势的一种突破性的新型无创生物医学成像技术,其原理是将脉冲激光导入到生物组织上,组织因瞬时热膨胀产生超声信号,通过探测此信号获得组织的光吸收信息。生物组织中血红蛋白对不同波长光的吸收程度不同,所被激发出的光声信号强弱程度也不同。选择高吸收的单波长对血管进行扫描,可直接成像,无需注射任何对比剂;而选择多波长进行扫描,则可通过计算获得血液中氧饱和度、氧代谢率等参数,这对研究眼前节血管形态及功能有着重大意义。Photoacoustic imaging is the latest development in the world, a breakthrough new non-invasive biomedical imaging technology with both optical and ultrasonic imaging advantages. Its principle is to introduce pulsed laser light into biological tissue, and the tissue will generate ultrasonic signals due to instantaneous thermal expansion. The light absorption information of the tissue is obtained by detecting this signal. Hemoglobin in biological tissue absorbs different wavelengths of light in different degrees, and the intensity of the excited photoacoustic signal is also different. Choose a high-absorption single wavelength to scan blood vessels, which can be directly imaged without injecting any contrast agent; while choosing multiple wavelengths to scan, you can obtain blood oxygen saturation, oxygen metabolism rate and other parameters through calculation, which is very important for the study of the anterior segment. Vascular morphology and function are of great significance.
血管提取算法一直是保证高效疾病诊断的前提而被广泛应用于磁共振、光学相干断层扫描等成像系统中,而光声成像中并没有合适的三维血管提取算法。二维血管数据提取方法虽然便于实现,但是投影后的二维数据所含的有用信息远小于三维数据,并不能高效的用于评估血管病变中。Vessel extraction algorithms have always been the prerequisite for efficient disease diagnosis and have been widely used in imaging systems such as magnetic resonance and optical coherence tomography. However, there is no suitable three-dimensional vessel extraction algorithm for photoacoustic imaging. Although the two-dimensional blood vessel data extraction method is easy to implement, the useful information contained in the projected two-dimensional data is far less than that of the three-dimensional data, and cannot be efficiently used in the assessment of vascular lesions.
发明内容Contents of the invention
有鉴于此,本发明实施例提供了血管图像提取方法、相关装置及存储设备,以解决现有技术中扫描图像成像质量不好的问题。In view of this, the embodiments of the present invention provide a blood vessel image extraction method, a related device and a storage device, so as to solve the problem of poor imaging quality of scanned images in the prior art.
本发明实施例的第一方面提供了一种血管图像提取方法,包括:The first aspect of the embodiments of the present invention provides a blood vessel image extraction method, including:
使用第一参数组对目标对象进行三维扫描,获得三维扫描数据,所述第一参数组包括X、Y和Z轴三个方向上的扫描距离参数,其中所述第一参数组的Z轴扫描距离为零;Use the first parameter group to perform three-dimensional scanning on the target object to obtain three-dimensional scanning data. The first parameter group includes scanning distance parameters in the three directions of X, Y and Z axes, wherein the Z-axis scanning of the first parameter group distance is zero;
根据所述三维扫描数据确定所述目标对象的Z轴动态扫描参数,所述Z轴动态扫描参数包括目标对象的表面弧线上N个点分别投影到焦平面的N个Z 轴距离,所述N为大于1的整数;Determine the Z-axis dynamic scanning parameters of the target object according to the three-dimensional scanning data, and the Z-axis dynamic scanning parameters include N Z-axis distances of N points on the surface arc of the target object respectively projected to the focal plane, the said N is an integer greater than 1;
根据所述Z轴动态扫描参数调整所述第一参数组中的Z轴动态扫描距离,获得第二参数组;Adjusting the Z-axis dynamic scanning distance in the first parameter group according to the Z-axis dynamic scanning parameters to obtain a second parameter group;
使用所述第二参数组对所述目标对象进行弧度扫描,得到所述目标对象的弧度扫描图像数据。performing arc scanning on the target object by using the second parameter set to obtain arc scanning image data of the target object.
在本申请实施例的一种实施方式中,所述通过开运算和闭运算的方式对所述三维血管图像进行去噪处理,得到去噪后的三维血管图像,包括:In an implementation manner of an embodiment of the present application, the denoising processing is performed on the three-dimensional blood vessel image by means of opening operation and closing operation to obtain a denoised three-dimensional blood vessel image, including:
对所述三维血管图像进行腐蚀运算处理,对腐蚀后的三维血管图像进行开运算,得到开运算图;performing an erosion operation on the three-dimensional blood vessel image, and performing an opening operation on the etched three-dimensional blood vessel image to obtain an opening operation diagram;
对所述三维血管图像进行膨胀运算处理,对膨胀后的三维血管图像进行闭运算,得到闭运算图;performing an expansion operation on the three-dimensional blood vessel image, and performing a closing operation on the expanded three-dimensional blood vessel image to obtain a closing operation diagram;
对所述开运算图和所述闭运算图进行傅里叶变换,得到去噪后的三维血管图像。Fourier transform is performed on the opening operation graph and the closing operation graph to obtain a denoised three-dimensional blood vessel image.
在本申请实施例的一种实施方式中,In one implementation manner of the embodiment of the present application,
通过高斯尺度空间提取所述去噪后的三维血管图像的血管特征图,包括:Extracting the blood vessel feature map of the denoised three-dimensional blood vessel image through Gaussian scale space, including:
将预设的高斯核函数与去噪后的三维血管图像进行卷积,构造所述三维血管图像的高斯金字塔;Convolving the preset Gaussian kernel function with the denoised three-dimensional blood vessel image to construct a Gaussian pyramid of the three-dimensional blood vessel image;
通过所述高斯金字塔中相邻尺度的图像相减,得到所述三维血管图像的高斯尺度空间;Obtaining the Gaussian scale space of the three-dimensional blood vessel image by subtracting images of adjacent scales in the Gaussian pyramid;
在所述高斯尺度空间中提取局部极值点形成所述三维血管图像的血管特征图。Extracting local extremum points in the Gaussian scale space to form a blood vessel feature map of the three-dimensional blood vessel image.
在本申请实施例的一种实施方式中,In one implementation manner of the embodiment of the present application,
所述三维血管图像包括:三维数据重建图像的最大幅值投影图。The three-dimensional blood vessel image includes: a maximum-magnitude projection image of the three-dimensional data reconstructed image.
本发明实施例的第二方面提供了一种血管图像提取装置,包括:The second aspect of the embodiments of the present invention provides a blood vessel image extraction device, including:
获取单元,用于获取三维血管图像;an acquisition unit, configured to acquire a three-dimensional blood vessel image;
去噪单元,用于通过开运算和闭运算的方式对所述三维血管图像进行去噪处理,得到去噪后的三维血管图像;A denoising unit, configured to perform denoising processing on the three-dimensional blood vessel image by means of an opening operation and a closing operation, to obtain a denoised three-dimensional blood vessel image;
特征提取单元,用于通过高斯尺度空间提取所述去噪后的三维血管图像的血管特征图;A feature extraction unit, configured to extract a blood vessel feature map of the denoised three-dimensional blood vessel image through a Gaussian scale space;
增强单元,用于通过海森矩阵对所述血管特征图进行图像增强,得到血管增强图像;An enhancement unit, configured to perform image enhancement on the blood vessel feature map through a Hessian matrix to obtain a blood vessel enhanced image;
图像提取单元,用于对所述血管增强图像进行区域增长,得到血管提取图像。The image extraction unit is configured to perform region growth on the enhanced blood vessel image to obtain an extracted blood vessel image.
在本申请实施例的一种实施方式中,所述去噪单元具体用于:In an implementation manner of the embodiment of the present application, the denoising unit is specifically used for:
对所述三维血管图像进行腐蚀运算处理,对腐蚀后的三维血管图像进行开运算,得到开运算图;performing an erosion operation on the three-dimensional blood vessel image, and performing an opening operation on the etched three-dimensional blood vessel image to obtain an opening operation diagram;
对所述三维血管图像进行膨胀运算处理,对膨胀后的三维血管图像进行闭运算,得到闭运算图;performing an expansion operation on the three-dimensional blood vessel image, and performing a closing operation on the expanded three-dimensional blood vessel image to obtain a closing operation diagram;
对所述开运算图和所述闭运算图进行傅里叶变换,得到去噪后的三维血管图像。Fourier transform is performed on the opening operation graph and the closing operation graph to obtain a denoised three-dimensional blood vessel image.
在本申请实施例的一种实施方式中,所述特征提取单元具体用于:In an implementation manner of the embodiment of the present application, the feature extraction unit is specifically used for:
通过高斯尺度空间提取所述去噪后的三维血管图像的血管特征图,包括:Extracting the blood vessel feature map of the denoised three-dimensional blood vessel image through Gaussian scale space, including:
将预设的高斯核函数与去噪后的三维血管图像进行卷积,构造所述三维血管图像的高斯金字塔;Convolving the preset Gaussian kernel function with the denoised three-dimensional blood vessel image to construct a Gaussian pyramid of the three-dimensional blood vessel image;
通过所述高斯金字塔中相邻尺度的图像相减,得到所述三维血管图像的高斯尺度空间;Obtaining the Gaussian scale space of the three-dimensional blood vessel image by subtracting images of adjacent scales in the Gaussian pyramid;
在所述高斯尺度空间中提取局部极值点形成所述三维血管图像的血管特征图。Extracting local extremum points in the Gaussian scale space to form a blood vessel feature map of the three-dimensional blood vessel image.
在本申请实施例的一种实施方式中,所述三维血管图像包括:三维数据重建图像的最大幅值投影图。In an implementation manner of the embodiment of the present application, the three-dimensional blood vessel image includes: a maximum-magnitude projection image of a reconstructed image from three-dimensional data.
本申请实施例第三方面提供另一种电子装置,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时,实现上述本申请实施例第一方面提供的血管图像提取方法。The third aspect of the embodiment of the present application provides another electronic device, including: a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the computer program, , to implement the blood vessel image extraction method provided in the first aspect of the embodiment of the present application.
本申请实施例第四方面提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时,实现上述本申请实施例第一方面提供的血管图像提取方法。The fourth aspect of the embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the blood vessel image extraction method provided in the first aspect of the above-mentioned embodiment of the present application is implemented.
本发明实施例与现有技术相比存在的有益效果是:The beneficial effect that the embodiment of the present invention exists compared with prior art is:
在本申请实施例中,通过开运算和闭运算的方式对所述三维血管图像进行去噪处理,通过高斯尺度空间提取所述去噪后的三维血管图像的血管特征图,再通过海森矩阵对所述血管特征图进行图像增强,得到血管增强图像,最后对所述血管增强图像进行区域增长,得到血管提取图像。本申请可以直接对三维血管数据进行提取而不用将数据进行二维投影后再对血管数据进行提取,能更加高效地运用于疾病诊断中。In the embodiment of the present application, the 3D blood vessel image is denoised by means of opening operation and closing operation, the blood vessel feature map of the denoised 3D blood vessel image is extracted through the Gaussian scale space, and then the Hessian matrix Image enhancement is performed on the blood vessel feature map to obtain a blood vessel enhanced image, and finally region growth is performed on the blood vessel enhanced image to obtain a blood vessel extraction image. The application can directly extract the three-dimensional blood vessel data without performing two-dimensional projection on the data and then extract the blood vessel data, which can be more efficiently used in disease diagnosis.
附图说明Description of drawings
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the descriptions of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only of the present invention. For some embodiments, those of ordinary skill in the art can also obtain other drawings based on these drawings without any creative effort.
图1是本发明实施例提供的血管图像提取方法的流程示意图;FIG. 1 is a schematic flowchart of a blood vessel image extraction method provided by an embodiment of the present invention;
图2是本发明实施例提供的一个实例示意图;Fig. 2 is a schematic diagram of an example provided by an embodiment of the present invention;
图3是本发明实施例提供的另一个实例示意图;Fig. 3 is a schematic diagram of another example provided by the embodiment of the present invention;
图4是本发明实施例提供的另一个实例示意图;Fig. 4 is a schematic diagram of another example provided by the embodiment of the present invention;
图5是本发明实施例提供的血管图像提取装置的结构示例图;Fig. 5 is a structural example diagram of a blood vessel image extraction device provided by an embodiment of the present invention;
图6是本发明实施例提供的电子装置的结构示意图。FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚地描述,显然,所描述的实施例是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are the embodiment of the present invention. Some examples, but not all examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.
本发明的说明书和权利要求书及上述附图中的术语“包括”以及它们任何变形,意图在于覆盖不排他的包含。例如包含一系列步骤或单元的过程、方法或系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。此外,术语“第一”、“第二”和“第三”等是用于区别不同对象,而非用于描述特定顺序。The terms "comprising" and any variations thereof in the description and claims of the present invention and the above drawings are intended to cover non-exclusive inclusion. For example, a process, method or system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units not listed, or optionally further includes Other steps or units inherent in these processes, methods, products or apparatus. In addition, the terms "first", "second", and "third", etc. are used to distinguish different objects, not to describe a specific order.
实施例一Embodiment one
请参阅图1,本申请实施例中一种血管图像提取方法的一个实施例,包括:Please refer to Fig. 1, an embodiment of a blood vessel image extraction method in the embodiment of the present application, including:
101、获取三维血管图像;101. Obtain a three-dimensional blood vessel image;
示例性的,本申请实施例中的三维血管图像可以通过对目标对象进行扫描获得。在本申请实施例中,目标对象可以为表面带弧度的动物器官。如,人体的眼前节。具体的,眼前节包括:前房、后房、晶状体悬韧带、房角、部分晶状体、周边玻璃体、视网膜及眼外肌附着点部和结膜等。Exemplarily, the three-dimensional blood vessel image in the embodiment of the present application may be obtained by scanning the target object. In the embodiment of the present application, the target object may be an animal organ with a curved surface. For example, the anterior segment of the human body. Specifically, the anterior segment includes: the anterior chamber, the posterior chamber, the zonular ligament of the lens, the angle of the chamber, part of the lens, the peripheral vitreous, the retina, the attachment point of the extraocular muscles, and the conjunctiva.
示例性的,本申请实施例中的三维扫描数据包括:三维数据重建图像的最大幅值投影图,以及最大幅值投影图中对应像素点的信号强度。Exemplarily, the three-dimensional scanning data in the embodiment of the present application includes: a maximum-magnitude projection map of a reconstructed image of the three-dimensional data, and a signal intensity of a corresponding pixel in the maximum-amplitude projection map.
102、通过开运算和闭运算的方式对所述三维血管图像进行去噪处理,得到去噪后的三维血管图像;102. Perform denoising processing on the three-dimensional blood vessel image by means of an opening operation and a closing operation, to obtain a denoised three-dimensional blood vessel image;
开运算一般平滑物体的轮廓、断开较窄的狭颈并消除细的突出物。闭运算同样也会平滑轮廓的一部分,但与开操作相反,它通常会弥合较窄的间断和细长的沟壑,消除小的孔洞,填补轮廓线的中的断裂。The opening operation generally smoothes the contours of objects, breaking off narrow necks and eliminating thin protrusions. The closing operation also smoothes part of the contour, but in contrast to the opening operation, it usually bridges narrower discontinuities and elongated gullies, eliminates small holes, and fills gaps in the contour line.
示例性的,对所述三维血管图像进行腐蚀运算处理,对腐蚀后的三维血管图像进行开运算,得到开运算图;对所述三维血管图像进行膨胀运算处理,对膨胀后的三维血管图像进行闭运算,得到闭运算图;对所述开运算图和所述闭运算图进行傅里叶变换,得到去噪后的三维血管图像。Exemplarily, an erosion operation is performed on the three-dimensional blood vessel image, and an opening operation is performed on the eroded three-dimensional blood vessel image to obtain an opening operation graph; an expansion operation is performed on the three-dimensional blood vessel image, and an expansion operation is performed on the expanded three-dimensional blood vessel image. Close operation to obtain a closed operation graph; performing Fourier transform on the open operation graph and the closed operation graph to obtain a denoised three-dimensional blood vessel image.
103、通过高斯尺度空间提取所述去噪后的三维血管图像的血管特征图;103. Extracting a blood vessel feature map of the denoised three-dimensional blood vessel image through a Gaussian scale space;
高斯尺度空间是一种对图像进行多尺度分析的理论,其基本思想是:假设 f(x)为原始信号定义在[0,π]范围内的傅立叶频谱,引入尺度参数的高斯核函数式中x是频率、t是尺度参数、e是自然常数,并与f(x)进行卷积,通过改变核函数的参数就可以得到f(x)在不同尺度下的空间表示序列。Gaussian scale space is a theory for multi-scale analysis of images. Its basic idea is: assuming that f(x) is the Fourier spectrum of the original signal defined in the range of [0, π], the Gaussian kernel function of the scale parameter is introduced into the formula x is the frequency, t is the scale parameter, e is the natural constant, and convolved with f(x), by changing the parameters of the kernel function, the spatial representation sequence of f(x) at different scales can be obtained.
示例性的,将预设的高斯核函数与去噪后的三维血管图像进行卷积,构造所述三维血管图像的高斯金字塔;通过所述高斯金字塔中相邻尺度的图像相减,得到所述三维血管图像的高斯尺度空间;在所述高斯尺度空间中提取局部极值点形成所述三维血管图像的血管特征图。Exemplarily, the preset Gaussian kernel function is convolved with the denoised three-dimensional blood vessel image to construct a Gaussian pyramid of the three-dimensional blood vessel image; by subtracting images of adjacent scales in the Gaussian pyramid, the A Gaussian scale space of the three-dimensional blood vessel image; extracting local extremum points in the Gaussian scale space to form a blood vessel feature map of the three-dimensional blood vessel image.
104、通过海森矩阵对所述血管特征图进行图像增强;104. Perform image enhancement on the blood vessel feature map by using a Hessian matrix;
通过海森矩阵对所述血管特征图进行图像增强,得到血管增强图像。Image enhancement is performed on the blood vessel feature map through a Hessian matrix to obtain a blood vessel enhanced image.
海森矩阵通过求图像中每个像素点的二阶导数寻找各个像素点的梯度信息,对于血管这种特殊的形态,会有沿着血管中心线方向梯度基本不变,沿着血管截面方向梯度变化很大的趋势,以此区分血管信号和其他信号,从而对血管信号进行增强。The Hessian matrix finds the gradient information of each pixel by calculating the second-order derivative of each pixel in the image. For the special shape of blood vessels, the gradient along the centerline of the blood vessel is basically unchanged, and the gradient along the direction of the blood vessel section In order to distinguish the vascular signal from other signals, the vascular signal can be enhanced.
105、对所述血管增强图像进行区域增长,得到血管提取图像。105. Perform region growing on the blood vessel enhanced image to obtain a blood vessel extraction image.
区域生长是根据事先定义的准则将像素或者子区域聚合成更大区域的过程。其基本思想是从一组生长点开始,将与该生长点性质相似的相邻像素或者区域与生长点合并,形成新的生长点,重复此过程直到不能生长为止,以此提取所有血管信号。提取血管信号时,首先将信号非常强的点设为种子点(因为血液的光声信号强度会强于其他信号),设定一定的阈值进行生长,直到不能生长为止。Region growing is the process of aggregating pixels or sub-regions into larger regions according to predefined criteria. The basic idea is to start from a group of growth points, merge adjacent pixels or regions with similar properties to the growth point to form a new growth point, and repeat this process until it cannot grow, so as to extract all blood vessel signals. When extracting blood vessel signals, first set the points with very strong signals as seed points (because the photoacoustic signal strength of blood will be stronger than other signals), and set a certain threshold to grow until it cannot grow.
在本申请实施例中,通过开运算和闭运算的方式对所述三维血管图像进行去噪处理,通过高斯尺度空间提取所述去噪后的三维血管图像的血管特征图,再通过海森矩阵对所述血管特征图进行图像增强,得到血管增强图像,最后对所述血管增强图像进行区域增长,得到血管提取图像。本申请可以直接对三维血管数据进行提取而不用将数据进行二维投影后再对血管数据进行提取,能更加高效地运用于疾病诊断中。In the embodiment of the present application, the 3D blood vessel image is denoised by means of opening operation and closing operation, the blood vessel feature map of the denoised 3D blood vessel image is extracted through the Gaussian scale space, and then the Hessian matrix Image enhancement is performed on the blood vessel feature map to obtain a blood vessel enhanced image, and finally region growth is performed on the blood vessel enhanced image to obtain a blood vessel extraction image. The application can directly extract the three-dimensional blood vessel data without performing two-dimensional projection on the data and then extract the blood vessel data, which can be more efficiently used in disease diagnosis.
实施例二Embodiment 2
本申请实施例以具体实验为例对本申请实施例中的血管图像提取方法进行说明,包括:The embodiment of the present application takes a specific experiment as an example to illustrate the blood vessel image extraction method in the embodiment of the present application, including:
本申请实施例的目标对象为眼球顶部表面的虹膜根部,通三维扫描装置对虹膜根部根部的血管图像进行扫描,获得如图2所示的虹膜血管图像。The target object of the embodiment of the present application is the root of the iris on the top surface of the eyeball. The image of blood vessels at the root of the iris is scanned by a three-dimensional scanning device to obtain the image of blood vessels in the iris as shown in FIG. 2 .
其中,本申请实施例对图2中矩形框内所框定的血管图像进行处理,图中的两个矩形框分别标记为区域1和区域2)。如图所示,两个标记区域具有两种不同的血管特点。区域1代表无序的虹膜部分分布式脉管系统,而区域2代表虹膜部分径向分布的血管。Wherein, the embodiment of the present application processes the blood vessel image framed in the rectangular frame in FIG. 2 , and the two rectangular frames in the figure are respectively marked as area 1 and area 2). As shown, the two labeled regions have two different vessel characteristics. Region 1 represents the disordered iris-partially distributed vasculature, while region 2 represents iris-partially distributed blood vessels.
请参阅图3,图3显示了经过本申请实施例中血管图像提取方法的各个关键步骤分别得到的处理结果。其中,图3中(a)至(d)为区域1血管提取的过程,(e)至(h)为区域二血管提取的过程。(d)和(h)分别为最终的血管提取图。图3中(a)和(e)分别是区域1和区域2的原始未处理图像。Please refer to FIG. 3 . FIG. 3 shows the processing results obtained through each key step of the blood vessel image extraction method in the embodiment of the present application. Among them, (a) to (d) in FIG. 3 are the process of blood vessel extraction in area 1, and (e) to (h) are the process of blood vessel extraction in area 2. (d) and (h) are the final blood vessel extraction images, respectively. (a) and (e) in Fig. 3 are the original unprocessed images of region 1 and region 2, respectively.
通过比较图中的血管信号可知,在图3的(b)和(f)中,我们可以清楚地看到基于Hessian矩阵的方法增强了血管信号的整个图像。然而,微血管信号是仍然相对较弱,因而无法诊断。但是之后经过强度转换,微血管信号进一步增强,得到图3的(c)和(g);进一步的,在完成血管增强图像的区域增长后,如图3中的(d)和(h),该背景噪声被完全删除,得到清晰的血管图像。By comparing the blood vessel signals in the figure, in (b) and (f) of Figure 3, we can clearly see that the method based on the Hessian matrix enhances the whole image of the blood vessel signals. However, the microvascular signal is still relatively weak and thus not diagnostic. However, after intensity conversion, the microvascular signal is further enhanced, and (c) and (g) in Figure 3 are obtained; further, after the region growth of the enhanced blood vessel image is completed, as shown in (d) and (h) in Figure 3, the Background noise is completely removed, resulting in clear images of blood vessels.
为了本申请实施例中算法的准确性,在图3中作虚线进行原始图像(图3 的(a)和(e))和最终图像“图3的(d)和(h)”的对比,如图4所示,图4 (a)中的不规则波浪线线和脉冲线分别代表图3(a)和(d)虚线处信号强度; (b)中的不规则波浪线线和脉冲线分别代表图3(e)和(h)黄色虚线处信号强度。观察可发现血管信号被精准的提取了出来。For the accuracy of the algorithm in the embodiment of the present application, make dotted line in Fig. 3 and carry out the contrast of original image (Fig. 3 (a) and (e)) and final image " Fig. 3 (d) and (h) ", As shown in Figure 4, the irregular wavy line and pulse line in Figure 4 (a) represent the signal strength at the dotted line in Figure 3 (a) and (d) respectively; the irregular wavy line and pulse line in (b) Represent the signal intensity at the yellow dotted line in Figure 3(e) and (h), respectively. Observation shows that blood vessel signals are accurately extracted.
实施例三Embodiment 3
本申请实施例还提供是实现上述血管图像提取方法的血管图像提取装置,请参阅图5,包括:The embodiment of the present application also provides a blood vessel image extraction device that implements the above blood vessel image extraction method, please refer to FIG. 5 , including:
获取单元501,用于获取三维血管图像;An acquisition unit 501, configured to acquire a three-dimensional blood vessel image;
去噪单元502,用于通过开运算和闭运算的方式对所述三维血管图像进行去噪处理,得到去噪后的三维血管图像;A denoising unit 502, configured to perform denoising processing on the three-dimensional blood vessel image by means of opening operation and closing operation, to obtain a denoised three-dimensional blood vessel image;
特征提取单元503,用于通过高斯尺度空间提取所述去噪后的三维血管图像的血管特征图;A feature extraction unit 503, configured to extract a blood vessel feature map of the denoised three-dimensional blood vessel image through a Gaussian scale space;
增强单元504,用于通过海森矩阵对所述血管特征图进行图像增强,得到血管增强图像;An enhancement unit 504, configured to perform image enhancement on the blood vessel feature map through a Hessian matrix to obtain a blood vessel enhanced image;
图像提取单元505,用于对所述血管增强图像进行区域增长,得到血管提取图像。The image extraction unit 505 is configured to perform region growing on the enhanced blood vessel image to obtain an extracted blood vessel image.
在本申请实施例的一种实施方式中,所述去噪单元502具体用于:In an implementation manner of the embodiment of the present application, the denoising unit 502 is specifically configured to:
对所述三维血管图像进行腐蚀运算处理,对腐蚀后的三维血管图像进行开运算,得到开运算图;performing an erosion operation on the three-dimensional blood vessel image, and performing an opening operation on the etched three-dimensional blood vessel image to obtain an opening operation diagram;
对所述三维血管图像进行膨胀运算处理,对膨胀后的三维血管图像进行闭运算,得到闭运算图;performing an expansion operation on the three-dimensional blood vessel image, and performing a closing operation on the expanded three-dimensional blood vessel image to obtain a closing operation diagram;
对所述开运算图和所述闭运算图进行傅里叶变换,得到去噪后的三维血管图像。Fourier transform is performed on the opening operation graph and the closing operation graph to obtain a denoised three-dimensional blood vessel image.
在本申请实施例的一种实施方式中,所述特征提取单元503具体用于:In an implementation manner of the embodiment of the present application, the feature extraction unit 503 is specifically configured to:
通过高斯尺度空间提取所述去噪后的三维血管图像的血管特征图,包括:Extracting the blood vessel feature map of the denoised three-dimensional blood vessel image through Gaussian scale space, including:
将预设的高斯核函数与去噪后的三维血管图像进行卷积,构造所述三维血管图像的高斯金字塔;Convolving the preset Gaussian kernel function with the denoised three-dimensional blood vessel image to construct a Gaussian pyramid of the three-dimensional blood vessel image;
通过所述高斯金字塔中相邻尺度的图像相减,得到所述三维血管图像的高斯尺度空间;Obtaining the Gaussian scale space of the three-dimensional blood vessel image by subtracting images of adjacent scales in the Gaussian pyramid;
在所述高斯尺度空间中提取局部极值点形成所述三维血管图像的血管特征图。Extracting local extremum points in the Gaussian scale space to form a blood vessel feature map of the three-dimensional blood vessel image.
在本申请实施例的一种实施方式中,所述三维血管图像包括:三维数据重建图像的最大幅值投影图。In an implementation manner of the embodiment of the present application, the three-dimensional blood vessel image includes: a maximum-magnitude projection image of a reconstructed image from three-dimensional data.
本实施例提供的电子装置中各功能模块实现各自功能的具体过程,请参见上述图1所示实施例中描述的具体内容,此处不再赘述。For the specific process of each functional module in the electronic device provided in this embodiment to realize their respective functions, please refer to the specific content described in the embodiment shown in FIG. 1 above, and details will not be repeated here.
实施例四Embodiment 4
本申请实施例提供一种电子装置,请参阅图6,该电子装置包括:An embodiment of the present application provides an electronic device, please refer to Figure 6, the electronic device includes:
存储器601、处理器602及存储在存储器601上并可在处理器602上运行的计算机程序,处理器602执行该计算机程序时,实现前述图1所示实施例中描述的血管图像提取方法。The memory 601, the processor 602, and the computer program stored in the memory 601 and operable on the processor 602, when the processor 602 executes the computer program, implements the blood vessel image extraction method described in the embodiment shown in FIG. 1 above.
进一步的,该电子装置还包括:Further, the electronic device also includes:
至少一个输入设备603以及至少一个输出设备604。At least one input device 603 and at least one output device 604 .
上述存储器601、处理器602、输入设备603以及输出设备604,通过总线605 连接。The aforementioned memory 601 , processor 602 , input device 603 and output device 604 are connected through a bus 605 .
其中,输入设备603具体可为摄像头、触控面板、物理按键或者鼠标等等。输出设备604具体可为显示屏。Wherein, the input device 603 may specifically be a camera, a touch panel, a physical button or a mouse, and the like. The output device 604 may specifically be a display screen.
存储器601可以是高速随机存取记忆体(RAM,Random Access Memory) 存储器,也可为非不稳定的存储器(non-volatile memory),例如磁盘存储器。存储器601用于存储一组可执行程序代码,处理器602与存储器601耦合。The memory 601 may be a high-speed random access memory (RAM, Random Access Memory) memory, or a non-volatile memory (non-volatile memory), such as a disk memory. The memory 601 is used to store a set of executable program codes, and the processor 602 is coupled to the memory 601 .
进一步的,本申请实施例还提供了一种计算机可读存储介质,该计算机可读存储介质可以是设置于上述各实施例中的电子装置中,该计算机可读存储介质可以是前述图3所示实施例中的存储器。该计算机可读存储介质上存储有计算机程序,该程序被处理器执行时实现前述图1所示实施例中描述的血管图像提取方法。进一步的,该计算机可存储介质还可以是U盘、移动硬盘、只读存储器 (ROM,Read-Only Memory)、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Further, the embodiment of the present application also provides a computer-readable storage medium, which can be set in the electronic device in each of the above-mentioned embodiments, and the computer-readable storage medium can be the memory in the example embodiment. A computer program is stored on the computer-readable storage medium, and when the program is executed by a processor, the blood vessel image extraction method described in the foregoing embodiment shown in FIG. 1 is implemented. Further, the computer storage medium can also be various media that can store program codes such as U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), RAM, magnetic disk or optical disk.
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或模块的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or modules may be in electrical, mechanical or other forms.
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or may be distributed to multiple network modules. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本申请各个实施例中的各功能模块可以集成在一个处理模块中,也可以是各个模块单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。In addition, each functional module in each embodiment of the present application may be integrated into one processing module, each module may exist separately physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules.
所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个可读存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的可读存储介质包括:U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of software products, and the computer software products are stored in a readable memory The medium contains several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The above-mentioned readable storage medium includes: various media capable of storing program codes such as U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk.
需要说明的是,对于前述的各方法实施例,为了简便描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请并不受所描述的动作顺序的限制,因为依据本申请,某些步骤可以采用其它顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定都是本申请所必须的。It should be noted that, for the sake of simplicity of description, the aforementioned method embodiments are expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Depending on the application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其它实施例的相关描述。In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.
以上为对本申请所提供的血管图像提取方法、电子装置及计算机可读存储介质的描述,对于本领域的技术人员,依据本申请实施例的思想,在具体实施方式及应用范围上均会有改变之处,综上,本说明书内容不应理解为对本申请的限制。The above is the description of the blood vessel image extraction method, electronic device and computer-readable storage medium provided by this application. For those skilled in the art, according to the ideas of the embodiments of this application, there will be changes in the specific implementation and application scope In summary, the contents of this specification should not be construed as limiting the application.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910816037.4A CN110610147A (en) | 2019-08-30 | 2019-08-30 | Blood vessel image extraction method, related device and storage device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910816037.4A CN110610147A (en) | 2019-08-30 | 2019-08-30 | Blood vessel image extraction method, related device and storage device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110610147A true CN110610147A (en) | 2019-12-24 |
Family
ID=68890617
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910816037.4A Pending CN110610147A (en) | 2019-08-30 | 2019-08-30 | Blood vessel image extraction method, related device and storage device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110610147A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111275668A (en) * | 2020-01-13 | 2020-06-12 | 浙江杜比医疗科技有限公司 | Breast blood vessel extraction method, system and device of NIR image |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050110791A1 (en) * | 2003-11-26 | 2005-05-26 | Prabhu Krishnamoorthy | Systems and methods for segmenting and displaying tubular vessels in volumetric imaging data |
CN102402796A (en) * | 2011-10-26 | 2012-04-04 | 重庆大学 | Three-dimensional structural description method of hepatic vascular system |
CN103218797A (en) * | 2012-01-19 | 2013-07-24 | 中国科学院上海生命科学研究院 | Method and system for processing and analyzing blood vessel image |
CN106600587A (en) * | 2016-12-09 | 2017-04-26 | 上海理工大学 | Lung CT image auxiliary detection processing device |
CN106793992A (en) * | 2014-05-14 | 2017-05-31 | Sync-Rx有限公司 | Object identifying |
CN107392900A (en) * | 2017-07-24 | 2017-11-24 | 太原理工大学 | A kind of multi-scale enhancement wave filter and the pulmonary nodule detection method of 3D features |
US20180045946A1 (en) * | 2016-08-10 | 2018-02-15 | Zeta Instruments, Inc. | Optical measurement of step size and plated metal thickness |
CN107808156A (en) * | 2017-07-31 | 2018-03-16 | 上海联影医疗科技有限公司 | Area-of-interest exacting method |
CN108154519A (en) * | 2017-12-25 | 2018-06-12 | 吉林大学 | Dividing method, device and the storage medium of eye fundus image medium vessels |
CN108898593A (en) * | 2018-06-25 | 2018-11-27 | 重庆知遨科技有限公司 | A kind of detection method based on the classification of abdominal CT Medical image fusion |
-
2019
- 2019-08-30 CN CN201910816037.4A patent/CN110610147A/en active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050110791A1 (en) * | 2003-11-26 | 2005-05-26 | Prabhu Krishnamoorthy | Systems and methods for segmenting and displaying tubular vessels in volumetric imaging data |
CN102402796A (en) * | 2011-10-26 | 2012-04-04 | 重庆大学 | Three-dimensional structural description method of hepatic vascular system |
CN103218797A (en) * | 2012-01-19 | 2013-07-24 | 中国科学院上海生命科学研究院 | Method and system for processing and analyzing blood vessel image |
CN106793992A (en) * | 2014-05-14 | 2017-05-31 | Sync-Rx有限公司 | Object identifying |
US20180045946A1 (en) * | 2016-08-10 | 2018-02-15 | Zeta Instruments, Inc. | Optical measurement of step size and plated metal thickness |
CN106600587A (en) * | 2016-12-09 | 2017-04-26 | 上海理工大学 | Lung CT image auxiliary detection processing device |
CN107392900A (en) * | 2017-07-24 | 2017-11-24 | 太原理工大学 | A kind of multi-scale enhancement wave filter and the pulmonary nodule detection method of 3D features |
CN107808156A (en) * | 2017-07-31 | 2018-03-16 | 上海联影医疗科技有限公司 | Area-of-interest exacting method |
CN108154519A (en) * | 2017-12-25 | 2018-06-12 | 吉林大学 | Dividing method, device and the storage medium of eye fundus image medium vessels |
CN108898593A (en) * | 2018-06-25 | 2018-11-27 | 重庆知遨科技有限公司 | A kind of detection method based on the classification of abdominal CT Medical image fusion |
Non-Patent Citations (1)
Title |
---|
1T. SUMATHI 等: "Multiscale Enhancement Filter Using Hessian Matrix: A Review", 《AUSTRALIAN JOURNAL OF BASIC AND APPLIED SCIENCES》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111275668A (en) * | 2020-01-13 | 2020-06-12 | 浙江杜比医疗科技有限公司 | Breast blood vessel extraction method, system and device of NIR image |
CN111275668B (en) * | 2020-01-13 | 2023-09-15 | 浙江杜比医疗科技有限公司 | Method, system and device for extracting breast blood vessels of NIR (near infrared) image |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11170258B2 (en) | Reducing noise in an image | |
Deng et al. | Deep learning in photoacoustic imaging: a review | |
Rajendran et al. | Photoacoustic imaging aided with deep learning: a review | |
EP1690230B1 (en) | Automatic multi-dimensional intravascular ultrasound image segmentation method | |
JP2006204912A (en) | Ultrasonic image processing method | |
He et al. | De-noising of photoacoustic microscopy images by attentive generative adversarial network | |
Awasthi et al. | Image-guided filtering for improving photoacoustic tomographic image reconstruction | |
Khor et al. | Ultrasound speckle reduction using wavelet-based generative adversarial network | |
US20240366183A1 (en) | Real-time super-resolution ultrasound microvessel imaging and velocimetry | |
Zhang et al. | Photoacoustic digital brain and deep-learning-assisted image reconstruction | |
KR20220064408A (en) | Systems and methods for analyzing medical images based on spatiotemporal data | |
Prakash et al. | Binary photoacoustic tomography for improved vasculature imaging | |
Mandal et al. | Multiscale edge detection and parametric shape modeling for boundary delineation in optoacoustic images | |
Sneha et al. | Performance analysis of wiener filter in restoration of COVID-19 chest X-ray images, ultrasound images and mammograms | |
CN110610147A (en) | Blood vessel image extraction method, related device and storage device | |
Gyger et al. | Three-dimensional speckle reduction in optical coherence tomography through structural guided filtering | |
Rajabi et al. | Speckle noise reduction and motion artifact correction based on modified statistical parameters estimation in OCT images | |
CN112869768A (en) | Multi-modality imaging-based body function multi-parameter quantification method and device | |
El-Hag et al. | DNN-driven hybrid denoising: advancements in speckle noise reduction | |
CN116138760A (en) | Self-adaptive enhanced laser speckle contrast blood flow imaging method | |
Wang et al. | Extractor-attention-predictor network for quantitative photoacoustic tomography | |
Ma et al. | 3D reconstruction of carotid artery from ultrasound images | |
Cardinal et al. | Automatic 3D segmentation of intravascular ultrasound images using region and contour information | |
Tamilkudimagal | Squeeze box filter for contrast enhancement in ultrasound despeckling | |
Amjadian et al. | Enhancing vascular network visualization in 3D photoacoustic imaging: in vivo experiments with a vasculature filter |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191224 |
|
RJ01 | Rejection of invention patent application after publication |