CN106780518A - A kind of MR image three-dimensional interactive segmentation methods of the movable contour model cut based on random walk and figure - Google Patents
A kind of MR image three-dimensional interactive segmentation methods of the movable contour model cut based on random walk and figure Download PDFInfo
- Publication number
- CN106780518A CN106780518A CN201710073688.XA CN201710073688A CN106780518A CN 106780518 A CN106780518 A CN 106780518A CN 201710073688 A CN201710073688 A CN 201710073688A CN 106780518 A CN106780518 A CN 106780518A
- Authority
- CN
- China
- Prior art keywords
- segmentation
- sigma
- point
- dimensional
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000011218 segmentation Effects 0.000 title claims abstract description 125
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000005295 random walk Methods 0.000 title claims abstract description 23
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 11
- 238000004422 calculation algorithm Methods 0.000 claims description 69
- 208000007913 Pituitary Neoplasms Diseases 0.000 claims description 37
- 208000010916 pituitary tumor Diseases 0.000 claims description 25
- 210000004556 brain Anatomy 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 3
- 238000003709 image segmentation Methods 0.000 abstract description 8
- 230000000694 effects Effects 0.000 abstract description 3
- 230000006870 function Effects 0.000 description 45
- 208000003174 Brain Neoplasms Diseases 0.000 description 10
- 206010028980 Neoplasm Diseases 0.000 description 8
- 210000005013 brain tissue Anatomy 0.000 description 6
- 210000001519 tissue Anatomy 0.000 description 6
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000012805 post-processing Methods 0.000 description 4
- 238000011160 research Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000003902 lesion Effects 0.000 description 3
- 238000002595 magnetic resonance imaging Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 210000004027 cell Anatomy 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000004445 quantitative analysis Methods 0.000 description 2
- 206010030113 Oedema Diseases 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 210000003484 anatomy Anatomy 0.000 description 1
- 210000001175 cerebrospinal fluid Anatomy 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007850 degeneration Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 238000005315 distribution function Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 210000004884 grey matter Anatomy 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 208000020816 lung neoplasm Diseases 0.000 description 1
- 208000037841 lung tumor Diseases 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000017074 necrotic cell death Effects 0.000 description 1
- 238000001208 nuclear magnetic resonance pulse sequence Methods 0.000 description 1
- 210000003977 optic chiasm Anatomy 0.000 description 1
- 230000001575 pathological effect Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000001817 pituitary effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 210000004872 soft tissue Anatomy 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 210000004885 white matter Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10088—Magnetic resonance imaging [MRI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30096—Tumor; Lesion
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
Abstract
Description
技术领域technical field
本发明涉及图像分割技术领域,特别是对磁共振成像的人脑图像进行区域分割的,基于随机游走和图割的活动轮廓模型的MR图像三维交互分割方法。The invention relates to the technical field of image segmentation, in particular to a three-dimensional interactive segmentation method of an MR image based on an active contour model of random walk and graph cut for area segmentation of a magnetic resonance imaging human brain image.
背景技术Background technique
磁共振成像(Magnetic resonance imaging,MRI)具有优良的软组织分辨力,可对人体各部位多角度、多平面成像,多种成像方法与脉冲序列技术的应用有助于对垂体瘤的定位、定性诊断。通常临床上医学影像的肿瘤分割会由医生在二维影像上逐序列手工描绘垂体瘤边界来完成。根据实体瘤疗效评价(RECIST)标准,放射医生会识别出二维影像上脑部的高亮度/低亮度组织,测量垂体瘤病灶一、两个方向的直径数值,但由于垂体瘤的形状多变,单一的直径并不能表示垂体瘤的体积。另外由于脑部扫描序列图像的数据量庞大,人工分割耗时费力。而且人工分割和影像信息分析的结果受医生的专业知识和操作熟练度影响,往往因人而异、主观性较大,很容易产生不可预测的结果。多模态垂体瘤磁共振(Magnetic resonance,MR)图像处理与分析,综合运用图像处理、图像分析、模式识别、机器学习等现代计算机技术,可以大大改进临床垂体瘤医学影像处理与分析的现状,提供更高效、准确、客观的分析结果。Magnetic resonance imaging (MRI) has excellent soft tissue resolution and can image various parts of the human body from multiple angles and planes. The application of various imaging methods and pulse sequence technology is helpful for the localization and qualitative diagnosis of pituitary tumors . Usually, tumor segmentation in clinical medical images is done by doctors manually drawing the boundaries of pituitary tumors sequentially on two-dimensional images. According to the Response Evaluation in Solid Tumors (RECIST) standard, the radiologist will identify the high-brightness/low-brightness tissue of the brain on the two-dimensional image, and measure the diameter of the pituitary tumor lesion in one or two directions. However, due to the variable shape of the pituitary tumor , a single diameter does not represent the volume of pituitary tumors. In addition, due to the huge amount of data in the brain scan sequence images, manual segmentation is time-consuming and laborious. Moreover, the results of manual segmentation and image information analysis are affected by the professional knowledge and operational proficiency of doctors, which often vary from person to person, are highly subjective, and are prone to unpredictable results. Multimodal pituitary tumor magnetic resonance (Magnetic resonance, MR) image processing and analysis, comprehensive use of modern computer technologies such as image processing, image analysis, pattern recognition, machine learning, etc., can greatly improve the current status of clinical medical image processing and analysis of pituitary tumors, Provide more efficient, accurate and objective analysis results.
垂体瘤属于脑肿瘤中的一种类型,临床实践中发现多模态脑垂体瘤的医学影像具有复杂的特性。其MR影像与其他脑肿瘤MR影像特点有相似之处,主要表现有:垂体瘤的结构复杂;其空间占位、形状和大小不确定;病变组织、周围软组织的灰度分布不均匀,密度分布有混叠,边界比较模糊;不同个体的组织结构存在较大差异;又由于MRI技术原理和图像采集过程中各种因素的影响,图像存在噪声、伪影等。因此要实现对垂体瘤的正确分割非常困难。脑肿瘤的分割任务包括正常脑组织(脑白质、脑灰质和脑脊液)、病变组织(水肿、肿瘤及其内部的坏死和囊变等)。从20世纪70年代开始,涌现出各种类型的脑肿瘤分割方法,主要可分为基于区域的分割方法、基于边缘的分割方法,以及结合区域和边界的分割方法,还有神经网络、模糊聚类、马尔科夫随机场模型、基于图论和基于图谱的其他分割方法。Pituitary tumors belong to one type of brain tumors. In clinical practice, it is found that the medical imaging of multimodal pituitary tumors has complex characteristics. The characteristics of its MR images are similar to those of other brain tumors. The main manifestations are: the structure of the pituitary tumor is complex; its space occupation, shape and size are uncertain; There is aliasing, and the boundaries are blurred; there are large differences in the organizational structure of different individuals; and due to the influence of various factors in the principle of MRI technology and the image acquisition process, there are noises and artifacts in the image. Therefore, it is very difficult to achieve the correct segmentation of pituitary tumors. The segmentation tasks of brain tumors include normal brain tissue (white matter, gray matter and cerebrospinal fluid), diseased tissue (edema, tumor and its internal necrosis and cystic degeneration, etc.). Since the 1970s, various types of brain tumor segmentation methods have emerged, which can be mainly divided into region-based segmentation methods, edge-based segmentation methods, and segmentation methods that combine regions and boundaries, as well as neural networks, fuzzy aggregation, etc. classes, Markov random field models, graph theory-based and graph-based other segmentation methods.
由于脑部医学图像的复杂性,各类分割方法仍只能就具体问题具体解决,尚没有一种通用的分割方法形成。目前的研究趋势呈现以下几个特点:Due to the complexity of brain medical images, various segmentation methods can only solve specific problems, and there is no general segmentation method. Current research trends present the following characteristics:
(1)融合各自优点的多种分割算法结合。如结合模糊聚类和形变模型的图像分割方法、基于区域生长和神经网络的分割方法;还有近年来发展出的,基于图论的分割算法,如图割和主动形状模型联合分割算法、图割和形变模型联合分割算法等。(1) Combination of multiple segmentation algorithms that combine their respective advantages. For example, the image segmentation method combined with fuzzy clustering and deformation model, the segmentation method based on region growing and neural network; and the segmentation algorithm based on graph theory developed in recent years, such as joint segmentation algorithm of graph cut and active shape model, graph Cutting and deformation model joint segmentation algorithm, etc.
(2)半自动的分割技术仍然是研究的重点方向。全自动分割算法可以大大提高脑肿瘤的分割效率,但在临床中还需允许医生根据具体病例进行特殊分割操作。交互式的半自动分割方法在自动分割结果的基础,使得医生可以评估分割结果、人工干预分割,弥补自动分割算法在进行特殊分割任务时的不足,达到精准分割、定量分析。如应用随机游走的脑肿瘤和肺肿瘤分割算法;也发展出一些交互式分割软件,如3D Slicer等等。(2) Semi-automatic segmentation technology is still the key direction of research. Fully automatic segmentation algorithm can greatly improve the segmentation efficiency of brain tumors, but in clinical practice, it is necessary to allow doctors to perform special segmentation operations according to specific cases. Based on the automatic segmentation results, the interactive semi-automatic segmentation method enables doctors to evaluate the segmentation results and manually intervene in the segmentation, making up for the shortcomings of the automatic segmentation algorithm in performing special segmentation tasks, and achieving accurate segmentation and quantitative analysis. For example, brain tumor and lung tumor segmentation algorithms using random walk; also developed some interactive segmentation software, such as 3D Slicer and so on.
近几年出现的自动、半自动交互式的脑肿瘤分割算法,可以大致分为基于机器学习的两个大类:生成算法和判别算法。生成算法从一系列先验图像(已知组织分类的图像)中学习健康脑组织类型的灰度空间分布,使用学习到的分布函数去“预测”健康组织、找出边界分割肿瘤。判别算法直接学习肿瘤和正常脑组织之间的灰度差异,用学习到的判别函数分类未标记的像素/体素。学习步骤既可以使用一些手工标记的病人训练图像进行离线执行,也可以通过用户在当前病人图像上标记种子区域在线完成。生成算法对于正常脑组织分割有优势,但对于任意形状的肿瘤分割则有难度。判别算法的优点是融合了正常脑组织和肿瘤两方面的灰度分布,有利于肿瘤的分割;但它仅使用局部图像特征,对多模态影像数据中不同组织的图像灰度要求相对一致,这是很难达到的,尤其对于MR图像来说。将两种方法结合,融合背景的脑结构解剖知识和病灶的灰度特性,可能会改善分割的正确性。The automatic and semi-automatic interactive brain tumor segmentation algorithms that have emerged in recent years can be roughly divided into two categories based on machine learning: generative algorithms and discriminative algorithms. The generative algorithm learns the gray-scale spatial distribution of healthy brain tissue types from a series of prior images (images with known tissue classifications), and uses the learned distribution function to "predict" healthy tissue and find boundaries to segment tumors. The discriminative algorithm directly learns the grayscale difference between tumor and normal brain tissue, and uses the learned discriminant function to classify unlabeled pixels/voxels. The learning step can be performed either offline using some manually labeled patient training images, or online by the user marking seed regions on the current patient image. Generative algorithms have advantages for normal brain tissue segmentation, but have difficulty in segmenting tumors with arbitrary shapes. The advantage of the discriminant algorithm is that it combines the gray distribution of normal brain tissue and tumor, which is beneficial to the segmentation of tumors; but it only uses local image features, and the requirements for image gray levels of different tissues in multimodal image data are relatively consistent. This is difficult to achieve, especially for MR images. Combining the two methods, fusing background anatomical knowledge of brain structures and grayscale characteristics of lesions, may improve the accuracy of segmentation.
近年来还出现了基于形变模型的脑肿瘤多模态影像分割方法。该类方法从图像中获取约束信息、目标位置、大小和形状等先验知识,既利用了图像本身的底层信息又结合了人体解剖结构的上层信息,适合于脑肿瘤多模态影像的三维数据分割。形变模型中基于水平集理论的几何形变模型,由于其可以解决曲线演化时拓扑结构变化问题,以及其他优于参数形变模型的特点,得到了广泛重视和发展。单个水平集函数只能将图像分割为目标区域和背景区域两个部分即图像两相分割,为满足图像中多个目标区域分割的需要,产生了多相水平集(Multiphase Level Set)方法。经过近二十年的发展,多相水平集思想逐渐应用到Mumford-Shah模型、Chan-Vese模型上。Li等人提出的LBF模型引入了高斯核函数,增强了水平集方法对边缘的捕获能力,在某些多相图像上仅使用一个水平集函数,解决了多相水平集算法需采用多个水平集函数所带来的计算复杂性问题;并由Peng等人发展为归一化的LBF模型。但是目前来看水平集方法的求解仍存在着方法复杂、计算量大的问题。In recent years, a multimodal image segmentation method for brain tumors based on deformation models has also emerged. This type of method obtains prior knowledge such as constraint information, target position, size, and shape from the image, which not only utilizes the underlying information of the image itself but also combines the upper information of the human anatomical structure, and is suitable for the three-dimensional data of multimodal images of brain tumors. segmentation. In the deformation model, the geometric deformation model based on the level set theory has been widely valued and developed because it can solve the problem of topology change when the curve evolves, and other characteristics are superior to the parametric deformation model. A single level set function can only divide the image into two parts, the target area and the background area, that is, the image two-phase segmentation. In order to meet the needs of multiple target area segmentation in the image, a multiphase level set (Multiphase Level Set) method was produced. After nearly two decades of development, the idea of multiphase level sets has been gradually applied to the Mumford-Shah model and the Chan-Vese model. The LBF model proposed by Li et al. introduces the Gaussian kernel function, which enhances the ability of the level set method to capture edges. Only one level set function is used on some multiphase images, which solves the problem that the multiphase level set algorithm needs to use multiple levels. The computational complexity problem brought by the set function; and developed into a normalized LBF model by Peng et al. But at present, the solution of level set method still has the problems of complex method and large amount of calculation.
以J.Egger为代表的研究团队提出了采用基于图论的图割和图搜索方法,设计出以模板为基础的半自动的垂体瘤分割方法。但从他们发表的研究论文来看,主要采用的病例均是形状规则、近似椭圆形状的垂体结构,分割难度相对不大。在图割算法和形变模型的能量函数中添加形状模型也是分割形状相对固定、变化不大的脑肿瘤的常见分割方法。但大部分的垂体瘤形状没有规则性,且可能会有对其他脑组织的浸润情况出现,所以,模板或形状模型在不规则形状的垂体瘤分割过程中所起作用有限。The research team represented by J.Egger proposed the use of graph theory-based graph cut and graph search methods, and designed a template-based semi-automatic pituitary tumor segmentation method. However, judging from their published research papers, the main cases used are regular and approximately elliptical pituitary structures, and the segmentation difficulty is relatively small. Adding a shape model to the energy function of the graph cut algorithm and the deformation model is also a common segmentation method for segmenting brain tumors with relatively fixed shape and little change. However, most pituitary tumors have irregular shapes and may infiltrate other brain tissues. Therefore, templates or shape models play a limited role in the segmentation of irregularly shaped pituitary tumors.
发明内容Contents of the invention
本发明要解决的技术问题为:提出一种基于随机游走(Random walk,RW)和图割(Graph cut)的活动轮廓模型(Random walks and graph cuts based active contourmodel,RGCACM)的MR图像三维交互分割方法,实现垂体瘤MR影像的三维分割,提高垂体瘤图像分割的准确性。The technical problem to be solved by the present invention is to propose a three-dimensional interactive MR image based on a random walk (Random walk, RW) and graph cut (Graph cut) active contour model (Random walks and graph cuts based active contourmodel, RGCACM) The segmentation method realizes the three-dimensional segmentation of pituitary tumor MR images and improves the accuracy of pituitary tumor image segmentation.
本发明采取的技术方案具体为:一种基于随机游走和图割的活动轮廓模型的MR图像三维交互分割方法,包括以下步骤:The technical solution adopted by the present invention is specifically: a method for three-dimensional interactive segmentation of MR images based on an active contour model of random walk and graph cut, comprising the following steps:
S1,获取初始边界曲面,包括步骤:S1, to obtain the initial boundary surface, including steps:
S11,选取随机游走算法所需的种子点,以该种子点作为三维中心点,从脑部MR三维数据中截取包含垂体瘤的局部三维MR图像数据;S11, selecting the seed point required by the random walk algorithm, using the seed point as the three-dimensional center point, and intercepting the local three-dimensional MR image data including the pituitary tumor from the three-dimensional brain MR data;
S12,利用三维随机游走算法对截取的局部三维MR图像数据进行处理,得到各体素点到达种子点的概率三维图;S12, using a three-dimensional random walk algorithm to process the intercepted local three-dimensional MR image data to obtain a three-dimensional map of the probability that each voxel point reaches the seed point;
S13,利用最大期望值算法选取概率阈值,以分割出疑似目标区域,将疑似目标区域内的体素作为活动轮廓模型算法的前景点,疑似目标区域的边界曲面即初始边界曲面;S13, using the maximum expected value algorithm to select a probability threshold to segment the suspected target area, using the voxels in the suspected target area as the foreground point of the active contour model algorithm, and the boundary surface of the suspected target area is the initial boundary surface;
S2,基于初始边界曲面,建立混合活动轮廓模型:对标准活动轮廓模型的能量函数中边界能量项采用标准测地线模型,区域能量项采用局部高斯模型描述的灰度最大后验概率,进而得到混合活动轮廓模型的能量函数;S2. Based on the initial boundary surface, a hybrid active contour model is established: the standard geodesic model is used for the boundary energy item in the energy function of the standard active contour model, and the gray maximum posterior probability described by the local Gaussian model is used for the regional energy item, and then obtained The energy function of the hybrid active contour model;
S3,模型离散化,包括:S3, model discretization, including:
S31,给每个体素点定义一个二元变量,赋值1和0分别对应代表前景点和背景点,以将区域能量项函数离散化;S31, define a binary variable for each voxel point, and assign values 1 and 0 to represent foreground points and background points respectively, so as to discretize the regional energy term function;
S32,利用割测度将边界能量项函数即测地线模型离散化;S32, using the cut measure to discretize the boundary energy term function, that is, the geodesic model;
S33,得到离散化后的能量函数;S33, obtaining a discretized energy function;
S4,构建图:对于截取的局部三维MR图像数据,将其中的每个体素点作为图的节点,采用每个体素点的6邻域进行图的构建;对初始边界曲面内和初始边界曲面外的体素点分别赋予初始值;并根据离散后的能量函数给节点间连接的边,节点与源点连接的边,和节点与汇点连接的边分别赋予对应的权值;S4, Constructing a graph: For the intercepted local 3D MR image data, each voxel point is used as a node of the graph, and the 6 neighborhoods of each voxel point are used to construct the graph; for the initial boundary surface and the initial boundary surface The voxel points of are assigned initial values; and according to the energy function after discretization, assign corresponding weights to the edges connecting nodes, the edges connecting nodes to source points, and the edges connecting nodes to sink points;
S5,基于步骤S4构建的图进行图割计算:采用最大流和最小割算法得到分割结果,提取分割结果中的边界曲面即为分割轮廓;S5, performing graph cut calculation based on the graph constructed in step S4: using the maximum flow and minimum cut algorithms to obtain the segmentation result, and extracting the boundary surface in the segmentation result as the segmentation contour;
S6,以当前分割轮廓作为初始边界曲面,重复迭代步骤S2至步骤S5,直至分割结果收敛,输出最终分割结果。S6, using the current segmentation contour as the initial boundary surface, iterating step S2 to step S5 repeatedly until the segmentation result converges, and outputting the final segmentation result.
进一步的,本发明还包括步骤S7,利用三维中值滤波对步骤S5得到的演化曲面进行处理,得到滤波后分割结果;步骤S6以当前滤波后的分割轮廓作为初始边界曲面。Further, the present invention also includes step S7, using three-dimensional median filtering to process the evolution surface obtained in step S5, to obtain a filtered segmentation result; step S6 uses the current filtered segmentation contour as the initial boundary surface.
优选的,步骤S11中,种子点的选取步骤为,在矢状位的二维显示图像中,选取中心位置切片,在切片中垂体瘤内近似中心位置选取一点,即作为种子点。所述近似中心位置即中心位置附近,此选取步骤为手动选取,故判断所选种子点是否近似中心位置依赖选取人来进行,以尽量靠近中心位置为基准,一般误差范围在垂体瘤直径的30%以内。Preferably, in step S11, the step of selecting the seed point is to select a slice at the central position in the sagittal two-dimensional display image, and select a point at the approximate central position of the pituitary tumor in the slice as the seed point. The approximate central position is near the central position. This selection step is manual selection, so judging whether the selected seed point is close to the central position depends on the selector, and is based on the position as close as possible to the central position. The general error range is 30% of the diameter of the pituitary tumor. % within.
优选的,步骤S11中,所述包含垂体瘤的局部三维MR图像数据的尺寸为71×71×41个体素。Preferably, in step S11, the size of the local three-dimensional MR image data including the pituitary tumor is 71×71×41 voxels.
步骤S13中,根据概率图的灰度值分布来确定,取值范围为0~1。In step S13, it is determined according to the gray value distribution of the probability map, and the value range is 0-1.
优选的,步骤S2中,给定图像域I(x):Ω→R为二维图像;闭合曲线C将图像分成两个独立区域,L(C)表示C的长度;设曲线C内区域为Ω1,曲线C外区域外为Ω2,对于图像域Ω的各像素p,考虑其半径为ρ的圆形邻域,定义为Ox={y:|x-y|≤ρ},x为圆形邻域的中心像素点,y为圆形邻域中除x外的任意像素点;Preferably, in step S2, the given image domain I(x): Ω→R is a two-dimensional image; the closed curve C divides the image into two independent areas, and L(C) represents the length of C; let the area inside the curve C be Ω 1 , and the area outside the curve C be Ω 2 , for each pixel p in the image domain Ω, consider its circular neighborhood with radius ρ, defined as O x ={y:|xy|≤ρ}, x is the central pixel of the circular neighborhood, and y is the circle Any pixel in the shape neighborhood except x;
则区域Ox∩Ωi内的像素点灰度概率密度函数表示为:Then the pixel gray probability density function in the area O x ∩Ω i is expressed as:
式中ui(x)和σi(x)分别为区域Ox∩Ωi内像素点x的局部灰度均值和方差,I(y)为像素点y的灰度值,where u i (x) and σ i (x) are the local gray mean and variance of pixel x in area O x ∩Ω i respectively, I(y) is the gray value of pixel y,
边界能量项EEdge采用标准测地线模型,区域能量项EReigon采用局部高斯模型描述的灰度最大后验概率形式的能量函数E表示为:The boundary energy item E Edge adopts the standard geodesic model, and the regional energy item E Reigon adopts the energy function E in the form of the gray maximum posterior probability described by the local Gaussian model as follows:
式中β是一个任意正常数,函数w是一个权重函数。where β is an arbitrary constant, and the function w is a weight function.
进一步的,本发明步骤S2中,权重函数w采用截断高斯核形式,表示为:Further, in step S2 of the present invention, the weight function w adopts a truncated Gaussian kernel form, expressed as:
式中α为使得∫w(x,y)=1成立的常数。即,本发明对邻域Ox中接近中心点x的像素y的灰度值I(y)赋予大的权重值。In the formula, α is a constant that makes ∫w(x, y)=1. That is, the present invention assigns a large weight value to the gray value I(y) of the pixel y close to the center point x in the neighborhood O x .
本发明步骤S3对模型进行离散化是为了与图割算法的能量函数相融合。优选的,步骤S31中,给每个体素点p定义一个二元变量xp,以对能量函数的区域能量项进行离散化:The discretization of the model in step S3 of the present invention is to integrate with the energy function of the graph cut algorithm. Preferably, in step S31, a binary variable x p is defined for each voxel point p to discretize the area energy term of the energy function:
Object表示前景点即分割目标,Background表示背景点;Object represents the foreground point, which is the segmentation target, and Background represents the background point;
区域能量项函数离散化后表示为:The discretization of the regional energy term function is expressed as:
p、q指代图像中不同的体素,xp、xq指代不同体素的二元值(0或1),N(p)指体素p的邻域。p, q refer to different voxels in the image, x p , x q refer to binary values (0 or 1) of different voxels, and N(p) refers to the neighborhood of voxel p.
us(p)、ut(p)和σs(p)、σt(p)分别为ui(x)和σi(x)的离散形式,表示如下:u s (p), u t (p) and σ s (p), σ t (p) are the discrete forms of u i (x) and σ i (x) respectively, expressed as follows:
步骤S32中,边界能量项函数离散化后表示为:In step S32, the boundary energy term function is discretized and expressed as:
ωpq为非负边权值,表达为三维形式即:ω pq is a non-negative edge weight, expressed in a three-dimensional form:
ΔΦpq=Δφpq·Δψpq=π2/4,对应6邻域中单位圆的角度间隔,δ为单位格的尺寸,可取值δ=1,|epq|为边界epq的单位长度,本发明中取值|epq|=1,D是常数黎曼测度。优选的,本发明中ωpq=π/4。ΔΦ pq = Δφ pq · Δψ pq = π 2 /4, corresponding to the angular interval of the unit circle in the 6-neighborhood, δ is the size of the unit cell, and the possible value δ=1, |e pq | is the unit length of the boundary e pq , the value |e pq |=1 in the present invention, D is a constant Riemann measure. Preferably, ω pq =π/4 in the present invention.
基于离散后的区域项和边界项,即可得到离散后的混合活动模型能量函数。Based on the discretized area items and boundary items, the discretized hybrid activity model energy function can be obtained.
优选的,为避免图割算法的标准能量函数中区域和边界项的平衡问题,并且区域项会影响图割算法趋于分割出小区域。离散后的能量函数采用乘法形式,即,将区域能量项作为边界能量项的权重项,离散后的能量函数表示为:Preferably, in order to avoid the balance problem of the area and boundary items in the standard energy function of the graph cut algorithm, and the area item will affect the graph cut algorithm tends to segment small areas. The energy function after discretization adopts the form of multiplication, that is, the regional energy item is used as the weight item of the boundary energy item, and the energy function after discretization is expressed as:
E=EEdge(p,q)·E'Region(p) (10)E=E Edge (p,q)·E' Region (p) (10)
如果邻域体素p,q同时位于分割目标内或外时,有|Es(p)+Et(q)|>0和|Es(q)+Et(p)|>0成立;如果p,q位于目标边界的两边,则有|Es(p)+Et(q)|≈0或|Es(q)+Et(p)|≈0成立。所以只有当邻域体素p,q分别位于目标边界的两边时,即p,q分别属于目标和背景区域时,公式(10)才能得到最小值。If the neighborhood voxel p, q are located inside or outside the segmentation target at the same time, there are |E s (p)+E t (q)|>0 and |E s (q)+E t (p)|>0 hold ; If p, q are located on both sides of the target boundary, then |E s (p)+E t (q)|≈0 or |E s (q)+E t (p)|≈0 holds true. So only when the neighborhood voxels p, q are located on both sides of the target boundary, that is, when p, q belong to the target and background regions respectively, the formula (10) can get the minimum value.
优选的,步骤S4中,定义体素点之间相互连接的边n-link权值为EEdge(p,q)·E'Region(p);如果|Es(p)|>|Et(p)|并且xp=1,则体素点与汇点T(指代分割目标)相连接的边t-link的权值设置为无穷;如果|Es(p)|<|Et(p)|并且xp=0,则体素点与源点S(指代背景)相连接的边t-link的权值设置为无穷。最后即可用最大流/最小割算法求解分割结果,即对图的能量函数求解,得到图中各节点的标号(0或1),此为现有技术。Preferably, in step S4, define the edge n-link weights connected to each other between voxel points as E Edge (p,q)·E' Region (p); if |E s (p)|>|E t (p)|and x p =1, then the weight of the edge t-link connecting the voxel point and the sink point T (referring to the segmentation target ) is set to infinity; if |E s (p)|<|E t (p)|and x p =0, then the weight of the edge t-link connecting the voxel point to the source point S (referring to the background) is set to infinity. Finally, the maximum flow/minimum cut algorithm can be used to solve the segmentation result, that is, the energy function of the graph is solved to obtain the label (0 or 1) of each node in the graph, which is the prior art.
有益效果Beneficial effect
本发明方法是基于图割的活动轮廓模型(Graph cuts based active contourmodel,GCACM)算法的改进和拓展,利用活动轮廓模型解决图割算法的分割边缘阶梯化缺点,同时也利用图割的最大流/最小割算法解决了活动轮廓模型水平集方法的计算复杂性问题,以及容易陷于局部点的缺点。为解决图割算法中的边界种子点选择问题,采用随机游走算法大概确定目标区域,并利用垂体瘤的相对固定解剖位置(鼻子后方、双眼正中、视交叉下方等),为随机游走算法手动交互提供种子点。结合位置先验知识和图割、活动轮廓模型实现垂体瘤的三维分割,可提高在例如垂体瘤的定位、与周围组织的病理关联以及体积测量等定量分析中的利用有效性。The method of the present invention is based on the improvement and expansion of the Graph cuts based active contour model (GCACM) algorithm, and utilizes the active contour model to solve the stepping defect of the segmentation edge of the graph cut algorithm, and also utilizes the maximum flow/ The minimum cut algorithm solves the problem of computational complexity of the level set method of the active contour model and the disadvantage of being easily trapped in local points. In order to solve the problem of boundary seed point selection in the graph cut algorithm, the random walk algorithm is used to roughly determine the target area, and the relatively fixed anatomical position of the pituitary tumor (behind the nose, in the middle of the eyes, below the optic chiasm, etc.) is used as a random walk algorithm Manual interaction provides seed points. Combining position prior knowledge with graph cut and active contour models to achieve 3D segmentation of pituitary tumors can improve the effectiveness of quantitative analysis such as pituitary tumor localization, pathological association with surrounding tissues, and volume measurement.
即本发明首次提供了一种具有可行性和有效性的半自动垂体瘤MR图像分割算法,结合了基于图论和基于活动轮廓模型的两类典型图像分割算法,可以实现规则和不规则垂体瘤的分割及体积估计,尤其对浸润型垂体瘤分割也有良好的准确性。交互式操作简单易行,只需用户鼠标选取两个点即可自动完成剩余的分割任务。算法中采用局部高斯分布描述图像区域灰度,可以有效解决MR图像垂体瘤病变区域灰度不均匀的问题。That is, the present invention provides a feasible and effective semi-automatic pituitary tumor MR image segmentation algorithm for the first time, combining two typical image segmentation algorithms based on graph theory and active contour model, which can realize regular and irregular pituitary tumors Segmentation and volume estimation, especially for invasive pituitary tumors, also have good accuracy. The interactive operation is simple and easy, and the remaining segmentation tasks can be automatically completed only by selecting two points with the user's mouse. In the algorithm, the local Gaussian distribution is used to describe the gray level of the image area, which can effectively solve the problem of uneven gray level in the pituitary tumor lesion area of MR images.
附图说明Description of drawings
图1所示为本发明方法流程示意图;Fig. 1 shows the schematic flow sheet of the method of the present invention;
图2所示为本发明分割过程和结果示意图,其中a-用户选取一个前景点(黄色点)和一个背景点(绿色点)叠加在原始矢状位二维图像上,红色方框表示截取的感兴趣区;b-叠加在概率图上的初始轮廓;c-叠加在原始图像上的分割轮廓;d-分割结果的三维渲染模型;Fig. 2 shows the segmentation process and result schematic diagram of the present invention, wherein a-user selects a foreground point (yellow point) and a background point (green point) to be superimposed on the original sagittal two-dimensional image, and the red box represents the intercepted Region of interest; b- the initial contour superimposed on the probability map; c- the segmentation contour superimposed on the original image; d- the 3D rendering model of the segmentation result;
图3所示为步骤S2中像素的圆形邻域示意图,虚线圆形表示像素x的邻域。FIG. 3 is a schematic diagram of the circular neighborhood of the pixel in step S2, and the dotted circle represents the neighborhood of the pixel x.
具体实施方式detailed description
以下结合附图和具体实施例进一步描述。It will be further described below in conjunction with the accompanying drawings and specific embodiments.
本发明基于随机游走和图割的活动轮廓模型的MR图像三维交互分割方法,包括以下步骤:The present invention is based on the MR image three-dimensional interactive segmentation method of the active contour model of random walk and graph cut, comprises the following steps:
S1,获取初始边界曲面,包括步骤:S1, to obtain the initial boundary surface, including steps:
S11,选取随机游走算法所需的种子点,以该种子点作为三维中心点,从脑部MR三维数据中截取包含垂体瘤的局部三维MR图像数据;S11, selecting the seed point required by the random walk algorithm, using the seed point as the three-dimensional center point, and intercepting the local three-dimensional MR image data including the pituitary tumor from the three-dimensional brain MR data;
S12,利用三维随机游走算法对截取的局部三维MR图像数据进行处理,得到各体素点到达种子点的概率三维图;S12, using a three-dimensional random walk algorithm to process the intercepted local three-dimensional MR image data to obtain a three-dimensional map of the probability that each voxel point reaches the seed point;
S13,利用最大期望值算法选取概率阈值,以分割出疑似目标区域,将疑似目标区域内的体素作为活动轮廓模型算法的前景点,疑似目标区域的边界曲面即初始边界曲面;S13, using the maximum expected value algorithm to select a probability threshold to segment the suspected target area, using the voxels in the suspected target area as the foreground point of the active contour model algorithm, and the boundary surface of the suspected target area is the initial boundary surface;
S2,基于初始边界曲面,建立混合活动轮廓模型:对标准活动轮廓模型的能量函数中边界能量项采用标准测地线模型,区域能量项采用局部高斯模型描述的灰度最大后验概率,进而得到混合活动轮廓模型的能量函数;S2. Based on the initial boundary surface, a hybrid active contour model is established: the standard geodesic model is used for the boundary energy item in the energy function of the standard active contour model, and the gray maximum posterior probability described by the local Gaussian model is used for the regional energy item, and then obtained The energy function of the hybrid active contour model;
S3,模型离散化,包括:S3, model discretization, including:
S31,给每个体素点定义一个二元变量,赋值1和0分别对应代表前景点和背景点,以将区域能量项函数离散化;S31, define a binary variable for each voxel point, and assign values 1 and 0 to represent foreground points and background points respectively, so as to discretize the regional energy term function;
S32,利用割测度将边界能量项函数即测地线模型离散化;S32, using the cut measure to discretize the boundary energy term function, that is, the geodesic model;
S33,得到离散化后的能量函数;S33, obtaining a discretized energy function;
S4,构建图:对于截取的局部三维MR图像数据,将其中的每个体素点作为图的节点,采用每个体素点的6邻域进行图的构建;对初始边界曲面内和初始边界曲面外的体素点分别赋予初始值;并根据离散后的能量函数给节点间连接的边,节点与源点连接的边,和节点与汇点连接的边分别赋予对应的权值;S4, Constructing a graph: For the intercepted local 3D MR image data, each voxel point is used as a node of the graph, and the 6 neighborhoods of each voxel point are used to construct the graph; for the initial boundary surface and the initial boundary surface The voxel points of are assigned initial values; and according to the energy function after discretization, assign corresponding weights to the edges connecting nodes, the edges connecting nodes to source points, and the edges connecting nodes to sink points;
S5,基于步骤S4构建的图进行图割计算:采用最大流和最小割算法得到分割结果,提取分割结果中的边界曲面即为分割轮廓;S5, performing graph cut calculation based on the graph constructed in step S4: using the maximum flow and minimum cut algorithms to obtain the segmentation result, and extracting the boundary surface in the segmentation result as the segmentation contour;
S6,以当前分割轮廓作为初始边界曲面,重复迭代步骤S2至步骤S5,直至分割结果收敛,输出最终分割结果。S6, using the current segmentation contour as the initial boundary surface, iterating step S2 to step S5 repeatedly until the segmentation result converges, and outputting the final segmentation result.
进一步的,本发明还可包括步骤S7,在S5与S6之间实施,即利用三维中值滤波对步骤S5得到的演化曲面进行处理,得到滤波后分割结果;步骤S6以当前滤波后的分割轮廓作为初始边界曲面。Further, the present invention can also include step S7, which is implemented between S5 and S6, that is, the evolution surface obtained in step S5 is processed by three-dimensional median filtering to obtain the filtered segmentation result; step S6 uses the current filtered segmentation contour as the initial boundary surface.
实施例1Example 1
参考图1所示,本实施例方法的步骤简述为:图像分割种子点选取及初始化边界曲面获取、改进的GCACM算法的迭代分割、分割结果的三维中值滤波后处理。也即下述的初始化步骤、分割步骤和后处理步骤,具体描述如下。Referring to Fig. 1, the steps of the method in this embodiment are briefly described as follows: image segmentation seed point selection and initial boundary surface acquisition, iterative segmentation of the improved GCACM algorithm, and post-processing of the three-dimensional median filter of the segmentation results. That is, the following initialization steps, segmentation steps and post-processing steps are described in detail as follows.
1、初始化步骤。主要为用户交互式手动选取Random walk算法所需的种子点,以及获取分割算法所需的初始边界曲面。1. Initialization steps. It is mainly for the user to interactively manually select the seed points required by the Random walk algorithm, and to obtain the initial boundary surface required by the segmentation algorithm.
为减少数据计算复杂度,并利用用户的医学背景知识,在原脑部MR三维数据中截取包含垂体瘤的数据立方体。具体做法是在矢状位的二维显示图像中,选取中心位置切片,再在垂体瘤内近似中心位置鼠标选取一点。以该点为中心截取数据立方体(本实验选用71×71×41大小的尺寸),同时该点也作为Random walk算法的前景点,然后在该切片图像内背景区域任意选取一点充当Random walk算法的背景点。In order to reduce the computational complexity of the data and make use of the user's medical background knowledge, the data cube containing the pituitary tumor was intercepted from the original three-dimensional brain MR data. The specific method is to select a slice at the central position in the sagittal two-dimensional display image, and then select a point in the approximate central position of the pituitary tumor with the mouse. Take this point as the center to intercept the data cube (in this experiment, the size of 71×71×41 is selected), and this point is also used as the foreground point of the Random walk algorithm, and then randomly select a point in the background area of the slice image as the random walk algorithm. background point.
对截取的数据立方体进行三维Random walk算法处理,得到各体素到达前景种子点的概率三维图。利用EM算法选取概率阈值,初步分割出疑似目标的区域,区域内的体素将会被用作GCACM的前景点,区域的边界曲面即是初始边界曲面。The intercepted data cube is processed by the three-dimensional random walk algorithm, and the probability three-dimensional map of each voxel reaching the foreground seed point is obtained. The EM algorithm is used to select the probability threshold, and the area of the suspected target is initially segmented. The voxels in the area will be used as the foreground points of GCACM, and the boundary surface of the area is the initial boundary surface.
获取初始边界曲面的过程如图2示意,以近似垂体瘤中心位置的一幅矢状位二维图像为例,首先a-用户选取一个前景点(黄色点)和一个背景点(绿色点)叠加在原始矢状位二维图像上,红色方框表示截取的感兴趣区;b图中为叠加在概率图上的初始轮廓,c图中为叠加在原始图像上的分割轮廓,d中为分割结果的三维渲染模型。The process of obtaining the initial boundary surface is shown in Figure 2. Taking a sagittal two-dimensional image approximately at the center of the pituitary tumor as an example, first a- the user selects a foreground point (yellow point) and a background point (green point) to superimpose On the original sagittal two-dimensional image, the red box represents the intercepted region of interest; in b is the initial contour superimposed on the probability map, in c is the segmentation contour superimposed on the original image, and in d is the segmentation The resulting 3D rendered model.
2、分割步骤,包括混合活动轮廓模型的设计、模型离散化、图的构建及求解。2. Segmentation steps, including the design of the hybrid active contour model, model discretization, graph construction and solution.
(1)混合活动轮廓模型的建立(1) Establishment of hybrid active contour model
参考图3所示,给定图像域I(x):Ω→R为二维图像。闭合曲线C将图像分成两个独立区域,L(C)表示C的长度。设曲线C内区域为Ω1,曲线C外区域外为Ω2。对于图像域Ω的每个像素p,考虑其半径为ρ的圆形邻域,定义为Ox={y:x-y≤ρ}。Referring to Figure 3, a given image domain I(x):Ω→R is a two-dimensional image. A closed curve C divides the image into two independent regions, and L(C) represents the length of C. Let the area inside the curve C be Ω 1 , and the area outside the curve C be Ω 2 . For each pixel p in the image domain Ω, consider its circular neighborhood with radius ρ, defined as O x ={y:xy≤ρ}.
区域Ox∩Ωi内的像素点灰度概率密度函数可表示如下:The pixel gray probability density function in the area O x ∩Ω i can be expressed as follows:
式中ui(x)和σi(x)分别为区域Ox∩Ωi内像素点x的局部灰度均值和方差。In the formula, u i (x) and σ i (x) are the local gray mean and variance of the pixel x in the area O x ∩Ω i , respectively.
能量函数结合了边界能量项和区域能量项,其中边界项EEdge采用标准测地线模型,区域项EReigon采用灰度局部高斯模型并且表示为最大后验概率(Maximum a posterioriprobability,MAP)形式。能量函数可写成如下形式:The energy function combines the boundary energy item and the regional energy item, where the boundary item E Edge adopts a standard geodesic model, and the regional item E Reigon adopts a gray-scale local Gaussian model and is expressed as a maximum a posteriori probability (Maximum a posteriori probability, MAP) form. The energy function can be written as follows:
式中β是一个任意正常数。函数w是一个权重函数,对邻域Ox中接近中心点x的像素y灰度值I(y)赋予大的权重值。本算法中采用截断高斯核形式的w,表示如下:where β is an arbitrary constant. The function w is a weight function, which assigns a large weight value to the gray value I(y) of the pixel y close to the center point x in the neighborhood O x . In this algorithm, w in the form of a truncated Gaussian kernel is used, expressed as follows:
其中α是常数,使得∫w(x,y)=1成立。where α is a constant such that ∫w(x,y)=1 holds.
(2)模型离散化(2) Model discretization
为了与图割算法的能量函数融合,给图中每个体素点p定义一个二元变量xp,赋值1和0分别代表前景点(分割目标)和背景点(背景),将区域项能量函数离散化,如式(4)所示。In order to integrate with the energy function of the graph cut algorithm, a binary variable x p is defined for each voxel point p in the graph, and the values 1 and 0 are assigned to represent the foreground point (segmentation target) and background point (background), respectively, and the energy function of the area item Discretization, as shown in formula (4).
再利用Boykov等人提出的割测度(Cut metric),将测地线模型离散化表示,则能量函数的边界项表示为:Using the cut metric proposed by Boykov et al. to discretize the geodesic model, the boundary term of the energy function is expressed as:
式中ωpq是非负边权值,可表达为三维形式如下:where ω pq is a non-negative edge weight, which can be expressed in three-dimensional form as follows:
上式中ΔΦpq=Δφpq·Δψpq=π2/4对应6邻域中单位圆的角度间隔,δ为单位格的尺寸,δ=1,|epq|为边界epq的单位长度,|epq|=1,D是常数黎曼测度,本发明中取ωpq=π/4。In the above formula, ΔΦ pq = Δφ pq · Δψ pq = π 2 /4 corresponds to the angular interval of the unit circle in the 6 neighborhoods, δ is the size of the unit cell, δ=1, |e pq | is the unit length of the boundary e pq , |e pq |=1, D is a constant Riemann measure, and ω pq =π/4 is taken in the present invention.
能量函数的区域项离散形式可表达如下:The discrete form of the area term of the energy function can be expressed as follows:
式中p、q指代图像中不同的体素,xp、xq指代不同体素的二元值(0或1),N(p)指体素p的邻域;us(p)、ut(p)和σs(p)、σt(p)分别为ui(x)和σi(x)的离散形式,如下所示:In the formula, p and q refer to different voxels in the image, x p and x q refer to the binary values (0 or 1) of different voxels, N(p) refers to the neighborhood of voxel p; u s (p ), u t (p) and σ s (p), σ t (p) are the discrete forms of u i (x) and σ i (x) respectively, as follows:
为避免图割算法的标准能量函数中区域和边界项的平衡问题,并且区域项会影响图割算法趋于分割出小区域。本算法使用乘法形式的能量函数,即使用区域项充当边界项的权重项,如公式(10)、(11)所示:In order to avoid the balance problem of the area and boundary items in the standard energy function of the graph cut algorithm, and the area item will affect the graph cut algorithm tends to segment small areas. This algorithm uses the energy function in the form of multiplication, that is, the area item is used as the weight item of the boundary item, as shown in formulas (10) and (11):
E=EEdge(p,q)·E'Region(p) (10)E=E Edge (p,q)·E' Region (p) (10)
如果邻域像素p,q同时位于分割目标(即垂体瘤区域)内或外时,有|Es(p)+Et(q)|>0和|Es(q)+Et(p)|>0成立;如果p,q位于目标边界的两边,则有|Es(p)+Et(q)|≈0或|Es(q)+Et(p)|≈0成立。所以只有当邻域像素p,q位于目标边界的两边时,公式(10)才能得到最小值。公式(10)取得最小值代表图的能量为最小值,即能量函数取得最优结果,而能量达到最优时即分割完成,此时分属目标和背景区域的体素点被赋予了不同的标记值。If the neighboring pixels p and q are located inside or outside the segmentation target (ie pituitary tumor area) at the same time, there are |E s (p)+E t (q)|>0 and |E s (q)+E t (p )|>0 is established; if p, q are located on both sides of the target boundary, then |E s (p)+E t (q)|≈0 or |E s (q)+E t (p)|≈0 is established . So formula (10) can get the minimum value only when the neighboring pixels p, q are located on both sides of the target boundary. The minimum value of formula (10) means that the energy of the image is the minimum value, that is, the energy function achieves the optimal result, and when the energy reaches the optimal value, the segmentation is completed. At this time, the voxel points belonging to the target and background areas are assigned different tag value.
(3)图的构建及求解(3) Construction and solution of graph
本发明用MR数据体中的每个体素充当图的节点,采用6邻域构建三维图。图中体素之间相互连接的边n-link权值设为EEdge(p,q)·E'Region(p);如果|Es(p)|>|Et(p)|并且xp=1,则体素与汇点T(对应目标)相连接的边t-link权值设置为无穷;如果|Es(p)|<|Et(p)|并且xp=0,则体素与源点S(对应背景)相连接的边t-link权值设置为无穷。最后用最大流/最小割算法求解分割结果,此处为现有技术,不做赘述。The present invention uses each voxel in the MR data volume as a graph node, and uses six neighborhoods to construct a three-dimensional graph. The n-link weight of the connected edges between voxels in the graph is set to E Edge (p,q)·E' Regi o n (p); if |E s (p)|>|E t (p)| And x p =1, then the t-link weight of the edge connecting the voxel to the sink T (corresponding target) is set to infinity; if |E s (p)|<|E t (p)| and x p = 0, the t-link weight of the edge connecting the voxel to the source point S (corresponding to the background) is set to infinity. Finally, the maximum flow/minimum cut algorithm is used to solve the segmentation result, which is the prior art here and will not be described in detail.
3、后处理3. Post-processing
对分割步骤所得的演化曲面再用三维中值滤波进行后处理,然后根据分割结果进行迭代分割直至结果收敛,得到最终的分割结果The evolution surface obtained in the segmentation step is post-processed with a three-dimensional median filter, and then iteratively segmented according to the segmentation result until the result converges to obtain the final segmentation result
本发明的迭代分割流程简述如下:The iterative segmentation process of the present invention is briefly described as follows:
(1)采用Random walk算法获取初始边界曲面Sur;初始赋值Sur内的体素p对应的二元变量xp为1,Sur外的体素p对应的xp为0;(1) Use the Random walk algorithm to obtain the initial boundary surface S ur ; the binary variable x p corresponding to the voxel p inside the initial assignment S ur is 1, and the x p corresponding to the voxel p outside S ur is 0;
(2)用公式(8)、(9)计算局部灰度的均值和方差us(p)、ut(p)和σs(p)、σt(p);(2) Calculate the mean and variance u s (p), u t (p) and σ s (p), σ t (p) of the local gray scale using formulas (8) and (9);
(3)用公式(10)表示的能量函数构建图;(3) construct graph with the energy function represented by formula (10);
(4)用最大流/最小割算法求解分割结果,再根据分割结果更新体素p对应的二元变量xp值,实际上,求解得到分割结果的同时也即更新了体素p对应的二元变量值;(4) Use the maximum flow/minimum cut algorithm to solve the segmentation result, and then update the value of the binary variable x p corresponding to the voxel p according to the segmentation result. meta variable value;
(5)用三维中值滤波器对分割结果进行光滑后处理;(5) Carry out smooth post-processing to the segmentation result with a three-dimensional median filter;
(6)以当前分割轮廓取代初始轮廓,即S2中的初始边界曲面,重复步骤(2)-(5)直到分割结果收敛,求得的分割结果不再变化即为收敛。(6) Replace the initial contour with the current segmentation contour, that is, the initial boundary surface in S2, and repeat steps (2)-(5) until the segmentation result converges, and the obtained segmentation result does not change, which means convergence.
4、实验结果4. Experimental results
利用本发明在23位垂体瘤病人的MR T1W数据上进行分割实验,结果示意图如图2中c、d所示。表1给出23个病例分割结果Dice系数值(Dice similarity coefficient,DSC)的最小值、最大值以及均值和标准方差值。DSC值定义为实验结果VE和金标准VG的相对重叠体积比,如公式(12)所示:Using the present invention to conduct a segmentation experiment on the MR T1W data of 23 pituitary tumor patients, the schematic diagrams of the results are shown in c and d in FIG. 2 . Table 1 shows the minimum value, maximum value, mean value and standard deviation value of Dice coefficient value (Dice similarity coefficient, DSC) of 23 case segmentation results. The DSC value is defined as the relative overlapping volume ratio of the experimental result V E and the gold standard V G , as shown in formula (12):
此外为表现出本发明方法分割效果的优越性,将本算法和另外两种已发表的分割算法(加载于软件3DSlice中的基于区域生长的GrowCut算法和一般GCACM算法)进行分割结果DSC值的比较。比较结果参阅表1,可以看到本算法的分割结果DSC值均值为88.36%,优于GrowCut算法的81.61%和一般GCACM算法的70.88%。说明本算法在垂体瘤分割应用中具有较高的有效性和准确性。In addition, in order to show the superiority of the segmentation effect of the method of the present invention, this algorithm and two other published segmentation algorithms (GrowCut algorithm based on region growth and general GCACM algorithm loaded in the software 3DSlice) were compared for the DSC value of the segmentation result . Refer to Table 1 for the comparison results. It can be seen that the average DSC value of the segmentation result of this algorithm is 88.36%, which is better than 81.61% of the GrowCut algorithm and 70.88% of the general GCACM algorithm. It shows that this algorithm has high validity and accuracy in the application of pituitary tumor segmentation.
表1本算法和两种已发表分割算法的分割结果DSC值Table 1. DSC values of segmentation results of this algorithm and two published segmentation algorithms
以上所述仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明技术原理的前提下,还可以做出若干改进和变形,这些改进和变形也应视为本发明的保护范围。The above is only a preferred embodiment of the present invention, it should be pointed out that for those of ordinary skill in the art, without departing from the technical principle of the present invention, some improvements and modifications can also be made. It should also be regarded as the protection scope of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710073688.XA CN106780518B (en) | 2017-02-10 | 2017-02-10 | A kind of MR image three-dimensional interactive segmentation method of the movable contour model cut based on random walk and figure |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710073688.XA CN106780518B (en) | 2017-02-10 | 2017-02-10 | A kind of MR image three-dimensional interactive segmentation method of the movable contour model cut based on random walk and figure |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106780518A true CN106780518A (en) | 2017-05-31 |
CN106780518B CN106780518B (en) | 2019-06-25 |
Family
ID=58956878
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710073688.XA Active CN106780518B (en) | 2017-02-10 | 2017-02-10 | A kind of MR image three-dimensional interactive segmentation method of the movable contour model cut based on random walk and figure |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106780518B (en) |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107292896A (en) * | 2017-08-15 | 2017-10-24 | 电子科技大学 | Contour extraction method based on Snake models |
CN107818566A (en) * | 2017-10-27 | 2018-03-20 | 中山大学 | A kind of image partition method based on partial structurtes information around random walk combination pixel |
CN108257118A (en) * | 2018-01-08 | 2018-07-06 | 浙江大学 | A kind of fracture adhesion dividing method based on normal direction corrosion and random walk |
CN108460783A (en) * | 2018-05-09 | 2018-08-28 | 电子科技大学 | A kind of cerebral magnetic resonance image organizational dividing method |
CN109191397A (en) * | 2018-08-28 | 2019-01-11 | 广州智美科技有限公司 | Voxel-based hole repairing method and device |
CN109741439A (en) * | 2018-12-07 | 2019-05-10 | 广州医科大学 | A three-dimensional reconstruction method of two-dimensional MRI fetal images |
CN110415252A (en) * | 2018-04-26 | 2019-11-05 | 北京连心医疗科技有限公司 | A kind of eye circumference organ segmentation method, equipment and storage medium based on CNN |
US10762629B1 (en) | 2019-11-14 | 2020-09-01 | SegAI LLC | Segmenting medical images |
CN112419343A (en) * | 2019-11-27 | 2021-02-26 | 上海联影智能医疗科技有限公司 | System and method for image segmentation |
CN112801851A (en) * | 2021-01-28 | 2021-05-14 | 太原科技大学 | Hardware system for cutting field plant leaves and cutting method thereof |
CN114066923A (en) * | 2021-11-29 | 2022-02-18 | 长春工业大学 | A 3D Otsu threshold segmentation method based on iteration and dimensional decomposition |
US11423544B1 (en) | 2019-11-14 | 2022-08-23 | Seg AI LLC | Segmenting medical images |
CN116630358A (en) * | 2023-07-25 | 2023-08-22 | 潍坊医学院附属医院 | Threshold segmentation method for brain tumor CT image |
CN116759052A (en) * | 2023-06-20 | 2023-09-15 | 华平祥晟(上海)医疗科技有限公司 | Image storage management system and method based on big data |
CN111093518B (en) * | 2017-08-17 | 2023-09-26 | 皇家飞利浦有限公司 | Ultrasound system for extracting image planes from volumetric data using touch interactions with images |
CN118340580A (en) * | 2024-05-11 | 2024-07-16 | 梦石科技(北京)有限公司 | Portable venipuncture operating system based on random walk and graph cut deformation model |
CN119832014A (en) * | 2025-03-14 | 2025-04-15 | 大连理工大学 | Method, equipment and storage medium for segmenting large intestine effusion |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103208114A (en) * | 2013-01-25 | 2013-07-17 | 西安电子科技大学 | Stomach adipose tissue extraction method based on interactive segmentation |
CN104835154A (en) * | 2015-05-03 | 2015-08-12 | 华东理工大学 | Color image object acquisition method based on random walk |
CN105701832A (en) * | 2016-01-19 | 2016-06-22 | 苏州大学 | PET-CT lung tumor segmentation method combining three-dimensional graph cut algorithm with random walk algorithm |
CN105957063A (en) * | 2016-04-22 | 2016-09-21 | 北京理工大学 | CT image liver segmentation method and system based on multi-scale weighting similarity measure |
-
2017
- 2017-02-10 CN CN201710073688.XA patent/CN106780518B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103208114A (en) * | 2013-01-25 | 2013-07-17 | 西安电子科技大学 | Stomach adipose tissue extraction method based on interactive segmentation |
CN104835154A (en) * | 2015-05-03 | 2015-08-12 | 华东理工大学 | Color image object acquisition method based on random walk |
CN105701832A (en) * | 2016-01-19 | 2016-06-22 | 苏州大学 | PET-CT lung tumor segmentation method combining three-dimensional graph cut algorithm with random walk algorithm |
CN105957063A (en) * | 2016-04-22 | 2016-09-21 | 北京理工大学 | CT image liver segmentation method and system based on multi-scale weighting similarity measure |
Non-Patent Citations (2)
Title |
---|
ZHENG Q ET AL.: "Graph cuts based active contour model with selective local or global segmentation", 《ELECTRONICS LETTERS》 * |
程伟: "基于随机游走的交互式图像分割算法研究", 《中国优秀硕士学位论文全文数据库信息科技辑(月刊)》 * |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107292896A (en) * | 2017-08-15 | 2017-10-24 | 电子科技大学 | Contour extraction method based on Snake models |
CN111093518B (en) * | 2017-08-17 | 2023-09-26 | 皇家飞利浦有限公司 | Ultrasound system for extracting image planes from volumetric data using touch interactions with images |
CN107818566A (en) * | 2017-10-27 | 2018-03-20 | 中山大学 | A kind of image partition method based on partial structurtes information around random walk combination pixel |
CN108257118A (en) * | 2018-01-08 | 2018-07-06 | 浙江大学 | A kind of fracture adhesion dividing method based on normal direction corrosion and random walk |
CN108257118B (en) * | 2018-01-08 | 2020-07-24 | 浙江大学 | Fracture adhesion segmentation method based on normal corrosion and random walk |
CN110415252B (en) * | 2018-04-26 | 2022-08-05 | 北京连心医疗科技有限公司 | CNN-based periocular organ segmentation method, CNN-based periocular organ segmentation equipment and CNN-based periocular organ segmentation storage medium |
CN110415252A (en) * | 2018-04-26 | 2019-11-05 | 北京连心医疗科技有限公司 | A kind of eye circumference organ segmentation method, equipment and storage medium based on CNN |
CN108460783A (en) * | 2018-05-09 | 2018-08-28 | 电子科技大学 | A kind of cerebral magnetic resonance image organizational dividing method |
CN108460783B (en) * | 2018-05-09 | 2019-03-12 | 电子科技大学 | A kind of cerebral magnetic resonance image organizational dividing method |
CN109191397A (en) * | 2018-08-28 | 2019-01-11 | 广州智美科技有限公司 | Voxel-based hole repairing method and device |
CN109741439A (en) * | 2018-12-07 | 2019-05-10 | 广州医科大学 | A three-dimensional reconstruction method of two-dimensional MRI fetal images |
CN109741439B (en) * | 2018-12-07 | 2023-12-15 | 广州医科大学 | Three-dimensional reconstruction method of two-dimensional MRI fetal image |
US11423544B1 (en) | 2019-11-14 | 2022-08-23 | Seg AI LLC | Segmenting medical images |
US10762629B1 (en) | 2019-11-14 | 2020-09-01 | SegAI LLC | Segmenting medical images |
CN112419343A (en) * | 2019-11-27 | 2021-02-26 | 上海联影智能医疗科技有限公司 | System and method for image segmentation |
CN112419343B (en) * | 2019-11-27 | 2024-08-30 | 上海联影智能医疗科技有限公司 | System and method for image segmentation |
CN112801851A (en) * | 2021-01-28 | 2021-05-14 | 太原科技大学 | Hardware system for cutting field plant leaves and cutting method thereof |
CN114066923A (en) * | 2021-11-29 | 2022-02-18 | 长春工业大学 | A 3D Otsu threshold segmentation method based on iteration and dimensional decomposition |
CN114066923B (en) * | 2021-11-29 | 2024-12-17 | 长春工业大学 | 3D Otsu threshold segmentation method based on iteration and dimension decomposition |
CN116759052B (en) * | 2023-06-20 | 2024-04-05 | 华平祥晟(上海)医疗科技有限公司 | Image storage management system and method based on big data |
CN116759052A (en) * | 2023-06-20 | 2023-09-15 | 华平祥晟(上海)医疗科技有限公司 | Image storage management system and method based on big data |
CN116630358B (en) * | 2023-07-25 | 2023-09-26 | 潍坊医学院附属医院 | Threshold segmentation method for brain tumor CT image |
CN116630358A (en) * | 2023-07-25 | 2023-08-22 | 潍坊医学院附属医院 | Threshold segmentation method for brain tumor CT image |
CN118340580A (en) * | 2024-05-11 | 2024-07-16 | 梦石科技(北京)有限公司 | Portable venipuncture operating system based on random walk and graph cut deformation model |
CN119832014A (en) * | 2025-03-14 | 2025-04-15 | 大连理工大学 | Method, equipment and storage medium for segmenting large intestine effusion |
Also Published As
Publication number | Publication date |
---|---|
CN106780518B (en) | 2019-06-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106780518A (en) | A kind of MR image three-dimensional interactive segmentation methods of the movable contour model cut based on random walk and figure | |
US11379985B2 (en) | System and computer-implemented method for segmenting an image | |
EP2916738B1 (en) | Lung, lobe, and fissure imaging systems and methods | |
Roy et al. | A deep learning-shape driven level set synergism for pulmonary nodule segmentation | |
Carvalho et al. | 3D segmentation algorithms for computerized tomographic imaging: a systematic literature review | |
Mharib et al. | Survey on liver CT image segmentation methods | |
US8358819B2 (en) | System and methods for image segmentation in N-dimensional space | |
CN105957066B (en) | CT image liver segmentation method and system based on automatic context model | |
US8571278B2 (en) | System and methods for multi-object multi-surface segmentation | |
Mesejo et al. | Biomedical image segmentation using geometric deformable models and metaheuristics | |
CN106340021B (en) | Blood vessel extraction method | |
Chen et al. | Segmenting the prostate and rectum in CT imagery using anatomical constraints | |
Staal et al. | Automatic rib segmentation and labeling in computed tomography scans using a general framework for detection, recognition and segmentation of objects in volumetric data | |
CN109741343A (en) | A T1WI-fMRI Image Tumor Collaborative Segmentation Method Based on 3D-Unet and Graph Theory Segmentation | |
CN108230301A (en) | A kind of spine CT image automatic positioning dividing method based on active contour model | |
CN101111865A (en) | System and method for segmenting the left ventricle in a cardiac image | |
US20120314949A1 (en) | System and Method for Image Segmentation by Optimizing Weighted Curvature | |
CN108510507A (en) | A kind of 3D vertebra CT image active profile dividing methods of diffusion-weighted random forest | |
Campadelli et al. | A segmentation framework for abdominal organs from CT scans | |
CN107680107A (en) | A kind of automatic division method of the diffusion tensor MR image based on multichannel chromatogram | |
Cao et al. | An automatic breast cancer grading method in histopathological images based on pixel-, object-, and semantic-level features | |
Tobon-Gomez et al. | Automatic training and reliability estimation for 3D ASM applied to cardiac MRI segmentation | |
Dahiya et al. | Integrated 3D anatomical model for automatic myocardial segmentation in cardiac CT imagery | |
Li et al. | An automated pipeline for cortical sulcal fundi extraction | |
CN107516314A (en) | Medical image supervoxel segmentation method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20190605 Address after: 215011 Bamboo Garden Road, Suzhou high tech Zone, Jiangsu Province, No. 209 Applicant after: Suzhou were Medical Technology Co. Ltd. Address before: 215123 No. 199 Renai Road, Suzhou Industrial Park, Suzhou City, Jiangsu Province Applicant before: Soochow University |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220315 Address after: 341000 Building 2, Ganzhou national high-level talent science and Innovation Park, No. 1, Wudangshan Road, high tech Zone, Zhanggong District, Ganzhou City, Jiangxi Province Patentee after: Jiangxi Bigway Medical Technology Co.,Ltd. Address before: 215011 No. 209 Chuk Yuen Road, hi tech Zone, Jiangsu, Suzhou Patentee before: SUZHOU BIGVISION MEDICAL TECHNOLOGY Co.,Ltd. |