[go: up one dir, main page]

CN111192251B - Follicle ultrasonic processing method and system based on level set image segmentation - Google Patents

Follicle ultrasonic processing method and system based on level set image segmentation Download PDF

Info

Publication number
CN111192251B
CN111192251B CN201911398714.1A CN201911398714A CN111192251B CN 111192251 B CN111192251 B CN 111192251B CN 201911398714 A CN201911398714 A CN 201911398714A CN 111192251 B CN111192251 B CN 111192251B
Authority
CN
China
Prior art keywords
follicle
area
image
segmentation
suspected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911398714.1A
Other languages
Chinese (zh)
Other versions
CN111192251A (en
Inventor
金丽
侯旻
谷朝臣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Peace Maternal And Child Health Care Institute Affiliated To Shanghai Jiaotong University School Of Medicine
Shanghai Jiao Tong University
Original Assignee
International Peace Maternal And Child Health Care Institute Affiliated To Shanghai Jiaotong University School Of Medicine
Shanghai Jiao Tong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Peace Maternal And Child Health Care Institute Affiliated To Shanghai Jiaotong University School Of Medicine, Shanghai Jiao Tong University filed Critical International Peace Maternal And Child Health Care Institute Affiliated To Shanghai Jiaotong University School Of Medicine
Priority to CN201911398714.1A priority Critical patent/CN111192251B/en
Publication of CN111192251A publication Critical patent/CN111192251A/en
Application granted granted Critical
Publication of CN111192251B publication Critical patent/CN111192251B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10132Ultrasound image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Image Processing (AREA)

Abstract

The invention provides a follicle ultrasonic processing method and a follicle ultrasonic processing system based on level set image segmentation, which are characterized in that a follicle ultrasonic image is subjected to image enhancement through pretreatment to obtain a high-quality pretreatment image; dividing the preprocessed image into a plurality of regions according to the gray distribution characteristics of the ultrasonic image, respectively calculating the region threshold of each region, and performing gray self-adaptive segmentation on each region based on the region threshold; performing secondary segmentation on the pre-segmentation area by adopting level set image segmentation, and enhancing the difference between a follicle area and a non-follicle area in the pre-segmentation area to obtain a suspected follicle area; based on a decision tree and a bagging algorithm, partitioning the suspected follicle area, extracting an independent complete follicle area, and performing follicle quality grading evaluation. The problems of strong subjectivity, few quantitative indexes and the like in ultrasonic follicle monitoring are solved; the automatic segmentation of the follicle ultrasonic image is realized, the diagnosis process is optimized, the diagnosis quality is improved, and the labor intensity of medical workers is reduced.

Description

基于水平集图像分割的卵泡超声处理方法和系统Follicle ultrasound processing method and system based on level set image segmentation

技术领域Technical Field

本发明涉及图像增强、图像降噪以及图像分割领域,具体地,涉及一种基于水平集图像分割的卵泡超声处理方法和系统,尤其是涉及基于双边滤波的图像降噪与自适应直方图的图像增强、基于灰度自适应阈值的预分割与基于水平集方法-CV模型二次分割的卵泡超声图像的图像处理方法,并采用最小二乘法对卵泡质量进行数字化定量评价。The present invention relates to the fields of image enhancement, image denoising and image segmentation, and in particular, to a method and system for ultrasonic processing of follicles based on level set image segmentation, and in particular to an image processing method for ultrasonic images of follicles based on image denoising and adaptive histogram based on bilateral filtering, pre-segmentation based on grayscale adaptive threshold and secondary segmentation based on level set method-CV model, and adopts least square method to perform digital quantitative evaluation on follicle quality.

背景技术Background Art

医学图像分割的是从完全依靠人工分割到实现半人工半自动分割再慢慢走向全自动分割的发展过程。早期的医学图像分割是依靠人工分割在图像上描绘期望的区域边界。半自动分割是把计算机技术和人的知识结合在一起,完成对图像的分割工作。比起单纯的人工分割,在一定程度上,减少了人力成本与人为因素的影响,但是超声图像的分割仍然受到了操作者的技术能力以及经验上的影响。近年,随着模糊技术和人工智能技术的发展,这类激素被广泛应用于图像分割领域,也使得部分医学图像的分割完全脱离了人为干预,实现了全自动分割。Medical image segmentation is a process of development from completely relying on manual segmentation to semi-manual and semi-automatic segmentation and then slowly moving towards fully automatic segmentation. Early medical image segmentation relied on manual segmentation to draw the boundaries of the desired area on the image. Semi-automatic segmentation combines computer technology and human knowledge to complete the image segmentation. Compared with simple manual segmentation, to a certain extent, it reduces the labor cost and the influence of human factors, but the segmentation of ultrasound images is still affected by the operator's technical ability and experience. In recent years, with the development of fuzzy technology and artificial intelligence technology, this type of hormone has been widely used in the field of image segmentation, which has also made the segmentation of some medical images completely free from human intervention and achieved fully automatic segmentation.

对于超声图像,经检索:欧玥等人在《改进测地线活动轮廓模型的超声图像分割》中实现了肝脏超声图像分割。金联等人在文《基于遗传算法的水平集超声图像分割》将遗传算法和水平集结合有效分分割出了肝脏超声图像的肿瘤,陈冠饶等人在文《一种基于生物仿真结构的神经网络在超声医学图像分割中的应用》心脏超声图像分割中应用了生物仿真结构的神经网络。For ultrasound images, after searching: Ou Yue et al. realized the segmentation of liver ultrasound images in the article "Ultrasound Image Segmentation with Improved Geodesic Active Contour Model". Jin Lian et al. combined genetic algorithm and level set to effectively segment the tumor in liver ultrasound images in the article "Level Set Ultrasound Image Segmentation Based on Genetic Algorithm". Chen Guanrao et al. applied a neural network with biological simulation structure in the segmentation of cardiac ultrasound images in the article "Application of a Neural Network Based on Biological Simulation Structure in Ultrasound Medical Image Segmentation".

但是目前针对于卵泡超声图像处理的研究仍是较为缺乏的,卵泡超声图像相对与其他医学超声图像,目标区域较小,数量不统一,且形状各异,难以直接应用其他的超声图像处理方法。However, there is still a lack of research on follicle ultrasound image processing. Compared with other medical ultrasound images, follicle ultrasound images have smaller target areas, inconsistent numbers, and different shapes, making it difficult to directly apply other ultrasound image processing methods.

与本申请相关的现有技术是专利文献105496453A,提供了一种黄牛卵泡超声监测系统及其监测方法,包括以下单元:读取显示超声图像单元,图像裁剪单元,图像去噪单元,卵泡检测单元,表面提取单元,三维重建单元,体积计算单元,体积检测单元以及点集渲染单元。提供了一个对黄牛卵泡超声图像处理及计算的平台,程序可以对超声图像进行去噪、检测卵泡、提取卵泡表面、卵泡三维重建、卵泡体积计算及监测功能。能够监测不同发展状态下黄牛卵泡发育情况,并可对疾病进行诊断和跟踪监测治疗,具有快捷、高效、准确率高、直观性强等优点。The prior art related to the present application is patent document 105496453A, which provides a yellow cattle follicle ultrasound monitoring system and a monitoring method thereof, including the following units: a reading and displaying ultrasound image unit, an image cropping unit, an image denoising unit, a follicle detection unit, a surface extraction unit, a three-dimensional reconstruction unit, a volume calculation unit, a volume detection unit, and a point set rendering unit. A platform for processing and calculating yellow cattle follicle ultrasound images is provided, and the program can perform denoising, follicle detection, follicle surface extraction, follicle three-dimensional reconstruction, follicle volume calculation and monitoring functions on ultrasound images. It can monitor the development of yellow cattle follicles under different development states, and can diagnose and track diseases for monitoring and treatment, with the advantages of being fast, efficient, highly accurate, and intuitive.

发明内容Summary of the invention

针对现有技术中的缺陷,本发明的目的是提供一种基于水平集图像分割的卵泡超声处理方法和系统。In view of the defects in the prior art, the object of the present invention is to provide a method and system for follicle ultrasound processing based on level set image segmentation.

根据本发明提供的一种基于水平集图像分割的卵泡超声处理方法,包括:According to the present invention, a method for ultrasonic processing of follicles based on level set image segmentation comprises:

预处理步骤:识别卵泡超声图像,通过预处理令卵泡超声图像进行图像增强,得到高质量的预处理图像;Preprocessing step: identifying the follicle ultrasound image, and performing image enhancement on the follicle ultrasound image through preprocessing to obtain a high-quality preprocessed image;

预分割步骤:根据超声图像的灰度分布特点,将预处理图像分成多个区域,分别计算各个区域的区域阈值,基于区域阈值对各区域进行灰度自适应分割,得到多个预分割区域;Pre-segmentation step: according to the grayscale distribution characteristics of the ultrasound image, the pre-processed image is divided into multiple regions, the regional threshold of each region is calculated respectively, and the grayscale adaptive segmentation of each region is performed based on the regional threshold to obtain multiple pre-segmented regions;

二次分割步骤:采用水平集图像分割对预分割区域进行二次分割,增强预分割区域中的卵泡区域、非卵泡区域之间的区别,得到疑似卵泡区域;Secondary segmentation step: level set image segmentation is used to perform secondary segmentation on the pre-segmented area, so as to enhance the distinction between the follicle area and the non-follicle area in the pre-segmented area and obtain the suspected follicle area;

区域甄别步骤:提取疑似卵泡区域的图像特征,基于决策树和bagging算法,对疑似卵泡区域进行分区,提取其中的独立完整卵泡区域,并计算该区域卵泡质量评估特征指标,通过由结合专家质量评估打分最小二乘法拟合建立的卵泡质量评估体系模型进行卵泡质量计算机打分评估。Regional identification steps: extract image features of suspected follicle areas, partition suspected follicle areas based on decision trees and bagging algorithms, extract independent and complete follicle areas, and calculate characteristic indicators of follicle quality assessment in this area. Use the follicle quality assessment system model established by least squares fitting combined with expert quality assessment scoring to perform computer scoring assessment of follicle quality.

优选地,所述预处理步骤包括:Preferably, the pretreatment step comprises:

噪声抑制步骤:识别卵泡超声图像后,借助双边滤波在保留卵泡超声图像的边缘细节信息的基础上,实现图像的噪声抑制,得到去噪图像;Noise suppression step: after identifying the follicle ultrasound image, bilateral filtering is used to suppress the image noise while retaining the edge detail information of the follicle ultrasound image to obtain a denoised image;

图像增强步骤:基于自适应直方图均衡对去噪图像的不同局部采用不同的增强方案,增强对比度同时保留图像细节,得到预处理图像。Image enhancement step: Based on adaptive histogram equalization, different enhancement schemes are used for different parts of the denoised image to enhance the contrast while retaining the image details to obtain a preprocessed image.

优选地,所述预分割步骤包括:Preferably, the pre-segmentation step comprises:

确定阈值步骤:根据预处理图像中灰度变化小的区域作为中心区域,以中心区域的平均灰度值作为基本阈值,降低中心区域以外的周边区域的阈值数值;Determine the threshold step: take the area with small grayscale change in the preprocessed image as the central area, take the average grayscale value of the central area as the basic threshold, and reduce the threshold value of the peripheral area outside the central area;

区域划分步骤:将像素点的相邻区域的基本阈值与像素点的阈值数值进行比较,自适应地进行区域划分,确定预分割区域。Region division step: compare the basic threshold of the adjacent area of the pixel with the threshold value of the pixel, perform region division adaptively, and determine the pre-segmentation area.

优选地,所述二次分割步骤包括:Preferably, the secondary segmentation step comprises:

区域排除步骤:根据成熟卵泡的大小设立裕度,作为预分割区域的区域面积阈值,排除过小区域和过大区域,得到疑似卵泡区域的粗略轮廓;Area exclusion step: according to the size of mature follicles, a margin is set as the area threshold of the pre-segmented area to exclude areas that are too small or too large, and obtain a rough outline of the suspected follicle area;

轮廓调控步骤:应用CV模型对疑似卵泡区域的粗略轮廓进行分割调控,得到疑似卵泡区域。Contour control step: Apply the CV model to segment and control the rough contour of the suspected follicle area to obtain the suspected follicle area.

优选地,所述区域甄别步骤包括:Preferably, the region identification step comprises:

分区步骤:提取疑似卵泡区域的多层次特征,应用主分量分析对多层次特征进行降维后,应用决策树和bagging算法将疑似卵泡区域进行分区,将分区中的非独立完整卵泡区域进行标识;Partitioning step: extract the multi-level features of the suspected follicle area, apply principal component analysis to reduce the dimension of the multi-level features, apply decision tree and bagging algorithm to partition the suspected follicle area, and identify the non-independent complete follicle area in the partition;

评估步骤:提取分区中的独立完整卵泡区域的特征指标,将特征指标结合专家质量评价的卵泡评估体系进行评估,并将评估结果采用最小二乘法进行拟合,得到卵泡质量的数字化定量评价。Evaluation steps: extract characteristic indicators of independent complete follicle areas in the partition, evaluate the characteristic indicators in combination with the follicle evaluation system of expert quality evaluation, and fit the evaluation results using the least squares method to obtain a digital quantitative evaluation of follicle quality.

根据本发明提供的一种基于水平集图像分割的卵泡超声处理系统,包括:According to the present invention, a follicle ultrasound processing system based on level set image segmentation is provided, comprising:

预处理模块:识别卵泡超声图像,通过预处理令卵泡超声图像进行图像增强,得到高质量的预处理图像;Preprocessing module: identifies the follicle ultrasound image, and enhances the follicle ultrasound image through preprocessing to obtain a high-quality preprocessed image;

预分割模块:根据超声图像的灰度分布特点,将预处理图像分成多个区域,分别计算各个区域的区域阈值,基于区域阈值对各区域进行灰度自适应分割,得到多个预分割区域;Pre-segmentation module: According to the grayscale distribution characteristics of the ultrasound image, the pre-processed image is divided into multiple regions, the regional threshold of each region is calculated respectively, and the grayscale adaptive segmentation of each region is performed based on the regional threshold to obtain multiple pre-segmented regions;

二次分割模块:采用水平集图像分割对预分割区域进行二次分割,增强预分割区域中的卵泡区域、非卵泡区域之间的区别,得到疑似卵泡区域;Secondary segmentation module: The level set image segmentation is used to perform secondary segmentation on the pre-segmented area, enhancing the distinction between the follicle area and the non-follicle area in the pre-segmented area, and obtaining the suspected follicle area;

区域甄别模块:提取疑似卵泡区域的图像特征,基于决策树和bagging算法,对疑似卵泡区域进行分区,提取其中的独立完整卵泡区域并进行专家质量评价。Regional identification module: Extract image features of suspected follicle areas, partition suspected follicle areas based on decision trees and bagging algorithms, extract independent and complete follicle areas and conduct expert quality evaluation.

优选地,所述预处理模块包括:Preferably, the preprocessing module comprises:

噪声抑制模块:识别卵泡超声图像后,借助双边滤波在保留卵泡超声图像的边缘细节信息的基础上,实现图像的噪声抑制,得到去噪图像;Noise suppression module: After identifying the follicle ultrasound image, bilateral filtering is used to suppress the noise of the image while retaining the edge detail information of the follicle ultrasound image to obtain a denoised image;

图像增强模块:基于自适应直方图均衡对去噪图像的不同局部采用不同的增强方案,增强对比度同时保留图像细节,得到预处理图像。Image enhancement module: Based on adaptive histogram equalization, different enhancement schemes are used for different parts of the denoised image to enhance the contrast while retaining the image details to obtain a preprocessed image.

优选地,所述预分割模块包括:Preferably, the pre-segmentation module comprises:

确定阈值模块:根据预处理图像中灰度变化小的区域作为中心区域,以中心区域的平均灰度值作为基本阈值,降低中心区域以外的周边区域的阈值数值;Determine the threshold module: take the area with small grayscale change in the preprocessed image as the central area, take the average grayscale value of the central area as the basic threshold, and reduce the threshold value of the peripheral area outside the central area;

区域划分模块:将像素点的相邻区域的基本阈值与像素点的阈值数值进行比较,自适应地进行区域划分,确定预分割区域。Region division module: compares the basic threshold of the adjacent area of the pixel with the threshold value of the pixel, adaptively divides the area, and determines the pre-segmentation area.

优选地,所述二次分割模块包括:Preferably, the secondary segmentation module comprises:

区域排除模块:根据成熟卵泡的大小设立裕度,作为预分割区域的区域面积阈值,排除过小区域和过大区域,得到疑似卵泡区域的粗略轮廓;Area exclusion module: A margin is set according to the size of mature follicles as the area threshold of the pre-segmented area, which excludes areas that are too small or too large to obtain a rough outline of the suspected follicle area;

轮廓调控模块:应用CV模型对疑似卵泡区域的粗略轮廓进行分割调控,得到疑似卵泡区域。Contour control module: The CV model is used to segment and control the rough contour of the suspected follicle area to obtain the suspected follicle area.

优选地,所述区域甄别模块包括:Preferably, the region identification module comprises:

分区模块:提取疑似卵泡区域的多层次特征,应用主分量分析对多层次特征进行降维后,应用决策树和bagging算法将疑似卵泡区域进行分区,将分区中的非独立完整卵泡区域进行标识;Partitioning module: extract the multi-level features of the suspected follicle area, apply principal component analysis to reduce the dimensionality of the multi-level features, apply decision tree and bagging algorithm to partition the suspected follicle area, and identify the non-independent complete follicle area in the partition;

评估模块:计算独立完整卵泡区域的卵泡质量评估特征指标,通过由结合专家质量评估打分最小二乘法拟合建立的卵泡质量评估体系模型进行卵泡质量计算机打分评估。Evaluation module: Calculate the characteristic indicators of follicle quality evaluation in independent and complete follicle areas, and perform computer scoring evaluation of follicle quality through the follicle quality evaluation system model established by least squares fitting combined with expert quality evaluation scoring.

与现有技术相比,本发明具有如下的有益效果:Compared with the prior art, the present invention has the following beneficial effects:

本发明基于水平集-CV模型方法,通过含双边滤波和自适应直方图均衡的预处理,基于自适应灰度阈值的预分割,基于CV模型-水平集方法分割,以及基于决策树和bagging算法的疑似卵泡区域甄别,克服了卵泡的斑点噪声和复杂纹理的影响,得到比较清晰准确的卵泡边界轮廓,针对卵泡超声图像中出现的卵泡弱边缘现象提出了CV模型-水平集方法分割速度控制算法,改善了分割效果。采用最小二乘法结合专家质量评估打分进行回归,实现卵泡质量的数字化定量评价。The present invention is based on the level set-CV model method, through pre-processing including bilateral filtering and adaptive histogram equalization, pre-segmentation based on adaptive grayscale threshold, segmentation based on the CV model-level set method, and suspected follicle area identification based on decision tree and bagging algorithm, overcomes the influence of follicle speckle noise and complex texture, obtains a relatively clear and accurate follicle boundary contour, proposes a CV model-level set method segmentation speed control algorithm for the weak edge phenomenon of follicles appearing in follicle ultrasound images, and improves the segmentation effect. The least squares method is used in combination with expert quality assessment scoring for regression to achieve digital quantitative evaluation of follicle quality.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

通过阅读参照以下附图对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

图1为卵泡超声图像处理的流程图;Fig. 1 is a flow chart of follicle ultrasound image processing;

图2为图像处理过程的变化情况;Figure 2 shows the changes in the image processing process;

图3为卵泡超声图像与基于灰度自适应阈值的预分割的效果图,a是卵泡超声图像,b是卵泡超声图像预分割的效果图;FIG3 is a diagram showing the effect of an ovarian follicle ultrasound image and pre-segmentation based on a grayscale adaptive threshold, a is an ovarian follicle ultrasound image, and b is a diagram showing the effect of a ovarian follicle ultrasound image pre-segmentation;

图4为基于水平集-CV模型二次分割的效果图;Figure 4 is a diagram showing the effect of secondary segmentation based on the level set-CV model;

图5为卵泡区域分区与卵泡质量评估效果图。Figure 5 is a diagram showing the follicle area division and follicle quality assessment results.

具体实施方式DETAILED DESCRIPTION

下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明,但不以任何形式限制本发明。应当指出的是,对本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变化和改进。这些都属于本发明的保护范围。The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several changes and improvements can also be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

本发明采用双边滤波和自适应直方图均衡预处理;再针对卵泡超声图像强度变化特点,采用了基于灰度自适应阈值分割进行预分割;然后采用CV模型-水平集方法对疑似卵泡区域进行二次分割,进一步提高分割效果,针对算法易在多卵泡弱边缘区域发生泄漏问题,对算法的分割速度做出调整;最后基于卵泡的形态、纹理特征采用决策树和bagging算法对疑似卵泡区域进行甄别,最后,从卵泡的圆润度、回声均匀度、内外灰度差异、饱满度及尺寸等指标建立卵泡评估体系,并采用最小二乘法结合专家的评价进行回归,实现了对卵泡的数字化定量评价。根据本发明提供的一种基于水平集图像分割的卵泡超声处理方法,包括:The present invention adopts bilateral filtering and adaptive histogram equalization preprocessing; then, according to the intensity change characteristics of follicular ultrasound images, grayscale adaptive threshold segmentation is used for pre-segmentation; then, the CV model-level set method is used to perform secondary segmentation on the suspected follicle area to further improve the segmentation effect, and the segmentation speed of the algorithm is adjusted to address the problem that the algorithm is prone to leakage in the weak edge area of multiple follicles; finally, based on the morphology and texture characteristics of the follicles, a decision tree and bagging algorithm are used to identify the suspected follicle area, and finally, a follicle evaluation system is established based on indicators such as the roundness, echo uniformity, internal and external grayscale differences, fullness and size of the follicles, and the least squares method is used in combination with expert evaluation for regression, thereby realizing digital quantitative evaluation of follicles. A follicle ultrasound processing method based on level set image segmentation provided by the present invention includes:

预处理步骤:识别卵泡超声图像,通过预处理令卵泡超声图像进行图像增强,得到高质量的预处理图像;Preprocessing step: identifying the follicle ultrasound image, and performing image enhancement on the follicle ultrasound image through preprocessing to obtain a high-quality preprocessed image;

预分割步骤:根据超声图像的灰度分布特点,将预处理图像分成多个区域,分别计算各个区域的区域阈值,基于区域阈值对各区域进行灰度自适应分割,得到多个预分割区域;Pre-segmentation step: according to the grayscale distribution characteristics of the ultrasound image, the pre-processed image is divided into multiple regions, the regional threshold of each region is calculated respectively, and the grayscale adaptive segmentation of each region is performed based on the regional threshold to obtain multiple pre-segmented regions;

二次分割步骤:采用水平集图像分割对预分割区域进行二次分割,增强预分割区域中的卵泡区域、非卵泡区域之间的区别,得到疑似卵泡区域;Secondary segmentation step: level set image segmentation is used to perform secondary segmentation on the pre-segmented area, so as to enhance the distinction between the follicle area and the non-follicle area in the pre-segmented area and obtain the suspected follicle area;

区域甄别步骤:提取疑似卵泡区域的图像特征,基于决策树和bagging算法,对疑似卵泡区域进行分区,提取其中的独立完整卵泡区域,并计算该区域卵泡质量评估特征指标,通过由结合专家质量评估打分最小二乘法拟合建立的卵泡质量评估体系模型进行卵泡质量计算机打分评估。Regional identification steps: extract image features of suspected follicle areas, partition suspected follicle areas based on decision trees and bagging algorithms, extract independent and complete follicle areas, and calculate characteristic indicators of follicle quality assessment in this area. Use the follicle quality assessment system model established by least squares fitting combined with expert quality assessment scoring to perform computer scoring assessment of follicle quality.

具体地,所述预处理步骤包括:Specifically, the pretreatment step includes:

噪声抑制步骤:识别卵泡超声图像后,借助双边滤波在保留卵泡超声图像的边缘细节信息的基础上,实现图像的噪声抑制,得到去噪图像;Noise suppression step: after identifying the follicle ultrasound image, bilateral filtering is used to suppress the image noise while retaining the edge detail information of the follicle ultrasound image to obtain a denoised image;

图像增强步骤:基于自适应直方图均衡对去噪图像的不同局部采用不同的增强方案,增强对比度同时保留图像细节,得到预处理图像。Image enhancement step: Based on adaptive histogram equalization, different enhancement schemes are used for different parts of the denoised image to enhance the contrast while retaining the image details to obtain a preprocessed image.

具体地,所述预分割步骤包括:Specifically, the pre-segmentation step includes:

确定阈值步骤:根据预处理图像中灰度变化小的区域作为中心区域,以中心区域的平均灰度值作为基本阈值,降低中心区域以外的周边区域的阈值数值;Determine the threshold step: take the area with small grayscale change in the preprocessed image as the central area, take the average grayscale value of the central area as the basic threshold, and reduce the threshold value of the peripheral area outside the central area;

区域划分步骤:将像素点的相邻区域的基本阈值与像素点的阈值数值进行比较,自适应地进行区域划分,确定预分割区域。Region division step: compare the basic threshold of the adjacent area of the pixel with the threshold value of the pixel, perform region division adaptively, and determine the pre-segmentation area.

具体地,所述二次分割步骤包括:Specifically, the secondary segmentation step includes:

区域排除步骤:根据成熟卵泡的大小设立裕度,作为预分割区域的区域面积阈值,排除过小区域和过大区域,得到疑似卵泡区域的粗略轮廓;Area exclusion step: according to the size of mature follicles, a margin is set as the area threshold of the pre-segmented area to exclude areas that are too small or too large, and obtain a rough outline of the suspected follicle area;

轮廓调控步骤:应用CV模型对疑似卵泡区域的粗略轮廓进行分割调控,得到疑似卵泡区域。Contour control step: Apply the CV model to segment and control the rough contour of the suspected follicle area to obtain the suspected follicle area.

具体地,所述区域甄别步骤包括:Specifically, the region identification step includes:

分区步骤:提取疑似卵泡区域的多层次特征,应用主分量分析对多层次特征进行降维后,应用决策树和bagging算法将疑似卵泡区域进行分区,将分区中的非独立完整卵泡区域进行标识;Partitioning step: extract the multi-level features of the suspected follicle area, apply principal component analysis to reduce the dimension of the multi-level features, apply decision tree and bagging algorithm to partition the suspected follicle area, and identify the non-independent complete follicle area in the partition;

评估步骤:提取分区中的独立完整卵泡区域的卵泡质量评估特征指标,通过由结合专家质量评估最小二乘法拟合建立的卵泡质量评估体系模型进行卵泡质量计算机打分评估。Evaluation steps: Extract the characteristic indicators of follicle quality evaluation of independent complete follicle areas in the partition, and perform computer scoring evaluation of follicle quality through the follicle quality evaluation system model established by combining the least squares method fitting with expert quality evaluation.

根据本发明提供的一种基于水平集图像分割的卵泡超声处理系统,包括:According to the present invention, a follicle ultrasound processing system based on level set image segmentation is provided, comprising:

预处理模块:识别卵泡超声图像,通过预处理令卵泡超声图像进行图像增强,得到高质量的预处理图像;Preprocessing module: identifies the follicle ultrasound image, and enhances the follicle ultrasound image through preprocessing to obtain a high-quality preprocessed image;

预分割模块:根据超声图像的灰度分布特点,将预处理图像分成多个区域,分别计算各个区域的区域阈值,基于区域阈值对各区域进行灰度自适应分割,得到多个预分割区域;Pre-segmentation module: According to the grayscale distribution characteristics of the ultrasound image, the pre-processed image is divided into multiple regions, the regional threshold of each region is calculated respectively, and the grayscale adaptive segmentation of each region is performed based on the regional threshold to obtain multiple pre-segmented regions;

二次分割模块:采用水平集图像分割对预分割区域进行二次分割,增强预分割区域中的卵泡区域、非卵泡区域之间的区别,得到疑似卵泡区域;Secondary segmentation module: The level set image segmentation is used to perform secondary segmentation on the pre-segmented area, enhancing the distinction between the follicle area and the non-follicle area in the pre-segmented area, and obtaining the suspected follicle area;

区域甄别模块:提取疑似卵泡区域的图像特征,基于决策树和bagging算法,对疑似卵泡区域进行分区,提取其中的独立完整卵泡区域并进行专家质量评价。Regional identification module: Extract image features of suspected follicle areas, partition suspected follicle areas based on decision trees and bagging algorithms, extract independent and complete follicle areas and conduct expert quality evaluation.

具体地,所述预处理模块包括:Specifically, the preprocessing module includes:

噪声抑制模块:识别卵泡超声图像后,借助双边滤波在保留卵泡超声图像的边缘细节信息的基础上,实现图像的噪声抑制,得到去噪图像;Noise suppression module: After identifying the follicle ultrasound image, bilateral filtering is used to suppress the noise of the image while retaining the edge detail information of the follicle ultrasound image to obtain a denoised image;

图像增强模块:基于自适应直方图均衡对去噪图像的不同局部采用不同的增强方案,增强对比度同时保留图像细节,得到预处理图像。Image enhancement module: Based on adaptive histogram equalization, different enhancement schemes are used for different parts of the denoised image to enhance the contrast while retaining the image details to obtain a preprocessed image.

具体地,所述预分割模块包括:Specifically, the pre-segmentation module includes:

确定阈值模块:根据预处理图像中灰度变化小的区域作为中心区域,以中心区域的平均灰度值作为基本阈值,降低中心区域以外的周边区域的阈值数值;Determine the threshold module: take the area with small grayscale change in the preprocessed image as the central area, take the average grayscale value of the central area as the basic threshold, and reduce the threshold value of the peripheral area outside the central area;

区域划分模块:将像素点的相邻区域的基本阈值与像素点的阈值数值进行比较,自适应地进行区域划分,确定预分割区域。Region division module: compares the basic threshold of the adjacent area of the pixel with the threshold value of the pixel, adaptively divides the area, and determines the pre-segmentation area.

具体地,所述二次分割模块包括:Specifically, the secondary segmentation module includes:

区域排除模块:根据成熟卵泡的大小设立裕度,作为预分割区域的区域面积阈值,排除过小区域和过大区域,得到疑似卵泡区域的粗略轮廓;Area exclusion module: A margin is set according to the size of mature follicles as the area threshold of the pre-segmented area, which excludes areas that are too small or too large to obtain a rough outline of the suspected follicle area;

轮廓调控模块:应用CV模型对疑似卵泡区域的粗略轮廓进行分割调控,得到疑似卵泡区域。Contour control module: The CV model is used to segment and control the rough contour of the suspected follicle area to obtain the suspected follicle area.

具体地,所述区域甄别模块包括:Specifically, the region identification module includes:

分区模块:提取疑似卵泡区域的多层次特征,应用主分量分析对多层次特征进行降维后,应用决策树和bagging算法将疑似卵泡区域进行分区,将分区中的非独立完整卵泡区域进行标识;Partitioning module: extract the multi-level features of the suspected follicle area, apply principal component analysis to reduce the dimensionality of the multi-level features, apply decision tree and bagging algorithm to partition the suspected follicle area, and identify the non-independent complete follicle area in the partition;

评估模块:计算独立完整卵泡区域的卵泡质量评估特征指标,通过由结合专家质量评估打分最小二乘法拟合建立的卵泡质量评估体系模型进行卵泡质量计算机打分评估。Evaluation module: Calculate the characteristic indicators of follicle quality evaluation in independent and complete follicle areas, and perform computer scoring evaluation of follicle quality through the follicle quality evaluation system model established by least squares fitting combined with expert quality evaluation scoring.

本发明提供的基于水平集图像分割的卵泡超声处理系统,可以通过基于水平集图像分割的卵泡超声处理方法的步骤流程实现。本领域技术人员可以将基于水平集图像分割的卵泡超声处理方法理解为所述基于水平集图像分割的卵泡超声处理系统的优选例。The follicle ultrasonic processing system based on level set image segmentation provided by the present invention can be implemented by the step flow of the follicle ultrasonic processing method based on level set image segmentation. Those skilled in the art can understand the follicle ultrasonic processing method based on level set image segmentation as a preferred example of the follicle ultrasonic processing system based on level set image segmentation.

具体实施中,如图1所示,本发明基于灰度自适应阈值分割和CV模型-水平集方法对超声卵泡图像进行处理,实现了卵泡区域的分割,最后通过最小二乘法实现卵泡质量的评估,包括如下步骤:In a specific implementation, as shown in FIG1 , the present invention processes the ultrasonic follicle image based on grayscale adaptive threshold segmentation and CV model-level set method, realizes the segmentation of the follicle area, and finally realizes the evaluation of the follicle quality by the least square method, including the following steps:

步骤100图像预处理,包括步骤110和步骤120,采用双边滤波进行噪声抑制和自适应直方图增强对图像增强,改善图像质量,为后续的处理做准备;Step 100 image preprocessing, including step 110 and step 120, adopts bilateral filtering to suppress noise and adaptive histogram enhancement to enhance the image, improve image quality, and prepare for subsequent processing;

步骤110:卵泡超声图像的噪声抑制,借助双边滤波在保留图像的边缘细节信息的基础上,实现图像的噪声抑制。Step 110: noise suppression of the follicle ultrasound image, by using bilateral filtering to achieve image noise suppression on the basis of retaining edge detail information of the image.

步骤120:卵泡超声图像的图像增强,基于自适应直方图均衡对图像的不同局部采用不同的增强方案,增强对比度同时保留图像细节。Step 120: Image enhancement of the follicle ultrasound image, using different enhancement schemes for different parts of the image based on adaptive histogram equalization to enhance contrast while retaining image details.

步骤200基于灰度自适应阈值的预分割,包含步骤210、步骤220、步骤230,基于自适应阈值分割的卵泡超声图像的预分割,根据超声图像灰度分布特点,分区域计算不同阈值并综合像素点周边像素灰度对图像进行处理。Step 200 is based on the pre-segmentation of grayscale adaptive threshold, including steps 210, 220 and 230. The pre-segmentation of the follicle ultrasound image based on adaptive threshold segmentation calculates different thresholds for each region according to the grayscale distribution characteristics of the ultrasound image and processes the image by comprehensively considering the grayscale of the pixels surrounding the pixel point.

步骤210:根据卵泡超声图像灰度变化较小的中心区域计算卵泡超声图像的分割的基本阈值。Step 210: Calculate a basic threshold for segmenting the follicle ultrasound image according to a central region of the follicle ultrasound image where the grayscale change is small.

步骤220:根据卵泡超声图像中心区域灰度较高,周边灰度较低的特点,在分割时,降低周边区域的阈值数值。Step 220: According to the characteristics that the grayscale of the central area of the follicle ultrasound image is higher and the grayscale of the peripheral area is lower, the threshold value of the peripheral area is reduced during segmentation.

步骤230:卵泡超声图像上的不规则亮斑和部分卵泡的弱边缘,都容易对分割造成影响,特别是容易使得距离较近的卵泡在分割时被联通。因此,不把一个像素点的灰度值作为对象,而是应用一个像素点的相邻区域平均灰度与阈值作比较作为分割依据。Step 230: Irregular bright spots and weak edges of some follicles on the follicle ultrasound image are likely to affect the segmentation, especially making it easy for follicles that are close to each other to be connected during segmentation. Therefore, instead of taking the gray value of a pixel as the object, the average gray value of the adjacent area of a pixel is compared with the threshold as the basis for segmentation.

所述分区域计算不同阈值是指基于灰度变化较小的中心区域的平均灰度选择中心区域卵泡分割的阈值,再根据超声图像中间区域灰度较大,周边区域灰度较小的特点,调整周边区域阈值,此外,为减少卵泡超声图像上的不规则亮斑和部分卵泡的弱边缘的影响,应用一个像素点的相邻区域平均灰度与阈值作比较作为分割依据。相对其他分割方法而言,这种方法有效地避免了卵泡由于距离过近且边缘较弱引起的在分割时把多个卵泡分割为一个整体的问题,同时有效避免了由于卵泡超声图像的纹理和亮斑等引起的错误分割,且相对而言将非卵泡区域误划分为卵泡区域的比例较少,不足之处是分割出的目标区域一般小于卵泡的真实区域,这个问题可以在后续的基于水平集的二次分割中得到解决。The calculation of different thresholds by region refers to selecting the threshold for follicle segmentation in the central region based on the average grayscale of the central region with smaller grayscale changes, and then adjusting the threshold of the peripheral region according to the characteristics of the larger grayscale in the middle region of the ultrasound image and the smaller grayscale in the peripheral region. In addition, in order to reduce the influence of irregular bright spots and weak edges of some follicles on the follicle ultrasound image, the average grayscale of the adjacent region of a pixel is compared with the threshold as the basis for segmentation. Compared with other segmentation methods, this method effectively avoids the problem of segmenting multiple follicles into a whole during segmentation due to the follicles being too close and the edges being weak, and effectively avoids the erroneous segmentation caused by the texture and bright spots of the follicle ultrasound image, and relatively speaking, the proportion of non-follicle areas mistakenly divided into follicle areas is relatively small. The disadvantage is that the segmented target area is generally smaller than the actual area of the follicle, and this problem can be solved in the subsequent secondary segmentation based on the level set.

步骤300基于水平集-CV模型的二次分割,包含步骤310、步骤320,使用基于水平集方法-CV模型的二次分割,采用水平集方法,并应用CV模型综合灰度自适应分割结果对图像进行二次分割。Step 300 is a secondary segmentation based on the level set-CV model, including steps 310 and 320, using the secondary segmentation based on the level set method-CV model, adopting the level set method, and applying the CV model to perform secondary segmentation on the image based on the grayscale adaptive segmentation result.

步骤310:经过预分割后,获得区域主要有:卵泡所在区域、由于背景纹理以及亮斑引起的错误分割,以及部分的背景区域。对这三类区域,主要从分割获得区域的大小以及距离边缘的距离来判断是否要基于区域进行下一步分割。误分割的背景区域一般面积较大,距离超声的边界较近,而由于背景纹理和亮斑误分割获得区域面积较小。因此,根据成熟卵泡的大小并设立一定的裕度,作为区域面积大小阈值,排除过小和过大区域。Step 310: After pre-segmentation, the main areas obtained are: the area where the follicle is located, the wrong segmentation caused by background texture and bright spots, and part of the background area. For these three types of areas, the size of the segmented area and the distance from the edge are mainly used to determine whether to perform the next segmentation based on the area. The wrongly segmented background area is generally larger in area and closer to the ultrasound boundary, while the area obtained by the wrong segmentation of background texture and bright spots is smaller in area. Therefore, a certain margin is set according to the size of the mature follicle as the area size threshold to exclude areas that are too small and too large.

步骤320:在灰度自适应阈值分割后排除非卵泡区域,得到了疑似卵泡区域的粗略轮廓,但是由于每个轮廓形状不一,给求取初始轮廓的表达带来一定困难,因此,选择了最接近与轮廓的椭圆作为初始运动曲线。以所在区域重心为椭圆的中心,计算区域在x轴与y轴上的投影长度,作为椭圆的长轴和短轴。Step 320: After grayscale adaptive threshold segmentation, the non-follicle area is excluded, and the rough outline of the suspected follicle area is obtained. However, since the shape of each outline is different, it is difficult to express the initial outline. Therefore, the ellipse closest to the outline is selected as the initial motion curve. The center of gravity of the area is taken as the center of the ellipse, and the projection length of the area on the x-axis and y-axis is calculated as the major axis and minor axis of the ellipse.

步骤330:应用CV模型-水平集方法对卵泡超声图像进行二次分割,在分割过程中,综合预分割中得到的结果对CV模型分割速度做出调控。基于灰度自适应阈值预分割结果的最接近椭圆作为二次分割的初始运动曲线,并在应用了水平集方法-CV模型的二次分割过程中,将预分割结果与二次分割结果作比较,当二次分割结果大于预分割面积时,降低分割速度。设CV模型-水平集算法分割速度在t时刻速度为v(t),它在t时刻轮廓内部区域面积为S(t),在预分割中,得到的区域面积为S0,卵泡的真实面积为S1,一般情况下S0<S1,S0为初始运动曲线包围区域的面积。在分割时,做出如下调整:Step 330: Apply the CV model-level set method to perform secondary segmentation on the follicle ultrasound image. During the segmentation process, the results obtained in the comprehensive pre-segmentation are used to adjust the CV model segmentation speed. The closest ellipse based on the grayscale adaptive threshold pre-segmentation result is used as the initial motion curve for the secondary segmentation, and in the secondary segmentation process using the level set method-CV model, the pre-segmentation result is compared with the secondary segmentation result. When the secondary segmentation result is larger than the pre-segmentation area, the segmentation speed is reduced. Suppose the segmentation speed of the CV model-level set algorithm at time t is v(t), and the area of the inner contour at time t is S(t). In the pre-segmentation, the area of the area obtained is S 0 , and the actual area of the follicle is S 1. Generally, S 0 <S 1 , and S 0 is the area of the area surrounded by the initial motion curve. During segmentation, the following adjustments are made:

Figure BDA0002346982510000091
Figure BDA0002346982510000091

其中λ为速度调控系数,λ≤1。Where λ is the speed control coefficient, λ≤1.

步骤400基于决策树和bagging算法的疑似卵泡区域甄别,包含步骤410、步骤420、步骤430,提取疑似卵泡区域的特征,并应用PCA进行降维,再采用决策树进行分类,并综合bagging算法提高决策树性能;Step 400 is based on the identification of suspected follicle regions by decision tree and bagging algorithm, including step 410, step 420, step 430, extracting the features of the suspected follicle regions, applying PCA for dimensionality reduction, and then using decision tree for classification, and combining bagging algorithm to improve the performance of decision tree;

步骤410:提取疑似卵泡区域的灰度、纹理、形状轮廓和空间等多层次特征。从卵泡的圆润度、回声均匀度、内外灰度差异、饱满度及尺寸等指标建立卵泡评估体系,并采用最小二乘法结合专家的评价进行回归,实现了对卵泡的数字化定量评价。Step 410: Extract the grayscale, texture, shape contour and space of the suspected follicle area. Establish a follicle evaluation system based on the roundness, echo uniformity, grayscale difference between inside and outside, fullness and size of the follicle, and use the least squares method combined with expert evaluation for regression to achieve digital quantitative evaluation of the follicle.

步骤420:应用了PCA(Principal Component Analysis)算法,对上述特征数据进行处理,实现降维。Step 420: Apply the PCA (Principal Component Analysis) algorithm to process the above feature data to achieve dimensionality reduction.

步骤430:应用决策树和bagging算法对疑似卵泡区域进行甄别,将疑似卵泡区域分为4类:无卵泡区域、独立而完整的卵泡区域、多卵泡区域、其他,将非独立完整的卵泡区域标识在图像上。Step 430: Apply decision tree and bagging algorithm to identify suspected follicle regions, and divide the suspected follicle regions into 4 categories: non-follicle region, independent and complete follicle region, multiple follicle region, and others, and mark the non-independent and complete follicle region on the image.

步骤500卵泡质量评价从卵泡的圆润度、内部回声均匀度、卵泡内外亮度差异、饱满度、尺寸等指标建立卵泡评估体系,并采用最小二乘法结合专家的评价进行回归,实现了对卵泡的数字化定量评价,包含步骤510、步骤520。Step 500 of the follicle quality evaluation is to establish a follicle evaluation system based on indicators such as the roundness of the follicle, uniformity of the internal echo, difference in brightness inside and outside the follicle, fullness, size, etc., and to use the least squares method combined with expert evaluation for regression to achieve a digital quantitative evaluation of the follicle, which includes steps 510 and 520.

步骤510:提取独立而完整的卵泡区域的卵泡的周长,面积,内外区域亮度等指标,并由上述指标计算圆润度、内部回声均匀度、卵泡内外亮度差异、饱满度、尺寸等指标,来建立卵泡评估体系。Step 510: Extract the circumference, area, inner and outer area brightness and other indicators of the independent and complete follicle area, and calculate the roundness, internal echo uniformity, follicle inner and outer brightness difference, fullness, size and other indicators based on the above indicators to establish a follicle evaluation system.

周长计算公式:Circumference calculation formula:

L=∫dlL = ∫dl

面积计算公式:Area calculation formula:

S=∫∫dsS = ∫∫ds

区域平均亮度计算公式:The calculation formula of regional average brightness is:

Figure BDA0002346982510000101
Figure BDA0002346982510000101

其中,g(i,j)为区域像素灰度值。Among them, g(i,j) is the grayscale value of the pixel in the region.

区域重心的像素坐标计算公式:The calculation formula of pixel coordinates of the center of gravity of the region is:

X=∑x/nX=∑x/n

Y=∑y/nY=∑y/n

卵泡最大平均直径计算公式:The formula for calculating the maximum average diameter of follicles is:

Figure BDA0002346982510000102
Figure BDA0002346982510000102

其中,d、dτ为过卵泡所在区域重心,相互垂直的一对直径线段。Among them, d and are a pair of diameter line segments passing through the center of gravity of the follicle area and perpendicular to each other.

圆润度指标采用卵泡所在区域的面积S和周长L等要素进行计算,计算公式:The roundness index is calculated using factors such as the area S and perimeter L of the follicle area. The calculation formula is:

Figure BDA0002346982510000103
Figure BDA0002346982510000103

其中,S为卵泡所在区域面积,L为卵泡所在区域周长。Among them, S is the area of the follicle area, and L is the circumference of the follicle area.

回声均匀度指标采用卵泡所在区域内像素灰度值g(i,j)和内部灰度平均值

Figure BDA0002346982510000104
等要素计算,计算公式:The echo uniformity index uses the pixel gray value g(i,j) in the follicle area and the internal gray value average
Figure BDA0002346982510000104
The calculation formula is:

Figure BDA0002346982510000105
Figure BDA0002346982510000105

其中,gin(i,j)为卵泡所在区域像素灰度值,

Figure BDA0002346982510000106
为卵泡所在区域平均亮度。Among them, g in (i, j) is the pixel gray value of the follicle area.
Figure BDA0002346982510000106
is the average brightness of the area where the follicle is located.

卵泡内外部亮度差异指标采用以卵泡所在区域的重心为圆心,以卵泡平均半径r的2倍为半径做圆,并根据卵泡分割结果划分该区域为卵泡内、外区域两部分,分别计算区域平均亮度,并采用如下公式计算卵泡内外部亮度差异指标:The brightness difference index of the inside and outside of the follicle is calculated by taking the center of gravity of the follicle area as the center and twice the average radius r of the follicle as the radius. The area is divided into two parts, the inside and outside of the follicle, according to the follicle segmentation results. The average brightness of each area is calculated, and the brightness difference index of the inside and outside of the follicle is calculated using the following formula:

Figure BDA0002346982510000111
Figure BDA0002346982510000111

饱满度指标采用卵泡所在区域的面积S和覆盖卵泡所在区域最小外接圆的面积SC计算,计算公式:The fullness index is calculated using the area S of the follicle area and the area SC of the minimum circumscribed circle covering the follicle area. The calculation formula is:

θ=S/SC θ=S/S C

尺寸指标采用卵泡最大平均直径进行计算,The size index is calculated using the maximum average diameter of the follicles.

Figure BDA0002346982510000112
Figure BDA0002346982510000112

步骤520:根据专家对卵泡质量的评估,采用最小二乘法对卵泡的圆润度、内部回声均匀度、卵泡内外亮度差异、饱满度、尺寸等指标进行拟合,得到卵泡质量的数字化定量评价。Step 520: Based on the expert's evaluation of the follicle quality, the least squares method is used to fit the indicators such as the roundness of the follicle, the uniformity of the internal echo, the difference in brightness inside and outside the follicle, the fullness, and the size, so as to obtain a digital quantitative evaluation of the follicle quality.

如图2所示,在本发明的实施过程中,卵泡超声图像的变化状态最终显示为边界轮廓比较清晰准确的卵泡,图中得到三个清晰的卵泡。如图5所示,基于决策树和bagging算法的疑似卵泡区域甄别效果图与基于最小二乘法的卵泡质量评估结果,图中存在对卵泡得分的具体标识,便于评估识别。As shown in Figure 2, during the implementation of the present invention, the change state of the follicle ultrasound image is finally displayed as a follicle with a relatively clear and accurate boundary contour, and three clear follicles are obtained in the figure. As shown in Figure 5, the suspected follicle area identification effect diagram based on the decision tree and bagging algorithm and the follicle quality assessment result based on the least squares method, the figure contains a specific mark for the follicle score, which is convenient for evaluation and identification.

如图3所示,基于卵泡超声图像与基于灰度自适应阈值的预分割的效果图,其中a是卵泡超声图像,b是卵泡超声图像预分割的效果图。如图4所示,基于水平集-CV模型二次分割的效果图,图中有对非独立完整卵泡区域的标识。As shown in Figure 3, the effect of pre-segmentation based on follicular ultrasound image and grayscale adaptive threshold, where a is the follicular ultrasound image and b is the effect of pre-segmentation of follicular ultrasound image. As shown in Figure 4, the effect of secondary segmentation based on level set-CV model, the non-independent complete follicle area is marked in the figure.

本发明解决了超声卵泡监测的评估主要由医师完成,存在主观性强,对医师要求高,量化指标少等问题;实现卵泡超声图像的自动分割,优化诊断流程,提高诊断质量,并减轻医务工作者的劳动强度。The present invention solves the problems that the evaluation of ultrasonic follicle monitoring is mainly completed by physicians, which is highly subjective, has high requirements for physicians, and has few quantitative indicators. It realizes automatic segmentation of follicle ultrasound images, optimizes the diagnosis process, improves the diagnosis quality, and reduces the labor intensity of medical workers.

本领域技术人员知道,除了以纯计算机可读程序代码方式实现本发明提供的系统、装置及其各个模块以外,完全可以通过将方法步骤进行逻辑编程来使得本发明提供的系统、装置及其各个模块以逻辑门、开关、专用集成电路、可编程逻辑控制器以及嵌入式微控制器等的形式来实现相同程序。所以,本发明提供的系统、装置及其各个模块可以被认为是一种硬件部件,而对其内包括的用于实现各种程序的模块也可以视为硬件部件内的结构;也可以将用于实现各种功能的模块视为既可以是实现方法的软件程序又可以是硬件部件内的结构。Those skilled in the art know that, in addition to implementing the system, device and its various modules provided by the present invention in a purely computer-readable program code, it is entirely possible to implement the same program in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers and embedded microcontrollers by logically programming the method steps. Therefore, the system, device and its various modules provided by the present invention can be considered as a hardware component, and the modules included therein for implementing various programs can also be considered as structures within the hardware component; the modules for implementing various functions can also be considered as both software programs for implementing the method and structures within the hardware component.

以上对本发明的具体实施例进行了描述。需要理解的是,本发明并不局限于上述特定实施方式,本领域技术人员可以在权利要求的范围内做出各种变化或修改,这并不影响本发明的实质内容。在不冲突的情况下,本申请的实施例和实施例中的特征可以任意相互组合。The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various changes or modifications within the scope of the claims, which does not affect the essence of the present invention. In the absence of conflict, the embodiments of the present application and the features in the embodiments can be combined with each other arbitrarily.

Claims (10)

1.一种基于水平集图像分割的卵泡超声处理方法,其特征在于,包括:1. A method for ultrasonic processing of follicles based on level set image segmentation, characterized by comprising: 预处理步骤:识别卵泡超声图像,通过预处理令卵泡超声图像进行图像增强,得到高质量的预处理图像;Preprocessing step: identifying the follicle ultrasound image, and performing image enhancement on the follicle ultrasound image through preprocessing to obtain a high-quality preprocessed image; 预分割步骤:根据超声图像的灰度分布特点,将预处理图像分成多个区域,分别计算各个区域的区域阈值,基于区域阈值对各区域进行灰度自适应分割,得到多个预分割区域;Pre-segmentation step: according to the grayscale distribution characteristics of the ultrasound image, the pre-processed image is divided into multiple regions, the regional threshold of each region is calculated respectively, and the grayscale adaptive segmentation of each region is performed based on the regional threshold to obtain multiple pre-segmented regions; 二次分割步骤:采用水平集图像分割对预分割区域进行二次分割,增强预分割区域中的卵泡区域、非卵泡区域之间的区别,得到疑似卵泡区域;Secondary segmentation step: level set image segmentation is used to perform secondary segmentation on the pre-segmented area, so as to enhance the distinction between the follicle area and the non-follicle area in the pre-segmented area and obtain the suspected follicle area; 区域甄别步骤:提取疑似卵泡区域的图像特征,基于决策树和bagging算法,对疑似卵泡区域进行分区,提取其中的独立完整卵泡区域,进行卵泡质量计算机打分评估。Regional identification step: Extract the image features of the suspected follicle area, partition the suspected follicle area based on the decision tree and bagging algorithm, extract the independent and complete follicle area, and perform computer scoring and evaluation of the follicle quality. 2.根据权利要求1所述的基于水平集图像分割的卵泡超声处理方法,其特征在于,所述预处理步骤包括:2. The method for follicle ultrasonic processing based on level set image segmentation according to claim 1, characterized in that the preprocessing step comprises: 噪声抑制步骤:识别卵泡超声图像后,借助双边滤波在保留卵泡超声图像的边缘细节信息的基础上,实现图像的噪声抑制,得到去噪图像;Noise suppression step: after identifying the follicle ultrasound image, bilateral filtering is used to suppress the image noise while retaining the edge detail information of the follicle ultrasound image to obtain a denoised image; 图像增强步骤:基于自适应直方图均衡对去噪图像的不同局部采用不同的增强方案,增强对比度同时保留图像细节,得到预处理图像。Image enhancement step: Based on adaptive histogram equalization, different enhancement schemes are used for different parts of the denoised image to enhance the contrast while retaining the image details to obtain a preprocessed image. 3.根据权利要求1所述的基于水平集图像分割的卵泡超声处理方法,其特征在于,所述预分割步骤包括:3. The method for follicle ultrasonic processing based on level set image segmentation according to claim 1, characterized in that the pre-segmentation step comprises: 确定阈值步骤:根据预处理图像中灰度变化小的区域作为中心区域,以中心区域的平均灰度值作为基本阈值,降低中心区域以外的周边区域的阈值数值;Determine the threshold step: take the area with small grayscale change in the preprocessed image as the central area, take the average grayscale value of the central area as the basic threshold, and reduce the threshold value of the peripheral area outside the central area; 区域划分步骤:将像素点的相邻区域的基本阈值与像素点的阈值数值进行比较,自适应地进行区域划分,确定预分割区域。Region division step: compare the basic threshold of the adjacent area of the pixel with the threshold value of the pixel, perform region division adaptively, and determine the pre-segmentation area. 4.根据权利要求1所述的基于水平集图像分割的卵泡超声处理方法,其特征在于,所述二次分割步骤包括:4. The method for follicle ultrasonic processing based on level set image segmentation according to claim 1, characterized in that the secondary segmentation step comprises: 区域排除步骤:根据成熟卵泡的大小设立裕度,作为预分割区域的区域面积阈值,排除过小区域和过大区域,得到疑似卵泡区域的粗略轮廓;Area exclusion step: according to the size of mature follicles, a margin is set as the area threshold of the pre-segmented area to exclude areas that are too small or too large, and obtain a rough outline of the suspected follicle area; 轮廓调控步骤:应用CV模型对疑似卵泡区域的粗略轮廓进行分割调控,得到疑似卵泡区域。Contour control step: Apply the CV model to segment and control the rough contour of the suspected follicle area to obtain the suspected follicle area. 5.根据权利要求1所述的基于水平集图像分割的卵泡超声处理方法,其特征在于,所述区域甄别步骤包括:5. The method for follicle ultrasonic processing based on level set image segmentation according to claim 1, characterized in that the region identification step comprises: 分区步骤:提取疑似卵泡区域的多层次特征,应用主分量分析对多层次特征进行降维后,应用决策树和bagging算法将疑似卵泡区域进行分区,将分区中的非独立完整卵泡区域进行标识;Partitioning step: extract the multi-level features of the suspected follicle area, apply principal component analysis to reduce the dimensionality of the multi-level features, apply decision tree and bagging algorithm to partition the suspected follicle area, and identify the non-independent complete follicle area in the partition; 评估步骤:计算提取分区中的独立完整卵泡区域的卵泡质量评估特征指标,通过由结合专家质量评估最小二乘法拟合建立的卵泡质量评估体系模型进行卵泡质量计算机打分评估。Evaluation steps: Calculate the characteristic indicators of follicle quality evaluation of independent complete follicle areas in the extracted partitions, and perform computer scoring evaluation of follicle quality through the follicle quality evaluation system model established by combining the least squares method fitting with expert quality evaluation. 6.一种基于水平集图像分割的卵泡超声处理系统,其特征在于,包括:6. A follicle ultrasound processing system based on level set image segmentation, characterized by comprising: 预处理模块:识别卵泡超声图像,通过预处理令卵泡超声图像进行图像增强,得到高质量的预处理图像;Preprocessing module: identifies the follicle ultrasound image, and enhances the follicle ultrasound image through preprocessing to obtain a high-quality preprocessed image; 预分割模块:根据超声图像的灰度分布特点,将预处理图像分成多个区域,分别计算各个区域的区域阈值,基于区域阈值对各区域进行灰度自适应分割,得到多个预分割区域;Pre-segmentation module: According to the grayscale distribution characteristics of the ultrasound image, the pre-processed image is divided into multiple regions, the regional threshold of each region is calculated respectively, and the grayscale adaptive segmentation of each region is performed based on the regional threshold to obtain multiple pre-segmented regions; 二次分割模块:采用水平集图像分割对预分割区域进行二次分割,增强预分割区域中的卵泡区域、非卵泡区域之间的区别,得到疑似卵泡区域;Secondary segmentation module: The level set image segmentation is used to perform secondary segmentation on the pre-segmented area, enhancing the distinction between the follicle area and the non-follicle area in the pre-segmented area, and obtaining the suspected follicle area; 区域甄别模块:提取疑似卵泡区域的图像特征,基于决策树和bagging算法,对疑似卵泡区域进行分区,提取其中的独立完整卵泡区域,进行卵泡质量计算机打分评估。Regional identification module: Extract image features of suspected follicle areas, partition suspected follicle areas based on decision trees and bagging algorithms, extract independent and complete follicle areas, and perform computer scoring and evaluation of follicle quality. 7.根据权利要求6所述的基于水平集图像分割的卵泡超声处理系统,其特征在于,所述预处理模块包括:7. The follicle ultrasound processing system based on level set image segmentation according to claim 6, characterized in that the preprocessing module comprises: 噪声抑制模块:识别卵泡超声图像后,借助双边滤波在保留卵泡超声图像的边缘细节信息的基础上,实现图像的噪声抑制,得到去噪图像;Noise suppression module: After identifying the follicle ultrasound image, bilateral filtering is used to suppress the noise of the image while retaining the edge detail information of the follicle ultrasound image to obtain a denoised image; 图像增强模块:基于自适应直方图均衡对去噪图像的不同局部采用不同的增强方案,增强对比度同时保留图像细节,得到预处理图像。Image enhancement module: Based on adaptive histogram equalization, different enhancement schemes are used for different parts of the denoised image to enhance the contrast while retaining the image details to obtain a preprocessed image. 8.根据权利要求6所述的基于水平集图像分割的卵泡超声处理系统,其特征在于,所述预分割模块包括:8. The follicle ultrasound processing system based on level set image segmentation according to claim 6, characterized in that the pre-segmentation module comprises: 确定阈值模块:根据预处理图像中灰度变化小的区域作为中心区域,以中心区域的平均灰度值作为基本阈值,降低中心区域以外的周边区域的阈值数值;Determine the threshold module: take the area with small grayscale change in the preprocessed image as the central area, take the average grayscale value of the central area as the basic threshold, and reduce the threshold value of the peripheral area outside the central area; 区域划分模块:将像素点的相邻区域的基本阈值与像素点的阈值数值进行比较,自适应地进行区域划分,确定预分割区域。Region division module: compares the basic threshold of the adjacent area of the pixel with the threshold value of the pixel, adaptively divides the area, and determines the pre-segmentation area. 9.根据权利要求6所述的基于水平集图像分割的卵泡超声处理系统,其特征在于,所述二次分割模块包括:9. The follicle ultrasound processing system based on level set image segmentation according to claim 6, characterized in that the secondary segmentation module comprises: 区域排除模块:根据成熟卵泡的大小设立裕度,作为预分割区域的区域面积阈值,排除过小区域和过大区域,得到疑似卵泡区域的粗略轮廓;Area exclusion module: A margin is set according to the size of mature follicles as the area threshold of the pre-segmented area, which excludes areas that are too small or too large to obtain a rough outline of the suspected follicle area; 轮廓调控模块:应用CV模型对疑似卵泡区域的粗略轮廓进行分割调控,得到疑似卵泡区域。Contour control module: The CV model is used to segment and control the rough contour of the suspected follicle area to obtain the suspected follicle area. 10.根据权利要求6所述的基于水平集图像分割的卵泡超声处理系统,其特征在于,所述区域甄别模块包括:10. The follicle ultrasound processing system based on level set image segmentation according to claim 6, characterized in that the region identification module comprises: 分区模块:提取疑似卵泡区域的多层次特征,应用主分量分析对多层次特征进行降维后,应用决策树和bagging算法将疑似卵泡区域进行分区,将分区中的非独立完整卵泡区域进行标识;Partitioning module: extract the multi-level features of the suspected follicle area, apply principal component analysis to reduce the dimensionality of the multi-level features, apply decision tree and bagging algorithm to partition the suspected follicle area, and identify the non-independent complete follicle area in the partition; 评估模块:计算提取分区中的独立完整卵泡区域的卵泡质量评估特征指标,通过由结合专家质量评估打分最小二乘法拟合建立的卵泡质量评估体系模型进行卵泡质量计算机打分评估。Evaluation module: Calculate and extract the characteristic indicators of follicle quality evaluation of independent complete follicle areas in the partition, and perform computer scoring evaluation of follicle quality through the follicle quality evaluation system model established by least squares fitting combined with expert quality evaluation scoring.
CN201911398714.1A 2019-12-30 2019-12-30 Follicle ultrasonic processing method and system based on level set image segmentation Active CN111192251B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911398714.1A CN111192251B (en) 2019-12-30 2019-12-30 Follicle ultrasonic processing method and system based on level set image segmentation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911398714.1A CN111192251B (en) 2019-12-30 2019-12-30 Follicle ultrasonic processing method and system based on level set image segmentation

Publications (2)

Publication Number Publication Date
CN111192251A CN111192251A (en) 2020-05-22
CN111192251B true CN111192251B (en) 2023-03-28

Family

ID=70707910

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911398714.1A Active CN111192251B (en) 2019-12-30 2019-12-30 Follicle ultrasonic processing method and system based on level set image segmentation

Country Status (1)

Country Link
CN (1) CN111192251B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113436221A (en) * 2021-05-31 2021-09-24 华东师范大学 Image segmentation weak annotation method using geometric shape layering
CN114511559B (en) * 2022-04-18 2022-10-11 杭州迪英加科技有限公司 Method, system and medium for multidimensional evaluation of the quality of stained nasal polyp pathological sections
CN115049642A (en) * 2022-08-11 2022-09-13 合肥合滨智能机器人有限公司 Carotid artery blood vessel intima-media measurement and plaque detection method
CN116503392B (en) * 2023-06-26 2023-08-25 细胞生态海河实验室 Follicular region segmentation method for ovarian tissue analysis
CN116912255B (en) * 2023-09-14 2023-12-19 济南宝林信息技术有限公司 Follicular region segmentation method for ovarian tissue analysis
CN118468919B (en) * 2024-07-11 2024-09-20 青岛海兴智能装备有限公司 Egg counter based on intelligent vision and counting method
CN118587239B (en) * 2024-08-07 2024-10-01 辽宁志圣达生物科技有限公司 Gynaecology and obstetrics's tumour ultrasonic examination system
CN119048502B (en) * 2024-10-30 2024-12-27 沈阳盛京生物细胞研发中心有限公司 A method and system for assisting in recognizing nursing images in reproductive medicine

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2174263A4 (en) * 2006-08-01 2013-04-03 Univ Pennsylvania MALIGNANCY DIAGNOSIS USING EXTRACTION BASED ON TISSUE HISTOPATHOLOGIC IMAGE CONTENT
EP2599055A2 (en) * 2010-07-30 2013-06-05 Fundação D. Anna Sommer Champalimaud E Dr. Carlos Montez Champalimaud Systems and methods for segmentation and processing of tissue images and feature extraction from same for treating, diagnosing, or predicting medical conditions
CN104599270B (en) * 2015-01-18 2017-10-10 北京工业大学 A kind of Ultrasound Image of Breast Tumor dividing method based on improvement level set algorithm
CN110033464B (en) * 2019-04-15 2023-03-10 齐齐哈尔医学院 Breast tumor ultrasonic image segmentation method based on level set algorithm

Also Published As

Publication number Publication date
CN111192251A (en) 2020-05-22

Similar Documents

Publication Publication Date Title
CN111192251B (en) Follicle ultrasonic processing method and system based on level set image segmentation
Ramani et al. Improved image processing techniques for optic disc segmentation in retinal fundus images
CN110276356B (en) Fundus image microaneurysm identification method based on R-CNN
CN106651846B (en) Segmentation method of retinal blood vessel images
US9959617B2 (en) Medical image processing apparatus and breast image processing method thereof
CN108846838B (en) Three-dimensional MRI (magnetic resonance imaging) semi-automatic focus image segmentation method and system
Pathan et al. Automated detection of optic disc contours in fundus images using decision tree classifier
CN106530283A (en) SVM (support vector machine)-based medical image blood vessel recognition method
CN111507932B (en) High-specificity diabetic retinopathy characteristic detection method and storage device
CN110929728B (en) Image region-of-interest dividing method, image segmentation method and device
CN104899926A (en) Medical image segmentation method and device
Jaafar et al. Automated detection and grading of hard exudates from retinal fundus images
CN108185984A (en) The method that eyeground color picture carries out eyeground lesion identification
Al-Fahdawi et al. A fully automatic nerve segmentation and morphometric parameter quantification system for early diagnosis of diabetic neuropathy in corneal images
CN107169975B (en) The analysis method and device of ultrasound image
CN110738637A (en) Automatic classification method and system for breast cancer pathological sections
TWI587844B (en) Medical image processing apparatus and breast image processing method thereof
CN106372593B (en) Optic disk area positioning method based on vascular convergence
CN112907581A (en) MRI (magnetic resonance imaging) multi-class spinal cord tumor segmentation method based on deep learning
CN114757953B (en) Medical ultrasonic image recognition method, equipment and storage medium
Biyani et al. A clustering approach for exudates detection in screening of diabetic retinopathy
Zhang et al. Retinal spot lesion detection using adaptive multiscale morphological processing
CN108230306A (en) Eyeground color picture blood vessel and arteriovenous recognition methods
Reza et al. Automatic detection of optic disc in fundus images by curve operator
CN113409275B (en) Method for determining thickness of transparent layer behind fetal neck based on ultrasonic image and related device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant