CN118750024A - A method for assisting detection of cardiovascular conditions in internal medicine - Google Patents
A method for assisting detection of cardiovascular conditions in internal medicine Download PDFInfo
- Publication number
- CN118750024A CN118750024A CN202410923407.5A CN202410923407A CN118750024A CN 118750024 A CN118750024 A CN 118750024A CN 202410923407 A CN202410923407 A CN 202410923407A CN 118750024 A CN118750024 A CN 118750024A
- Authority
- CN
- China
- Prior art keywords
- target
- heart
- determining
- echocardiogram
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000002526 effect on cardiovascular system Effects 0.000 title claims abstract description 31
- 238000001514 detection method Methods 0.000 title claims abstract description 24
- 239000003814 drug Substances 0.000 title claims abstract description 22
- 230000000747 cardiac effect Effects 0.000 claims abstract description 224
- 238000012216 screening Methods 0.000 claims abstract description 9
- 238000011156 evaluation Methods 0.000 claims description 39
- 238000012549 training Methods 0.000 claims description 21
- 230000008859 change Effects 0.000 claims description 20
- 238000009826 distribution Methods 0.000 claims description 16
- 230000008569 process Effects 0.000 claims description 16
- 238000003708 edge detection Methods 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 2
- 238000002604 ultrasonography Methods 0.000 abstract description 22
- 230000000694 effects Effects 0.000 abstract description 12
- 238000012545 processing Methods 0.000 abstract description 5
- 230000000875 corresponding effect Effects 0.000 description 172
- 239000000523 sample Substances 0.000 description 35
- 230000002596 correlated effect Effects 0.000 description 16
- 238000004590 computer program Methods 0.000 description 13
- 230000017531 blood circulation Effects 0.000 description 4
- 238000002592 echocardiography Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 210000001519 tissue Anatomy 0.000 description 4
- 238000013527 convolutional neural network Methods 0.000 description 3
- 238000003745 diagnosis Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 2
- 101000827703 Homo sapiens Polyphosphoinositide phosphatase Proteins 0.000 description 2
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 2
- 102100023591 Polyphosphoinositide phosphatase Human genes 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 210000000038 chest Anatomy 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000010247 heart contraction Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 210000001562 sternum Anatomy 0.000 description 2
- 101100177165 Caenorhabditis elegans har-1 gene Proteins 0.000 description 1
- 208000024172 Cardiovascular disease Diseases 0.000 description 1
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000037237 body shape Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013155 cardiography Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 210000002837 heart atrium Anatomy 0.000 description 1
- 230000000004 hemodynamic effect Effects 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000037368 penetrate the skin Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 210000004872 soft tissue Anatomy 0.000 description 1
- 210000000779 thoracic wall Anatomy 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/02—Measuring pulse or heart rate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/14—Vascular patterns
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Surgery (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Vascular Medicine (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Evolutionary Computation (AREA)
- Databases & Information Systems (AREA)
- Cardiology (AREA)
- Image Analysis (AREA)
Abstract
本发明涉及图像数据处理技术领域,具体涉及一种用于内科的心血管状况辅助检测方法,该方法包括:获取待检测患者在预设数量个心跳周期内每个预设时刻下的目标超声心动图;从每个心脏切面图像中筛选出心脏结构轮廓,并确定每个心脏切面图像对应的辨识清晰待增强因子;确定每个心跳周期对应的低分辨因子;根据辨识清晰待增强因子和低分辨因子,确定每帧目标超声心动图对应的目标标准差;根据每帧目标超声心动图对应的目标标准差,通过高斯插值核,对每帧目标超声心动图进行上采样,得到目标图像,其中,目标标准差是高斯插值核所服从的标准差。本发明通过对目标超声心动图进行图像数据处理,提高了对超声心动图进行上采样的效果。
The present invention relates to the field of image data processing technology, and in particular to a cardiovascular condition auxiliary detection method for internal medicine, the method comprising: obtaining a target ultrasound cardiogram of a patient to be detected at each preset time within a preset number of heartbeat cycles; screening out the cardiac structure contour from each heart section image, and determining a clear identification factor to be enhanced corresponding to each heart section image; determining a low resolution factor corresponding to each heartbeat cycle; determining a target standard deviation corresponding to each frame of the target ultrasound cardiogram according to the clear identification factor to be enhanced and the low resolution factor; and upsampling each frame of the target ultrasound cardiogram through a Gaussian interpolation kernel according to the target standard deviation corresponding to each frame of the target ultrasound cardiogram to obtain a target image, wherein the target standard deviation is the standard deviation obeyed by the Gaussian interpolation kernel. The present invention improves the effect of upsampling the ultrasound cardiogram by performing image data processing on the target ultrasound cardiogram.
Description
技术领域Technical Field
本发明涉及图像数据处理技术领域,具体涉及一种用于内科的心血管状况辅助检测方法。The present invention relates to the technical field of image data processing, and in particular to an auxiliary detection method for cardiovascular conditions in internal medicine.
背景技术Background Art
随着科技的发展,图像数据处理的应用越来越广泛,比如,可以应用于内科的心血管状况辅助检测,具体地,医生可以通过观察采集的超声心动图,对患者进行初步诊断。由于环境等因素的影响,采集的超声心动图的分辨率可能较低,从而导致一些重要细节难以在超声心动图中显示,因此,往往需要对采集的超声心动图进行上采样,以提高超声心动图的分辨率。目前,对图像进行上采样时,通常采用的方法为:为高斯插值核预设一个其所服从的标准差,并通过高斯插值核,对图像进行上采样。其中,为高斯插值核预设的标准差往往是依据人工经验设置的。With the development of science and technology, the application of image data processing is becoming more and more extensive. For example, it can be used in the auxiliary detection of cardiovascular conditions in internal medicine. Specifically, doctors can make a preliminary diagnosis of patients by observing the collected echocardiograms. Due to the influence of environmental factors and other factors, the resolution of the collected echocardiograms may be low, which makes it difficult to display some important details in the echocardiograms. Therefore, it is often necessary to upsample the collected echocardiograms to improve the resolution of the echocardiograms. At present, when upsampling an image, the method usually used is: preset a standard deviation for the Gaussian interpolation kernel, and upsample the image through the Gaussian interpolation kernel. Among them, the standard deviation preset for the Gaussian interpolation kernel is often set based on manual experience.
然而,当为高斯插值核预设一个其所服从的标准差,并通过高斯插值核,对采集的多帧超声心动图进行上采样时,经常会存在如下技术问题:However, when a standard deviation is preset for the Gaussian interpolation kernel and multiple acquired echocardiogram frames are upsampled using the Gaussian interpolation kernel, the following technical problems often occur:
由于环境等因素的影响,往往导致不同帧超声心动图的分辨率不同,所以,对不同帧超声心动图进行上采样时其需要的标准差往往不同,因此,若只预设一个标准差,则可能会导致对部分超声心动图进行上采样的效果较差,其次,由于为高斯插值核预设的标准差往往是依据人工经验设置的,其设置结果往往受到人为主观因素的影响,所以设置结果往往并不准确,从而导致对超声心动图进行上采样的效果较差。Due to the influence of environmental factors, the resolutions of different frames of echocardiograms are often different. Therefore, the standard deviations required for upsampling different frames of echocardiograms are often different. Therefore, if only one standard deviation is preset, it may lead to poor upsampling effects on some echocardiograms. Secondly, since the standard deviation preset for the Gaussian interpolation kernel is often set based on manual experience, the setting results are often affected by human subjective factors, so the setting results are often inaccurate, resulting in poor upsampling effects on echocardiograms.
发明内容Summary of the invention
为了解决对超声心动图进行上采样的效果较差的技术问题,本发明提出了一种用于内科的心血管状况辅助检测方法。In order to solve the technical problem of poor upsampling effect of echocardiogram, the present invention proposes an auxiliary detection method for cardiovascular condition in internal medicine.
第一方面,本发明提供了一种用于内科的心血管状况辅助检测方法,该方法包括:In a first aspect, the present invention provides a method for auxiliary detection of cardiovascular conditions for internal medicine, the method comprising:
获取待检测患者在预设数量个心跳周期内每个预设时刻下的目标超声心动图,其中,目标超声心动图包含心脏切面图像;Acquire a target echocardiogram of the patient to be tested at each preset time within a preset number of heartbeat cycles, wherein the target echocardiogram includes a heart section image;
从每个心脏切面图像中筛选出心脏结构轮廓,并根据每个心脏切面图像中心脏结构轮廓上边缘线的数量,以及心脏结构轮廓上像素点之间的灰度差异,确定每个心脏切面图像对应的辨识清晰待增强因子;Screening out the cardiac structure contour from each cardiac section image, and determining the identification clarity enhancement factor corresponding to each cardiac section image according to the number of edge lines on the cardiac structure contour in each cardiac section image and the grayscale difference between the pixels on the cardiac structure contour;
根据每个心跳周期与其他心跳周期内目标超声心动图之间的灰度差异,以及所述待检测患者对应的体征信息,确定每个心跳周期对应的低分辨因子;Determine a low-resolution factor corresponding to each heartbeat cycle according to the grayscale difference between each heartbeat cycle and the target echocardiogram in other heartbeat cycles, and the corresponding physical sign information of the patient to be detected;
根据每帧目标超声心动图包含的心脏切面图像对应的辨识清晰待增强因子,以及每帧目标超声心动图所属心跳周期对应的低分辨因子,确定每帧目标超声心动图对应的目标标准差;Determine the target standard deviation corresponding to each frame of the target echocardiogram according to the identification clear enhancement factor corresponding to the heart section image contained in each frame of the target echocardiogram and the low resolution factor corresponding to the heartbeat cycle to which each frame of the target echocardiogram belongs;
根据每帧目标超声心动图对应的目标标准差,通过高斯插值核,对每帧目标超声心动图进行上采样,得到目标图像,其中,目标标准差是高斯插值核所服从的标准差。According to the target standard deviation corresponding to each frame of the target echocardiogram, each frame of the target echocardiogram is upsampled by a Gaussian interpolation kernel to obtain a target image, wherein the target standard deviation is the standard deviation obeyed by the Gaussian interpolation kernel.
结合上述第一方面,在一种可能的实现方式中,所述根据每个心脏切面图像中心脏结构轮廓上边缘线的数量,以及心脏结构轮廓上像素点之间的灰度差异,确定每个心脏切面图像对应的辨识清晰待增强因子,包括:In combination with the first aspect, in a possible implementation, determining the identification clarity enhancement factor corresponding to each cardiac section image according to the number of edge lines on the cardiac structure contour in each cardiac section image and the grayscale difference between pixels on the cardiac structure contour includes:
将每个心脏结构轮廓上每两个像素点对应的灰度值的差值绝对值,确定为这两个像素点之间的参考灰度差异;The absolute value of the difference between the grayscale values corresponding to every two pixel points on the contour of each cardiac structure is determined as the reference grayscale difference between the two pixel points;
根据每个心脏结构轮廓上所有像素点之间的参考灰度差异,确定每个心脏结构轮廓对应的灰度代表差异,其中,参考灰度差异和灰度代表差异呈正相关关系;According to the reference grayscale difference between all pixel points on each cardiac structure contour, the grayscale representative difference corresponding to each cardiac structure contour is determined, wherein the reference grayscale difference and the grayscale representative difference are positively correlated;
对每个心脏结构轮廓进行边缘检测,得到边缘线,并根据每个心脏结构轮廓上边缘线的数量和其对应的灰度代表差异,确定每个心脏结构轮廓对应的边缘辨识待调整指标,其中,心脏结构轮廓上边缘线的数量和其对应的灰度代表差异均与其对应的边缘辨识待调整指标呈正相关关系;Perform edge detection on each cardiac structure contour to obtain edge lines, and determine the edge identification index to be adjusted corresponding to each cardiac structure contour according to the number of edge lines on each cardiac structure contour and the corresponding grayscale representative difference, wherein the number of edge lines on the cardiac structure contour and the corresponding grayscale representative difference are both positively correlated with the corresponding edge identification index to be adjusted;
根据每个心脏切面图像中所有心脏结构轮廓对应的边缘辨识待调整指标,以及每个心脏切面图像中各个心脏结构轮廓上像素点对应的灰度值,确定每个心脏切面图像对应的辨识清晰待增强因子。According to the edge recognition indexes to be adjusted corresponding to all cardiac structure contours in each cardiac section image and the grayscale values corresponding to the pixels on each cardiac structure contour in each cardiac section image, the recognition clarity factor to be enhanced corresponding to each cardiac section image is determined.
结合上述第一方面,在一种可能的实现方式中,所述根据每个心脏切面图像中所有心脏结构轮廓对应的边缘辨识待调整指标,以及每个心脏切面图像中各个心脏结构轮廓上像素点对应的灰度值,确定每个心脏切面图像对应的辨识清晰待增强因子,包括:In combination with the first aspect, in a possible implementation, determining the identification clarity factor to be enhanced corresponding to each cardiac section image according to the edge identification indicators to be adjusted corresponding to all cardiac structure contours in each cardiac section image and the grayscale values corresponding to the pixels on each cardiac structure contour in each cardiac section image includes:
将每个心脏结构轮廓上所有像素点对应的预设邻域的并集,确定为每个心脏结构轮廓对应的参考邻域;The union of the preset neighborhoods corresponding to all the pixel points on each cardiac structure contour is determined as the reference neighborhood corresponding to each cardiac structure contour;
根据每个心脏结构轮廓及其对应的参考邻域和边缘辨识待调整指标,确定每个心脏结构轮廓对应的轮廓待调整指标;Determine the contour index to be adjusted corresponding to each cardiac structure contour according to each cardiac structure contour and its corresponding reference neighborhood and edge identification index to be adjusted;
根据每个心脏切面图像中所有心脏结构轮廓对应的轮廓待调整指标,确定每个心脏切面图像对应的辨识清晰待增强因子,其中,轮廓待调整指标和辨识清晰待增强因子呈正相关关系。According to the contour adjustment index corresponding to all cardiac structure contours in each cardiac section image, the identification clarity enhancement factor corresponding to each cardiac section image is determined, wherein the contour adjustment index and the identification clarity enhancement factor are positively correlated.
结合上述第一方面,在一种可能的实现方式中,所述根据每个心脏结构轮廓及其对应的参考邻域和边缘辨识待调整指标,确定每个心脏结构轮廓对应的轮廓待调整指标,包括:In combination with the first aspect, in a possible implementation, determining the contour index to be adjusted corresponding to each cardiac structure contour according to each cardiac structure contour and its corresponding reference neighborhood and edge identification index to be adjusted includes:
将每个心脏结构轮廓上所有像素点对应的灰度值的均值,确定为每个心脏结构轮廓对应的第一灰度代表因子;The mean of the grayscale values corresponding to all the pixels on each cardiac structure contour is determined as the first grayscale representative factor corresponding to each cardiac structure contour;
将每个心脏结构轮廓对应的参考邻域内所有像素点对应的灰度值的均值,确定为每个心脏结构轮廓对应的第二灰度代表因子;The average of the grayscale values corresponding to all the pixels in the reference neighborhood corresponding to each cardiac structure contour is determined as the second grayscale representative factor corresponding to each cardiac structure contour;
将每个心脏结构轮廓对应的第一灰度代表因子和第二灰度代表因子之间的差异,确定为每个心脏结构轮廓对应的灰度对比差异;Determine the difference between the first grayscale representative factor and the second grayscale representative factor corresponding to each cardiac structure contour as the grayscale contrast difference corresponding to each cardiac structure contour;
根据每个心脏结构轮廓对应的边缘辨识待调整指标和灰度对比差异,确定每个心脏结构轮廓对应的轮廓待调整指标,其中,边缘辨识待调整指标与轮廓待调整指标呈正相关关系,灰度对比差异与轮廓待调整指标呈负相关关系。According to the edge identification index to be adjusted and the grayscale contrast difference corresponding to each cardiac structure contour, the contour index to be adjusted corresponding to each cardiac structure contour is determined, wherein the edge identification index to be adjusted is positively correlated with the contour index to be adjusted, and the grayscale contrast difference is negatively correlated with the contour index to be adjusted.
结合上述第一方面,在一种可能的实现方式中,所述根据每个心跳周期与其他心跳周期内目标超声心动图之间的灰度差异,以及所述待检测患者对应的体征信息,确定每个心跳周期对应的低分辨因子,包括:In combination with the first aspect above, in a possible implementation, determining the low-resolution factor corresponding to each heartbeat cycle according to the grayscale difference between each heartbeat cycle and the target echocardiogram in other heartbeat cycles, and the physical sign information corresponding to the patient to be detected, includes:
根据每两个心跳周期内目标超声心动图之间的灰度差异,确定每两个心跳周期之间的信息变化量;According to the grayscale difference between the target echocardiograms within each two heartbeat cycles, the information change amount between each two heartbeat cycles is determined;
根据所述待检测患者对应的体征信息,确定所述待检测患者对应的分辨率评估值;Determining a resolution evaluation value corresponding to the patient to be detected according to the physical sign information corresponding to the patient to be detected;
根据分辨率评估值,以及每个心跳周期与其他心跳周期之间的信息变化量,确定每个心跳周期对应的低分辨因子,其中,信息变化量和分辨率评估值均与低分辨因子呈正相关关系。The low resolution factor corresponding to each heartbeat cycle is determined according to the resolution evaluation value and the information change amount between each heartbeat cycle and other heartbeat cycles, wherein the information change amount and the resolution evaluation value are both positively correlated with the low resolution factor.
结合上述第一方面,在一种可能的实现方式中,所述根据每两个心跳周期内目标超声心动图之间的灰度差异,确定每两个心跳周期之间的信息变化量,包括:In combination with the first aspect above, in a possible implementation, determining the amount of information change between every two heartbeat cycles according to the grayscale difference between the target echocardiograms within every two heartbeat cycles includes:
将任意一个心跳周期确定为标记周期,将所述标记周期之外的任意一个心跳周期确定为参考周期,将所述标记周期内任意一帧目标超声心动图确定为标记图像,并从所述参考周期内筛选出对应的帧序号与所述标记图像对应的帧序号相同的目标超声心动图,作为参考图像;Determine any one heartbeat cycle as a marking cycle, determine any one heartbeat cycle outside the marking cycle as a reference cycle, determine any one frame of target echocardiogram within the marking cycle as a marking image, and select a target echocardiogram whose corresponding frame number is the same as that of the marking image from within the reference cycle as a reference image;
将所述标记图像对应的平均灰度与所述参考图像对应的平均灰度之间的差值绝对值,确定为所述标记图像与所述参考图像之间的目标灰度差异;Determine the absolute value of the difference between the average grayscale corresponding to the marked image and the average grayscale corresponding to the reference image as the target grayscale difference between the marked image and the reference image;
将所述标记图像对应的灰度方差与所述参考图像对应的灰度方差之间的差值绝对值,确定为所述标记图像与所述参考图像之间的灰度分布差异;Determine the absolute value of the difference between the grayscale variance corresponding to the marked image and the grayscale variance corresponding to the reference image as the grayscale distribution difference between the marked image and the reference image;
根据所述标记图像与所述参考图像之间的目标灰度差异,以及所述标记图像与所述参考图像之间的灰度分布差异,确定所述标记图像与所述参考图像之间的目标差异因子,其中,目标灰度差异和灰度分布差异均与目标差异因子呈正相关关系;Determining a target difference factor between the marked image and the reference image according to a target grayscale difference between the marked image and the reference image, and a grayscale distribution difference between the marked image and the reference image, wherein both the target grayscale difference and the grayscale distribution difference are positively correlated with the target difference factor;
根据每两个心跳周期内的所有目标差异因子,确定每两个心跳周期之间的信息变化量,其中,目标差异因子与信息变化量呈正相关关系。The information variation between every two heartbeat cycles is determined according to all target difference factors within every two heartbeat cycles, wherein the target difference factor is positively correlated with the information variation.
结合上述第一方面,在一种可能的实现方式中,所述根据所述待检测患者对应的体征信息,确定所述待检测患者对应的分辨率评估值,包括:In combination with the first aspect above, in a possible implementation manner, determining the resolution evaluation value corresponding to the patient to be detected according to the physical sign information corresponding to the patient to be detected includes:
将所述待检测患者对应的体征信息输入预先训练完成的分辨率评估网络,并通过预先训练完成的分辨率评估网络,输出所述待检测患者对应的分辨率评估值,其中,分辨率评估网络的训练过程包括:Inputting the vital sign information corresponding to the patient to be detected into a pre-trained resolution evaluation network, and outputting the resolution evaluation value corresponding to the patient to be detected through the pre-trained resolution evaluation network, wherein the training process of the resolution evaluation network includes:
构建分辨率评估网络;Construct a resolution assessment network;
获取样本体征信息集合,其中,所述样本体征信息集合中的样本体征信息对应的分辨率评估值已知;Acquire a sample vital sign information set, wherein the resolution evaluation value corresponding to the sample vital sign information in the sample vital sign information set is known;
以所述样本体征信息集合为训练集,以样本体征信息对应的分辨率评估值为训练标签,对构建的分辨率评估网络进行训练,得到训练完成的分辨率评估网络。The sample vital sign information set is used as a training set, and the resolution assessment value corresponding to the sample vital sign information is used as a training label to train the constructed resolution assessment network to obtain a trained resolution assessment network.
结合上述第一方面,在一种可能的实现方式中,所述根据每帧目标超声心动图包含的心脏切面图像对应的辨识清晰待增强因子,以及每帧目标超声心动图所属心跳周期对应的低分辨因子,确定每帧目标超声心动图对应的目标标准差,包括:In combination with the first aspect, in a possible implementation, determining the target standard deviation corresponding to each frame of the target echocardiogram according to the identification clarity factor to be enhanced corresponding to the cardiac section image contained in each frame of the target echocardiogram and the low resolution factor corresponding to the heart cycle to which each frame of the target echocardiogram belongs includes:
将每帧目标超声心动图包含的心脏切面图像对应的辨识清晰待增强因子,与每帧目标超声心动图所属心跳周期对应的低分辨因子之间的欧式范数,确定为每帧目标超声心动图对应的目标标准差。The Euclidean norm between the identification clear factor to be enhanced corresponding to the cardiac section image contained in each frame of the target echocardiogram and the low resolution factor corresponding to the heart cycle to which each frame of the target echocardiogram belongs is determined as the target standard deviation corresponding to each frame of the target echocardiogram.
结合上述第一方面,在一种可能的实现方式中,所述从每个心脏切面图像中筛选出心脏结构轮廓,包括:In combination with the first aspect above, in a possible implementation manner, screening out the cardiac structure contour from each cardiac section image includes:
将每个心脏切面图像输入预先训练完成的心脏结构轮廓识别网络,并通过预先训练完成的心脏结构轮廓识别网络,识别每个心脏切面图像中的心脏结构轮廓。Each cardiac section image is input into a pre-trained cardiac structure contour recognition network, and the pre-trained cardiac structure contour recognition network is used to recognize the cardiac structure contour in each cardiac section image.
结合上述第一方面,在一种可能的实现方式中,心脏结构轮廓识别网络的训练过程,包括:In combination with the first aspect above, in a possible implementation, the training process of the cardiac structure contour recognition network includes:
构建心脏结构轮廓识别网络;Construct a cardiac structure contour recognition network;
获取样本心脏切面图像集合,其中,所述样本心脏切面图像集合中的样本心脏切面图像中标注了心脏结构轮廓;Acquire a set of sample cardiac section images, wherein the cardiac structure contours are marked in the sample cardiac section images in the set of sample cardiac section images;
以所述样本心脏切面图像集合为训练集,以样本心脏切面图像中标注的心脏结构轮廓为训练标签,对构建的心脏结构轮廓识别网络进行训练,得到训练完成的心脏结构轮廓识别网络。The constructed cardiac structure contour recognition network is trained using the sample cardiac section image set as a training set and the cardiac structure contours annotated in the sample cardiac section images as training labels to obtain a trained cardiac structure contour recognition network.
本发明具有如下有益效果:The present invention has the following beneficial effects:
本发明的一种用于内科的心血管状况辅助检测方法,通过对目标超声心动图进行图像数据处理,解决了对超声心动图进行上采样的效果较差的技术问题,提高了对超声心动图进行上采样的效果。本发明综合考虑了多个与分辨率相关的指标,比如,辨识清晰待增强因子和低分辨因子等,量化了对每帧目标超声心动图进行上采样时需要的目标标准差,从而可以实现对每帧目标超声心动图进行自适应上采样,进而提高了上采样效果。其次,本发明量化目标标准差的过程相对比较客观,在一定程度上减少了人为主观因素的影响,从而提高了目标标准差确定的准确度,进而提高了对每帧目标超声心动图进行上采样的效果。The present invention is an auxiliary detection method for cardiovascular conditions in internal medicine, which solves the technical problem of poor upsampling effect of the echocardiogram by processing the image data of the target echocardiogram, and improves the effect of upsampling the echocardiogram. The present invention comprehensively considers multiple indicators related to resolution, such as the identification of clear factors to be enhanced and low resolution factors, and quantifies the target standard deviation required when upsampling each frame of the target echocardiogram, so that adaptive upsampling of each frame of the target echocardiogram can be achieved, thereby improving the upsampling effect. Secondly, the process of quantifying the target standard deviation of the present invention is relatively objective, which reduces the influence of human subjective factors to a certain extent, thereby improving the accuracy of determining the target standard deviation, and then improving the effect of upsampling each frame of the target echocardiogram.
第二方面,本发明提供了一种用于内科的心血管状况辅助检测系统,所述系统包括:In a second aspect, the present invention provides a cardiovascular condition auxiliary detection system for internal medicine, the system comprising:
图像获取模块,用于获取待检测患者在预设数量个心跳周期内每个预设时刻下的目标超声心动图,其中,目标超声心动图包含心脏切面图像;An image acquisition module, used to acquire a target echocardiogram of the patient to be tested at each preset time within a preset number of heartbeat cycles, wherein the target echocardiogram includes a heart section image;
筛选确定模块,用于从每个心脏切面图像中筛选出心脏结构轮廓,并根据每个心脏切面图像中心脏结构轮廓上边缘线的数量,以及心脏结构轮廓上像素点之间的灰度差异,确定每个心脏切面图像对应的辨识清晰待增强因子;A screening and determination module is used to screen out the cardiac structure contour from each cardiac section image, and determine the identification clarity enhancement factor corresponding to each cardiac section image according to the number of edge lines on the cardiac structure contour in each cardiac section image and the grayscale difference between the pixels on the cardiac structure contour;
分辨因子确定模块,用于根据每个心跳周期与其他心跳周期内目标超声心动图之间的灰度差异,以及所述待检测患者对应的体征信息,确定每个心跳周期对应的低分辨因子;A resolution factor determination module, used to determine a low resolution factor corresponding to each heartbeat cycle according to the grayscale difference between each heartbeat cycle and the target echocardiogram in other heartbeat cycles, and the physical sign information corresponding to the patient to be detected;
标准差确定模块,用于根据每帧目标超声心动图包含的心脏切面图像对应的辨识清晰待增强因子,以及每帧目标超声心动图所属心跳周期对应的低分辨因子,确定每帧目标超声心动图对应的目标标准差;A standard deviation determination module is used to determine a target standard deviation corresponding to each frame of the target echocardiogram according to a clear identification factor to be enhanced corresponding to the cardiac section image contained in each frame of the target echocardiogram and a low resolution factor corresponding to the heart cycle to which each frame of the target echocardiogram belongs;
上采样模块,用于根据每帧目标超声心动图对应的目标标准差,通过高斯插值核,对每帧目标超声心动图进行上采样,得到目标图像,其中,目标标准差是高斯插值核所服从的标准差。The upsampling module is used to upsample each frame of the target echocardiogram through a Gaussian interpolation kernel according to a target standard deviation corresponding to each frame of the target echocardiogram to obtain a target image, wherein the target standard deviation is the standard deviation obeyed by the Gaussian interpolation kernel.
第三方面,提供了一种服务器,包括存储器和处理器。该存储器用于存储可执行程序代码,该处理器用于从存储器中调用并运行该可执行程序代码,使得该设备执行上述第一方面或第一方面任意一种可能的实现方式中的方法。In a third aspect, a server is provided, comprising a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, so that the device executes the method in the first aspect or any possible implementation of the first aspect.
第四方面,提供了一种计算机程序产品,该计算机程序产品包括:计算机程序代码,当该计算机程序代码在计算机上运行时,使得该计算机执行上述第一方面或第一方面任意一种可能的实现方式中的方法。In a fourth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute the method in the first aspect or any possible implementation of the first aspect.
第五方面,提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序代码,当该计算机程序代码在计算机上运行时,使得该计算机执行上述第一方面或第一方面任意一种可能的实现方式中的方法。In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program code. When the computer program code runs on a computer, the computer executes the method in the above-mentioned first aspect or any possible implementation of the first aspect.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案和优点,下面将对实施例或现有技术描述中所需要使用的附图作简单的介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它附图。In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
图1为本发明的一种用于内科的心血管状况辅助检测方法的流程图;FIG1 is a flow chart of a cardiovascular condition auxiliary detection method for internal medicine of the present invention;
图2为本发明的辨识清晰待增强因子确定方法的流程图;FIG2 is a flow chart of a method for determining a clear identification factor to be enhanced according to the present invention;
图3为本发明的辨识清晰待增强因子确定方法的又一流程图;FIG3 is another flow chart of a method for determining a clear factor to be enhanced according to the present invention;
图4为本发明的轮廓待调整指标确定方法的流程图;FIG4 is a flow chart of a method for determining a contour index to be adjusted according to the present invention;
图5为本发明的低分辨因子确定方法的流程图;FIG5 is a flow chart of a method for determining a low resolution factor according to the present invention;
图6为本发明的一种用于内科的心血管状况辅助检测系统的组成结构示意图;FIG6 is a schematic diagram of the composition structure of a cardiovascular condition auxiliary detection system for internal medicine according to the present invention;
图7为本发明的一种计算机设备的结构示意图。FIG. 7 is a schematic diagram of the structure of a computer device according to the present invention.
具体实施方式DETAILED DESCRIPTION
为了更进一步阐述本发明为达成预定发明目的所采取的技术手段及功效,以下结合附图及较佳实施例,对依据本发明提出的技术方案的具体实施方式、结构、特征及其功效,详细说明如下。在下述说明中,不同的“一个实施例”或“另一个实施例”指的不一定是同一个实施例。此外,一个或多个实施例中的特定特征、结构或特点可由任何合适形式组合。In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the specific implementation methods, structures, features and effects of the technical solutions proposed by the present invention are described in detail below in conjunction with the accompanying drawings and preferred embodiments. In the following description, different "one embodiment" or "another embodiment" does not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics in one or more embodiments may be combined in any suitable form.
除非另有定义,本文所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
参考图1,示出了根据本发明的一种用于内科的心血管状况辅助检测方法的一些实施例的流程。该用于内科的心血管状况辅助检测方法,包括以下步骤:Referring to FIG1 , a flow chart of some embodiments of a cardiovascular condition auxiliary detection method for internal medicine according to the present invention is shown. The cardiovascular condition auxiliary detection method for internal medicine comprises the following steps:
步骤S1,获取待检测患者在预设数量个心跳周期内每个预设时刻下的目标超声心动图。Step S1, obtaining a target echocardiogram of a patient to be tested at each preset time within a preset number of heartbeat cycles.
其中,待检测患者可以是待进行心血管状况检测的患者。预设数量可以是预先设置的数量。例如,预设数量可以为6。一个心跳周期表征待检测患者的一个心跳过程。例如,从待检测患者一次心跳的起始到待检测患者下一次心跳的起始之间的时长,可以作为一个心跳周期。上一个心跳周期的结束时刻可以是下一个心跳周期的开始时刻。预设时刻可以是预先设置的时刻。相邻预设时刻之间的时长可以相同。例如,相邻预设时刻之间的时长可以为0.15秒。目标超声心动图可以是与心脏相关的超声心动图,并且本发明实施例中的目标超声心动图可以是灰度图像。超声心动图可以表征心脏收缩和舒张时的结构变化、血流速度和方向等状态。例如,超声心动图可以包括心脏切面图像、组织多普勒成像和应变图像等。所以,目标超声心动图可以包含心脏切面图像、组织多普勒成像和应变图像。心脏切面图像可以是与患者心脏相关的切面图像。例如,心脏切面图像可以包括心房、心室、瓣膜和大血管等心脏结构。Among them, the patient to be detected may be a patient to be tested for cardiovascular condition. The preset number may be a preset number. For example, the preset number may be 6. A heartbeat cycle represents a heartbeat process of the patient to be detected. For example, the duration from the start of a heartbeat of the patient to be detected to the start of the next heartbeat of the patient to be detected may be regarded as a heartbeat cycle. The end time of the previous heartbeat cycle may be the start time of the next heartbeat cycle. The preset time may be a preset time. The duration between adjacent preset times may be the same. For example, the duration between adjacent preset times may be 0.15 seconds. The target echocardiogram may be an echocardiogram related to the heart, and the target echocardiogram in the embodiment of the present invention may be a grayscale image. The echocardiogram may represent the structural changes, blood flow velocity and direction, and other states during heart contraction and diastole. For example, the echocardiogram may include a heart section image, tissue Doppler imaging, and a strain image. Therefore, the target echocardiogram may include a heart section image, a tissue Doppler imaging, and a strain image. The heart section image may be a section image related to the patient's heart. For example, a cross-sectional image of the heart may include cardiac structures such as the atria, ventricles, valves, and great vessels.
需要说明的是,超声心动图是一种使用高频声波来生成心脏图像的非侵入性检查方法,它能够提供心脏结构和功能的详细信息,对于诊断和治疗心血管疾病非常重要,其中,高频声波,又称为超声波。超声心动图的获取原理为:超声心动图仪器发出高频声波,这些声波穿透皮肤和身体组织到达心脏。当声波遇到心脏的结构时,它们被反射回仪器,由接收器捕捉这些回声,然后,仪器将这些数据转换为实时的心脏图像。其次,当超声心动图的分辨率不足时,往往需要对超声心动图进行上采样,使心脏结构之间的差异更加明显,并且使血流的速度和方向更加清晰可见,从而有助于医生更容易的识别不同组织和结构之间的边界,以及评估心脏血流动力学和检测瓣膜功能。一般情况下,同一个患者在短时间内不同心跳周期对应的时长往往相同。在对患者进行心血管状况辅助检测过程中,往往不会长时间采集超声心动图,因此,上述预设数量个心跳周期对应的时长往往相同。It should be noted that echocardiography is a non-invasive examination method that uses high-frequency sound waves to generate cardiac images. It can provide detailed information on the structure and function of the heart and is very important for the diagnosis and treatment of cardiovascular diseases. Among them, high-frequency sound waves are also called ultrasound. The principle of obtaining echocardiography is as follows: the echocardiography instrument emits high-frequency sound waves, which penetrate the skin and body tissues to reach the heart. When the sound waves encounter the structure of the heart, they are reflected back to the instrument, and the receiver captures these echoes. Then, the instrument converts these data into real-time cardiac images. Secondly, when the resolution of the echocardiogram is insufficient, it is often necessary to upsample the echocardiogram to make the differences between the cardiac structures more obvious and to make the speed and direction of blood flow more clearly visible, so as to help doctors more easily identify the boundaries between different tissues and structures, as well as to evaluate cardiac hemodynamics and detect valve function. In general, the duration corresponding to different heartbeat cycles of the same patient in a short period of time is often the same. In the process of auxiliary detection of cardiovascular conditions of patients, echocardiograms are often not collected for a long time. Therefore, the duration corresponding to the above-mentioned preset number of heartbeat cycles is often the same.
作为示例,可以通过超声心动图仪器包括的超声探头进行超声波扫描,采集每个预设时刻下待检测患者的超声心动图,作为目标超声心动图。As an example, an ultrasonic probe included in an ultrasonic cardiography instrument may be used to perform ultrasonic scanning to acquire an ultrasonic cardiogram of the patient to be detected at each preset time as a target ultrasonic cardiogram.
需要说明的是,一般来说,在获取超声心动图的过程中,往往需要将患者安置在舒适的体位,为了便于探头的滑动和超声波的传导,往往需要在患者的胸部涂抹适量的凝胶;根据患者的体型、年龄和需要检查的部位,选择适当的超声探头,常用的超声探头包括线性探头和凸面探头;将超声探头放置在患者的胸部,通常是胸骨左侧的心前区,根据需要在不同位置进行扫描,包括胸骨左缘、心尖区等;调整探头的位置和角度,以最佳方式观察心脏结构,需要说明的是,在采集各个目标超声心动图时,探头的位置和角度保持不变,此时探头的位置和角度可以是依据人工经验设置的;然后开始超声波扫描,同时观察超声心动图的实时显示;在扫描过程中,记录心脏收缩和舒张时的结构变化、血流速度和方向等信息影像,构成超声心动图。It should be noted that, generally speaking, in the process of obtaining an echocardiogram, the patient often needs to be placed in a comfortable position. In order to facilitate the sliding of the probe and the conduction of ultrasonic waves, it is often necessary to apply an appropriate amount of gel on the patient's chest; according to the patient's body shape, age and the part to be examined, an appropriate ultrasound probe is selected. Commonly used ultrasound probes include linear probes and convex probes; the ultrasound probe is placed on the patient's chest, usually in the precordial area on the left side of the sternum, and scans are performed at different positions as needed, including the left edge of the sternum, the apex area, etc.; the position and angle of the probe are adjusted to observe the heart structure in the best way. It should be noted that when acquiring each target echocardiogram, the position and angle of the probe remain unchanged. At this time, the position and angle of the probe can be set based on manual experience; then start the ultrasonic scan, and observe the real-time display of the echocardiogram at the same time; during the scan, the structural changes, blood flow velocity and direction during heart contraction and relaxation, and other information images are recorded to form an echocardiogram.
步骤S2,从每个心脏切面图像中筛选出心脏结构轮廓,并根据每个心脏切面图像中心脏结构轮廓上边缘线的数量,以及心脏结构轮廓上像素点之间的灰度差异,确定每个心脏切面图像对应的辨识清晰待增强因子。Step S2, screening out the cardiac structure contour from each cardiac section image, and determining the identification clarity enhancement factor corresponding to each cardiac section image according to the number of edge lines on the cardiac structure contour in each cardiac section image and the grayscale difference between the pixels on the cardiac structure contour.
其中,心脏结构轮廓可以表征心脏结构的边界。需要说明的是,由于环境等多种因素的影响,可能导致心脏结构的边界并不能完全清晰地显示,所以,可能导致心脏结构的边界由多个边缘线构成,因此,心脏结构轮廓上可以包含多个边缘线。The cardiac structure contour may represent the boundary of the cardiac structure. It should be noted that due to the influence of various factors such as the environment, the boundary of the cardiac structure may not be completely clearly displayed, so the boundary of the cardiac structure may be composed of multiple edge lines. Therefore, the cardiac structure contour may include multiple edge lines.
作为示例,从每个心脏切面图像中筛选出心脏结构轮廓的方法可以为:对每个心脏切面图像进行超像素分割,将得到的每个超像素块作为一个心脏结构,并将每个超像素块的边界确定为心脏结构轮廓。As an example, a method for filtering out the cardiac structure contour from each cardiac section image may be: performing superpixel segmentation on each cardiac section image, treating each obtained superpixel block as a cardiac structure, and determining the boundary of each superpixel block as the cardiac structure contour.
可选地,从每个心脏切面图像中筛选出心脏结构轮廓的方法还可以为:将每个心脏切面图像输入预先训练完成的心脏结构轮廓识别网络,并通过预先训练完成的心脏结构轮廓识别网络,识别每个心脏切面图像中的心脏结构轮廓。Optionally, the method for filtering out the cardiac structure contour from each cardiac section image may also be: inputting each cardiac section image into a pre-trained cardiac structure contour recognition network, and identifying the cardiac structure contour in each cardiac section image through the pre-trained cardiac structure contour recognition network.
其中,心脏结构轮廓识别网络可以是用于识别心脏结构轮廓。比如,心脏结构轮廓识别网络可以是CNN(Convolutional Neural Networks,卷积神经网络)。The heart structure contour recognition network may be used to recognize the heart structure contour. For example, the heart structure contour recognition network may be a CNN (Convolutional Neural Networks).
例如,心脏结构轮廓识别网络的训练过程包括以下步骤:For example, the training process of a cardiac structure contour recognition network includes the following steps:
第一步,构建心脏结构轮廓识别网络。The first step is to build a cardiac structure contour recognition network.
比如,可以构建CNN,作为训练前的心脏结构轮廓识别网络。For example, a CNN can be constructed as a pre-trained cardiac structure contour recognition network.
第二步,获取样本心脏切面图像集合。The second step is to obtain a set of sample heart section images.
其中,上述样本心脏切面图像集合中的样本心脏切面图像中标注了心脏结构轮廓。The sample cardiac section images in the sample cardiac section image set are annotated with cardiac structure contours.
第三步,以上述样本心脏切面图像集合为训练集,以样本心脏切面图像中标注的心脏结构轮廓为训练标签,对构建的心脏结构轮廓识别网络进行训练,得到训练完成的心脏结构轮廓识别网络。The third step is to use the above-mentioned sample cardiac section image set as a training set and the cardiac structure contours annotated in the sample cardiac section images as training labels to train the constructed cardiac structure contour recognition network to obtain a trained cardiac structure contour recognition network.
作为又一示例,根据每个心脏切面图像中心脏结构轮廓上边缘线的数量,以及心脏结构轮廓上像素点之间的灰度差异,确定每个心脏切面图像对应的辨识清晰待增强因子的流程可以如图2所示,具体可以包括以下步骤:As another example, according to the number of edge lines on the contour of the cardiac structure in each cardiac section image and the grayscale difference between the pixels on the contour of the cardiac structure, the process of determining the clear identification factor to be enhanced corresponding to each cardiac section image can be shown in FIG. 2, and can specifically include the following steps:
步骤201,将每个心脏结构轮廓上每两个像素点对应的灰度值的差值绝对值,确定为这两个像素点之间的参考灰度差异。Step 201: determine the absolute value of the difference between the grayscale values corresponding to every two pixel points on each cardiac structure contour as the reference grayscale difference between the two pixel points.
步骤202,根据每个心脏结构轮廓上所有像素点之间的参考灰度差异,确定每个心脏结构轮廓对应的灰度代表差异。Step 202: Determine the grayscale representative difference corresponding to each cardiac structure contour according to the reference grayscale difference between all pixel points on each cardiac structure contour.
其中,参考灰度差异可以和灰度代表差异呈正相关关系。Among them, the reference grayscale difference can be positively correlated with the grayscale representative difference.
步骤203,对每个心脏结构轮廓进行边缘检测,得到边缘线,并根据每个心脏结构轮廓上边缘线的数量和其对应的灰度代表差异,确定每个心脏结构轮廓对应的边缘辨识待调整指标。Step 203 , edge detection is performed on each cardiac structure contour to obtain edge lines, and the edge recognition index to be adjusted corresponding to each cardiac structure contour is determined according to the number of edge lines on each cardiac structure contour and the corresponding grayscale representative difference.
其中,心脏结构轮廓上边缘线的数量和其对应的灰度代表差异均可以与其对应的边缘辨识待调整指标呈正相关关系。Among them, the number of edge lines on the contour of the heart structure and the corresponding grayscale representative differences can be positively correlated with the corresponding edge recognition index to be adjusted.
例如,确定心脏结构轮廓对应的边缘辨识待调整指标对应的公式可以为:For example, the formula for determining the edge recognition index to be adjusted corresponding to the cardiac structure contour may be:
其中,JVr是心脏切面图像中第r个心脏结构轮廓对应的边缘辨识待调整指标。r是心脏切面图像中心脏结构轮廓的序号。Gr是心脏切面图像中第r个心脏结构轮廓上边缘线的数量。nr是心脏切面图像中第r个心脏结构轮廓上像素点的数量。i和j是心脏切面图像中第r个心脏结构轮廓上不同像素点的序号。||是取绝对值函数。gri是心脏切面图像中第r个心脏结构轮廓上第i个像素点对应的灰度值。grj是心脏切面图像中第r个心脏结构轮廓上第j个像素点对应的灰度值。|gri-grj|是第i个像素点和第j个像素点之间的参考灰度差异。是心脏切面图像中第r个心脏结构轮廓对应的灰度代表差异。 Wherein, JV r is the edge recognition index to be adjusted corresponding to the r-th cardiac structure contour in the cardiac section image. r is the serial number of the cardiac structure contour in the cardiac section image. G r is the number of edge lines on the r-th cardiac structure contour in the cardiac section image. n r is the number of pixels on the r-th cardiac structure contour in the cardiac section image. i and j are the serial numbers of different pixels on the r-th cardiac structure contour in the cardiac section image. || is the absolute value function. g ri is the grayscale value corresponding to the i-th pixel on the r-th cardiac structure contour in the cardiac section image. g rj is the grayscale value corresponding to the j-th pixel on the r-th cardiac structure contour in the cardiac section image. |g ri -g rj | is the reference grayscale difference between the i-th pixel and the j-th pixel. It is the grayscale representation difference corresponding to the rth cardiac structure contour in the cardiac section image.
需要说明的是,当Gr越大时,往往说明第r个心脏结构轮廓上的边缘线越不连续,往往说明第r个心脏结构轮廓的可辨识度越低,往往说明第r个心脏结构轮廓所属心脏切面图像的分辨率可能越低。当越大时,往往说明第r个心脏结构轮廓上的灰度分布越不均匀,往往说明第r个心脏结构轮廓的可辨识度越低,往往说明第r个心脏结构轮廓所属心脏切面图像的分辨率可能越低。因此,当JVr越大时,往往说明第r个心脏结构轮廓上的边缘线越不连续,并且第r个心脏结构轮廓上的灰度分布越不均匀;往往说明第r个心脏结构轮廓的可辨识度越低,往往说明第r个心脏结构轮廓所属心脏切面图像的分辨率可能越低。It should be noted that when G r is larger, it often means that the edge line on the r-th cardiac structure contour is more discontinuous, the recognizability of the r-th cardiac structure contour is lower, and the resolution of the cardiac section image to which the r-th cardiac structure contour belongs may be lower. When JV r is larger, it often indicates that the grayscale distribution on the r-th cardiac structure contour is more uneven, the recognizability of the r-th cardiac structure contour is lower, and the resolution of the cardiac section image to which the r-th cardiac structure contour belongs may be lower. Therefore, when JV r is larger, it often indicates that the edge line on the r-th cardiac structure contour is more discontinuous, and the grayscale distribution on the r-th cardiac structure contour is more uneven; it often indicates that the recognizability of the r-th cardiac structure contour is lower, and the resolution of the cardiac section image to which the r-th cardiac structure contour belongs may be lower.
步骤204,根据每个心脏切面图像中所有心脏结构轮廓对应的边缘辨识待调整指标,以及每个心脏切面图像中各个心脏结构轮廓上像素点对应的灰度值,确定每个心脏切面图像对应的辨识清晰待增强因子。Step 204, determining the identification clarity enhancement factor corresponding to each cardiac section image according to the edge identification adjustment index corresponding to all cardiac structure contours in each cardiac section image and the grayscale value corresponding to the pixel points on each cardiac structure contour in each cardiac section image.
例如,根据每个心脏切面图像中所有心脏结构轮廓对应的边缘辨识待调整指标,以及每个心脏切面图像中各个心脏结构轮廓上像素点对应的灰度值,确定每个心脏切面图像对应的辨识清晰待增强因子的流程可以如图3所示,具体可以包括以下步骤:For example, according to the edge recognition indexes to be adjusted corresponding to all cardiac structure contours in each cardiac section image, and the grayscale values corresponding to the pixels on the contours of each cardiac structure in each cardiac section image, the process of determining the recognition clarity factor to be enhanced corresponding to each cardiac section image can be shown in FIG. 3, and can specifically include the following steps:
步骤301,将每个心脏结构轮廓上所有像素点对应的预设邻域的并集,确定为每个心脏结构轮廓对应的参考邻域。Step 301: determine the union of preset neighborhoods corresponding to all pixel points on each cardiac structure contour as a reference neighborhood corresponding to each cardiac structure contour.
其中,预设邻域可以是预先设置的邻域。比如,预设邻域可以是5×5邻域。The preset neighborhood may be a preset neighborhood, for example, a 5×5 neighborhood.
步骤302,根据每个心脏结构轮廓及其对应的参考邻域和边缘辨识待调整指标,确定每个心脏结构轮廓对应的轮廓待调整指标。Step 302: Determine the contour index to be adjusted corresponding to each cardiac structure contour according to each cardiac structure contour and its corresponding reference neighborhood and edge identification index to be adjusted.
例如,轮廓待调整指标确定方法的流程可以如图4所示,具体可以包括以下步骤:For example, the process of the method for determining the index to be adjusted of the profile may be as shown in FIG4 , and may specifically include the following steps:
步骤401,将每个心脏结构轮廓上所有像素点对应的灰度值的均值,确定为每个心脏结构轮廓对应的第一灰度代表因子。Step 401: determine the mean value of the grayscale values corresponding to all the pixels on each cardiac structure contour as the first grayscale representative factor corresponding to each cardiac structure contour.
步骤402,将每个心脏结构轮廓对应的参考邻域内所有像素点对应的灰度值的均值,确定为每个心脏结构轮廓对应的第二灰度代表因子。Step 402: Determine the average of the grayscale values corresponding to all pixels in the reference neighborhood corresponding to each cardiac structure contour as a second grayscale representative factor corresponding to each cardiac structure contour.
步骤403,将每个心脏结构轮廓对应的第一灰度代表因子和第二灰度代表因子之间的差异,确定为每个心脏结构轮廓对应的灰度对比差异。Step 403: Determine the difference between the first grayscale representative factor and the second grayscale representative factor corresponding to each cardiac structure contour as the grayscale contrast difference corresponding to each cardiac structure contour.
比如,可以将每个心脏结构轮廓对应的第一灰度代表因子和第二灰度代表因子之间的差值,确定为每个心脏结构轮廓对应的灰度对比差异。For example, the difference between the first grayscale representative factor and the second grayscale representative factor corresponding to each cardiac structure contour may be determined as the grayscale contrast difference corresponding to each cardiac structure contour.
又如,可以将每个心脏结构轮廓对应的第一灰度代表因子和第二灰度代表因子之间的差值绝对值,确定为每个心脏结构轮廓对应的灰度对比差异。For another example, the absolute value of the difference between the first grayscale representative factor and the second grayscale representative factor corresponding to each cardiac structure contour may be determined as the grayscale contrast difference corresponding to each cardiac structure contour.
需要说明的是,一般来说,心脏结构轮廓往往比其周围区域亮,所以心脏结构轮廓的灰度往往比其周围区域的灰度高,因此,计算两者差异时可以通过差值计算也可以通过差值的绝对值计算,此时两者差异也就是灰度对比差异。It should be noted that, generally speaking, the outline of the heart structure is often brighter than its surrounding area, so the grayscale of the outline of the heart structure is often higher than the grayscale of the surrounding area. Therefore, when calculating the difference between the two, the difference can be calculated by difference calculation or by the absolute value of the difference. At this time, the difference between the two is the grayscale contrast difference.
步骤404,根据每个心脏结构轮廓对应的边缘辨识待调整指标和灰度对比差异,确定每个心脏结构轮廓对应的轮廓待调整指标。Step 404 , determining the contour index to be adjusted corresponding to each cardiac structure contour according to the edge recognition index to be adjusted and the grayscale contrast difference corresponding to each cardiac structure contour.
其中,边缘辨识待调整指标可以与轮廓待调整指标呈正相关关系。灰度对比差异可以与轮廓待调整指标呈负相关关系。The edge identification index to be adjusted may be positively correlated with the contour index to be adjusted, and the grayscale contrast difference may be negatively correlated with the contour index to be adjusted.
步骤303,根据每个心脏切面图像中所有心脏结构轮廓对应的轮廓待调整指标,确定每个心脏切面图像对应的辨识清晰待增强因子。Step 303 , determining a recognition clarity factor to be enhanced corresponding to each cardiac section image according to the contour adjustment indicators corresponding to all cardiac structure contours in each cardiac section image.
其中,轮廓待调整指标可以和辨识清晰待增强因子呈正相关关系。Among them, the contour index to be adjusted can be positively correlated with the identification clarity factor to be enhanced.
比如,确定心脏切面图像对应的辨识清晰待增强因子对应的公式可以为:For example, the formula for determining the clear identification factor to be enhanced corresponding to the cardiac section image can be:
其中,Ea是第a个心脏切面图像对应的辨识清晰待增强因子。a是心脏切面图像的序号。Ra是第a个心脏切面图像中心脏结构轮廓的数量。r是心脏切面图像中心脏结构轮廓的序号。JVar是第a个心脏切面图像中第r个心脏结构轮廓对应的边缘辨识待调整指标。har1是第a个心脏切面图像中第r个心脏结构轮廓对应的第一灰度代表因子。har2是第a个心脏切面图像中第r个心脏结构轮廓对应的第二灰度代表因子。是预先设置的大于0的因子,主要用于防止分母为0,如,可以为0.001。har1-har2可以表征第r个心脏结构轮廓对应的灰度对比差异。可以表征第r个心脏结构轮廓对应的轮廓待调整指标。 Wherein, E a is the identification clarity enhancement factor corresponding to the a-th cardiac section image. a is the serial number of the cardiac section image. Ra is the number of cardiac structure contours in the a-th cardiac section image. r is the serial number of the cardiac structure contour in the cardiac section image. JV ar is the edge identification adjustment index corresponding to the r-th cardiac structure contour in the a-th cardiac section image. h ar1 is the first grayscale representative factor corresponding to the r-th cardiac structure contour in the a-th cardiac section image. h ar2 is the second grayscale representative factor corresponding to the r-th cardiac structure contour in the a-th cardiac section image. It is a pre-set factor greater than 0, mainly used to prevent the denominator from being 0, such as, It can be 0.001. h ar1 -h ar2 can represent the grayscale contrast difference corresponding to the r-th cardiac structure contour. The contour index to be adjusted corresponding to the r-th cardiac structure contour can be represented.
需要说明的是,当JVar越大时,往往说明第a个心脏切面图像中第r个心脏结构轮廓的可辨识度越低。当har1-har2越大时,往往说明第a个心脏切面图像中第r个心脏结构轮廓的亮度相对越高于其周围区域的亮度,往往说明越能够清晰地把第r个心脏结构轮廓表征的心脏结构分割出来,往往说明第a个心脏切面图像中第r个心脏结构轮廓的可辨识度越高。因此,当Ea越大时,往往说明第a个心脏切面图像中心脏结构轮廓的可辨识度相对越低,往往说明第a个心脏切面图像的分辨率可能越低。It should be noted that when JV ar is larger, it often indicates that the recognizability of the r-th cardiac structure contour in the a-th cardiac section image is lower. When har1 -har2 is larger, it often indicates that the brightness of the r-th cardiac structure contour in the a-th cardiac section image is relatively higher than the brightness of its surrounding area, which often indicates that the cardiac structure represented by the r-th cardiac structure contour can be more clearly segmented, and often indicates that the recognizability of the r-th cardiac structure contour in the a-th cardiac section image is higher. Therefore, when E a is larger, it often indicates that the recognizability of the cardiac structure contour in the a-th cardiac section image is relatively lower, which often indicates that the resolution of the a-th cardiac section image may be lower.
步骤S3,根据每个心跳周期与其他心跳周期内目标超声心动图之间的灰度差异,以及待检测患者对应的体征信息,确定每个心跳周期对应的低分辨因子。Step S3, determining a low-resolution factor corresponding to each heartbeat cycle according to the grayscale difference between each heartbeat cycle and the target echocardiogram in other heartbeat cycles, and the corresponding physical sign information of the patient to be tested.
作为示例,低分辨因子确定方法的流程可以如图5所示,具体可以包括以下步骤:As an example, the process of the method for determining the low resolution factor may be shown in FIG5 , and may specifically include the following steps:
步骤501,根据每两个心跳周期内目标超声心动图之间的灰度差异,确定每两个心跳周期之间的信息变化量。Step 501, determining the information change amount between every two heartbeat cycles according to the grayscale difference between the target echocardiograms within every two heartbeat cycles.
例如,确定每两个心跳周期之间的信息变化量可以包括以下步骤:For example, determining the amount of information change between every two heartbeat cycles may include the following steps:
第一步,将任意一个心跳周期确定为标记周期,将上述标记周期之外的任意一个心跳周期确定为参考周期,将上述标记周期内任意一帧目标超声心动图确定为标记图像,并从上述参考周期内筛选出对应的帧序号与上述标记图像对应的帧序号相同的目标超声心动图,作为参考图像。In the first step, any heartbeat cycle is determined as a marking cycle, any heartbeat cycle other than the marking cycle is determined as a reference cycle, any frame of target echocardiogram within the marking cycle is determined as a marking image, and a target echocardiogram whose corresponding frame number is the same as the frame number corresponding to the marking image is screened out from the reference cycle as a reference image.
其中,目标超声心动图在其所属心跳周期内采集的序号,即为目标超声心动图对应的帧序号。比如,心跳周期内采集的第一帧目标超声心动图对应的帧序号可以为1。又如,参考周期内第一帧目标超声心动图对应的帧序号,可以等于标记周期内第一帧目标超声心动图对应的帧序号。The serial number of the target echocardiogram collected in the heartbeat cycle to which it belongs is the frame serial number corresponding to the target echocardiogram. For example, the frame serial number corresponding to the first frame of the target echocardiogram collected in the heartbeat cycle may be 1. For another example, the frame serial number corresponding to the first frame of the target echocardiogram in the reference cycle may be equal to the frame serial number corresponding to the first frame of the target echocardiogram in the marking cycle.
第二步,将上述标记图像对应的平均灰度与上述参考图像对应的平均灰度之间的差值绝对值,确定为上述标记图像与上述参考图像之间的目标灰度差异。In the second step, the absolute value of the difference between the average grayscale corresponding to the marked image and the average grayscale corresponding to the reference image is determined as the target grayscale difference between the marked image and the reference image.
其中,标记图像对应的平均灰度可以为标记图像中所有像素点对应的灰度值的均值。参考图像对应的平均灰度可以为参考图像中所有像素点对应的灰度值的均值。The average grayscale corresponding to the marked image may be the average of the grayscale values corresponding to all pixels in the marked image. The average grayscale corresponding to the reference image may be the average of the grayscale values corresponding to all pixels in the reference image.
第三步,将上述标记图像对应的灰度方差与上述参考图像对应的灰度方差之间的差值绝对值,确定为上述标记图像与上述参考图像之间的灰度分布差异。In the third step, the absolute value of the difference between the grayscale variance corresponding to the marked image and the grayscale variance corresponding to the reference image is determined as the grayscale distribution difference between the marked image and the reference image.
其中,标记图像对应的灰度方差可以是标记图像中所有像素点对应的灰度值的方差。参考图像对应的灰度方差可以是参考图像中所有像素点对应的灰度值的方差。The grayscale variance corresponding to the marked image may be the variance of the grayscale values corresponding to all pixels in the marked image, and the grayscale variance corresponding to the reference image may be the variance of the grayscale values corresponding to all pixels in the reference image.
第四步,根据上述标记图像与上述参考图像之间的目标灰度差异,以及上述标记图像与上述参考图像之间的灰度分布差异,确定上述标记图像与上述参考图像之间的目标差异因子。In the fourth step, a target difference factor between the marked image and the reference image is determined according to the target grayscale difference between the marked image and the reference image, and the grayscale distribution difference between the marked image and the reference image.
其中,目标灰度差异和灰度分布差异均可以与目标差异因子呈正相关关系。Among them, both the target grayscale difference and the grayscale distribution difference can be positively correlated with the target difference factor.
第五步,根据每两个心跳周期内的所有目标差异因子,确定每两个心跳周期之间的信息变化量。The fifth step is to determine the information change between every two heartbeat cycles based on all target difference factors within every two heartbeat cycles.
其中,目标差异因子可以与信息变化量呈正相关关系。Among them, the target difference factor can be positively correlated with the amount of information change.
比如,确定任意两个心跳周期之间的信息变化量对应的公式可以为:For example, the formula for determining the information change between any two heartbeat cycles can be:
其中,JBfk是第f个心跳周期与第k个心跳周期之间的信息变化量。f和k是不同心跳周期的序号。M是心跳周期内目标超声心动图的总数。m是心跳周期内目标超声心动图的序号。||是取绝对值函数。hfm是第f个心跳周期内第m帧目标超声心动图对应的平均灰度。hkm是第k个心跳周期内第m帧目标超声心动图对应的平均灰度。σfm是第f个心跳周期内第m帧目标超声心动图对应的灰度方差。σkm是第k个心跳周期内第m帧目标超声心动图对应的灰度方差。|hfm-hkm|是第f个心跳周期内第m帧目标超声心动图,与第k个心跳周期内第m帧目标超声心动图之间的目标灰度差异。|σfm-σkm|是第f个心跳周期内第m帧目标超声心动图,与第k个心跳周期内第m帧目标超声心动图之间的灰度分布差异。|hfm-hkm|×|σfm-σkm|是第f个心跳周期内第m帧目标超声心动图,与第k个心跳周期内第m帧目标超声心动图之间的目标差异因子。 Wherein, JB fk is the information change between the f-th heart cycle and the k-th heart cycle. f and k are the serial numbers of different heart cycles. M is the total number of target echocardiograms within the heart cycle. m is the serial number of the target echocardiogram within the heart cycle. || is the absolute value function. h f m is the average grayscale corresponding to the m-th frame target echocardiogram within the f-th heart cycle. h km is the average grayscale corresponding to the m-th frame target echocardiogram within the k-th heart cycle. σ fm is the grayscale variance corresponding to the m-th frame target echocardiogram within the f-th heart cycle. σ km is the grayscale variance corresponding to the m-th frame target echocardiogram within the k-th heart cycle. |h fm -h km | is the target grayscale difference between the m-th frame target echocardiogram within the f-th heart cycle and the m-th frame target echocardiogram within the k-th heart cycle. |σ fm -σ km | is the grayscale distribution difference between the target echocardiogram of the mth frame in the fth heartbeat cycle and the target echocardiogram of the mth frame in the kth heartbeat cycle. |h fm -h km |×|σ fm -σ km | is the target difference factor between the target echocardiogram of the mth frame in the fth heartbeat cycle and the target echocardiogram of the mth frame in the kth heartbeat cycle.
需要说明的是,当|hfm-hkm|越大时,往往说明第f个心跳周期和第k个心跳周期内第m帧目标超声心动图之间呈现的整体灰度越不相似。当|σfm-σkm|越大时,往往说明第f个心跳周期和第k个心跳周期内第m帧目标超声心动图之间的灰度分布相对越不相似。一般情况下,同一个患者在短时间段内对应的不同心跳周期往往具有相似性,其采集的不同心跳周期内的实际信息分布往往相似,当拍摄的不同心跳周期内的超声心动图的灰度变化较大时,往往可能是由于环境等因素的影响,导致不同心跳周期内采集的超声心动图的分辨率不同,从而导致不同心跳周期内超声心动图呈现的灰度分布不同。当JBfk越大时,往往说明第f个心跳周期和第k个心跳周期之间的灰度分布变化越不相似,往往说明第f个心跳周期和第k个心跳周期之间的信息变化量越大,往往说明第f个心跳周期和第k个心跳周期内越可能存在分辨率低的超声心动图。It should be noted that when |h fm -h km | is larger, it often means that the overall grayscale presented between the target echocardiogram of the mth frame in the fth heartbeat cycle and the kth heartbeat cycle is less similar. When |σ fm -σ km | is larger, it often means that the grayscale distribution between the target echocardiogram of the mth frame in the fth heartbeat cycle and the kth heartbeat cycle is relatively less similar. Generally, different heartbeat cycles corresponding to the same patient in a short period of time are often similar, and the actual information distribution in different heartbeat cycles collected is often similar. When the grayscale of the ultrasound cardiograms taken in different heartbeat cycles varies greatly, it may often be due to the influence of factors such as the environment, resulting in different resolutions of the ultrasound cardiograms collected in different heartbeat cycles, thereby resulting in different grayscale distributions presented in the ultrasound cardiograms in different heartbeat cycles. When JB fk is larger, it often means that the grayscale distribution changes between the f-th heartbeat cycle and the k-th heartbeat cycle are more dissimilar, it often means that the information change between the f-th heartbeat cycle and the k-th heartbeat cycle is larger, and it often means that there is more likely to be low-resolution echocardiograms in the f-th heartbeat cycle and the k-th heartbeat cycle.
步骤502,根据待检测患者对应的体征信息,确定待检测患者对应的分辨率评估值。Step 502: Determine a resolution evaluation value corresponding to the patient to be detected based on the physical sign information corresponding to the patient to be detected.
其中,体征信息可以是与人体相关的信息。比如,体征信息可以包括但不限于:身高、体重、心脏位置和大小、胸壁结构、肺部状况、血流状况、皮肤和软组织条件。分辨率评估值可以表征采集的患者超声心动图的分辨率较低的可能性。The physical sign information may be information related to the human body. For example, the physical sign information may include, but is not limited to, height, weight, heart position and size, chest wall structure, lung condition, blood flow condition, skin and soft tissue condition. The resolution evaluation value may indicate the possibility that the acquired patient echocardiogram has a low resolution.
需要说明的是,患者的体征往往影响其对应的超声心动图的分辨率。比如,若患者较肥胖,则采集的该患者的超声心动图的分辨率往往相对较低。It should be noted that the patient's physical signs often affect the resolution of the corresponding echocardiogram. For example, if the patient is obese, the resolution of the echocardiogram collected from the patient is often relatively low.
例如,可以将上述待检测患者对应的体征信息输入预先训练完成的分辨率评估网络,并通过预先训练完成的分辨率评估网络,输出上述待检测患者对应的分辨率评估值。For example, the vital sign information corresponding to the patient to be detected may be input into a pre-trained resolution evaluation network, and the resolution evaluation value corresponding to the patient to be detected may be output through the pre-trained resolution evaluation network.
其中,分辨率评估网络可以是用于分辨率评估的网络。比如,分辨率评估网络可以是FNN(FeedforwardNeural Network,全连接神经网络)。The resolution evaluation network may be a network used for resolution evaluation, for example, a FNN (Feedforward Neural Network, fully connected neural network).
比如,分辨率评估网络的训练过程可以包括以下步骤:For example, the training process of the resolution assessment network may include the following steps:
第一步,构建分辨率评估网络。The first step is to build a resolution evaluation network.
如,可以构建FNN,作为训练前的分辨率评估网络。For example, an FNN can be constructed as a resolution evaluation network before training.
第二步,获取样本体征信息集合。The second step is to obtain a set of sample vital signs information.
其中,上述样本体征信息集合中的样本体征信息对应的分辨率评估值已知。Among them, the resolution evaluation value corresponding to the sample vital sign information in the above sample vital sign information set is known.
如,可以通过多名医生,基于样本体征信息进行图像低分辨可能性的评估,将得到的该样本体征信息对应的所有评估值的均值,确定为该样本体征信息对应的分辨率评估值。其中,通过医生得到的评估值的取值范围可以为[0,1],并且评估值越大时,往往说明采集患者超声心动图时产生分辨率较低的可能性越大。For example, multiple doctors can evaluate the possibility of low image resolution based on sample vital sign information, and determine the average of all evaluation values corresponding to the sample vital sign information as the resolution evaluation value corresponding to the sample vital sign information. The evaluation value obtained by the doctors can be in the range of [0, 1], and the larger the evaluation value, the greater the possibility of low resolution when acquiring the patient's echocardiogram.
第三步,以上述样本体征信息集合为训练集,以样本体征信息对应的分辨率评估值为训练标签,对构建的分辨率评估网络进行训练,得到训练完成的分辨率评估网络。In the third step, the constructed resolution assessment network is trained using the above sample vital sign information set as a training set and the resolution assessment value corresponding to the sample vital sign information as a training label to obtain a trained resolution assessment network.
步骤503,根据分辨率评估值,以及每个心跳周期与其他心跳周期之间的信息变化量,确定每个心跳周期对应的低分辨因子。Step 503: Determine a low resolution factor corresponding to each heartbeat cycle according to the resolution evaluation value and the information change amount between each heartbeat cycle and other heartbeat cycles.
其中,信息变化量和分辨率评估值均可以与低分辨因子呈正相关关系。Among them, both the information change amount and the resolution evaluation value can be positively correlated with the low resolution factor.
例如,确定心跳周期对应的低分辨因子对应的公式可以为:For example, the formula for determining the low-resolution factor corresponding to the heartbeat cycle may be:
其中,JGf是第f个心跳周期对应的低分辨因子。f和k是不同心跳周期的序号。N是预设数量,也就是获取的心跳周期的数量。JBfk是第f个心跳周期与第k个心跳周期之间的信息变化量。P是待检测患者对应的分辨率评估值。 Wherein, JG f is the low resolution factor corresponding to the f-th heartbeat cycle. f and k are the serial numbers of different heartbeat cycles. N is the preset number, that is, the number of heartbeat cycles obtained. JB fk is the information change between the f-th heartbeat cycle and the k-th heartbeat cycle. P is the resolution evaluation value corresponding to the patient to be tested.
需要说明的是,一般情况下,采集患者的超声心动图时医生往往会将超声探头放置于相对合适的位置,所以,采集的同一个患者的不同心跳周期内相同帧序号的超声心动图往往比较相似,若某个心跳周期内的超声心动图与其他心跳周期内相同帧序号的超声心动图越不相似,则往往说明可能由于环境等因素的影响导致该心跳周期内的超声心动图发生了异常。在实际情况中超声心动图发生异常时往往会使其分辨率变得更低,往往不会使其分辨率变高。并且当P越大时,往往说明采集的待检测患者超声心动图的分辨率可能越低,往往说明对目标超声心动图进行上采样时越需要为高斯插值核设置较高的标准差。因此,当JGf越大时,往往说明第f个心跳周期内的超声心动图与其他心跳周期内的超声心动图越不相似,并且采集的待检测患者超声心动图的分辨率可能越低;往往说明对第f个心跳周期内的目标超声心动图进行上采样时越需要为高斯插值核设置较高的标准差。It should be noted that, in general, when collecting the patient's echocardiogram, the doctor often places the ultrasound probe in a relatively suitable position. Therefore, the ultrasound cardiograms of the same patient with the same frame number in different heartbeat cycles are often similar. If the ultrasound cardiogram in a certain heartbeat cycle is less similar to the ultrasound cardiograms with the same frame number in other heartbeat cycles, it often indicates that the ultrasound cardiogram in the heartbeat cycle may be abnormal due to the influence of environmental factors. In actual situations, when the ultrasound cardiogram is abnormal, its resolution often becomes lower, and it often does not increase its resolution. And when P is larger, it often indicates that the resolution of the collected ultrasound cardiogram of the patient to be tested may be lower, and it often indicates that when upsampling the target ultrasound cardiogram, it is necessary to set a higher standard deviation for the Gaussian interpolation kernel. Therefore, when JG f is larger, it often means that the echocardiogram in the f-th heart cycle is less similar to the echocardiograms in other heart cycles, and the resolution of the acquired echocardiogram of the patient to be tested may be lower; it often means that when upsampling the target echocardiogram in the f-th heart cycle, it is necessary to set a higher standard deviation for the Gaussian interpolation kernel.
步骤S4,根据每帧目标超声心动图包含的心脏切面图像对应的辨识清晰待增强因子,以及每帧目标超声心动图所属心跳周期对应的低分辨因子,确定每帧目标超声心动图对应的目标标准差。Step S4, determining the target standard deviation corresponding to each frame of the target echocardiogram according to the identification clarity factor to be enhanced corresponding to the cardiac section image contained in each frame of the target echocardiogram and the low resolution factor corresponding to the heart cycle to which each frame of the target echocardiogram belongs.
作为示例,可以将每帧目标超声心动图包含的心脏切面图像对应的辨识清晰待增强因子,与每帧目标超声心动图所属心跳周期对应的低分辨因子之间的欧式范数,确定为每帧目标超声心动图对应的目标标准差。As an example, the Euclidean norm between the clear identification factor to be enhanced corresponding to the cardiac section image contained in each frame of the target echocardiogram and the low resolution factor corresponding to the heart cycle to which each frame of the target echocardiogram belongs can be determined as the target standard deviation corresponding to each frame of the target echocardiogram.
其中,欧式范数,又称为欧氏范数。Among them, the Euclidean norm is also called the Euclidean norm.
例如,确定目标超声心动图对应的目标标准差对应的公式可以为:For example, the formula for determining the target standard deviation corresponding to the target echocardiogram may be:
其中,Tm是心跳周期内第m帧目标超声心动图对应的目标标准差。m是心跳周期内目标超声心动图的序号。Em是心跳周期内第m帧目标超声心动图包含的心脏切面图像对应的辨识清晰待增强因子。JGm是心跳周期内第m帧目标超声心动图所属心跳周期对应的低分辨因子。 Wherein, T m is the target standard deviation corresponding to the target echocardiogram of the mth frame in the cardiac cycle. m is the serial number of the target echocardiogram in the cardiac cycle. E m is the identification clear enhancement factor corresponding to the cardiac section image contained in the target echocardiogram of the mth frame in the cardiac cycle. JG m is the low resolution factor corresponding to the cardiac cycle to which the target echocardiogram of the mth frame in the cardiac cycle belongs.
需要说明的是,当Em越大时,往往说明第m帧目标超声心动图包含的心脏切面图像中心脏结构轮廓的可辨识度相对越低,往往说明第m帧目标超声心动图的分辨率可能越低,往往说明对第m帧目标超声心动图进行上采样时越需要为高斯插值核设置较高的标准差。当JGm越大时,往往说明第m帧目标超声心动图所属心跳周期内的超声心动图与其他心跳周期内的超声心动图越不相似,并且采集的待检测患者超声心动图的分辨率可能越低;往往说明对第m帧目标超声心动图所属心跳周期内的目标超声心动图进行上采样时越需要为高斯插值核设置较高的标准差,往往说明对第m帧目标超声心动图进行上采样时越需要为高斯插值核设置较高的标准差。因此,Tm可以表征对第m帧目标超声心动图进行上采样时需要为高斯插值核设置的标准差。It should be noted that when Em is larger, it often means that the recognizability of the cardiac structure contour in the cardiac section image contained in the target echocardiogram of the mth frame is relatively low, it often means that the resolution of the target echocardiogram of the mth frame may be lower, and it often means that a higher standard deviation needs to be set for the Gaussian interpolation kernel when upsampling the target echocardiogram of the mth frame. When JGm is larger, it often means that the echocardiogram within the heartbeat cycle to which the target echocardiogram of the mth frame belongs is less similar to the echocardiograms within other heartbeat cycles, and the resolution of the acquired patient's ultrasound cardiogram may be lower; it often means that a higher standard deviation needs to be set for the Gaussian interpolation kernel when upsampling the target echocardiogram within the heartbeat cycle to which the target echocardiogram of the mth frame belongs, and it often means that a higher standard deviation needs to be set for the Gaussian interpolation kernel when upsampling the target echocardiogram of the mth frame. Therefore, Tm can represent the standard deviation that needs to be set for the Gaussian interpolation kernel when upsampling the target echocardiogram of the mth frame.
步骤S5,根据每帧目标超声心动图对应的目标标准差,通过高斯插值核,对每帧目标超声心动图进行上采样,得到目标图像。Step S5, upsampling each frame of the target echocardiogram through a Gaussian interpolation kernel according to the target standard deviation corresponding to each frame of the target echocardiogram to obtain a target image.
其中,目标标准差是高斯插值核所服从的标准差。上采样,又称为上采样插值或图像金子塔算法。The target standard deviation is the standard deviation obeyed by the Gaussian interpolation kernel. Upsampling is also called upsampling interpolation or image pyramid algorithm.
作为示例,在对任意一帧目标超声心动图进行上采样时,可以将该目标超声心动图对应的目标标准差作为高斯插值核所需要服从的标准差,通过高斯插值核,可以实现对该目标超声心动图的上采样,并将上采样后得到的图像确定为目标图像,医生可以通过观察所有的目标图像,对上述待检测患者的心血管状况进行初步诊断。As an example, when upsampling any frame of target echocardiogram, the target standard deviation corresponding to the target echocardiogram can be used as the standard deviation that the Gaussian interpolation kernel needs to obey. Through the Gaussian interpolation kernel, upsampling of the target echocardiogram can be achieved, and the image obtained after upsampling can be determined as the target image. The doctor can make a preliminary diagnosis of the cardiovascular condition of the patient to be tested by observing all the target images.
具体地,根据每帧目标超声心动图对应的目标标准差,通过高斯插值核,对每帧目标超声心动图进行上采样可以包括:对一个心跳周期内的所有帧目标超声心动图来说,可以在图像矩阵中相邻的行和列分别加入空白格,并且保证图像的大小一致,将高斯核,作为上采样插值过程中的插值核,将Tm作为心跳周期内第m帧目标超声心动图的插值核所服从的标准差,高斯核会生成一组服从该标准差的卷积核的权重,然后作为插入原图像中的空白格与邻域像素点进行卷积的权重值,进而获取插入的空白格表示的像素点的像素值,从而完成对每帧目标超声心动图的上采样插值,以增强目标超声心动图的分辨率。Specifically, according to the target standard deviation corresponding to each frame of the target echocardiogram, upsampling each frame of the target echocardiogram through the Gaussian interpolation kernel may include: for all frames of the target echocardiogram within a heartbeat cycle, blank cells may be added to adjacent rows and columns in the image matrix, and the size of the image is ensured to be consistent, and the Gaussian kernel is used as the interpolation kernel in the upsampling interpolation process, and T m is used as the standard deviation obeyed by the interpolation kernel of the mth frame of the target echocardiogram within the heartbeat cycle. The Gaussian kernel will generate a set of convolution kernel weights that obey the standard deviation, and then use them as weight values for convolving the blank cells inserted into the original image with the neighboring pixel points, thereby obtaining the pixel values of the pixel points represented by the inserted blank cells, thereby completing the upsampling interpolation of each frame of the target echocardiogram to enhance the resolution of the target echocardiogram.
参考图6,基于与上述方法实施例相同的发明构思,本发明提供了一种用于内科的心血管状况辅助检测系统,该系统包括存储器、处理器以及存储在存储器上并可在处理器上运行的计算机程序,上述计算机程序被处理器执行时实现一种用于内科的心血管状况辅助检测系统的步骤,具体可以包括:Referring to FIG6 , based on the same inventive concept as the above method embodiment, the present invention provides a cardiovascular condition auxiliary detection system for internal medicine, the system comprising a memory, a processor, and a computer program stored in the memory and executable on the processor. When the above computer program is executed by the processor, the steps of implementing a cardiovascular condition auxiliary detection system for internal medicine may specifically include:
图像获取模块601,用于获取待检测患者在预设数量个心跳周期内每个预设时刻下的目标超声心动图,其中,目标超声心动图包含心脏切面图像;An image acquisition module 601 is used to acquire a target echocardiogram of a patient to be tested at each preset time within a preset number of heartbeat cycles, wherein the target echocardiogram includes a heart section image;
筛选确定模块602,用于从每个心脏切面图像中筛选出心脏结构轮廓,并根据每个心脏切面图像中心脏结构轮廓上边缘线的数量,以及心脏结构轮廓上像素点之间的灰度差异,确定每个心脏切面图像对应的辨识清晰待增强因子;A screening and determination module 602 is used to screen out the cardiac structure contour from each cardiac section image, and determine the identification clarity enhancement factor corresponding to each cardiac section image according to the number of edge lines on the cardiac structure contour in each cardiac section image and the grayscale difference between the pixels on the cardiac structure contour;
分辨因子确定模块603,用于根据每个心跳周期与其他心跳周期内目标超声心动图之间的灰度差异,以及上述待检测患者对应的体征信息,确定每个心跳周期对应的低分辨因子;The resolution factor determination module 603 is used to determine the low resolution factor corresponding to each heartbeat cycle according to the grayscale difference between each heartbeat cycle and the target echocardiogram in other heartbeat cycles, and the physical sign information corresponding to the patient to be detected;
标准差确定模块604,用于根据每帧目标超声心动图包含的心脏切面图像对应的辨识清晰待增强因子,以及每帧目标超声心动图所属心跳周期对应的低分辨因子,确定每帧目标超声心动图对应的目标标准差;The standard deviation determination module 604 is used to determine the target standard deviation corresponding to each frame of the target echocardiogram according to the identification clarity factor to be enhanced corresponding to the cardiac section image contained in each frame of the target echocardiogram and the low resolution factor corresponding to the heart cycle to which each frame of the target echocardiogram belongs;
上采样模块605,用于根据每帧目标超声心动图对应的目标标准差,通过高斯插值核,对每帧目标超声心动图进行上采样,得到目标图像,其中,目标标准差是高斯插值核所服从的标准差。The up-sampling module 605 is used to up-sample each frame of the target echocardiogram through a Gaussian interpolation kernel according to a target standard deviation corresponding to each frame of the target echocardiogram to obtain a target image, wherein the target standard deviation is the standard deviation obeyed by the Gaussian interpolation kernel.
图7是本发明实施例提供的一种计算机设备的结构示意图。示例性的,如图7所示,该计算机设备700包括:存储器701、处理器702以及存储在该存储器701中并在处理器702上运行的计算机程序703,其中,该处理器702执行该计算机程序703时,使得该计算机设备可执行前述介绍的任意一种用于内科的心血管状况辅助检测方法。Fig. 7 is a schematic diagram of the structure of a computer device provided by an embodiment of the present invention. Exemplarily, as shown in Fig. 7, the computer device 700 includes: a memory 701, a processor 702, and a computer program 703 stored in the memory 701 and running on the processor 702, wherein when the processor 702 executes the computer program 703, the computer device can execute any of the cardiovascular condition auxiliary detection methods for internal medicine described above.
基于与上述方法实施例相同的发明构思,本发明提供了一种服务器,包括存储器和处理器。该存储器用于存储可执行程序代码,该处理器用于从存储器中调用并运行该可执行程序代码,使得该设备执行上述任意一种用于内科的心血管状况辅助检测方法。Based on the same inventive concept as the above method embodiment, the present invention provides a server, including a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, so that the device executes any one of the above cardiovascular condition auxiliary detection methods for internal medicine.
基于与上述方法实施例相同的发明构思,本发明提供了一种计算机程序产品,该计算机程序产品包括:计算机程序代码,当该计算机程序代码在计算机上运行时,使得该计算机执行上述任意一种用于内科的心血管状况辅助检测方法。Based on the same inventive concept as the above method embodiment, the present invention provides a computer program product, which includes: computer program code, when the computer program code runs on a computer, the computer executes any one of the above cardiovascular condition auxiliary detection methods for internal medicine.
基于与上述方法实施例相同的发明构思,本发明提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序代码,当该计算机程序代码在计算机上运行时,使得该计算机执行上述任意一种用于内科的心血管状况辅助检测方法。Based on the same inventive concept as the above-mentioned method embodiment, the present invention provides a computer-readable storage medium, which stores a computer program code. When the computer program code runs on a computer, the computer executes any one of the above-mentioned cardiovascular condition auxiliary detection methods for internal medicine.
综上,本发明综合考虑了多个与分辨率相关的指标,比如,辨识清晰待增强因子和低分辨因子等,量化了对每帧目标超声心动图进行上采样时需要的目标标准差,从而可以实现对每帧目标超声心动图进行自适应上采样,进而提高了上采样效果。其次,本发明量化目标标准差的过程相对比较客观,在一定程度上减少了人为主观因素的影响,从而提高了目标标准差确定的准确度,进而提高了对每帧目标超声心动图进行上采样的效果。In summary, the present invention comprehensively considers multiple indicators related to resolution, such as identifying clear factors to be enhanced and low resolution factors, and quantifies the target standard deviation required for upsampling each frame of target echocardiogram, so that adaptive upsampling of each frame of target echocardiogram can be achieved, thereby improving the upsampling effect. Secondly, the process of quantifying the target standard deviation of the present invention is relatively objective, which reduces the influence of human subjective factors to a certain extent, thereby improving the accuracy of determining the target standard deviation, and then improving the effect of upsampling each frame of target echocardiogram.
以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围,均应包含在本发明的保护范围之内。The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features can be replaced by equivalents. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410923407.5A CN118750024A (en) | 2024-07-10 | 2024-07-10 | A method for assisting detection of cardiovascular conditions in internal medicine |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410923407.5A CN118750024A (en) | 2024-07-10 | 2024-07-10 | A method for assisting detection of cardiovascular conditions in internal medicine |
Publications (1)
Publication Number | Publication Date |
---|---|
CN118750024A true CN118750024A (en) | 2024-10-11 |
Family
ID=92946795
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410923407.5A Pending CN118750024A (en) | 2024-07-10 | 2024-07-10 | A method for assisting detection of cardiovascular conditions in internal medicine |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118750024A (en) |
-
2024
- 2024-07-10 CN CN202410923407.5A patent/CN118750024A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Zhang et al. | Context-guided fully convolutional networks for joint craniomaxillofacial bone segmentation and landmark digitization | |
Saikumar et al. | A novel implementation heart diagnosis system based on random forest machine learning technique. | |
Zhu et al. | Comparative analysis of active contour and convolutional neural network in rapid left-ventricle volume quantification using echocardiographic imaging | |
US20220148237A1 (en) | Clustering algorithm-based multi-parameter cumulative calculation method for lower limb vascular calcification indexes | |
Loizou et al. | Manual and automated media and intima thickness measurements of the common carotid artery | |
CN103054563B (en) | A kind of quantification of blood vessel wall image texture characteristic and extracting method | |
Wong et al. | GCW-UNet segmentation of cardiac magnetic resonance images for evaluation of left atrial enlargement | |
JP2013542046A (en) | Ultrasound image processing system and method | |
US7024024B1 (en) | System for contrast echo analysis | |
CN112819818B (en) | Image recognition module training method and device | |
Liu et al. | Cardiac magnetic resonance image segmentation based on convolutional neural network | |
CN110163877A (en) | A kind of method and system of MRI ventricular structure segmentation | |
CN113592802B (en) | An automatic detection system for mitral valve annular displacement based on ultrasound images | |
CN113689441A (en) | A Dynamic Segmentation Method of Left Ventricular Ultrasound Based on DeepLabV3 Network | |
CN111820948A (en) | Fetal growth parameter measuring method and system and ultrasonic equipment | |
US8224047B2 (en) | System and method for measuring left ventricular torsion | |
CN110246566A (en) | Method, system and storage medium are determined based on the conduct disorder of convolutional neural networks | |
CN112674791A (en) | Optimization method and system for ultrasonic elastography of muscles | |
Perez-Gonzalez et al. | Spatial compounding of 3-D fetal brain ultrasound using probabilistic maps | |
US20060100518A1 (en) | Automated diastolic function analysis with ultrasound | |
CN117036302A (en) | Method and system for determining calcification degree of aortic valve | |
CN118750024A (en) | A method for assisting detection of cardiovascular conditions in internal medicine | |
US12251261B2 (en) | Device for acquiring a sequence of ultrasonograms and associated method | |
CN116777962A (en) | Two-dimensional medical image registration method and system based on artificial intelligence | |
CN112914610B (en) | Contrast-enhanced echocardiography wall thickness automatic analysis system and method based on deep learning |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |