[go: up one dir, main page]

CN109493343A - Method and device for segmenting abnormal area of medical image - Google Patents

Method and device for segmenting abnormal area of medical image Download PDF

Info

Publication number
CN109493343A
CN109493343A CN201811639008.7A CN201811639008A CN109493343A CN 109493343 A CN109493343 A CN 109493343A CN 201811639008 A CN201811639008 A CN 201811639008A CN 109493343 A CN109493343 A CN 109493343A
Authority
CN
China
Prior art keywords
image
abnormal
block
medical image
medical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811639008.7A
Other languages
Chinese (zh)
Inventor
黄烨霖
熊健皓
赵昕
张大磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Eaglevision Medical Technology Co Ltd
Original Assignee
Shanghai Eaglevision Medical Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Eaglevision Medical Technology Co Ltd filed Critical Shanghai Eaglevision Medical Technology Co Ltd
Priority to CN201811639008.7A priority Critical patent/CN109493343A/en
Publication of CN109493343A publication Critical patent/CN109493343A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/187Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10132Ultrasound image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30041Eye; Retina; Ophthalmic
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30096Tumor; Lesion

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)

Abstract

本发明提供一种医疗图像异常区域分割方法及设备,所述方法包括:获取医疗图像;将所述医疗图像划分为多个待分类图像块,并利用第一机器学习模型分别对各个所述待分类图像块进行分类,分类结果为正常图像块或异常图像块;分别基于所述异常图像块在所述医疗图像中取待分割图像块,并利用第二机器学习模型分别对各个所述待分割图像块进行语义分割,分割结果为异常像素点;在所述医疗图像中标注所述异常像素点。

The present invention provides a method and device for segmenting an abnormal area of a medical image. The method includes: acquiring a medical image; dividing the medical image into a plurality of image blocks to be classified, and using a first machine learning model to segment each of the to-be-classified image blocks respectively. classifying the image blocks, and the classification result is a normal image block or an abnormal image block; taking the to-be-segmented image blocks in the medical image based on the abnormal image blocks respectively, and using the second machine learning model to classify each of the to-be-segmented image blocks respectively The image block is semantically segmented, and the segmentation result is an abnormal pixel point; the abnormal pixel point is marked in the medical image.

Description

Medical image abnormal area dividing method and equipment
Technical field
The present invention relates to medical image processing fields, and in particular to a kind of medical image abnormal area dividing method and sets It is standby.
Background technique
In computer vision field, the research direction of hot spot mainly has image recognition, target positioning and detection at present, semantic Segmentation etc..Image segmentation is the vital component part of computer vision, is by the key step of image procossing to image analysis Suddenly.
Image segmentation, which refers to, divides the image into several mutually according to features such as gray scale, colour, spatial texture, geometries Disjoint region so that these features show consistency or similitude in the same area, and shows between different zones It is apparent different out.Semantic segmentation is to identify the semanteme in each piece of region on the basis of image segmentation.Image, semantic segmentation It is an important branch in the field AI, is widely used in GIS-Geographic Information System at present, unmanned vehicle drives, medical imaging point In the fields such as analysis, robot.
It in the analysis task of some medical images, needs to detect the region of some lesions, which is carried out Segmentation, counts the information such as area, doctor can be helped to make more accurate diagnosis to disease.Convolutional neural networks end to end More accurately result can be obtained in image segmentation field by powerful ability to express.But for convolutional neural networks etc. For machine learning model, if foreground information only accounts for the ratio of image-region very little, the more difficult excellent performance that trains The identification accuracy of expression model, model can be relatively low.
The size of medical image is usually larger, and some abnormal areas only account for very small ratio, some are even less than hundred A ten thousandth.The prior art identifies medical image using machine learning models such as convolutional neural networks, finds compared with small difference The accuracy in normal region is poor.
Summary of the invention
In view of this, the present invention provides a kind of medical image abnormal area dividing method, include the following steps:
Obtain medical image;
The medical image is divided into multiple image to be classified blocks, and using the first machine learning model respectively to each The image to be classified block is classified, and classification results are normal image block or abnormal image block;
It is based respectively on the abnormal image block and takes image block to be split in the medical image, and utilize the second engineering It practises model and semantic segmentation is carried out to each image block to be split respectively, segmentation result is extraordinary image vegetarian refreshments;
The extraordinary image vegetarian refreshments is marked in the medical image.
Optionally, the adjacent image to be classified block overlaps.
Optionally, the medical image is divided into multiple image to be classified blocks, comprising:
The medical image is traversed using the first sliding window for being sized and obtains image to be classified block, in ergodic process Glide direction include horizontal direction and vertical direction, the sliding step in two directions is respectively less than the sliding window Length and width.
Optionally, first machine learning model exports bianry image block, for indicating the normal picture block and institute State abnormal image block.
Optionally, it is based respectively on the abnormal image block and takes image block to be split in the medical image, comprising:
Identify the abnormal communication region being made of abnormal image block described at least one;
The second image block to be split being sized is taken in the medical image centered on the abnormal communication region.
Optionally, second machine learning model output is that the extraordinary image vegetarian refreshments at least one channel covers figure, wherein Including at least one extraordinary image vegetarian refreshments.
Optionally, second machine learning model output is that the extraordinary image vegetarian refreshments in two channels covers figure, including extremely Few two kinds of extraordinary image vegetarian refreshments.
Optionally, the extraordinary image vegetarian refreshments is marked in the medical image, comprising:
Corresponding semantic segmentation result is marked in each image block to be split respectively;
Whole annotation results are mapped back in the medical image.
Optionally, the medical image is eye fundus image, the method be used to divide blutpunkte in eye fundus image and/or Exudation point.
Correspondingly, the present invention also provides a kind of medical image abnormal area splitting equipments, comprising: at least one processor with And the memory being connect at least one described processor communication;Wherein, the memory be stored with can by it is described at least one The instruction that processor executes, described instruction are executed by least one described processor, so that at least one described processor executes Above-mentioned medical image abnormal area dividing method.
Medical image is divided into multiple wait divide by the medical image abnormal area dividing method provided according to the present invention first Class image block, and using a machine learning model respectively to each image to be classified block classify determining normal picture block and Abnormal image block realizes the coarse positioning to abnormal position, background content is excluded, so that can be no longer to back in subsequent processes Scape content carries out identifying processing, improves recognition efficiency;Then image to be split is obtained in medical image according to abnormal image block Block, includes extraordinary image vegetarian refreshments in these image blocks to be split, and accounting of the extraordinary image vegetarian refreshments in image block to be split is much big In the accounting in whole medical image, segmented image block is treated using another machine learning model on this basis and carries out language Justice segmentation, finds extraordinary image vegetarian refreshments, it is possible thereby to improve the accuracy to abnormal area identification.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is the flow chart of the medical image abnormal area dividing method in the embodiment of the present invention;
Fig. 2 is the flow chart of the eye fundus image abnormal area dividing method in the embodiment of the present invention;
Fig. 3 is the eye fundus image in the embodiment of the present invention;
Fig. 4 is that enhancing treated result is carried out to eye fundus image shown in Fig. 3;
Fig. 5 is the result that partial region is eliminated in eye fundus image;
Fig. 6 is the schematic diagram for obtaining image to be classified block in the embodiment of the present invention using sliding window;
Fig. 7 is to determine the schematic diagram for taking figure range in the embodiment of the present invention based on connected region;
Fig. 8 is the schematic diagram for obtaining image block to be split in the embodiment of the present invention based on connected region;
Fig. 9 is the schematic diagram for marking semantic segmentation result in the embodiment of the present invention in image block to be split;
Figure 10 is the schematic diagram of the semantic segmentation result obtained using technical solution provided in an embodiment of the present invention.
Specific embodiment
Technical solution of the present invention is clearly and completely described below in conjunction with attached drawing, it is clear that described implementation Example is a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill Personnel's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
In the description of the present invention, it should be noted that term " center ", "upper", "lower", "left", "right", "vertical", The orientation or positional relationship of the instructions such as "horizontal", "inner", "outside" be based on the orientation or positional relationship shown in the drawings, merely to Convenient for description the present invention and simplify description, rather than the device or element of indication or suggestion meaning must have a particular orientation, It is constructed and operated in a specific orientation, therefore is not considered as limiting the invention.In addition, term " first ", " second " are only For descriptive purposes, it is not understood to indicate or imply relative importance.
As long as in addition, the non-structure each other of technical characteristic involved in invention described below different embodiments It can be combined with each other at conflict.
The embodiment of the invention provides a kind of medical image abnormal area dividing method, this method can be by computer kimonos The electronic equipments such as business device execute.Machine learning model has been used to identify image in the method, the machine learning model can be with It is the neural network of multiple types and structure.This method comprises the following steps as shown in Figure 1:
S1A obtains medical image.In one embodiment, acquisition is single channel image, such as CT (Computed Tomography, CT scan) image, ultrasound examination image etc.;In another embodiment, acquisition It is multichannel image, e.g. fundus photograph.
Medical image can be the original image acquired by medical detection device, is also possible to by processing or treated Image.
Medical image is divided into multiple image to be classified blocks by S2A, and using the first machine learning model respectively to each Image to be classified block is classified, and classification results are normal image block or abnormal image block.The size of image to be classified block can It is set according to the size of medical image, for most cases, the size of image to be classified block should be significantly less than entire doctor Treat the size of image.Such as the size of medical image is 1000*1000 (pixel), the size of the image to be classified block marked off It can be 100*100 (pixel).
The size of different image to be classified blocks can be same or different.Adjacent image to be classified block boundary can To be immediately adjacent to each other, can also overlap.
Sample data should be used to be trained it before using the first machine learning model, and to have it certain Classification capacity.Specifically can be used largely be known as normal image block and be known as abnormal image block to initial model into Row training, training data include abnormal and normal two classifications, model, that is, distinguishable input image block category after training In normal class or exception class.
The first machine learning model in this step only needs to carry out image block two classification, for an image to be classified Block output is one in both normal or abnormal classification results.Do not include any lesion content in normal picture block, it is different Including in normal image block at least partly may be the content of lesion, but the first machine learning model need not identify specific lesion position It sets, need not also identify lesion type.Most of background content can be removed after this step is classified.
The output of first machine learning model is for expressing the information of image to be classified block type, such as can be image, retouches State information etc..
S3A is based respectively on abnormal image block and takes image block to be split in medical image, and utilizes the second machine learning mould Type carries out semantic segmentation to each image block to be split respectively, and segmentation result is extraordinary image vegetarian refreshments.Abnormal image block and to be split The size of image block can be it is same or different, such as can medical image content directly to abnormal image block carry out language Justice segmentation, further determines that abnormal pixel therein;Based on the abnormal image block that one or more can also be connected to really Fixed one takes figure range comprising these abnormal image blocks, then takes figure range to take image to be split in medical image with this Block includes that picture material corresponding with abnormal image block and normal picture block are corresponding in the image block to be split obtained in this way Picture material.
For a medical image, multiple image blocks to be split may be obtained, these image blocks to be split there can be weight Folded part.
Sample data should be used to be trained it before using the second machine learning model, and to have it certain Semantic segmentation ability, the specific sample image block training that handmarking's abnormal area can be used obtain.The step in Two machine learning models can identify the position of extraordinary image vegetarian refreshments, and abnormal type.The output of second machine learning model is used for The information of abnormal expression pixel, e.g. various colors are covered the intuitive image information such as figure, lines, wire frame, are also possible to The descriptive information such as pixel coordinate, type.
Abnormal particular content is depending on different types of medical image, such as CT image, can be extremely lump, Canceration area, hyperplastic tissue etc.;For fundus photograph, blutpunkte, exudation point etc. can be extremely.
S4A marks abnormal pixel point in medical image.The extraordinary image vegetarian refreshments label of all image blocks to be split is being cured The all position of exception and type can be shown by treating in image.There is the case where overlapping for multiple image blocks to be split can be with Union is taken, pixel is divided into exception in any one image block to be split, then marks the pixel in medical image.Mark There are many forms, and various colors can be used for example covers icon note extraordinary image vegetarian refreshments, and it is different that lines, wire frame mark also can be used Normal pixel etc. form.
Medical image, is divided into more by the medical image abnormal area dividing method provided according to embodiments of the present invention first A image to be classified block, and determining normogram of classifying is carried out to each image to be classified block respectively using a machine learning model As block and abnormal image block, the coarse positioning to abnormal position is realized, background content is excluded, so that can not in subsequent processes Identifying processing is carried out to background content again, improves recognition efficiency;Then it is obtained in medical image according to abnormal image block wait divide Image block is cut, includes extraordinary image vegetarian refreshments in these image blocks to be split, accounting of the extraordinary image vegetarian refreshments in image block to be split is wanted The accounting being far longer than in whole medical image, treats segmented image block using another machine learning model on this basis Semantic segmentation is carried out, extraordinary image vegetarian refreshments is found, it is possible thereby to improve the accuracy to abnormal area identification.
In conjunction with Fig. 2-Figure 10, the embodiment of the present invention provides a kind of eye fundus image abnormal area dividing method, and this method is used for Identify the blutpunkte in eye fundus image and exudation point.As shown in Fig. 2, this method comprises the following steps:
S1B pre-processes eye fundus image to enhance pixel point feature.Such as image shown in Fig. 3, it can reinforce Its contrast obtains image shown in Fig. 4.Specifically Gauss enhancing will can be carried out again after original eye fundus image Gaussian smoothing, drawn high The contrast in the region of abnormal point.The algorithm that Gauss enhancing uses is Adaptive contrast enhancement algorithm, using unsharp masking Technology: eye fundus image is divided into two parts first, first is that the unsharp masking part of low frequency, can pass through the low pass filtered of image Wave (smooth, fuzzy technology) obtains;Second is that radio-frequency component, can cross original image and subtract unsharp masking acquisition.Then high frequency section It is amplified and is added in unsharp masking, finally obtain enhancing image as shown in Figure 4.
Picture blutpunkte and exudation point after processed can contrast be stronger on entire eye fundus image, and shows more Apparent feature.
S2B, the exclusive segment region in the eye fundus image of enhancing contrast, wherein the partial region can be with right and wrong eyeground Region (peripheral background area) and certain known certain final identification mesh target area is not included.E.g. peripheral background With optic disk region, their shape, position and pixel value tag has obvious feature in whole image, can pass through Setting pixel threshold finds and excludes these regions.More complicated and accurate method can certainly be used, such as uses one Trained machine learning model identifies these interference regions.
Final purpose is to be partitioned into blutpunkte and exudation point in embodiments of the present invention, due to being not in these in optic disk Lesion, therefore selection excludes optic disk region to obtain image as shown in Figure 5.
S3B obtains image to be classified block using sliding window traversal eye fundus image, and the glide direction in ergodic process includes Horizontal direction and vertical direction, the sliding step in both direction are respectively less than the length and width of sliding window.
The size of sliding window is 128*128 (pixel), the ruler of the image to be classified block thus obtained in the present embodiment Very little is 128*128 (pixel), much smaller than the size of entire eye fundus image.Fig. 6 shows the mistake of sliding window traversal eye fundus image Journey schematic diagram, using the window that moves right after sliding window acquirement image to be classified block a, step-length is 64 (pixels), is obtained wait divide Class image block b, so that the adjacent image to be classified block of horizontal direction overlaps and (has half overlapping in the present embodiment);It is similar Ground moves down window in vertical direction, and step-length is 64 (pixels), obtains image to be classified block c, vertically to adjacent to be sorted Image block overlaps and (has half overlapping in the present embodiment), while image to be classified block b and image to be classified block c also have portion Divide overlapping (having a quarter overlapping in the present embodiment).Entire eye fundus image can be divided after traversing image in this manner At multiple images block, partly overlapping image to be classified block can eliminate boundary effect in subsequent classification to the shadow of classification results It rings.
In other embodiments, sliding step can also be made identical as image block length and width, so that image to be classified block does not have Overlapping, or overlapping or nonoverlapping image to be classified block are obtained using other modes.
S4B respectively classifies to each image to be classified block using the first convolutional neural networks, exports bianry image Block, for indicating normal picture block and abnormal image block.What the first convolutional neural networks in the present embodiment exported is pixel value The image block that image block or pixel value for 0 are 255.It is available such as Fig. 7 after classifying to all image to be classified blocks Shown in cover figure, it is normal picture block that wherein white, which is abnormal image block, black,.This image is shown to clearly demonstrate Intermediate result out, when practical application, need not show this image.
S5B identifies the abnormal communication region being made of at least one abnormal image block.Such as have one in image shown in Fig. 7 The biggish white area of a little areas, this region are made of multiple abnormal image blocks, they constitute a big connection Region;Simultaneously there are also the lesser white area of area, the smallest white area is an abnormal image block, is also regarded as one A connected region.
S6B takes image block to be split centered on abnormal communication region in eye fundus image.At this with one in Fig. 7 compared with For big connected region, it can determine that one takes figure range (white dashed line frame in figure) centered on the connected region, at this Taken in embodiment figure range be the size of image block preset namely to be split be it is preset, having a size of 224* 224 (pixels).Fig. 8 is in eye fundus image according to the schematic diagram for taking figure range to obtain image block 81 to be split.For other companies Logical region, no matter its size, the image block to be split of 224*224 (pixel) is all taken centered on connected region.This makes There is also overlapped situations between some image blocks to be split.
The size of image block 81 to be split is 224*224 (pixel) in this embodiment, and when practical application can be according to final Its size of the curriculum offering to be divided, the size should be at least more than the sizes of an image to be classified block.
S7B carries out semantic segmentation, output abnormality pixel to each image block to be split using the second convolutional neural networks Cover figure.In order to clearly show that the blutpunkte in eye fundus image and exudation point, the second convolutional neural networks in the present embodiment are defeated Out be two channel images, it can pass through color value abundant show two kinds of extraordinary image vegetarian refreshments.It in other embodiments, can also be with Export it is single pass cover figure, such as binary map can identify a kind of extraordinary image vegetarian refreshments, and single pass image can be used different Gray scale identifies a variety of extraordinary image vegetarian refreshments.
Second convolutional neural networks are made of convolutional layer, active coating, pond layer and up-sampling layer.Convolutional layer is using size It is weighted for the local data in a window in the convolution kernel and input data of 3*3, then sliding is rolled up on the image Product window, until the complete all input datas of convolution;Active coating is introduced to neuron non-using ReLu line rectification function Linear factor is handled input data by activation primitive max { 0, x };Pond layer uses maximum Chi Huafa.Network it is defeated Enter be triple channel image block to be split, output is the figure of covering in two channels, and each pixel of correspondence image is prospect (exception) and back The probability value of scape (normal).
S8B marks corresponding semantic segmentation result in each image block to be split respectively.It is with image block 81 to be split Result shown in Fig. 9 can be obtained in covering after figure is combined with image block 81 to be split for second convolutional neural networks output by example.
S9B maps back whole annotation results in eye fundus image.After being handled respectively each image block to be split, it will tie Fruit maps back in original image, obtains the accurate segmentation result of the abnormal area of final eyeground figure.As shown in Figure 10, wherein it is dark (practical is red) Regional Representative hemorrhagic areas, light color (practical is green) Regional Representative's seepage areas.
The eye fundus image abnormal area dividing method provided according to embodiments of the present invention removes boundary in pretreatment stage With optic disk region, reservation area-of-interest can reduce the generation in part puppet region, reduce noise jamming;In pretreatment stage, Using Adaptive contrast enhancement algorithm, the contrast of image can be drawn high, highlights the contrast of abnormal point, improves subsequent mesh Mark the accuracy rate of detection;In the coarse positioning processing in abnormal point region, is operated, can effectively be traversed in image using sliding window All areas, improve to the recall rate of abnormal area;In the coarse positioning module in abnormal point region, convolutional neural networks are used Model is classified, and the powerful ability to express of deep learning, the classification of each image block of accurate judgement can be used;To region It in the processing for carrying out semantic segmentation mould, is split using convolutional neural networks model, the powerful table of deep learning can be used Danone power, classification belonging to each pixel in accurate judgement image block;It is handled using coarse positioning and semantic segmentation handles phase In conjunction with mode, enable in the training of parted pattern, anomalous content accounting is big, and it is higher to be easy to train segmentation accuracy Network, to improve the accuracy divided to eye fundus image abnormal area.
One embodiment of the present of invention additionally provides a kind of medical image abnormal area segmenting device, comprising:
Acquiring unit, for obtaining medical image;
Division unit, for the medical image to be divided into multiple image to be classified blocks;
First machine learning model, for classifying respectively to each image to be classified block, classification results are positive Normal image block or abnormal image block;
Figure unit is taken, takes image block to be split in the medical image for being based respectively on the abnormal image block;
Second machine learning model, for carrying out semantic segmentation, segmentation result to each image block to be split respectively For extraordinary image vegetarian refreshments;
Unit is marked, for marking the extraordinary image vegetarian refreshments in the medical image.
As a preferred embodiment, the figure unit is taken to include:
Connected region recognition unit, the abnormal communication region being made of for identification abnormal image block described at least one;
Connected region takes figure unit, for taking second to set in the medical image centered on the abnormal communication region The image block to be split of scale cun.
As a preferred embodiment, marking unit includes:
Image block marks unit, for marking corresponding semantic segmentation knot in each image block to be split respectively Fruit;
Map unit, for mapping back whole annotation results in the medical image.
One embodiment of the present of invention additionally provides a kind of medical image abnormal area splitting equipment, comprising:
At least one processor and the memory being connect at least one described processor communication;Wherein, the storage Device is stored with the instruction that can be executed by least one described processor, and described instruction is executed by least one described processor, with At least one described processor is set to execute above-mentioned medical image or eye fundus image abnormal area dividing method.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more, The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates, Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one The step of function of being specified in a box or multiple boxes.
Obviously, the above embodiments are merely examples for clarifying the description, and does not limit the embodiments.It is right For those of ordinary skill in the art, can also make on the basis of the above description it is other it is various forms of variation or It changes.There is no necessity and possibility to exhaust all the enbodiments.And it is extended from this it is obvious variation or It changes still within the protection scope of the invention.

Claims (10)

1.一种医疗图像异常区域分割方法,其特征在于,包括如下步骤:1. a medical image abnormal area segmentation method, is characterized in that, comprises the steps: 获取医疗图像;obtain medical images; 将所述医疗图像划分为多个待分类图像块,并利用第一机器学习模型分别对各个所述待分类图像块进行分类,分类结果为正常图像块或异常图像块;dividing the medical image into a plurality of image blocks to be classified, and using the first machine learning model to classify each of the image blocks to be classified, and the classification result is a normal image block or an abnormal image block; 分别基于所述异常图像块在所述医疗图像中取待分割图像块,并利用第二机器学习模型分别对各个所述待分割图像块进行语义分割,分割结果为异常像素点;Obtaining image blocks to be segmented in the medical image based on the abnormal image blocks respectively, and using a second machine learning model to perform semantic segmentation on each of the image blocks to be segmented, and the segmentation results are abnormal pixels; 在所述医疗图像中标注所述异常像素点。The abnormal pixel points are marked in the medical image. 2.根据权利要求1所述的方法,其特征在于,相邻的所述待分类图像块有部分重叠。2 . The method according to claim 1 , wherein the adjacent image blocks to be classified partially overlap. 3 . 3.根据权利要求2所述的方法,其特征在于,将所述医疗图像划分为多个待分类图像块,包括:3. The method according to claim 2, wherein dividing the medical image into a plurality of image blocks to be classified comprises: 利用第一设定尺寸的滑动窗口遍历所述医疗图像取得待分类图像块,遍历过程中的滑动方向包括水平方向和竖直方向,在两个所述方向中的滑动步长均小于所述滑动窗口的长度和宽度。Use the sliding window of the first set size to traverse the medical image to obtain the image block to be classified, the sliding direction in the traversing process includes the horizontal direction and the vertical direction, and the sliding step in the two directions is smaller than the sliding The length and width of the window. 4.根据权利要求1所述的方法,其特征在于,所述第一机器学习模型输出二值图像块,用于表示所述正常图像块和所述异常图像块。4 . The method according to claim 1 , wherein the first machine learning model outputs a binary image block, which is used to represent the normal image block and the abnormal image block. 5 . 5.根据权利要求1-4中任一项所述的方法,其特征在于,分别基于所述异常图像块在所述医疗图像中取待分割图像块,包括:5. The method according to any one of claims 1-4, wherein obtaining image blocks to be segmented in the medical image based on the abnormal image blocks respectively, comprising: 识别由至少一个所述异常图像块组成的异常连通区域;Identifying an abnormally connected region consisting of at least one of the abnormal image blocks; 以所述异常连通区域为中心在所述医疗图像中取第二设定尺寸的待分割图像块。Taking the abnormal connected area as a center, an image block to be divided of a second set size is taken from the medical image. 6.根据权利要求1所述的方法,其特征在于,所述第二机器学习模型输出的是至少一个通道的异常像素点掩图,其中包括至少一种异常像素点。6 . The method according to claim 1 , wherein the output of the second machine learning model is an abnormal pixel mask of at least one channel, which includes at least one abnormal pixel. 7 . 7.根据权利要求6所述的方法,其特征在于,所述第二机器学习模型输出的是二通道的异常像素点掩图,其中包括至少两种异常像素点。7 . The method according to claim 6 , wherein the output of the second machine learning model is a two-channel abnormal pixel point mask, which includes at least two types of abnormal pixel points. 8 . 8.根据权利要求1-7中任一项所述的方法,其特征在于,在所述医疗图像中标注所述异常像素点,包括:8. The method according to any one of claims 1-7, wherein marking the abnormal pixel point in the medical image comprises: 分别在各个所述待分割图像块中标注相应的语义分割结果;Marking corresponding semantic segmentation results in each of the to-be-segmented image blocks; 将全部标注结果映射回所述医疗图像中。All annotation results are mapped back into the medical image. 9.根据权利要求1-8中任一项所述的方法,其特征在于,所述医疗图像为眼底图像,所述方法用于分割眼底图像中的出血点和/或渗出点。9. The method according to any one of claims 1-8, wherein the medical image is a fundus image, and the method is used for segmenting bleeding points and/or exudation points in the fundus image. 10.一种医疗图像异常区域分割设备,其特征在于,包括:至少一个处理器以及与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器执行权利要求1-9中任一项所述的医疗图像异常区域分割方法。10. A medical image abnormal area segmentation device, comprising: at least one processor and a memory connected in communication with the at least one processor; wherein the memory stores data executable by the at least one processor. The instruction is executed by the at least one processor, so that the at least one processor executes the method for segmenting an abnormal region of a medical image according to any one of claims 1-9.
CN201811639008.7A 2018-12-29 2018-12-29 Method and device for segmenting abnormal area of medical image Pending CN109493343A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811639008.7A CN109493343A (en) 2018-12-29 2018-12-29 Method and device for segmenting abnormal area of medical image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811639008.7A CN109493343A (en) 2018-12-29 2018-12-29 Method and device for segmenting abnormal area of medical image

Publications (1)

Publication Number Publication Date
CN109493343A true CN109493343A (en) 2019-03-19

Family

ID=65713447

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811639008.7A Pending CN109493343A (en) 2018-12-29 2018-12-29 Method and device for segmenting abnormal area of medical image

Country Status (1)

Country Link
CN (1) CN109493343A (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109948575A (en) * 2019-03-27 2019-06-28 中国科学技术大学 Segmentation Method of Eyeball Region in Ultrasound Image
CN110136140A (en) * 2019-04-16 2019-08-16 上海鹰瞳医疗科技有限公司 Fundus image blood vessel image segmentation method and device
CN110176002A (en) * 2019-06-05 2019-08-27 深圳大学 A kind of the lesion detection method and terminal device of radioscopic image
CN110210483A (en) * 2019-06-13 2019-09-06 上海鹰瞳医疗科技有限公司 Medical image lesion region dividing method, model training method and equipment
CN110459319A (en) * 2019-05-16 2019-11-15 腾讯科技(深圳)有限公司 The assistant diagnosis system of breast molybdenum target image based on artificial intelligence
CN110491480A (en) * 2019-05-22 2019-11-22 腾讯科技(深圳)有限公司 A kind of medical image processing method, device, electromedical equipment and storage medium
CN111046835A (en) * 2019-12-24 2020-04-21 杭州求是创新健康科技有限公司 Eyeground illumination multiple disease detection system based on regional feature set neural network
CN111127425A (en) * 2019-12-23 2020-05-08 北京至真互联网技术有限公司 Target detection positioning method and device based on retina fundus image
CN111369530A (en) * 2020-03-04 2020-07-03 浙江明峰智能医疗科技有限公司 CT image pulmonary nodule rapid screening method based on deep learning
CN111583203A (en) * 2020-04-27 2020-08-25 齐鲁工业大学 Pathological image labeling method and system based on deep learning model
CN111582235A (en) * 2020-05-26 2020-08-25 瑞纳智能设备股份有限公司 Alarm method, system and equipment for monitoring abnormal events in station in real time
CN111724352A (en) * 2020-05-30 2020-09-29 同济大学 A SMD LED defect labeling method based on kernel density estimation
CN111754514A (en) * 2019-03-28 2020-10-09 天津工业大学 Segmentation method of bleeding points in fundus images based on channel weighting and Dilated convolutional neural network
CN112784922A (en) * 2021-02-07 2021-05-11 重庆渝抗医药科技有限公司 Extraction and classification method of intelligent cloud medical images
CN112883983A (en) * 2021-02-09 2021-06-01 北京迈格威科技有限公司 Feature extraction method and device and electronic system
CN113470037A (en) * 2020-03-31 2021-10-01 阿里巴巴集团控股有限公司 Data processing method, device and system
CN113724157A (en) * 2021-08-11 2021-11-30 浙江大华技术股份有限公司 Image blocking method, image processing method, electronic device, and storage medium
CN113763330A (en) * 2021-08-17 2021-12-07 北京医准智能科技有限公司 Blood vessel segmentation method and device, storage medium and electronic equipment
TWI750518B (en) * 2019-04-01 2021-12-21 大陸商北京市商湯科技開發有限公司 Image processing method, image processing device, electronic equipment and computer readable storage medium
CN114742979A (en) * 2022-04-15 2022-07-12 推想医疗科技股份有限公司 Position identification method and device based on positioning patch, storage medium and equipment
CN114757908A (en) * 2022-04-12 2022-07-15 平安国际智慧城市科技股份有限公司 Image processing method, device, device and storage medium based on CT image
CN115761611A (en) * 2022-12-18 2023-03-07 四川数聚智造科技有限公司 Multi-stage multi-base image difference filtering method based on image contrast anomaly detection
CN118570122A (en) * 2024-05-10 2024-08-30 中山大学孙逸仙纪念医院 Method and system for identifying nail fungus abnormalities based on multiple models
CN119295493A (en) * 2024-12-12 2025-01-10 南京市中医院 Tumor medical image processing method and system for tumor ablation treatment system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107330449A (en) * 2017-06-13 2017-11-07 瑞达昇科技(大连)有限公司 Method and device for detecting signs of diabetic retinopathy
WO2017214023A1 (en) * 2016-06-10 2017-12-14 Amnis Corporation A method to combine brightfield and fluorescent channels for cell image segmentation and morphological analysis using images obtained from imaging flow cytometer (ifc)
CN108109152A (en) * 2018-01-03 2018-06-01 深圳北航新兴产业技术研究院 Medical Images Classification and dividing method and device
CN108682015A (en) * 2018-05-28 2018-10-19 科大讯飞股份有限公司 Lesion segmentation method, apparatus, equipment and storage medium in a kind of biometric image
CN108961296A (en) * 2018-07-25 2018-12-07 腾讯科技(深圳)有限公司 Eye fundus image dividing method, device, storage medium and computer equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017214023A1 (en) * 2016-06-10 2017-12-14 Amnis Corporation A method to combine brightfield and fluorescent channels for cell image segmentation and morphological analysis using images obtained from imaging flow cytometer (ifc)
CN107330449A (en) * 2017-06-13 2017-11-07 瑞达昇科技(大连)有限公司 Method and device for detecting signs of diabetic retinopathy
CN108109152A (en) * 2018-01-03 2018-06-01 深圳北航新兴产业技术研究院 Medical Images Classification and dividing method and device
CN108682015A (en) * 2018-05-28 2018-10-19 科大讯飞股份有限公司 Lesion segmentation method, apparatus, equipment and storage medium in a kind of biometric image
CN108961296A (en) * 2018-07-25 2018-12-07 腾讯科技(深圳)有限公司 Eye fundus image dividing method, device, storage medium and computer equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
曲彦: "肺部CT图像肺实质分割算法研究", 《中国优秀硕士学位论文全文数据库 医药卫生科技辑》 *

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109948575A (en) * 2019-03-27 2019-06-28 中国科学技术大学 Segmentation Method of Eyeball Region in Ultrasound Image
CN109948575B (en) * 2019-03-27 2023-03-24 中国科学技术大学 Eyeball area segmentation method in ultrasonic image
CN111754514A (en) * 2019-03-28 2020-10-09 天津工业大学 Segmentation method of bleeding points in fundus images based on channel weighting and Dilated convolutional neural network
TWI750518B (en) * 2019-04-01 2021-12-21 大陸商北京市商湯科技開發有限公司 Image processing method, image processing device, electronic equipment and computer readable storage medium
CN110136140A (en) * 2019-04-16 2019-08-16 上海鹰瞳医疗科技有限公司 Fundus image blood vessel image segmentation method and device
CN110459319A (en) * 2019-05-16 2019-11-15 腾讯科技(深圳)有限公司 The assistant diagnosis system of breast molybdenum target image based on artificial intelligence
US11984225B2 (en) 2019-05-22 2024-05-14 Tencent Technology (Shenzhen) Company Limited Medical image processing method and apparatus, electronic medical device, and storage medium
CN110491480A (en) * 2019-05-22 2019-11-22 腾讯科技(深圳)有限公司 A kind of medical image processing method, device, electromedical equipment and storage medium
CN110491480B (en) * 2019-05-22 2021-04-30 腾讯科技(深圳)有限公司 Medical image processing method and device, electronic medical equipment and storage medium
CN110176002A (en) * 2019-06-05 2019-08-27 深圳大学 A kind of the lesion detection method and terminal device of radioscopic image
CN110176002B (en) * 2019-06-05 2022-04-01 深圳大学 Focus detection method of X-ray image and terminal device
CN110210483B (en) * 2019-06-13 2021-05-11 上海鹰瞳医疗科技有限公司 Medical image lesion region segmentation method, model training method and device
CN110210483A (en) * 2019-06-13 2019-09-06 上海鹰瞳医疗科技有限公司 Medical image lesion region dividing method, model training method and equipment
CN111127425B (en) * 2019-12-23 2023-04-28 北京至真互联网技术有限公司 Target detection positioning method and device based on retina fundus image
CN111127425A (en) * 2019-12-23 2020-05-08 北京至真互联网技术有限公司 Target detection positioning method and device based on retina fundus image
CN111046835A (en) * 2019-12-24 2020-04-21 杭州求是创新健康科技有限公司 Eyeground illumination multiple disease detection system based on regional feature set neural network
CN111369530A (en) * 2020-03-04 2020-07-03 浙江明峰智能医疗科技有限公司 CT image pulmonary nodule rapid screening method based on deep learning
CN113470037A (en) * 2020-03-31 2021-10-01 阿里巴巴集团控股有限公司 Data processing method, device and system
CN111583203A (en) * 2020-04-27 2020-08-25 齐鲁工业大学 Pathological image labeling method and system based on deep learning model
CN111582235A (en) * 2020-05-26 2020-08-25 瑞纳智能设备股份有限公司 Alarm method, system and equipment for monitoring abnormal events in station in real time
CN111724352B (en) * 2020-05-30 2022-11-15 同济大学 A Method for Marking SMD LED Defects Based on Kernel Density Estimation
CN111724352A (en) * 2020-05-30 2020-09-29 同济大学 A SMD LED defect labeling method based on kernel density estimation
CN112784922A (en) * 2021-02-07 2021-05-11 重庆渝抗医药科技有限公司 Extraction and classification method of intelligent cloud medical images
CN112883983A (en) * 2021-02-09 2021-06-01 北京迈格威科技有限公司 Feature extraction method and device and electronic system
CN113724157A (en) * 2021-08-11 2021-11-30 浙江大华技术股份有限公司 Image blocking method, image processing method, electronic device, and storage medium
CN113724157B (en) * 2021-08-11 2024-11-08 浙江大华技术股份有限公司 Image segmentation method, image processing method, electronic device and storage medium
CN113763330A (en) * 2021-08-17 2021-12-07 北京医准智能科技有限公司 Blood vessel segmentation method and device, storage medium and electronic equipment
CN114757908A (en) * 2022-04-12 2022-07-15 平安国际智慧城市科技股份有限公司 Image processing method, device, device and storage medium based on CT image
CN114742979A (en) * 2022-04-15 2022-07-12 推想医疗科技股份有限公司 Position identification method and device based on positioning patch, storage medium and equipment
CN115761611A (en) * 2022-12-18 2023-03-07 四川数聚智造科技有限公司 Multi-stage multi-base image difference filtering method based on image contrast anomaly detection
CN118570122A (en) * 2024-05-10 2024-08-30 中山大学孙逸仙纪念医院 Method and system for identifying nail fungus abnormalities based on multiple models
CN119295493A (en) * 2024-12-12 2025-01-10 南京市中医院 Tumor medical image processing method and system for tumor ablation treatment system
CN119295493B (en) * 2024-12-12 2025-02-25 南京市中医院 Tumor medical image processing method and system of tumor ablation treatment system

Similar Documents

Publication Publication Date Title
CN109493343A (en) Method and device for segmenting abnormal area of medical image
CN109584246B (en) DCM (cardiac muscle diagnosis and treatment) radiological image segmentation method based on multi-scale feature pyramid
Shaziya et al. Automatic lung segmentation on thoracic CT scans using U-net convolutional network
Zhang et al. Automated semantic segmentation of red blood cells for sickle cell disease
Akram et al. Multilayered thresholding-based blood vessel segmentation for screening of diabetic retinopathy
US11967181B2 (en) Method and device for retinal image recognition, electronic equipment, and storage medium
CN108010021A (en) A kind of magic magiscan and method
Madooei et al. Automatic detection of blue-white veil by discrete colour matching in dermoscopy images
Pan et al. Cell detection in pathology and microscopy images with multi-scale fully convolutional neural networks
Jamil et al. Melanoma segmentation using bio-medical image analysis for smarter mobile healthcare
Bhattacharjee et al. Review on histopathological slide analysis using digital microscopy
Javed et al. An intelligent saliency segmentation technique and classification of low contrast skin lesion dermoscopic images based on histogram decision
CN110210483A (en) Medical image lesion region dividing method, model training method and equipment
JP2017520354A (en) Method for automatic segmentation and quantification of body tissue
CN113889238B (en) Image identification method and device, electronic equipment and storage medium
Sornapudi et al. EpithNet: Deep regression for epithelium segmentation in cervical histology images
Singh et al. Designing a retrieval-based diagnostic aid using effective features to classify skin lesion in dermoscopic images
CN110782434A (en) Intelligent marking and positioning device for brain tuberculosis MRI image focus
CN104331864B (en) Based on the processing of the breast image of non-down sampling contourlet and the significant model of vision
CN110136140A (en) Fundus image blood vessel image segmentation method and device
CN118135620B (en) Method and system for identifying microvascular invasion area of liver cancer based on pathological slice images
Waseem et al. Drusen detection from colored fundus images for diagnosis of age related Macular degeneration
Ibrahim et al. Texture and pixel intensity characterization-based image segmentation with morphology and watershed techniques
Ashame et al. Abnormality Detection in Eye Fundus Retina
Chinna Babu et al. Melanoma skin segmentation process using PCA and morphological methods

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination