(3) summary of the invention
The object of the present invention is to provide a kind of on the basis of traditional images dividing method, the advantage of performance level set aspect the curve evolvement numerical solution can access the method for outline extraction of level set medical ultrasonic image area based on edge and statistical nature that high-quality ultrasonic image area profile extracts the result.
The object of the present invention is achieved like this: it comprises three parts: slightly extract based on the region contour of original image (1); (2) based on the ultrasonoscopy pre-service of original image; (3) the level set image-region profile based on edge and statistical nature of bound fraction (1) and part (2) extracts.The image-region profile slightly extracts, image pre-service, image-region profile are smart extracts, the image-region profile is thick to be extracted according to the characteristics of selection area interested (as tumour etc.) in ultrasonoscopy, adopt image negate, Gaussian function background inhibition, binaryzation, morphology opening operation to go to disturb, need not the initialization Level Set Method and extract the regional coarse contours of extraction such as profile, as the initial value of the smart extraction algorithm of follow-up profile; A kind of selective anisotropic medical ultrasonic image smoothing algorithm is adopted in the image pre-service; The image-region profile is smart to extract the level set region contour extraction method that adopts edge and statistical nature to combine.
(1) first: region contour slightly extracts.
The thick purpose of extracting of region contour is to do initialization for the meticulous extraction of back facial contour, and it is divided into following five steps:
1) image negate
In ultrasonoscopy, mostly present echoless or low echo property characteristic such as area-of-interests such as ventricle, tumor of breast (being selection area).The purpose of image negate is for these zones present high brightness, and tissue on every side becomes low-light level, for next step is prepared.
The negate formula is as follows:
μ
2(i,j)=255-μ
1(i,j) (1)
I in the formula, j are respectively the horizontal ordinate and the ordinates of certain pixel in the image, μ
1, μ
2It is respectively before the conversion and the image after the conversion.
2) self-adapting Gaussian function background suppresses
The effect of Adaptive Suppression function is to make the area-of-interest that is positioned at picture centre present high brightness, and deep pixel is in low-light level even is zero.So-called self-adaptation is meant the size automatically adjusting of inhibition function window width according to area-of-interest.The present invention has designed a kind of Adaptive Suppression function based on Gaussian function, function expression as shown in the formula:
P is the coordinate of certain some pixel in the image in the formula,
Be the centre coordinate of image,
σ
x 2, σ
y 2Be respectively the axial variance of image x, y, and σ
x=w/4, σ
y=h/4, wherein w, h are respectively the width and the height of image.
After the adaptive Gauss inhibition, area-of-interests such as image tumour will be than surrounding tissue brightness height.
3) utilization otsu image automatic threshold algorithm is converted into bianry image to image
The otsu algorithm is the automatic selection algorithm of a kind of image threshold of classics, and this algorithm is asked for the maximal value (being maximum between-cluster variance) of following formula by exhaustive method, thereby determines the threshold value of image:
ω in the formula
1(t), ω
2(t) being image is divided into the probability of two time-likes, u by threshold value t
1(t), u
2(t) be the average of two classes respectively.
Adopt otsu automatic threshold method to calculate the threshold value of image, thereby image is become bianry image.
4) operation such as image degrease, other material interference
From view picture ultrasonoscopy shearing area-of-interest the time, inevitably can around the area-of-interest profile, attach the image that fat or other tissue are arranged.These tissues belong to the dark hypoecho tissue, brightness is lower in medical ultrasonic image, behind the image inversion operation, the image of these tissues will present high brightness, though suppressing operation its brightness meeting of back through adaptive Gauss decreases, yet behind otsu adaptive thresholding Value Operations, wherein a part still might keep.For the interference that prevents that these from organizing bright spot, adopt the method for morphology opening operation to remove these bright spots, promptly consider ultrasonoscopy resolution, to the bright spot of those areas, all remove as interference less than certain pixel count.
5) the closed region profile extracts
Adopt a kind of initialization Level Set Method that need not to extract profile, can obtain the area-of-interest profile of a sealing, its Evolution Equation is:
Div is a divergence operator in the formula,
Be gradient operator, δ (φ) is a Dirac function, and parameter lambda is positive weight constant,
* be convolution algorithm, standard deviation is the Gaussian function G of σ
σ(x)=(2 π σ)
-1/2Exp (| x|
2/ 4 σ).
This Level Set Method has overcome traditional level set needs continuous initialization level set function in evolution process shortcoming, compares with traditional Level Set Method to have that speed is fast, the simple advantage of Numerical Implementation.
(2) second portion: ultrasonoscopy pre-service.
Because ultrasonoscopy structure more complicated, signal to noise ratio (S/N ratio) are low, the meticulous profile that directly extracts area-of-interests such as tumour is difficulty relatively, so earlier ultrasonoscopy is done pre-service.
At the characteristics of medical ultrasonic image, adopt a kind of selective anisotropic medical ultrasonic image smoothing algorithm as image pre-processing method, its expression formula is:
In the formula
Be gradient operator, * is a convolution algorithm, and div is a divergence operator.Spread function g (| s|) be a monotonic decreasing function, when | s| → ∞, g (| s|) → 0, as the control rate of propagation, to strengthen the image border.Usually spread function is elected as
K wherein is the Grads threshold parameter.G in the formula
σ(x)=(2 π σ)
-1/2Exp (| x|
2/ 4 σ).Because
Essence be image to be done based on the smoothing processing of Gaussian function to remove noise earlier, the Grad of the image after the computing then is according to Grad decision image smoothing degree.
(3) third part: the level set image-region profile based on edge and statistical nature extracts.
This part is that the essence of image outline is extracted.Elder generation is embedded in the coarse contour image that extracts through first finishing the pretreated image of second portion, as the smart level set initialization of extracting of third part, begins the level set region contour extraction of third part based on edge and statistical nature then.
Be based on the curve differentiation method of geometric deformation model based on the level set region contour extracting method of edge and statistical nature.Suppose to develop curve C (s, t)=[X (s, t), Y (s, t)], wherein s is the arbitrary parameter variable, t is time (R.Malladi, J.A.Sethian, B.C.Vemuri.Shape Modeling with Front Propagation:Level Set Approach.IEEE Trans.on Pattern Analysis and Machine Intelligence, 1995,17 (2): 158-175).If developing the interior of curve is N to unit normal vector, curvature is k, and then curve can be represented with following partial differential equation along the evolution process of its unit normal vector direction:
V in the formula (k) is a velocity function, every evolution speed on the decision curve.
The basic thought of geometric deformation model is that speed of deformation (with curvature and/or constant) and view data are combined, and evolving speed is stopped at object edge.How according to view data and geometrical property design proper speed function, make contour curve develop as early as possible and stop at the core content that is based on geometry deformation model image edge extracting on the object boundary exactly.The geometry deformation model is generally realized (R.Malladi with Level Set Method, J.A.Sethian, B.C.Vemuri.Shape Modeling withFront Propagation:Level Set Approach.IEEE Trans.on Pattern Analysis and Machine Intelligence, 1995,17 (2): 158-175).
Suppose a level set function φ (x, y, t), its zero level collection be C (s, t), then have φ (C (and s, t), t)=0, ask its differential, and utilize the chain type rule to obtain t:
Be without loss of generality, can suppose φ in the zero level collection for negative, for just, the interior of level set curve to unit normal vector is so outside the zero level collection
Wushu (6) is brought formula (7) into, so have:
Curvature k at zero level Ji Chu is:
Formula (8) is the fundamental equation of level set, establishes F=V (k), and function F just is based on the curve evolving speed function of curvature so, and it depends on:
1. the forward position local characteristics that develops of curve for example develops the local curvature of curve;
2. with the relevant external parameter of input data, for example gradient;
3. Fu Jia propagation item.
At the characteristics of ultrasonoscopy, synthetic image marginal information and local texture statistics feature, level set equation speed develops function and elects as:
F=g(x,y)[λ(k(x,y)-k)-probn(x,y)] (10)
Wherein g (x, y)=(1-η (x, y))
2, (x y) is point (x, the edge confidence degree of y) locating to η.Based on the rim detection of edge confidence degree than have based on traditional gradient operator edge detection method calculate simple, efficient is high, to advantages such as insensitive for noise (Meer Peter, Georgescu Bogdan.Edge Detection with Embedded Confidence.IEEE Trans.Pattern Analysis andMachine Intelligence.2001,23 (12): 1351-1365).Because (x, y)<1, (x is y) just more near 1, so (x y) can be very little, and the speed of differentiation will approach zero for g when curve develops edge near edge η more for 0<η.K is a mean curvature, and λ is positive parameter.
Probn (x, y) represent current point (x is the possibility size of area-of-interest outside organization y), and it is drawn by following formula:
Wherein p be wait to classify a little coordinate (x, y), mapping function
β is positive adjusting parameter, and f () is the support vector machine decision function (V.Vapnik.Statistical Learning Theory.Wiley, 1998) based on gaussian kernel function, and its expression formula is:
In the formula (11)
Be nine texture feature vectors, they are respectively mean square deviation coefficients (1) and based on the contrast of grey scale difference image, angle second moment, average, entropy (0 °, 90 ° both direction totally 8).Its expression formula is:
1) mean square deviation coefficient
2) contrast
3) the angle second order is apart from (energy)
4) average
5) entropy
Formula (11) finally is:
Wherein K () is a gaussian kernel function, promptly
, λ
i, ω
0Be the parameter that obtains in the training stage in order to the structure decision function, y
iBe the v of i support vector
iThe class label, N
sIt is the number of support vector.
U, σ are respectively the average and the variances of image in the window.
p
Δ(i) distribution probability of presentation video μ difference, it finds the solution as follows: establish (x, y) be in the image a bit, this point and the point that faces mutually (x+dx, grey scale difference y+dy) is defined as:
Δμ(x,y)=μ(x,y)-μ(x+dx,y+dy) (19)
Obtain the difference value of every of entire image, as the brightness of image and do normalized, the grey scale difference image Δ μ that composing images μ is ordered according to the histogram of difference image, obtains p this difference result
Δ(i), 0≤i≤L-1, L are the maximum possible difference values.If i is less, but bigger frequency values is arranged, this situation represents that texture is more coarse; If histogram of difference is more smooth, illustrate that then texture is more careful.Generally when calculating based on the grey scale difference parametric texture, do 0 °, 90 ° both direction grey scale differences, get dx=1, dy=1, the textures windows size elects 15 * 15 as, like this every bit is had 9 proper vectors.
As seen from formula (18), when the probn of certain some value more near 1 the time, just think the tissue of area-of-interest outside.If approach 0, this point belongs to area-of-interest.See (10) formula now again, establish level set initialization curve in area-of-interest the time, curve begins to develop, and at this moment function probn approaches 0, and only ((x y)-k) decides k evolving speed, and speed is bigger by curvature part λ.When function probn approached 1, the curve evolving speed was by curvature that develops curve and the decision of probn difference, and evolving speed reduces.By the method for adding image local textural characteristics, the evolving speed that develops curve is not only determined by the edge at this place, also relevant with the image property that develops wavefront place image-region, the wavefront differentiation in weak edge also can be stopped.
Of low quality at present existing ultrasonic image area profile extraction method, can't satisfy the problem of the actual needs of medical diagnosis, the present invention proposes a kind of region contour extracting method of medical ultrasonic image, this method is considered the characteristics of medical ultrasonic image, organically combining based on rim detection with based on the method for provincial characteristics, on the basis of traditional images dividing method, the advantage of performance level set aspect the curve evolvement numerical solution obtained high-quality ultrasonic image area profile and extracted the result.
The medical ultrasonic image area profile extraction method that the present invention proposes can be divided into three parts: (1) region contour slightly extracts; (2) ultrasonoscopy pre-service; (3) the level set image-region profile based on edge and statistical nature extracts.Wherein first and second portion are based on all that original image carries out, and third part is to realize on first and the synthetic result's of second portion basis.Can carry out first's operation earlier, also can carry out the second portion operation earlier, perhaps two parts carry out simultaneously.
The above concrete steps of the medical ultrasonic image area profile extraction method that proposes for the present invention.The present invention combines rim detection and based on the method for provincial characteristics, and the application level collection carries out the curve evolvement numerical solution, therefore can access higher-quality result images.
(5) embodiment
The present invention is further illustrated with concrete embodiment below in conjunction with accompanying drawing:
Among Fig. 1: 101 slightly extract, 102 for being the meticulous extraction of level set region contour based on edge and statistical nature based on anisotropic ultrasonoscopy pre-service, 103 for the area-of-interest profile; Among Fig. 2: 201 for the tumor of breast original image, 202 for image inversion operation result, 203 for the image result of application self-adapting Gaussian function after handling, 204 for slightly extracting the result for profile for the image, 206 after degrease and the interference of other materials based on the bianry image of OTSU adaptive threshold, 205; Among Fig. 3: 301 are embedded into result in the pretreated image for coarse contour for ultrasonoscopy pre-service result, 302; Among Fig. 4: 401 is that original tumor of breast image, 402 is for the level set medical ultrasonic image area profile based on edge and statistical nature extracts the result, 403 contour extraction methods that propose for the present invention extract result's (redness) and medical expert's manual drawing result (white) contrast; Among Fig. 5: the profile that 501 profiles of cutting apart for the inventive method, 502 are cut apart for the inventive method for the profile of medical expert's manual drawing, 503 and the profile phase of medical expert's manual drawing are relatively, the profile that the area of lost part, 504 is cut apart for the inventive method and the profile phase of medical expert's manual drawing are relatively, the profile that the area of lap, 505 is cut apart for the inventive method and the profile phase of medical expert's manual drawing relatively have more the area of part.
In conjunction with Fig. 1, present embodiment is as follows based on the specific implementation step of the level set medical ultrasonic image area profile extraction method of edge and statistical nature:
(1) the region of interest area image is carried out cutting.The purpose of reducing is to reduce the calculated amount that profile extracts automatically, the method of reducing is to comprise whole image of interest zone, and Edge Distance area-of-interest profile is unsuitable excessive, is generally hundreds of to about several ten thousand pixels, is chosen as 96 * 64 pixels in the present embodiment;
(2) extract the initial profile of area-of-interest, the tumor of breast original image for after reducing shown in 201 among Fig. 2 utilizes formula (1) to carry out the image negate, obtains image 202; Pass through formula (2) Gaussian function background again and suppress, obtain image 203; Adopt otsu automatic threshold method to calculate the threshold value of image, image is become bianry image, shown among Fig. 2 204; Adopt morphology opening operation method to remove the discontinuous bright spot at random of image again, in the present embodiment area is thought that less than the bright spot of 5 pixels bright spot is removed at random, reach the purpose of interference such as degrease, obtain image 205; Utilize formula (4) to realize that the sealing image outline extracts, and can obtain the initial profile of a tumour, shown among Fig. 2 206;
(3) the tumor of breast original image shown in 201 in to Fig. 2 utilizes formula (5) to carry out the anisotropy image smoothing, obtains the pretreated image shown in 301 in the accompanying drawing 3;
(4) initial profile 206 of step (2) gained is embedded in the pretreated image 301, obtains image 302;
(5) utilize formula (19) to calculate the difference image of pretreated image;
(6) utilize formula (13)-(18) to calculate the proper vector of region of interest tract tissue
(7) the improvement iteration cross term verification method [7] that proposes of utilization Carl Staelin is determined the parameter of gaussian kernel function support vector machine (C γ), is got C=512 promptly 2 in the present embodiment
9, γ=0.03125 promptly 2
-5
(8) using formula (10) is cut apart image, extracts the profile of final area-of-interest.
Describe for beneficial effect of the present invention below in conjunction with embodiment.Picked at random three width of cloth malignant galactophore supersonic tumor images and three width of cloth breast ultrasound benign tumour images.The similarity measurement of the profile that the employing aforementioned embodiments is extracted and the tumour profile of medical expert's manual drawing is estimated the profile extraction effect.The medical expert comprises that radiation expert and clinical expert form, so these manual profiles have certain authority, can estimate the effect of automatic extraction.As shown in Figure 5,501 profiles of cutting apart for the inventive method, 502 is the profile of medical expert's manual drawing.The profile phase of 503 profiles of cutting apart for the inventive method and medical expert's manual drawing relatively, the area of lost part is designated as S2; 504 is the area of lap, is designated as S3; 505 for having more the area of part, is designated as S1, and then similarity measurement is defined as follows:
The value of O when O=0, illustrates with two profiles and do not occur simultaneously between 0 and 1, when O=1, illustrates that the profile cut apart and the profile of medical expert's manual drawing overlap fully.The similarity measurement result of aforesaid 6 width of cloth tumor images is respectively: 97.84%, 98.45%, 98.33%, 92.12%, 96.62%, 98.39%, and average similarity tolerance is 96.96%.Adopt aforementioned embodiments that 240 breast ultrasound evaluate image (wherein malignant tumour 128 width of cloth, optimum 112 width of cloth) are carried out the tumour profile and extract research, average similarity tolerance is 91.37%.
Document Yu-Len Huang, Yu-Ru Jiang, Dar-Ren Chen.Level Set Contouring for BreastTumor in Sonography.Journal of Digital Imaging.2007,20 (3): the tumour profile of mammary gland is extracted in the 238-247 employing based on smothing filtering and traditional level set contour extraction method, (3 width of cloth are the benign tumour image to have provided 6 width of cloth images in evaluation of algorithm, 3 width of cloth are the malignant tumour image in addition) profile extraction result, similarity measurement is respectively: 95%, 86%, 95%, 95%, 94%, 91%, this 6 width of cloth image similarity tolerance average is 92.67%.Adopt 118 width of cloth image libraries (pernicious 34 width of cloth, optimum 84 width of cloth) that the algorithm that this article proposes is assessed simultaneously in the document, average similarity tolerance is 87.64%.
From above analysis as can be known, the region contour extracting method of the medical ultrasonic image of the present invention's proposition can obtain higher profile and extract quality.