Background technology
3 D ultrasound system is in fusion of imaging, surgical navigational, biopsy and the application in field such as to melt more and more, and it is more directly perceived than two-dimensional ultrasonic image, and comprises more time and space shape information.The advantages such as the 3 D ultrasound system based on free arm (freehand) is more flexible than mechanical 3 D ultrasound system, has arbitrarily angled scanning, and mobile space is unrestricted.Freedom-arm, three-D ultrasonic system commonly used has: based on the freedom-arm, three-D ultrasonic system of electromagnetic transducer; Freedom-arm, three-D ultrasonic system based on active light/passive optical sensor.Three-dimensional scaling is important in a freedom-arm, three-D ultrasonic system link, refer to by someway or the device, determine the transformation relation between each space coordinates in the 3 D ultrasound system.Know the transformation relation between each space coordinates, with ultrasonic scanning localizing objects point, the coordinate of ground point of plane of ultrasound is through coordinate transform, from the ultrasonic scanning spatial alternation to sensor space, position, transform to again world space, thereby know impact point in the position of world space, for ultrasonic fusion of imaging, surgical navigational etc. provide positional information.An important step is with the point of the point on the ultrasonoscopy and another modal data corresponding registration one by one in ultrasonic fusion of imaging, its essence is with impact point in world coordinates the position and another modal data in the position of impact point be mapped, accurately obtain the position of impact point in world coordinates and have a significant impact improving registration accuracy.
The acoustic beam relevant with 3 D ultrasound system has error in three directions: axial error, lateral error, thickness error.
Axial error (axial): the error on the ultrasonic beam axis, relevant with wavelength in theory, only have when 2 distances greater than wavelength 1/2 the time, ultrasonicly could produce respectively two echoes, equal can differentiate on the ultrasonic beam axis minimum range of point-to-point transmission.
Lateral error (lateral): claim again lateral error, the error vertical with axial direction, it and focal position, axial depth, the aperture, the ultrasonic beam diameter, multi-beam is synthetic relevant.Horizontal direction direction perpendicular to axial direction is in the ultrasonic scanning plane that axially coexists.
Thickness error (elevational, thickness): the error on the plane of ultrasound thickness direction, it and probe crystal oscillator, the geometry of acoustic lens, axial depth is relevant.Thickness direction and axial direction, lateral are mutually vertical.
Technology has been ignored the thickness of ultrasonic sound field at present, regards the ultrasonic scanning space as X to the conversion in sensor space, position
Usz=0 2D plane is to the conversion of 3d space, the X here
UszThe coordinate of the ultrasonic imaging space thickness direction (can be expressed as Z axis) that refers to.
But in actual applications, because ultrasonic beam itself has certain thickness, simultaneously the characteristics of ultrasonic beam far field diversity are not so that ultra sonic imaging is the situation in a unlimited thin cross section of reflection but the plane that certain thickness arranged and disperse gradually, on the stricti jurise, because the thickness of ignoring ultrasonic sound field causes the inaccurate of location, and then affect the precision of ultrasonic fusion of imaging and surgical navigational.
During ultrasonic scanning, because the physical characteristic of probe determines that the error of ultrasonic all directions is not identical.Axially and lateral error less, the thickness direction error is larger.In the two-dimensional ultrasound system, what mainly pay close attention to is axial and lateral error, more to the optimization of axial and lateral error, less to the concern of thickness direction error, and optimization is less or not optimization also.Mostly do not consider sound field thickness factor in the present freedom-arm, three-D ultrasonic system, but in 3 D ultrasound system the impact of thickness error than axially and lateral error much larger.Although some technology has been considered sound field thickness factor, it reduces the impact that thickness error brings by special device, uses very inconvenient.
Summary of the invention
The main technical problem to be solved in the present invention is, localization method and the device of a kind of 3 D ultrasound system and impact point thereof is provided, and sound field thickness factor is taken into account, and impact point is demarcated, and improves the positioning accuracy of impact point.
According to an aspect of the present invention, provide a kind of object location method of 3 D ultrasound system, comprising:
This impact point is at the coordinate in each ultrasonic scanning space when obtaining ultrasonic probe and repeatedly same impact point being scanned from different directions;
Select a ultrasonic scanning space as the reference space, with all ultrasonic scanning space coordinatess of obtaining behind the Multiple-Scan to this with reference to space projection, obtain each ultrasonic scanning space coordinates to this transformation matrix with reference to the space;
Correlated measure according to all directions assigns weight for each time scan-data;
Calculate impact point at the coordinate in reference space according to weight and each ultrasonic scanning space coordinates to this transformation matrix with reference to the space;
Utilize the transformation matrix from the ultrasonic scanning space to the world coordinates space that obtains in advance with impact point in the coordinate transform in reference space to the world coordinates space.In one embodiment, when described correlated measure according to all directions assigns weight for each time scan-data according to following rule: the component of weight on axial direction, lateral or thickness direction, estimating the projected size that makes progress the party according to corresponding scan-data determines, for the less weight of scan-data distribution of the large direction of correlated measure projection, be that the scan-data of the little direction of correlated measure projection distributes larger weight.
The coordinate of impact point in the reference space adopts following formula to calculate:
Wherein, X '
UsrefBe impact point at the coordinate in reference space, N is the scanning times to same impact point, α
jThe weight vectors of the j time scan-data, T
Usred_usjThat the j time ultrasonic scanning space is to the transformation matrix with reference to the space, X
UsjThe original coordinates that is impact point in the j time ultrasonic scanning space.
According to a further aspect in the invention, a kind of object location device of 3 D ultrasound system is provided, be used for impact point from the ultrasonic scanning spatial alternation to the world coordinates space, described device comprises: original coordinates obtains the unit, obtains this impact point at the coordinate in ultrasonic scanning space for the ultrasonoscopy from each scanning when ultrasonic probe scans same impact point from different directions; Projecting cell be used for to select a ultrasonic scanning space as the reference space, with all ultrasonic scanning space coordinatess of obtaining behind the Multiple-Scan to this with reference to space projection, obtain each ultrasonic scanning space coordinates to this transformation matrix with reference to the space; The weight allocation unit is used for assigning weight for each time scan-data according to the correlated measure of all directions; The coordinate modification unit is used for calculating impact point at the coordinate in reference space according to weight and each ultrasonic scanning space coordinates to this transformation matrix with reference to the space; Coordinate transformation unit, be used for to utilize the transformation matrix from the ultrasonic scanning space to the world coordinates space that obtains in advance with impact point in the coordinate transform in reference space to the world coordinates space.
The present invention also provides a kind of 3 D ultrasound system simultaneously, comprising: ultrasonic probe is used for to those who are investigated's target site emission ultrasound wave; The supersound process module is used for the echo-signal that receives is processed, and obtains the ultrasonoscopy of target site; Caliberating device for detection of the locator data of ultrasonic probe, and is demarcated ultrasonoscopy and locator data, obtains the transformation matrix from the ultrasonic scanning space to the world coordinates space; Data computation module is used for demarcating the data reconstruction of getting well or with other modal data registration, and the ultrasonoscopy at export target position and/or data, and described data computation module comprises above-mentioned object location device; Display module is used for ultrasonoscopy and the data of target site are shown.
The present invention is by the projection of ultrasonic scanning different directions correlated measure on the reference space, distribute different weights, axial and the lateral error higher with the ultrasonic scanning spatial accuracy remedies the low thickness error of precision, thereby improves impact point in the positioning accuracy in ultrasonic scanning space.
The specific embodiment
By reference to the accompanying drawings the present invention is described in further detail below by the specific embodiment.
In the application's embodiment, sound field thickness factor is taken into account, simultaneously combined echocardiography axially and lateral error by measuring target point repeatedly, is given different weights, obtains the accurate world space coordinate of impact point.When localizing objects point, ultrasonic probe carries out Multiple-Scan to same impact point from a plurality of directions, and after being scanned at every turn this impact point at the coordinate in ultrasonic scanning space and the transformation matrix between the different coordinate space.With other ultrasonic scanning space coordinates to one of them ultrasonic scanning space projection (perhaps with all ultrasonic scanning spaces to a new space projection), according to relevant the estimating of certainty of measurement (being called for short " correlated measure "), be assigned to different weights, obtain revising rear impact point after the weighted sum at the coordinate figure in reference space.Transform to world coordinates with revised with reference to spatial value again, thereby the axial and lateral error higher with the ultrasonic scanning spatial accuracy remedies the low thickness error of precision, reduced the error of sound field thickness direction, the coordinate of the impact point that obtains is also more accurate, has improved follow-up ultrasonic fusion of imaging mid point to registration accuracy.
Among a kind of embodiment, the block diagram of freedom-arm, three-D ultrasonic system as shown in Figure 1: 3 D ultrasound system comprises ultrasonic probe 101, supersound process module 104, caliberating device 100, data computation module 106 and display module 107.Ultrasonic probe 101 is used for to those who are investigated's target site emission ultrasound wave; Supersound process module 104 is used for the echo-signal that receives is processed, and obtains the ultrasonoscopy of target site; Caliberating device 100 is used for carrying out three-dimensional scaling, namely passes through someway or device, determines the transformation relation between each space coordinates in the 3 D ultrasound system.In one embodiment, caliberating device 100 comprises position sensor, register control and demarcating module, and position sensor is used for the positional information of detecting ultrasonic probe, for example comes the pop one's head in position sensor 102 of 101 locus of detecting ultrasonic by magnetic or light.In one embodiment, position sensor 102 comprises an emitter and a receptor, the receptor of its Position Sensor 102 is fixed on the probe 101, the emitter of position sensor 102 then is fixed near the imaging position (diagnosis position), and along with the movement of popping one's head in, constantly provide positional information by receptor and the relative bearing between the emitter that records.Register control 103 is used for obtaining according to the positional information of ultrasonic probe the locus of ultrasonic probe; Demarcating module 105 is used for ultrasonoscopy and locator data are demarcated.
Transformation relation between the space coordinates comprises the transformation relation from the ultrasonic scanning space to sensor space, position, from the position sensor space to the transformation relation the world coordinates space, and the spatial alternation of freedom-arm, three-D ultrasonic system as shown in Figure 2 relation.Space coordinate transformation closes:
X
w=T
w_s·T
s_us·X
us -------------------------------(1)
X wherein
UsThat point is at the coordinate in ultrasonic scanning space, X
wThat point is at the coordinate of world's coordinate space, T
S_usThat the ultrasonic scanning space is to the transformation matrix in sensor space, position, T
W_sThat the position sensor space is to the transformation matrix in world coordinates space.Position sensor be fixed on probe upper motionless, when ultrasound parameter is constant, T
S_usImmobilize.T
W_sObtained by register control and position sensor, along with the movement of probe, T
W_sConstantly change.
After the transformation relation of knowing between each space coordinates, it is available ultrasonic scanning localizing objects point, the coordinate of ground point of plane of ultrasound is through coordinate transform, from the ultrasonic scanning spatial alternation to sensor space, position, transform to again world space, thereby know that impact point is in the position of world's coordinate space.
The impact point that data computation module 106 namely is used for ultrasonic scanning is obtained is from the ultrasonic scanning spatial alternation to the world coordinates space, is used for demarcating the data reconstruction of getting well or with other modal data registration, and the ultrasonoscopy at export target position and data; The ultrasonoscopy of the target site that data computation module 106 obtains and data and some functional parameters output to display module 107 and show.In embodiments of the present invention, data computation module 106 comprises the object location device, and the object location device is used for more accurately localizing objects point, thus more accurately with impact point from the ultrasonic scanning spatial alternation to the world coordinates space.
In the prior art, in calibration process, do not consider the thickness of ultrasonic sound field, X
UsThere is certain error, for the impact point that makes acquisition more accurate at the coordinate in ultrasonic scanning space, in an embodiment of the present invention, as shown in Figure 3, the object location device comprises that original coordinates obtains unit 301, projecting cell 302, weight allocation unit 303, coordinate modification unit 304 and coordinate transformation unit 305.Original coordinates obtains unit 301 and is used for obtaining impact point at the coordinate in ultrasonic scanning space from ultrasonoscopy when ultrasonic probe scans impact point from different directions; Projecting cell 302 is used for selecting a ultrasonic scanning space as the reference space, with all ultrasonic scanning space coordinatess of obtaining behind the Multiple-Scan to this with reference to space projection, obtain each ultrasonic scanning space coordinates to this transformation matrix with reference to the space; Weight allocation unit 303 is used for assigning weight for each time scan-data according to the correlated measure of all directions, in one embodiment, according to following regular allocation weight: weight in a direction (for example, axial direction, lateral or thickness direction) on component, determine in the projected size that the party makes progress according to corresponding scan-data correlated measure, for the less weight of scan-data distribution of the large direction of correlated measure projection, be that the scan-data of the little direction of correlated measure distributes larger weight.Coordinate modification unit 304 is used for calculating impact point at the coordinate in reference space according to weight and each ultrasonic scanning space coordinates to this transformation matrix with reference to the space; Coordinate transformation unit 305 utilizes the ultrasonic scanning space of in advance acquisition to the transformation matrix T in sensor space, position
S_us, and the transformation matrix T from the position sensor space to the world coordinates space that is obtained in advance by caliberating device 100
W_s, impact point is arrived the world coordinates space in the coordinate transform in reference space.
In one embodiment, the coordinate of impact point in the reference space adopts following formula to calculate:
Wherein, X '
UsrefBe impact point at the coordinate in reference space, N is scanning sum, α
jThe weight vectors of the j time scan-data, T
Usref_usjThat the j time ultrasonic scanning space is to the transformation matrix with reference to the space, X
UsjThe original coordinates that is impact point in the j time ultrasonic scanning space.Wherein, can be any one ultrasonic scanning space with reference to the space, for example can be the ultrasonic scanning space of certain scanning, also can be the space new with irrelevant one in scanning direction.
Based on the 3 D ultrasound system of above-mentioned 3 D ultrasound system and object location device, in one embodiment, the object location method may further comprise the steps as shown in Figure 4:
Step S1, from different directions, the same impact point of Multiple-Scan, each scanning direction namely consists of a ultrasonic scanning space, obtain impact point at the coordinate in this ultrasonic scanning space after each scanning, caliberating device 100 obtains the transformation matrix between each coordinate space simultaneously, and for example the ultrasonic scanning space is to the transformation matrix in sensor space, position, and the position sensor space is to the transformation matrix in world coordinates space.For example carry out N scanning, N is the integer greater than 1.Scan mode can be twice sweep, and the twice sweep direction is as far as possible vertical; Also can be repeatedly a plurality of scanning directions, each scanning direction is run-down at least; The scanning direction can be to divide equally as far as possible, also can be the ultrasonic scanning that any direction is not divided equally.
Step S2, in N scanning, select wherein once (for example the i time) ultrasonic scanning space as the reference space, with other N-1 time scanning coordinate to the i time ultrasonic scanning space projection, and obtain each ultrasonic scanning space coordinates to this transformation matrix with reference to the space, wherein, N is scanning times, and i is the sequence number in the ultrasonic scanning space that is projected, 1≤i≤N.
Step S3 gives different weights according to estimate (the abbreviation correlated measure) relevant from certainty of measurement on each scanning direction to each scan-data.In the different ultrasonic scanning spaces, has different certainties of measurement on the different directions, this is to be determined by the precision of instrument, correlated measure can be following physical quantity: error, variance or resolution, certainly, those skilled in the art can also be as required be defined as correlated measure with other the physical quantity relevant with certainty of measurement.Give different weights according to correlated measure to scan-data, if correlated measure is larger in this direction, then should make this direction little on the final result impact, the weight of distribution should be less; If correlated measure is less in this direction, then should make this direction large on the final result impact, the weight of distribution also should be larger.
Step S4, according to weight and each ultrasonic scanning space coordinates to this transformation matrix with reference to the space recomputate impact point in the i time ultrasonic scanning space namely with reference to the coordinate X ' in space
UsiIn one embodiment, obtain new coordinate figure X ' by weighted sum
Usi, shown in (2):
X′
usi=α
1·(T
usi_us1·X
us1)+…+α
i·X
usi++…+α
N·(T
usi_usN·X
usN)-------(3)
Wherein: X '
UsiThat impact point is at the correction coordinate in the i time ultrasonic scanning space, α
1, α
2... α
NThe weight vectors of each time scan-data, T
Usi_usNThat the N time ultrasonic scanning space obtaining in advance is to the transformation matrix in the i time ultrasonic scanning space, X
UsiThe original coordinates that is impact point in the i time ultrasonic scanning space.
Be situation with reference to the space for the i time ultrasonic scanning space of definition, impact point is at the correction coordinate X ' in the i time ultrasonic scanning space
UsiBe impact point at the coordinate in reference space.
Step S5 uses the scan conversion matrix again the i time, with the coordinate figure X ' of impact point in the reference space
UsiTransform to the world coordinates space by formula (1), thereby obtain impact point more accurate coordinate figure in world's coordinate space.
In one embodiment, inverse ratio according to the projection of correlated measure (for example error/variance) is that scan-data is given different weights, divides for the large direction of correlated measure projection to be equipped with little weight, and the little direction of correlated measure projection is distributed large weight, weight meets normalization, namely
Thereby it is little that large the estimating of error affected final result, and estimating the final result impact that error is little is large, makes the impact point that obtains revise coordinate in world's coordinate space more accurate.
For each ultrasonic scanning, the inventor finds to exist following characteristics, that is: ultrasonic thickness direction precision is low, and the precision of axial and side direction is higher, therefore, the present embodiment carries out Multiple-Scan to same impact point from different directions, obtain the coordinate figure in the ultrasonic scanning space of impact point in each time scanning, for example, as shown in Figure 5, if impact point is in the ultrasonic scanning of twice angled (for example 90 degree), in for the first time scanning, because the thickness direction precision is low, can not accurately obtain thickness direction coordinate figure (namely perpendicular to the coordinate on the scan plane direction), but in for the second time scanning, this direction becomes and is the side direction coordinate, because the precision of side direction is higher, therefore can obtain comparatively accurate coordinate figure.For measurement result repeatedly can be combined, provide a more result of high measurement accuracy, each time need to be measured unification and in a public coordinate system, do projection, and assign weight by correlated measure, recomputate the coordinate figure of this impact point, thereby the axial and lateral error higher with the ultrasonic scanning spatial accuracy remedies the low thickness error of precision, improved the positioning accuracy of impact point.
How the below calculates impact point at the coordinate in reference space with a kind of instantiation explanation, as shown in Figure 5, repeats the same impact point of scanning N time in a plurality of directions, obtains impact point at the coordinate figure X in the i time ultrasonic scanning space
Usi={ X
Usix, X
Usiy, 0,1}
T(wherein 1≤i≤N), caliberating device 100 obtains position sensor to the transformation matrix T of world coordinates
W_si, because position and ultrasound parameter that position sensor is fixed on the probe all do not have variation in scanning process, so the ultrasonic scanning space is to the transformation matrix T in sensor space, position
S_usImmobilize.Suppose correlated measure δ
i=[δ
Ix, δ
It, δ
Iz]
TThe lateral at impact point place when representing the i time ultrasonic scanning (x axle), axial direction (y axle), the correlated measure of thickness direction (z axle).Same δ
N=[δ
Nx, δ
Ny, δ
Nz]
TWhen representing the N time ultrasonic scanning, the correlated measure of impact point place all directions.Because ultrasound data is at x, y, the precision correlated measure on the z axle (for example error/variance) and the degree of depth, frequency etc. various factors is relevant, δ
iAnd δ
NNot identical.Generally speaking, lateral δ
x, axial direction δ
yLess, thickness direction δ
zLarger.
Different directions has different certainties of measurement, for example axial direction, lateral and thickness direction have different certainties of measurement, give different weights according to correlated measure to scan-data, for example, the component of weight on axial direction, lateral or thickness direction estimated the projected size that makes progress the party according to corresponding scan-data and determined, for the less weight of scan-data distribution of the large direction of correlated measure projection, be that the scan-data of the little direction of correlated measure projection distributes larger weight.
Calculate new coordinate X ' with formula (2)
Usi(coordinate under the i time ultrasonic scanning space (namely with reference to the space)), X '
UsixBe X '
Usi=X '
Usix, X '
Usiy, X '
Usiz, 1}
TThe x component, its computing formula is
X′
usix=α
1x·{T
usi_us1·X
us1}
x+…α
ix·X
usix+…+α
Nx·{T
usi_usN·X
usN}
x----------(4)
0≤α wherein
1x, α
2x... α
Nx≤ 1,
Order
Cx makes
Normalized parameter, { }
xThe x component of expression vector.
T
Usi_usNSpin matrix
Square matrix that forms of respective value.
Can get the y axle equally, the new coordinate figure X ' on the z axle
Usiy, X '
Usiz, obtain at last the coordinate X ' of new rectification
Usi, the X ' of this moment
UsiZ direction of principal axis value X '
UsizCan be non-vanishing.
X′
w=T
w_si·T
s_us·X′
usi----------------(5)
T wherein
S_usThat the ultrasonic scanning space is to the transformation matrix in sensor space, position, T
W_siThe position sensor space is to the transformation matrix in world coordinates space when being the i time ultrasonic scanning.Through type (4) is with the corrected the i time ultrasonic scanning spatial value X ' of impact point
UsiTransform to the world coordinates space, obtain the world space coordinate X ' of more accurate impact point
wX '
UsiZ direction of principal axis value X '
UsizMight be non-vanishing, original two-dimensional ultrasound plane to the conversion between the three-dimensional position sensing device coordinate system, is expanded to certain thickness ultrasonic acoustic beam face to the conversion between the three-dimensional position sensing device space.By the projection of correlated measure, distribute different weights, the axial and lateral error higher with the ultrasonic scanning spatial accuracy remedies the low thickness error of precision, improves the positioning accuracy of impact point.
Object location typical application is the right registration of ultrasonic fusion of imaging mid point in the freedom-arm, three-D ultrasonic system.An important step is the demarcation registration with ultrasonoscopy and another modal data in the ultrasonic fusion of imaging, it be with impact point in world coordinates the position and another modal data in the position of impact point be mapped, the raising of extraterrestrial target spot placement accuracy, can greatly improve registration accuracy, thereby improve the quality of ultrasonic fusion of imaging.The data of another mode can be the imaging datas such as CT, MRI.
In another embodiment, from different directions behind the Multiple-Scan impact point, select a new ultrasonic scanning space that is different from arbitrary scanning direction as the reference space, with all ultrasonic scanning space coordinatess of obtaining behind the Multiple-Scan to this with reference to space projection, obtain each ultrasonic scanning space coordinates to this transformation matrix with reference to the space, correlated measure according to all directions assigns weight for each time scan-data equally, then calculate impact point at this coordinate with reference to the space according to weight and each ultrasonic scanning space coordinates to this transformation matrix with reference to the space, its computing formula is:
X′
usnew=α
1·(T
usnew_us1·X
us1)+…+α
i(T
usnew_usi·X
usi)++…+α
N·(T
usnew_usN·X
usN)---(6)
Wherein: X '
UsnewThat impact point is at the correction coordinate in reference space, α
1, α
2... α
NThe weight vectors of each time scan-data of calculating according to correlated measure, T
Usnew_usNThat the N time ultrasonic scanning space is to the transformation matrix in this new space, X
UsiThe original coordinates that is impact point in the i time ultrasonic scanning space.
In the above-described embodiments, the correlated measure on the different directions can also be resolution, also can be the ultrasonic distributed data that water listens instrument to measure.Correlated measure can be set-point such as δ
x=1, δ
y=1.5, δ
z=3.Also can be degree of depth l, wavelength X, the isoparametric function of first geometry D that shakes is such as δ
x=f
x(l, λ, D), δ
y=f
y(l, λ, D), δ
z=f
z(l, λ, D), for example δ
x=k
x* l* λ, δ
y=k
y* λ, δ
z=k
z* cos (λ/D), kx wherein, ky, kz be the certainty of measurement on all directions relevant estimate parameter.
In above-described embodiment, the weight of distributing according to correlated measure satisfies
α
Ix≤ 1, α
iCan also be other forms, for example α
iCorrelated measure during for each time scanning impact point, the function alpha of each transformation matrix
Ix=f (δ
1, δ
2..., δ
N, T
Us1_us2..., T
Us1_usN), for example
Perhaps
Deng.
In above-described embodiment, position sensor can be based on the position sensor of electromagnetic induction, also can be based on the position sensor of optical principle, also can be based on other position sensor such as grade of Principles of Acoustics.
Above content is in conjunction with concrete embodiment further description made for the present invention, can not assert that implementation of the present invention is confined to these explanations.For the general technical staff of the technical field of the invention, without departing from the inventive concept of the premise, can also make some simple deduction or replace, all should be considered as belonging to protection scope of the present invention.