Detailed Description
As shown in fig. 1, according to the method proposed by the present invention, a volume probe is used to perform three-dimensional scanning imaging on a scanning area containing a fetus, and ultrasonic waves are transmitted and ultrasonic echoes are received. In performing a three-dimensional scan, a sampling frame that is as large as possible may be taken so that the area imaged by the scan encompasses as large as possible or completely the fetal area. And the ultrasonic echo obtained by three-dimensional scanning is subjected to subsequent signal processing and three-dimensional imaging processing to obtain three-dimensional volume data of a scanning area. In the case of three-dimensional imaging of a fetus, these three-dimensional volume data generally include volume data representing an amniotic fluid region and volume data representing regions of the fetus, placenta, uterine wall, and the like, and the sets of three-dimensional volume data representing the respective regions are still referred to herein as an amniotic fluid region, a fetal region, a placental region, and a uterine wall region.
For obstetrical volume imaging, it is desirable to render the surface of the fetus three-dimensionally visible to show the morphology of the fetus. However, when the surface of the fetus is rendered in a three-dimensional visual manner, the fetus is occluded by the placenta, the uterine wall, and other areas around the fetus, and it is difficult to visually image the surface of the fetus.
It is considered that in practice the fetus is usually encapsulated by amniotic fluid, i.e. the uterine wall and between the placenta and the fetus except for the umbilical cord, only amniotic fluid. Therefore, in the invention, the amniotic fluid area is extracted, and the curved surface is obtained in the amniotic fluid area, and because the amniotic fluid area usually covers the fetus, the curved surface also covers the fetus, only the amniotic fluid and the fetus are arranged in the curved surface, and the area such as the uterine wall, the placenta and the like is arranged outside the curved surface. Then, the areas outside the curved surface are removed, i.e., the uterine wall and placenta are removed, and only the portion including the fetal area and the amniotic fluid area is left. The remaining portion is rendered using a visualization algorithm. Because the amniotic fluid area is an anechoic area or a hypoechoic area and does not influence the three-dimensional visual rendering, the three-dimensional visual image of the fetus can be conveniently obtained without being influenced by tissues such as placenta, uterine wall and the like. The steps are explained in detail below.
In step 102, a volume probe may be used to scan and image a fetal-containing region of the abdomen of the pregnant woman using conventional volume imaging methods. In this step, a sampling area as large as possible can be taken to contain the fetus as much as possible or completely in the scanning area, so that the whole fetus can be imaged to obtain three-dimensional volume data.
The characteristics of the ultrasound echo signals in the amniotic and fetal regions of the scanned region are different, for example, the amniotic region is usually a hypoechoic or anechoic region. Therefore, after obtaining the three-dimensional volume data of the scanned region, in step 104, the amniotic fluid region, such as signal intensity or gray value, may be extracted from the three-dimensional volume data according to the characteristic parameters of the echo signal of the amniotic fluid region. For example, a threshold value is set, and of the three-dimensional volume data, the three-dimensional volume data with the signal intensity lower than the threshold value is regarded as the three-dimensional volume data belonging to the amniotic fluid region, and the three-dimensional volume data with the signal intensity higher than the threshold value is regarded as the volume data of the non-amniotic fluid region. And judging all the three-dimensional volume data, namely extracting the three-dimensional volume data of the amniotic fluid area to obtain the amniotic fluid area.
After the amniotic fluid region is obtained, at least one curved surface is constructed in the amniotic fluid region in step 106. Fig. 2 is a schematic diagram of the positional relationship between the amniotic fluid region and the uterine wall and the placental and fetal regions (umbilical cord not shown). As shown in fig. 2, typically the amniotic fluid region is located between the uterine wall and the placental and fetal regions, and the amniotic fluid region covers the fetal region. Thus, the amniotic fluid region is in the form of a hollow convex sphere-like shape in space, and there are a variety of ways in which to construct the curved surface that covers the fetal region.
One method is traced by the user. The extracted amniotic fluid area is displayed in each section image, a user manually traces the contour of a desired curved surface in the amniotic fluid area in each displayed section image, and the system receives the input of the user and generates the required curved surface according to the contour traced by the user.
The second method is to automatically trace the boundary of the amniotic fluid region by an ultrasonic diagnostic system. The system automatically identifies all boundary points of the amniotic fluid region, the uterine wall and the placenta region, and all the identified boundary points can form the required curved surface. For example, the boundary between the amniotic fluid region and other regions can be detected by an edge detection method, then the boundary between the detected amniotic fluid region and the uterine wall and the placental region can be selected, and if there is a discontinuous part in the boundary, the discontinuous part is connected in a fitting manner, so that the required curved surface can be obtained. In this embodiment, the edge detection may use a conventional method for detecting an edge according to the signal intensity or gray scale of a three-dimensional volume data point.
Another method of surface construction is shown in fig. 3 and may include steps 602, 604, and 606. In step 602, determining feature points in an amniotic fluid region; in step 604, a curved surface is constructed according to the feature points, and a curved surface can be constructed; meanwhile, considering that one curved surface cannot include the whole fetal region because the spatial shape of the amniotic fluid region is usually irregular, a plurality of curved surfaces can be constructed; after the plurality of curved surfaces are constructed, the curved surfaces are combined to synthesize a composite curved surface that ultimately includes the fetal region, step 606. There are also various methods of selecting feature points and constructing a curved surface.
One method may be to select a plurality of feature points on the boundary of the amniotic fluid region with the uterine wall and the placental region and then fit a surface based on these feature points.
The simplest fitting surface in this method may be a plane. For example, four points may be selected on the boundary, the four points forming an inscribed rectangle of the amniotic fluid region, a plane within the inscribed rectangle constituting an inscribed rectangle plane of the amniotic fluid region, and such that the inscribed rectangle plane is within the amniotic fluid region without intersecting the fetal region. Then, respectively taking each side of the inscribed rectangle or a part of the side of the inscribed rectangle as one side, and respectively continuously forming another inscribed rectangle plane which is positioned in the amniotic fluid area and is not intersected with the fetal area; then, the other sides of the other inscribed rectangle are used to continue to make similar inscribed rectangle planes, and the like, until the currently made inscribed rectangle plane is intersected with the previously formed inscribed rectangle plane. Thus, the curved surface formed by all the inscribed rectangular planes is the synthetic curved surface covering the fetal region. As shown in fig. 4.
In this embodiment, an inscribed rectangle plane may not be formed, but an arbitrary inscribed quadrangle plane that does not intersect with the fetal region is formed, and then similar inscribed quadrangle planimers that do not intersect with the fetal region are formed by using each side or a part of the side of the inscribed quadrangle as one side, and so on until the inscribed quadrangle plane that is currently made intersects with the inscribed quadrangle plane that is formed before. Thus, the curved surface formed by all the inscribed quadrilateral planes is the synthetic curved surface which covers the fetal region.
In another embodiment of the present invention, three feature points or five or more feature points may be selected on the boundary to form an inscribed triangle plane or inscribed polygon plane of the amniotic fluid region, which does not intersect with the fetal region, and then the inscribed triangle plane or inscribed polygon plane, which does not intersect with the fetal region, is continuously drawn with the side of the inscribed triangle or inscribed polygon as one side until the inscribed triangle plane or inscribed polygon plane is intersected with the previously formed inscribed triangle plane or inscribed polygon plane in a manner similar to the foregoing method. Thus, all of these inscribed triangle planes or inscribed polygon planes constitute a composite curved surface that encompasses the fetal region.
The fitted surface may also be other than a planar combination, but other types of surfaces. Such as spline surfaces, quadratic surfaces, high-order surfaces, or other types of composite surfaces that are composed of respective sub-surfaces. As shown in fig. 5, first four feature points A, B, C, D are selected on the boundary of the amniotic fluid region with the uterine wall and the placental region, wherein the four feature points form an inscribed rectangle of the amniotic fluid region, and a key control point P is selected within the amniotic fluid region.
As shown in fig. 5, the vertex coordinates of the inscribed rectangle ABCD are a (x1, y1, z1), B (x2, y1, z1), C (x1, y2, z1), and D (x2, y2, z 1). Let the coordinates of the key control point P be (x0, y0, z 0). On the basis of the method, a plurality of auxiliary points can be made: making a perpendicular line (projection) from the key control point P to the plane of the rectangle ABCD to obtain a foot (projection point) Q (x0, y0, z 1); the point Q is respectively perpendicular to the four sides of the rectangle ABCD, and then the foot E (x1, y0, z1), F (x2, y0, z1), G (x0, y1, z1) and H (x0, y2, z1) are obtained. Wherein E, F, G, H can be considered as the projected point of the key control point P on the initial frame.
The surface may be an algebraic surface defined by the critical control points P and at least one of the points. For example, a paraboloid having point P as the vertex and passing through point E, F, G, H; or a paraboloid with point P as the vertex and passing through A, B, C, D; or a hyperboloid having point P as the vertex and passing through point E, F, G, H; or a hyperboloid having point P as the vertex and passing through point A, B, C, D; or an ellipsoid which takes the point P as a vertex and passes through the point E, F, G, H; or an ellipsoid which takes the point P as a vertex and passes through the point A, B, C, D; a paraboloid of revolution or a hyperboloid of revolution having point P as a vertex and passing through point E, F; a paraboloid of revolution or a hyperboloid of revolution having point P as a vertex and passing through point G, H; a paraboloid of revolution or a hyperboloid of revolution having point P as a vertex and passing through point A, D; a paraboloid of revolution or a hyperboloid of revolution having point P as a vertex and passing through point B, C; a point P is taken as a vertex and passes through a conical surface or a circular table surface of one point or a plurality of points A, B, C, D, E, F, G, H; and so on. Of course, the curved surface may be a high-order curved surface passing through the point P and some or all of the points described above, or a curved surface defined by the point P and other points on the line segment AB, BD, DC, or AC other than the points described above.
The method for generating the curved surface can be set by a three-dimensional ultrasonic imaging system in a default mode, and can also be flexibly selected by a user through a human-computer interface according to the requirements of actual conditions. After the mode of generating the curved surface is determined, because the coordinates of the points P and A, B, C, D, E, F, G, H are known or can be calculated, the curved surface equation can be solved according to the common mathematical method, thereby determining the required curved surface.
The surface may be a spline surface defined by the key control points, the feature points, and the projected points of the key control points on ABCD, that is, a spline surface defined by the points P and A, B, C, D, E, F, G, H. It may be a Bezier spline surface, a B-spline surface, a NURBS spline surface, or other types of spline surfaces. The calculation according to which spline surface is to be performed may be specified by default by the three-dimensional ultrasound imaging system or selected by the user through a human-machine interface.
When calculating, firstly, a 3 × 3 control point matrix is established:
on the premise that the spline surface form (for example, the Bezier surface is agreed) is determined, the parameter equation of the surface can be directly obtained from the matrix M, and the surface to be determined is determined.
By selecting key control point P and feature point A, B, C, D at the time of construction of the surface, the resulting surface is located in the amniotic fluid region and does not intersect the fetal region.
After obtaining the curved surface, similarly, other similar curved surfaces can be calculated, such as the curved surface defined by ABMN and the key control point T in fig. 5, the curved surface defined by MNCD and the key control point R, and so on. The combined curved surface is the required synthetic curved surface coated with the fetal region.
After the curve is obtained, the side of the curve facing the fetal region is defined as the inside and the side facing the uterine wall and the placental region as the outside. In step 108, the portion of the three-dimensional volume data that is outside the curved surface is removed, leaving only the inside portion. Thus, the three-dimensional volume data of the uterine wall and the placental region are removed, and only the three-dimensional volume data of the amniotic fluid and the fetal region are retained. Then, in step 110, the remaining three-dimensional volume data is rendered in a three-dimensional visualization manner, so that a good three-dimensional image of the surface of the fetus can be obtained, and the influence of the uterine wall and the placenta is removed.
In the embodiment of the present invention, the method for performing three-dimensional visual rendering on the retained three-dimensional volume data may be a three-dimensional visual rendering method commonly used in the industry, and is not described herein again.
Correspondingly, in another embodiment of the present invention, an apparatus for three-dimensional ultrasound imaging is provided, where the apparatus for three-dimensional ultrasound imaging includes a data acquisition module, an extraction module, a curved surface generation module, a data update module, and a rendering module.
The data acquisition module is used for transmitting ultrasonic waves to an imaging target area and receiving ultrasonic echoes to acquire three-dimensional volume data of the imaging target area, wherein the three-dimensional volume data comprises a fetal area and an amniotic fluid area; the extraction module is used for extracting the amniotic fluid region from the three-dimensional volume data; the curved surface generation module is used for generating at least one curved surface in the extracted amniotic fluid area, and the fetal area is positioned on the inner side of the curved surface; the data updating module is used for removing the three-dimensional data positioned on the outer side of the curved surface to obtain updated three-dimensional data; and the drawing module is used for performing three-dimensional visual drawing on the updated three-dimensional volume data.
The extraction module extracts the amniotic fluid region from the three-dimensional volume data according to the characteristic parameters of the echo signals of the amniotic fluid region.
The extraction module may include: the device comprises a threshold setting submodule and a judging submodule, wherein the threshold setting submodule is used for setting a threshold, and the judging submodule is used for judging that an area with the signal intensity smaller than the threshold in the three-dimensional volume data is an amniotic fluid area.
In one embodiment of the present invention, the curved surface generating module may include a receiving sub-module configured to receive a curved surface profile input by a user, and a first curved surface generating sub-module configured to generate at least one curved surface according to the received curved surface profile input by the user.
In an embodiment of the present invention, the curved surface generating module may include a boundary detecting submodule and a second curved surface generating submodule, where the boundary detecting submodule is configured to detect a boundary of the amniotic fluid region; the second curved surface generation submodule is used for generating at least one curved surface according to the detected boundary of the amniotic fluid area.
In an embodiment of the present invention, the curved surface generation module may include a feature point selection sub-module and a third curved surface generation sub-module. The characteristic point selection submodule is used for selecting at least one characteristic point in the amniotic fluid area; and the third curved surface generation submodule is used for generating at least one curved surface according to the at least one characteristic point.
In an embodiment of the present invention, the curved surface generating module may further include a boundary detecting submodule, where the boundary detecting submodule is configured to detect a boundary of the amniotic fluid region; in this embodiment, the feature point selection sub-module selects at least three feature points on the boundary of the amniotic fluid area detected by the boundary detection sub-module; and the third curved surface generation submodule selects at least three characteristic points as an inscribed polygon plane of the amniotic fluid area according to the characteristic point selection submodule, and the inscribed polygon plane is not intersected with the fetal area. For example, three feature points can be selected on the boundary of the amniotic fluid region, and then the three feature points are used as vertexes to be used as an inscribed triangle of the amniotic fluid region; or selecting four characteristic points on the boundary of the amniotic fluid area, and then taking the four characteristic points as vertexes to be used as an inscribed quadrangle of the amniotic fluid area; or selecting five characteristic points on the boundary of the amniotic fluid area, and then taking the five characteristic points as vertexes to serve as inscribed pentagons of the amniotic fluid area; and so on.
In an embodiment of the present invention, the third curved surface generation submodule may further continue to use one side of the inscribed polygon plane as the inscribed polygon plane of the amniotic fluid region, and so on until the inscribed polygon plane currently being used intersects with the inscribed polygon plane previously being used. Each of the inscribed polygon planes of the amniotic fluid region can be processed in this way, and the inscribed polygon plane of the amniotic fluid region is continuously drawn by taking the side as one of the sides, and so on until the currently drawn inscribed polygon plane is intersected with the previously drawn inscribed polygon plane.
In an embodiment of the present invention, the curved surface generation submodule may further include a feature point selection submodule, a third curved surface generation submodule, and a boundary detection submodule, where the boundary detection submodule is configured to detect a boundary of the amniotic fluid region; the characteristic point selection submodule selects at least three characteristic points on the boundary of the amniotic fluid area; the third curved surface generation submodule comprises an inscribed polygon generation unit, a key control point selection unit and a curved surface generation unit. The inscribed polygon generating unit is used for making an inscribed polygon of the amniotic fluid area according to the selected characteristic points; the key control point selection unit is used for selecting at least one key control point on the outer side of an inscribed polygon made in the amniotic fluid area; the surface generation unit is configured to generate at least one surface using the at least one key control point and at least one element of the inscribed polygon.
In an embodiment of the present invention, the surface generation unit calculates an algebraic surface defined by the at least one key control point and the at least one element on the inscribed polygon.
In an embodiment of the present invention, the surface generating unit calculates a spline surface defined by the key control point, the feature point of the inscribed polygon, and the projection point of the key control point on the inscribed polygon.
The present invention has been described above with reference to specific examples, but the present invention is not limited to these specific examples. It will be understood by those skilled in the art that various changes, substitutions of equivalents, variations, and the like can be made thereto without departing from the spirit of the invention, and the scope of the invention is to be determined from the following claims.