CN100450445C - Real-time, freedom-arm, three-D ultrasonic imaging system and method therewith - Google Patents
Real-time, freedom-arm, three-D ultrasonic imaging system and method therewith Download PDFInfo
- Publication number
- CN100450445C CN100450445C CNB2006100111601A CN200610011160A CN100450445C CN 100450445 C CN100450445 C CN 100450445C CN B2006100111601 A CNB2006100111601 A CN B2006100111601A CN 200610011160 A CN200610011160 A CN 200610011160A CN 100450445 C CN100450445 C CN 100450445C
- Authority
- CN
- China
- Prior art keywords
- dimensional
- reconstruction
- image
- ultrasound
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000003384 imaging method Methods 0.000 title claims abstract description 35
- 238000002604 ultrasonography Methods 0.000 claims abstract description 55
- 238000003745 diagnosis Methods 0.000 claims abstract description 13
- 238000009877 rendering Methods 0.000 claims abstract description 12
- 239000000523 sample Substances 0.000 claims description 5
- 230000006870 function Effects 0.000 claims description 4
- 238000004891 communication Methods 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 abstract description 6
- 238000003759 clinical diagnosis Methods 0.000 abstract description 4
- 238000012285 ultrasound imaging Methods 0.000 description 14
- 230000009466 transformation Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 8
- 239000011159 matrix material Substances 0.000 description 7
- 230000029058 respiratory gaseous exchange Effects 0.000 description 7
- 238000005070 sampling Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 238000002474 experimental method Methods 0.000 description 3
- 238000012800 visualization Methods 0.000 description 3
- 238000013178 mathematical model Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000001605 fetal effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Images
Landscapes
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
本发明涉及超声成像技术领域,特别是一种实时自由臂三维超声成像系统及其方法。系统包括:PC机;B超仪;视频采集卡;定位装置;PC机分别连接于B超仪和定位装置。方法包括;(1)视频采集卡连续不断地采集B超仪输出的模拟视频信号;(2)PC机连续不断地从定位装置读取位置发射器和位置接收器间的6自由度参数;(3)PC机为最新采集到的二维B超图像匹配上相应的方位信息,然后根据二维图像进行三维重建;(4)PC机对每一幅二维图像进行三维重建后,计算整个体的重建率和重建率增量,然后动态更新重建率,并根据重建率增量驱动扫描重建体的实时体绘制。本发明用于临床诊断中对诊断部位进行实时、交互的三维超声成像。
The invention relates to the technical field of ultrasonic imaging, in particular to a real-time free-arm three-dimensional ultrasonic imaging system and a method thereof. The system includes: a PC; a B-ultrasound instrument; a video acquisition card; a positioning device; the PC is respectively connected to the B-ultrasonic instrument and the positioning device. The method comprises: (1) the video acquisition card continuously collects the analog video signal output by the B-ultrasound instrument; (2) the PC continuously reads the 6-degree-of-freedom parameter between the position transmitter and the position receiver from the positioning device; 3) The PC matches the corresponding orientation information with the newly acquired 2D B-ultrasound image, and then performs 3D reconstruction based on the 2D image; (4) After the PC performs 3D reconstruction of each 2D image, calculate the whole volume The reconstruction rate and the reconstruction rate increment, and then dynamically update the reconstruction rate, and drive the real-time volume rendering of the scanned reconstructed body according to the reconstruction rate increment. The invention is used for real-time and interactive three-dimensional ultrasonic imaging of the diagnosis part in clinical diagnosis.
Description
技术领域 technical field
本发明涉及超声成像技术领域,特别是一种实时自由臂三维超声成像系统及其方法。The invention relates to the technical field of ultrasonic imaging, in particular to a real-time free-arm three-dimensional ultrasonic imaging system and a method thereof.
背景技术 Background technique
获取三维超声图像的方法被称为三维超声成像方法,它是自二维B超成像以来医学诊断技术史上的又一次飞跃。目前三维超声成像系统中使用的三维成像方法有直接三维超声成像方法(采用三维容积阵列探头一次成像)和重建式三维超声成像方法两种。由于直接三维超声成像系统的硬件价格比较昂贵,且不适合大区域的三维超声成像,因此现在国内外使用的三维超声成像系统大多数还是采用重建式三维超声成像方法,具体包括机械臂三维超声成像、手持机械扫三维超声成像和带有定位装置的自由臂三维超声成像这三种方法。其中自由臂三维超声成像方法只需在传统的二维B超探头的把持端固定上一个定位装置的接收器就可以进行目标体的三维扫描成像,能将任何一台常规的二维超声仪升级成三维超声设备。由于其使用方便灵活,已经成为三维超声成像研究和临床应用领域非常活跃的部分。The method of obtaining three-dimensional ultrasound images is called three-dimensional ultrasound imaging method, which is another leap in the history of medical diagnostic technology since two-dimensional B-ultrasound imaging. The three-dimensional imaging methods currently used in the three-dimensional ultrasound imaging system include direct three-dimensional ultrasound imaging method (one-time imaging using a three-dimensional volume array probe) and reconstruction three-dimensional ultrasound imaging method. Since the hardware of the direct 3D ultrasound imaging system is relatively expensive and is not suitable for 3D ultrasound imaging of large areas, most of the 3D ultrasound imaging systems currently used at home and abroad still use reconstruction 3D ultrasound imaging methods, specifically including 3D ultrasound imaging of manipulators. Three-dimensional ultrasonic imaging, hand-held mechanical scanning and free-arm three-dimensional ultrasonic imaging with a positioning device. Among them, the free-arm three-dimensional ultrasonic imaging method only needs to fix the receiver of a positioning device on the handle end of the traditional two-dimensional B-ultrasound probe to perform three-dimensional scanning imaging of the target body, which can upgrade any conventional two-dimensional ultrasonic instrument into a three-dimensional ultrasound device. Because of its convenience and flexibility, it has become a very active part in the field of 3D ultrasound imaging research and clinical application.
国内外在自由臂三维超声成像方面的研究已经有十多年的历史,取得了一定的成果。在临床诊断中,临床医生需要获得诊断部位的尽可能详细的信息,以得出更准确的诊断结果。因此临床医生希望在扫描的同时,就能知道诊断部位的哪些部分已经完成扫描成像,哪些部分还需要进行扫描成像,从而可以根据这些信息交互地扫描得到诊断部位的比较完备的三维图像。但现有的自由臂三维超声成像系统将扫描、三维重建和可视化分离,或是在采集完成所有扫描数据后再进行重建和显示,或是在扫描的同时进行采集、重建,在扫描完成后再进行显示,这就不能提供必要的交互信息,临床医生只能在其重建完成并显示后才能看到扫描成像的结果,而不能在扫描的过程中实时掌握扫描成像的信息,从而不能根据实际诊断的需要实时交互地扫描得到完备的三维图像。The research on free-arm three-dimensional ultrasound imaging at home and abroad has a history of more than ten years and has achieved certain results. In clinical diagnosis, clinicians need to obtain as detailed information as possible of the diagnosis site in order to obtain more accurate diagnosis results. Therefore, clinicians hope that while scanning, they can know which parts of the diagnostic part have been scanned and which parts need to be scanned, so that they can interactively scan based on this information to obtain a relatively complete three-dimensional image of the diagnostic part. However, the existing free-arm 3D ultrasound imaging system separates scanning, 3D reconstruction and visualization, or reconstructs and displays after collecting all the scanning data, or collects and reconstructs while scanning, and then performs reconstruction after scanning is completed. Display, which cannot provide the necessary interactive information, clinicians can only see the results of scanning imaging after the reconstruction is completed and displayed, but cannot grasp the information of scanning imaging in real time during the scanning process, so that the actual diagnosis cannot be made The need for real-time interactive scanning to obtain a complete three-dimensional image.
发明内容 Contents of the invention
本发明所述的实时自由臂三维超声成像系统以传统B超仪、视频采集卡和定位装置为接口,以一种实时自由臂三维超声成像方法为核心,将得到的二维B超图像实时重建成三维超声图像,并根据重建率增量驱动扫描重建体的实时体绘制。The real-time free-arm three-dimensional ultrasonic imaging system of the present invention takes a traditional B-ultrasound instrument, a video acquisition card and a positioning device as an interface, takes a real-time free-arm three-dimensional ultrasonic imaging method as the core, and reconstructs the obtained two-dimensional B-ultrasound image in real time It generates 3D ultrasound images and drives real-time volume rendering of scanned reconstructed volumes based on reconstruction rate increments.
根据本发明,所述系统由两部分组成,第一部分是实时自由臂三维超声成像硬件系统;第二部分是在第一部分基础上的实时自由臂三维超声成像软件系统。According to the present invention, the system is composed of two parts, the first part is a real-time free-arm three-dimensional ultrasonic imaging hardware system; the second part is a real-time free-arm three-dimensional ultrasonic imaging software system based on the first part.
在本发明中,系统连续不断地采集二维B超图像和读取定位装置的发射器与接收器间的6自由度方位信息,实时为最新采集到的B超图像匹配上相应的方位信息,然后对该二维图像进行快速实时三维重建。系统对每一幅二维图像进行三维重建后都会计算整个体的重建率和重建率增量,然后动态更新显示整个体的重建率,并根据重建率增量驱动扫描重建体的实时体绘制。由于临床医生在对诊断部位进行扫描的同时,不仅能定性地看到扫描重建的可视化结果,还可以定量地看到整个体的重建率,使得其能够根据实际诊断的需要,扫描重建得到诊断部位的完备的三维图像。并且由于系统采用了数据驱动的三维重建方法,这便可以结合循环呼吸的特点克服呼吸对扫描重建产生的影响,提高成像质量。本发明用于临床诊断中对诊断部位进行实时、交互的三维超声成像。In the present invention, the system continuously collects two-dimensional B-ultrasound images and reads the 6-degree-of-freedom orientation information between the transmitter and the receiver of the positioning device, and matches the corresponding orientation information for the newly collected B-ultrasound images in real time. This 2D image is then subjected to fast real-time 3D reconstruction. After 3D reconstruction of each 2D image, the system will calculate the reconstruction rate and the reconstruction rate increment of the whole volume, then dynamically update and display the reconstruction rate of the whole volume, and drive the real-time volume rendering of the scanned reconstructed volume according to the reconstruction rate increment. Because clinicians can not only qualitatively see the visualization results of scan reconstruction while scanning the diagnostic part, but also quantitatively see the reconstruction rate of the whole body, so that they can scan and reconstruct the diagnostic part according to the needs of actual diagnosis. complete 3D image. And because the system adopts a data-driven three-dimensional reconstruction method, it can combine the characteristics of respiration to overcome the influence of respiration on the scan reconstruction and improve the imaging quality. The invention is used for real-time and interactive three-dimensional ultrasonic imaging of the diagnosis part in clinical diagnosis.
附图说明 Description of drawings
图1是本发明的实时自由臂三维超声成像系统图。Fig. 1 is a diagram of the real-time free-arm three-dimensional ultrasonic imaging system of the present invention.
图2是本发明的实时自由臂三维超声成像方法流程图。Fig. 2 is a flowchart of the real-time free-arm three-dimensional ultrasonic imaging method of the present invention.
图3是实时自由臂三维超声成像系统的三维重建的框架图。Fig. 3 is a frame diagram of the 3D reconstruction of the real-time free-arm 3D ultrasound imaging system.
图4是本发明所采用的对二维图像像素进行坐标变换的数学模型图。Fig. 4 is a mathematical model diagram for coordinate transformation of two-dimensional image pixels adopted in the present invention.
图5是本发明采用一个循环队列缓存结构和三个处理线程B超图像匹配图。Fig. 5 is a B-ultrasound image matching diagram using a circular queue buffer structure and three processing threads in the present invention.
图6是本发明在扫描重建前系统将重建体空间网格化图。Fig. 6 is a grid diagram of the reconstructed volume space by the system before scanning and reconstruction in the present invention.
图7是采用本发明进行实时重建实验的动态过程图。Fig. 7 is a dynamic process diagram of a real-time reconstruction experiment using the present invention.
具体实施方式 Detailed ways
根据本发明,所述的实时自由臂三维超声成像硬件系统的系统结构见图1。该硬件系统包括如下几个部分:实时自由臂三维超声成像系统以实时自由臂三维超声成像软件系统为核心,以传统B超仪、视频采集卡和定位装置为接口,实现临床诊断中对诊断部位进行实时交互的扫描成像。According to the present invention, the system structure of the real-time free-arm three-dimensional ultrasonic imaging hardware system is shown in FIG. 1 . The hardware system includes the following parts: The real-time free-arm three-dimensional ultrasonic imaging system takes the real-time free-arm three-dimensional ultrasonic imaging software system as the core, and uses the traditional B-ultrasound instrument, video acquisition card and positioning device as the interface to realize the diagnosis of the diagnosis site in clinical diagnosis. Perform real-time interactive scan imaging.
图1本发明的实时自由臂三维超声成像系统包括:The real-time free-arm three-dimensional ultrasonic imaging system of the present invention of Fig. 1 comprises:
一台PC机,该PC机具有安装视频采集卡的插槽并能支持视频采集卡工作。其通讯接口采用USB接口用于和定位装置的USB接口相连,或采用串行接口用于和定位装置的串行接口相连,并能从定位装置读取位置发射器和位置接收器间的6自由度参数。A PC, the PC has a slot for installing a video capture card and can support the work of the video capture card. Its communication interface adopts USB interface for connecting with the USB interface of the positioning device, or adopts a serial interface for connecting with the serial interface of the positioning device, and can read the 6-freedom between the position transmitter and the position receiver from the positioning device. degree parameter.
一台B超仪,该B超仪能连续不断地采集诊断部位的二维B超图像,并能将采集到的二维B超图像以模拟视频信号的形式输出;所述B超仪具有对二维B超图像的测距功能。A B-ultrasound instrument, which can continuously collect two-dimensional B-ultrasound images of diagnostic parts, and can output the collected two-dimensional B-ultrasound images in the form of analog video signals; The ranging function of two-dimensional B-ultrasound images.
一个视频采集卡,视频采集卡在PC机内;用于采集模拟视频信号输出,并将采集到的模拟视频信号转换为PC机可以处理的二维数字图像,该视频采集卡能通过连接线与B超仪的模拟视频输出口相连,能连续不断地采集B超仪输出的模拟视频信号,并能将转换后的二维数字图像送入PC机的内存。A video capture card, the video capture card is in the PC; it is used to collect analog video signal output, and convert the collected analog video signal into a two-dimensional digital image that can be processed by the PC. The analog video output port of the B-ultrasound instrument is connected, which can continuously collect the analog video signal output by the B-ultrasound instrument, and can send the converted two-dimensional digital image into the memory of the PC.
一台定位装置,该装置至少具有一对发射器和接收器,定位装置的接收器被固定在B超仪探头的把持端,发射器被固定在离诊断部位一定方位的地方,该定位装置可以通过连接线与PC机的USB口或串行接口相连,能连续不断地测量发射器和接收器间的6自由度参数,并将其送入输出缓存供PC机读取。PC机分别连接于B超仪和定位装置。A positioning device, which has at least a pair of transmitters and receivers, the receiver of the positioning device is fixed on the handle end of the probe of the B-ultrasound instrument, and the transmitter is fixed at a certain position from the diagnosis site. The positioning device can Connected to the USB port or serial interface of the PC through the connecting line, the 6-degree-of-freedom parameters between the transmitter and the receiver can be continuously measured, and sent to the output buffer for the PC to read. The PC is respectively connected to the B-ultrasonic instrument and the positioning device.
所述PC机具有安装视频采集卡的插槽并能支持视频采集卡工作,其通讯接口采用USB接口用于和定位装置的USB接口相连,或采用串行接口用于和定位装置的串行接口相连,并能从定位装置读取位置发射器和位置接收器间的6自由度参数。The PC has a slot for installing a video capture card and can support the work of the video capture card, and its communication interface adopts a USB interface for connecting with the USB interface of the positioning device, or adopts a serial interface for connecting with the serial interface of the positioning device Connected, and can read the 6-DOF parameters between the position transmitter and the position receiver from the positioning device.
所述B超仪能连续不断地采集二维B超图像,并能将采集到的二维B超图像以模拟视频信号的形式输出;所述B超仪具有对二维B超图像的测距功能。The B-ultrasonic instrument can continuously collect two-dimensional B-ultrasonic images, and can output the collected two-dimensional B-ultrasonic images in the form of analog video signals; Function.
所述视频采集卡能通过连接线与B超仪的模拟视频输出口相连,能连续不断地采集B超仪输出的模拟视频信号,并能将转换后的二维数字图像送入PC机的内存。The video acquisition card can be connected with the analog video output port of the B-ultrasonic instrument through the connecting wire, can continuously collect the analog video signal output by the B-ultrasonic instrument, and can send the converted two-dimensional digital image into the memory of the PC .
所述定位装置的接收器被固定在B超仪探头的把持端,发射器被固定在离诊断部位一定方位的地方;所述定位装置可以通过连接线与PC机的USB口或串行接口相连,能连续不断地测量发射器和接收器间的6自由度参数,并将其送入输出缓存供PC机读取。The receiver of the positioning device is fixed on the holding end of the probe of the B-ultrasound instrument, and the transmitter is fixed at a certain position away from the diagnosis site; the positioning device can be connected to the USB port or the serial interface of the PC through a connecting line , can continuously measure the 6-DOF parameters between the transmitter and the receiver, and send them to the output buffer for PC to read.
图2是本发明的实时自由臂三维超声成像方法流程图。在扫描的同时,一方面视频采集卡连续不断地采集B超仪输出的模拟视频信号,并将转换后的二维数字图像送入计算机的内存,另一方面计算机连续不断地读取定位仪的发射器与接收器间的方位信息,这两者是并行地进行的。计算机实时为最新采集到的二维B超图像匹配上相应的方位信息,并对该二维图像进行实时的三维重建。在每完成一幅二维图像的三维重建后,都重新计算体的重建率和重建率增量,然后更新显示体的重建率,并根据重建率增量驱动扫描重建体的重新体绘制。Fig. 2 is a flowchart of the real-time free-arm three-dimensional ultrasonic imaging method of the present invention. While scanning, on the one hand, the video acquisition card continuously collects the analog video signal output by the B-ultrasound instrument, and sends the converted two-dimensional digital image into the memory of the computer; on the other hand, the computer continuously reads the locator's Azimuth information between transmitter and receiver, both of which are carried out in parallel. The computer matches the corresponding azimuth information to the newly acquired two-dimensional B-ultrasound image in real time, and performs real-time three-dimensional reconstruction on the two-dimensional image. After each 3D reconstruction of a 2D image is completed, the volume reconstruction rate and the reconstruction rate increment are recalculated, and then the reconstruction rate of the displayed volume is updated, and the re-volume rendering of the scanned and reconstructed volume is driven according to the reconstruction rate increment.
根据本发明,所述的实时自由臂三维超声成像软件系统是在PC机内实现的,方法流程见图2。该软件系统的自由臂三维超声成像方法包括如下步骤:According to the present invention, the real-time free-arm three-dimensional ultrasonic imaging software system is implemented in a PC, and the method flow is shown in FIG. 2 . The free-arm three-dimensional ultrasonic imaging method of the software system includes the following steps:
(1)视频采集卡连续不断地采集B超仪输出的模拟视频信号,并将转换后的二维数字图像送入PC机的内存;(1) The video acquisition card continuously collects the analog video signal output by the B-ultrasound instrument, and sends the converted two-dimensional digital image into the memory of the PC;
(2)PC机连续不断地从定位装置读取位置发射器和位置接收器间的6自由度参数;(2) The PC continuously reads the 6-DOF parameters between the position transmitter and the position receiver from the positioning device;
(3)PC机为最新采集到的二维B超图像匹配上相应的方位信息,然后对该二维图像进行三维重建;(3) The PC matches the corresponding orientation information for the newly acquired two-dimensional B-ultrasound image, and then performs three-dimensional reconstruction on the two-dimensional image;
(4)PC机对每一幅二维图像进行三维重建后,计算整个体的重建率和重建率增量,然后动态更新显示整个体的重建率,并根据重建率增量驱动扫描重建体的实时体绘制。(4) After the PC performs 3D reconstruction of each 2D image, calculate the reconstruction rate and the reconstruction rate increment of the whole body, then dynamically update and display the reconstruction rate of the whole body, and drive the scanning of the reconstructed body according to the reconstruction rate increment Real-time volume rendering.
所述的方法,还包括以下步骤:The described method also includes the following steps:
只有当最新采集到的二维B超图像得到成功的方位信息匹配时才进行三维重建,否则丢弃该二维B超图像。The three-dimensional reconstruction is performed only when the newly acquired two-dimensional B-ultrasound image is successfully matched with the orientation information, otherwise the two-dimensional B-ultrasound image is discarded.
还包括以下步骤:Also includes the following steps:
在扫描重建过程中的任意时刻都可以暂停扫描,暂停不会损坏已扫描重建的数据,而且之后可继续进行扫描重建。The scan can be paused at any time during the scan and rebuild process, the pause will not damage the scanned and reconstructed data, and the scan and rebuild can be continued afterwards.
用和二维B超图像采集时间最接近的前、后两个方位数据插值的方法为最新采集到的二维B超图像匹配上方位信息。Using the interpolation method of the front and back azimuth data closest to the acquisition time of the two-dimensional B-ultrasound image to match the upper azimuth information for the latest acquired two-dimensional B-ultrasound image.
采用基于二维B超图像的数据驱动的三维重建方法,只有采集到二维B超图像才可能进行该二维图像的三维重建。Using the data-driven three-dimensional reconstruction method based on the two-dimensional B-ultrasound image, the three-dimensional reconstruction of the two-dimensional image is possible only when the two-dimensional B-ultrasound image is collected.
临床医生选择受呼吸影响较小的诊断部位进行连续不断的扫描成像从而达到较好的成像质量。The clinician selects the diagnostic part less affected by breathing for continuous scanning and imaging to achieve better imaging quality.
根据本发明,所述三维重建过程总体上可分为对二维图像像素进行坐标变换和在重建体空间中进行体采样两个阶段。According to the present invention, the three-dimensional reconstruction process can generally be divided into two stages: coordinate transformation of two-dimensional image pixels and volume sampling in the reconstructed volume space.
三维重建的框架见图3。在扫描重建前,系统预先根据需要或按一定准则适当地选取体素的大小,并将重建体空间网格化为一个规则的体素场,其中每个体素都是具有一定大小的长方体块。在扫描重建过程中,系统获得二维图像和与该二维图像相关的方位信息,利用一系列坐标变换将二维图像的每一个像素都变换到重建体空间坐标系下。在规则的体素场中,对重建体空间坐标系下的每一个像素进行体采样,即按一定准则将这些像素的像素值赋给体素场中合适的体素,从而完成了二维图像的三维重建。随着扫描的继续,系统不断地进行二维图像的三维重建,最终得到一个规则的体数据集,也即重建体数据。The framework of 3D reconstruction is shown in Fig. 3. Before scanning and reconstruction, the system pre-selects the size of voxels according to needs or according to certain criteria, and grids the reconstructed volume space into a regular voxel field, in which each voxel is a cuboid block with a certain size. During the scanning and reconstruction process, the system obtains the two-dimensional image and the orientation information related to the two-dimensional image, and uses a series of coordinate transformations to transform each pixel of the two-dimensional image into the reconstruction space coordinate system. In the regular voxel field, volume sampling is performed on each pixel in the reconstructed volume space coordinate system, that is, the pixel values of these pixels are assigned to the appropriate voxel in the voxel field according to certain criteria, thus completing the two-dimensional image 3D reconstruction of . As the scanning continues, the system continuously performs three-dimensional reconstruction of two-dimensional images, and finally obtains a regular volume data set, that is, reconstructed volume data.
本发明所采用的对二维图像像素进行坐标变换的数学模型见图4。图中共有4个坐标系。P是建立在B超扫描平面上的坐标系,其X轴和Y轴都在扫描平面内,分别沿着二维扫描图像的横向和纵向。因为每一幅二维B超图像平面都与扫描平面一致,所以任何一个像素在P坐标系中的Z坐标值都为零。R是建立在所述接收器上的坐标系,T是建立在所述发射器上的坐标系,这两个坐标系分别采用6自由度定位仪的所述定位装置的接收器和发射器的默认坐标系。C是建立在重建体空间上的坐标系,一般选取C的坐标原点在重建体空间的一个顶点,而其三个轴向分别在经过这个顶点的三条棱上。二维B超图像像素从P坐标系到C坐标系的坐标变换过程可参见图4中白线的运动路径。其坐标变换关系可以用三个坐标变换矩阵连乘的形式来表示:CX=CTT·TTR·RTP·PX,其中The mathematical model for coordinate transformation of two-dimensional image pixels adopted in the present invention is shown in FIG. 4 . There are 4 coordinate systems in the figure. P is a coordinate system established on the B-ultrasound scanning plane, and its X-axis and Y-axis are both in the scanning plane, respectively along the horizontal and vertical directions of the two-dimensional scanning image. Because the plane of each two-dimensional B-ultrasound image is consistent with the scanning plane, the Z coordinate value of any pixel in the P coordinate system is zero. R is the coordinate system established on the receiver, and T is the coordinate system established on the transmitter. These two coordinate systems respectively adopt the receiver and the transmitter of the positioning device of the 6-DOF locator. The default coordinate system. C is a coordinate system established on the reconstructed volume space. Generally, the coordinate origin of C is selected at a vertex of the reconstructed volume space, and its three axes are respectively on the three edges passing through this vertex. The coordinate transformation process of the two-dimensional B-ultrasound image pixels from the P coordinate system to the C coordinate system can be referred to the movement path of the white line in Fig. 4 . Its coordinate transformation relationship can be expressed in the form of multiplication of three coordinate transformation matrices: C X = C T T · T T R · R T P · P X, where
PX=[sxμsyv 01]T 是二维图像像素在P坐标系下坐标值的齐次形式。Sx和Sy分别是二维图像像素在横向和纵向的间隔,可以根据B超仪的测距功能求出,v和μ分别是用于存储二维图像的二维数组的行和列的索引值,RTP是P坐标系到R坐标系的坐标变换矩阵,TTR是R坐标系到T坐标系的坐标变换矩阵,CTT是T坐标系到C坐标系的坐标变换矩阵,CX是像素经变换后在C坐标系下坐标值的齐次形式。RTP,TTR和CTT可以写成一个统一的矩阵形式: P X=[s x μs y v 01] T is the homogeneous form of the coordinate values of the two-dimensional image pixels in the P coordinate system. S x and S y are the horizontal and vertical intervals of two-dimensional image pixels respectively, which can be obtained according to the ranging function of the B-ultrasound instrument, and v and μ are the row and column values of the two-dimensional array used to store the two-dimensional image respectively Index value, R T P is the coordinate transformation matrix from P coordinate system to R coordinate system, T T R is the coordinate transformation matrix from R coordinate system to T coordinate system, C T T is the coordinate transformation matrix from T coordinate system to C coordinate system , C X is the homogeneous form of the coordinate value of the transformed pixel in the C coordinate system. R T P , T T R and C T T can be written in a unified matrix form:
表示I坐标系到J坐标系的坐标变换矩阵。x,y,z,α,β,γ是两坐标系间的6自由度参数。Indicates the coordinate transformation matrix from the I coordinate system to the J coordinate system. x, y, z, α, β, γ are 6 degrees of freedom parameters between the two coordinate systems.
由公式CX=CTT·TTR·RTP·PX可知,将二维图像像素从P坐标系变换到C坐标系必须要知道与这个二维图像相关的一系列变换矩阵。RTP可以通过空间校准得到,CTT是根据实际扫描需要而交互选择的矩阵参数,两者都可以预先得到。因此只需要得到与二维图像相关的TTR就可以将该二维图像像素变换到C坐标系下。这就要求在采集二维图像的同一时刻采集得到TTR。但实际上达不到这一同时性,因为计算机不能同时进行这两个数据的采集。From the formula C X = C T T · T T R · R T P · P X, it can be seen that to transform the pixels of a two-dimensional image from the P coordinate system to the C coordinate system, it is necessary to know a series of transformation matrices related to the two-dimensional image. R T P can be obtained through spatial calibration, and C T T is a matrix parameter that is interactively selected according to actual scanning needs, both of which can be obtained in advance. Therefore, it is only necessary to obtain the TTR related to the two-dimensional image to transform the pixels of the two-dimensional image into the C coordinate system. This requires TTR to be collected at the same time as the two-dimensional image is collected. But in fact, this simultaneity cannot be achieved, because the computer cannot collect these two data at the same time.
图5是本发明采用一个循环队列缓存结构和三个处理线程B超图像匹配图。位置采集线程持续不断地将从定位仪读入的方位数据及其时间标记存放入循环队列缓存。匹配线程实时根据最新采集到的二维图像的时间标记到循环队列缓存中去查找与该二维图像匹配的方位数据。Fig. 5 is a B-ultrasound image matching diagram using a circular queue buffer structure and three processing threads in the present invention. The location acquisition thread continuously stores the orientation data read from the locator and its time stamp into the circular queue buffer. The matching thread searches the circular queue buffer for the orientation data matching the two-dimensional image in real time according to the time stamp of the latest collected two-dimensional image.
本发明采用一个循环缓存结构和三个处理线程为最新采集到的二维B超图像匹配上相应的方位信息,匹配过程见图5所示。循环缓存的长度为N,用于循环存放最新读入的方位数据及其时间标记。循环存放的方法如下:The present invention adopts a circular buffer structure and three processing threads to match the corresponding orientation information on the newly collected two-dimensional B-ultrasound images, and the matching process is shown in FIG. 5 . The length of the circular buffer is N, which is used to circularly store the latest read orientation data and its time stamp. The method of circular storage is as follows:
(1)开辟一个长度为N的数据缓存,设置一个对该缓存的索引,记为n,(1) Open up a data cache with a length of N, and set an index to the cache, denoted as n,
且0<n<N-1.And 0<n<N-1.
(2)在每增加一个数据存放前,将n=n+1,若n=N,则置n=0,并将(2) Before each additional data is stored, set n=n+1, if n=N, set n=0, and
该数据放入数据缓存中n所索引的位置。The data is put into the data cache at the location indexed by n.
使用循环缓存不仅能将未知数量的数据存放在一个有限大小的内存空间,而且还避免了内存搬移带来的额外开销,在所述这样一个要求实时的系统中明显提高了效率。The use of circular cache can not only store unknown amount of data in a limited memory space, but also avoid the extra overhead caused by memory transfer, which obviously improves the efficiency in such a system that requires real-time.
本发明所述的三个处理线程分别是位置采集线程、二维图像采集线程和匹配线程,具体实现方法如下:The three processing threads of the present invention are respectively a position acquisition thread, a two-dimensional image acquisition thread and a matching thread, and the specific implementation methods are as follows:
(1)位置采集线程持续不断地从定位仪读入R坐标系与T坐标系间的方位数据,同时为其标记上采集时间,记为Tp。并将6自由度参数及其时间标记存放入循环缓存;(1) The position acquisition thread continuously reads the orientation data between the R coordinate system and the T coordinate system from the locator, and at the same time marks the acquisition time for it, which is recorded as Tp. And store the 6-degree-of-freedom parameters and their time stamps in the circular buffer;
(2)二维图像采集线程持续不断地采集二维B超图像,并将其存放入PC机的内存中,同时为其标记上采集时间,记为Ti;(2) The two-dimensional image acquisition thread continuously acquires the two-dimensional B-ultrasound image, and stores it in the memory of the PC, and marks the acquisition time for it at the same time, which is recorded as Ti;
(3)匹配线程实时根据最新采集的二维图像的时间标记到循环缓存中去查找。若Tp1<Ti<Tp2,则取出与Tp1和Tp2对应的方位数据,线性插值出与该二维图像匹配的方位数据。若Ti大于循环缓存中的最大Tp,则立即追加一个方位数据的读入,用循环缓存中最大Tp所对应的方位数据和追加读入的方位数据,线性插值出与该二维图像匹配的方位数据。若Ti小于循环缓存中的最小Tp,则舍弃该二维图像,不对其进行重建。由于图像数据的采集时间比方位数据的采集时间长,因此一般都不会出现第三种情况。(3) The matching thread searches in the circular buffer according to the time stamp of the latest collected two-dimensional image in real time. If Tp1<Ti<Tp2, the orientation data corresponding to Tp1 and Tp2 are taken out, and the orientation data matching the two-dimensional image is obtained by linear interpolation. If Ti is greater than the maximum Tp in the circular buffer, immediately add an orientation data read-in, use the orientation data corresponding to the maximum Tp in the circular buffer and the additional read-in orientation data, and linearly interpolate the orientation that matches the two-dimensional image data. If Ti is smaller than the minimum Tp in the circular buffer, the two-dimensional image is discarded and not reconstructed. Since the acquisition time of image data is longer than that of azimuth data, the third case generally does not occur.
根据本发明,在扫描重建前,系统就已经将重建体空间网格化为了一个规则的体素场,每个体素是一个长方体块,且所有体素的大小都是相等的,该规则体素场在计算机内部以三维数组的形式表示。并将所有体素的初值置0。规则的体素场见图6,该规则体素场在PC机中以三维数组的形式表示。由所述的匹配线程,系统得到了最新采集的二维B超图像和与其匹配的R、T坐标系间的6自由度参数。在6自由度参数转换为矩阵TTR之后,就可以利用所述公式CX=CTT·TTR·RTP·PX将二维图像像素变换到C坐标系下。对变换到C坐标系下的每一个像素点进行体采样,便得到了该像素在规则体素场中的重建结果。本发明中采用最近邻保样的方法对像素点进行体采样。其方法如下:According to the present invention, before scanning and reconstruction, the system has gridded the reconstructed volume space into a regular voxel field, each voxel is a cuboid block, and all voxels are equal in size, the regular voxel Fields are represented internally by the computer as three-dimensional arrays. And set the initial value of all voxels to 0. The regular voxel field is shown in Fig. 6, and the regular voxel field is expressed in the form of a three-dimensional array in the PC. From the matching thread, the system obtains the newly acquired two-dimensional B-ultrasound image and the 6-degree-of-freedom parameters between the R and T coordinate systems matched with it. After the 6-DOF parameters are transformed into the matrix TTR , the two-dimensional image pixels can be transformed into the C coordinate system by using the formula C X = C T T · T T R · R T P · P X . Volume sampling is performed on each pixel transformed into the C coordinate system, and the reconstruction result of the pixel in the regular voxel field is obtained. In the present invention, the nearest neighbor sampling method is adopted to perform volume sampling on the pixel points. The method is as follows:
(1)设像素p在C坐标系下的位置为P,像素值为Vp;(1) Let the position of the pixel p in the C coordinate system be P, and the pixel value be Vp ;
(2)设体素v在C坐标系下所占的空间区域为R,体素值为Vv;(2) Set the space area occupied by the voxel v under the C coordinate system as R, and the voxel value is V v ;
(3)若对像素pi,其Pi在Rj范围内,同时体素vj的体素值为0,(3) If the pixel p i is within the range of R j , and the voxel value of voxel v j is 0,
且尚未被赋值,则使Vvj=Vpi。and has not been assigned a value, then make V vj =V pi .
图7是采用本发明进行实时重建实验的动态过程图。图中的物体是实验用的胎儿模型。在整个扫描过程中,系统实时获取二维图像数据及其方位信息,实时进行三维重建计算,并根据重建率增量驱动扫描重建体的实时体绘制。图中分别显示了完成整个体扫描重建的30%、60%、85%和92%时的体绘制结果。Fig. 7 is a dynamic process diagram of a real-time reconstruction experiment using the present invention. The object in the picture is the fetal model used in the experiment. During the whole scanning process, the system acquires 2D image data and its orientation information in real time, performs 3D reconstruction calculation in real time, and drives the real-time volume rendering of the scanned reconstructed volume according to the reconstruction rate increment. The figure shows the volume rendering results when 30%, 60%, 85% and 92% of the whole volume scan reconstruction are completed, respectively.
根据本发明,在对每一幅二维图像进行三维重建后,计算整个体的重建率和重建率增量,然后动态更新显示整个体的重建率,并根据重建率增量驱动扫描重建体的实时体绘制,实时重建的动态可视化过程见图7。具体实现包括如下步骤:According to the present invention, after performing three-dimensional reconstruction on each two-dimensional image, calculate the reconstruction rate and the reconstruction rate increment of the whole body, then dynamically update and display the reconstruction rate of the whole body, and drive the scanning of the reconstructed body according to the reconstruction rate increment The dynamic visualization process of real-time volume rendering and real-time reconstruction is shown in Figure 7. The specific implementation includes the following steps:
(1)设规则体素场中的体素总数为Vtotal;(1) Let the total number of voxels in the regular voxel field be V total ;
(2)设规则体素场中,当前已被填充的体素(在三维重建过程中被赋值)数目为Vcurrent,且初始Vcurrent=0;(2) Assuming that in the regular voxel field, the number of currently filled voxels (assigned during the 3D reconstruction process) is V current , and the initial V current =0;
(3)设重建体在上一次三维体显示时,规则体素场中已被填充的体素数目为Vorigin,且初始Vorigin=Vcurrent=0;(3) Assume that the number of filled voxels in the regular voxel field is V origin when the reconstructed body is displayed in the last 3D volume, and the initial V origin =V current =0;
(4)设驱动扫描重建体实时体绘制的重建率增量阈值为R(如5%);(4) Set the reconstruction rate increment threshold of the real-time volume rendering of the driving scanning reconstruction volume as R (such as 5%);
(5)在对每一幅二维图像进行三维重建过程中,若有一个新体素被填充,则Vcurrent=Vcurrent+1;(5) During the three-dimensional reconstruction of each two-dimensional image, if a new voxel is filled, then V current = V current +1;
(6)在对每一幅二维图像进行三维重建后,计算整个体的重建率Rtotal=100*Vcurrent/Vtotal;(6) After performing three-dimensional reconstruction on each two-dimensional image, calculate the reconstruction rate R total of the whole body =100*V current /V total ;
(7)在对每一幅二维图像进行三维重建后,计算重建率增量(7) After 3D reconstruction of each 2D image, calculate the reconstruction rate increment
Radd=100*(Vcurrent-Vorigin)/Vtotal;R add =100*(V current -V origin )/V total ;
(8)若Radd>R,则驱动扫描重建体的实时体绘制,并令Vorigin=Vcurrent。(8) If R add >R, drive the real-time volume rendering of the scanned reconstructed volume, and set V origin =V current .
根据本发明,要求临床医生对受呼吸影响较小的诊断部位进行实时、交互的扫描成像,从而能达到较好的成像质量。According to the present invention, clinicians are required to perform real-time and interactive scanning and imaging of diagnostic parts that are less affected by breathing, so as to achieve better imaging quality.
在本发明中,由于采用了基于二维图像的数据驱动的三维重建方法,因此在扫描重建过程中的任意时刻都可以暂停扫描,暂停不会损坏已扫描重建的数据,而且之后可继续进行扫描重建。根据所述三维重建方法的优点,并结合循环呼吸的特点,便可以克服呼吸对扫描重建产生的影响,提高成像质量,一种克服呼吸对扫描重建产生影响的方法,该方法包括如下步骤:In the present invention, since the data-driven three-dimensional reconstruction method based on two-dimensional images is adopted, the scanning can be suspended at any time during the scanning and reconstruction process, and the pause will not damage the scanned and reconstructed data, and the scanning can be continued afterwards reconstruction. According to the advantages of the three-dimensional reconstruction method, combined with the characteristics of respiration, the influence of respiration on scan reconstruction can be overcome, and the imaging quality can be improved. A method for overcoming the influence of respiration on scan reconstruction includes the following steps:
具体步骤如下:Specific steps are as follows:
(1)叮嘱病人深吸一口气,屏住呼吸;(1) Instruct the patient to take a deep breath and hold his breath;
(2)开始对诊断部位进行扫描成像,持续几秒钟后停止;(2) Start to scan and image the diagnostic site, and stop after a few seconds;
(3)叮嘱病人换气,然后再次深吸一口气,屏住呼吸;(3) Instruct the patient to take a breath, then take another deep breath and hold it;
(4)再次开始对诊断部位进行扫描成像,持续几秒钟后停止;(4) Start to scan and image the diagnostic site again, and stop after a few seconds;
(5)循环反复,直到完成对诊断部位的扫描成像。(5) The cycle is repeated until the scanning and imaging of the diagnosis site is completed.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNB2006100111601A CN100450445C (en) | 2006-01-11 | 2006-01-11 | Real-time, freedom-arm, three-D ultrasonic imaging system and method therewith |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNB2006100111601A CN100450445C (en) | 2006-01-11 | 2006-01-11 | Real-time, freedom-arm, three-D ultrasonic imaging system and method therewith |
Publications (2)
Publication Number | Publication Date |
---|---|
CN100998511A CN100998511A (en) | 2007-07-18 |
CN100450445C true CN100450445C (en) | 2009-01-14 |
Family
ID=38257385
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNB2006100111601A Expired - Fee Related CN100450445C (en) | 2006-01-11 | 2006-01-11 | Real-time, freedom-arm, three-D ultrasonic imaging system and method therewith |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN100450445C (en) |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101569541B (en) * | 2008-04-29 | 2011-04-06 | 香港理工大学 | Three-dimensional ultrasonic imaging system |
US8900146B2 (en) * | 2009-07-27 | 2014-12-02 | The Hong Kong Polytechnic University | Three-dimensional (3D) ultrasound imaging system for assessing scoliosis |
CN102406511B (en) * | 2010-09-21 | 2014-09-10 | 株式会社东芝 | Ultrasonic probe and ultrasonic diagnostic device |
CN102373922B (en) * | 2011-11-03 | 2014-08-13 | 中国电子科技集团公司第二十二研究所 | Well periphery ultrasonic imaging downhole tool |
CN103654856A (en) * | 2013-12-23 | 2014-03-26 | 中国科学院苏州生物医学工程技术研究所 | Small real-time free-arm three-dimensional ultrasound imaging system |
CN103860197B (en) * | 2014-03-14 | 2016-07-06 | 深圳先进技术研究院 | Free style 3-D supersonic imaging methods, devices and systems |
JP6854237B2 (en) | 2014-03-28 | 2021-04-07 | インテュイティブ サージカル オペレーションズ, インコーポレイテッド | Quantitative 3D visualization of instruments in the field of view |
CN106456271B (en) * | 2014-03-28 | 2019-06-28 | 直观外科手术操作公司 | The quantitative three-dimensional imaging and printing of surgery implant |
JP6938369B2 (en) | 2014-03-28 | 2021-09-22 | インテュイティブ サージカル オペレーションズ, インコーポレイテッド | Surgical system with tactile feedback based on quantitative 3D imaging |
CN105204835A (en) * | 2014-06-26 | 2015-12-30 | 阿里巴巴集团控股有限公司 | Scanning method and device for operation object |
CN104095653B (en) * | 2014-07-25 | 2016-07-06 | 上海理工大学 | A kind of freedom-arm, three-D ultrasonic image-forming system and formation method |
US10743844B2 (en) | 2014-07-29 | 2020-08-18 | Koninklijke Philips N.V. | Ultrasound imaging apparatus |
CN105982693A (en) * | 2015-01-27 | 2016-10-05 | 中慧医学成像有限公司 | Imaging method |
CA3022157C (en) * | 2016-04-26 | 2022-05-17 | Telefield Medical Imaging Limited | An ultrasound imaging method and device with incremental imaging for target |
JP7337806B2 (en) * | 2018-01-03 | 2023-09-04 | コーニンクレッカ フィリップス エヌ ヴェ | Ultrasound Imaging System with Tissue-Specific Presets for Diagnostic Examinations |
TWM584009U (en) * | 2019-01-31 | 2019-09-21 | 許斐凱 | Trachea model reconstruction system utilizing ultrasound and deep learning technology |
CN110974305B (en) * | 2019-12-13 | 2021-04-27 | 山东大学齐鲁医院 | Deep learning-based remote cardiac ultrasound 3D imaging system and method |
CN112862944B (en) * | 2019-11-09 | 2024-04-12 | 无锡祥生医疗科技股份有限公司 | Human tissue ultrasonic modeling method, ultrasonic equipment and storage medium |
CN110689792A (en) * | 2019-11-19 | 2020-01-14 | 南方医科大学深圳医院 | Ultrasound examination virtual diagnosis training system and method |
CN111968222B (en) * | 2020-08-04 | 2022-07-05 | 西北工业大学 | A three-dimensional ultrasound reconstruction method of human tissue in non-stationary state |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5924989A (en) * | 1995-04-03 | 1999-07-20 | Polz; Hans | Method and device for capturing diagnostically acceptable three-dimensional ultrasound image data records |
US20020062077A1 (en) * | 1996-08-22 | 2002-05-23 | Synthes Usa | 3-D ultrasound recording device |
JP2004261245A (en) * | 2003-02-28 | 2004-09-24 | Aloka Co Ltd | Ultrasonograph |
-
2006
- 2006-01-11 CN CNB2006100111601A patent/CN100450445C/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5924989A (en) * | 1995-04-03 | 1999-07-20 | Polz; Hans | Method and device for capturing diagnostically acceptable three-dimensional ultrasound image data records |
US20020062077A1 (en) * | 1996-08-22 | 2002-05-23 | Synthes Usa | 3-D ultrasound recording device |
JP2004261245A (en) * | 2003-02-28 | 2004-09-24 | Aloka Co Ltd | Ultrasonograph |
Non-Patent Citations (2)
Title |
---|
一种基于不规则采样平面的超声三维图像重建方法. 郝晓辉等.清华大学学报(自然科学版),第39卷第9期. 1999 * |
医学超声三维成像的发展现状与展望. 高上凯等.电子商务,第11期. 1998 * |
Also Published As
Publication number | Publication date |
---|---|
CN100998511A (en) | 2007-07-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN100450445C (en) | Real-time, freedom-arm, three-D ultrasonic imaging system and method therewith | |
JP5567502B2 (en) | Medical training method and apparatus | |
US10828010B2 (en) | Image diagnosis apparatus and method for dynamically focusing tracked ultrasound probe with multimodal imaging system | |
US8798342B2 (en) | Method and system for ultrasound imaging with cross-plane images | |
US7935059B2 (en) | System and method for 3-D imaging | |
US9366754B2 (en) | Ultrasound imaging system and method | |
CN103068315B (en) | Ultrasonic imaging apparatus and three-dimensional image display method using ultrasonic image | |
CN104246528A (en) | Magnetic resonance imaging with automatic selection of a recording sequence | |
CN103955961A (en) | Statistics-based ultrasonic sequence image three-dimensional reconstruction method and system | |
US12070358B2 (en) | Enhanced ultrasound imaging apparatus and associated methods of work flow | |
US10667796B2 (en) | Method and system for registering a medical image with a graphical model | |
CN113143317A (en) | Ultrasonic imaging method, ultrasonic imaging device, computer equipment and storage medium | |
CN103761767A (en) | Quick three-dimensional ultrasound image reconstruction method based on sparse data | |
US20130223703A1 (en) | Medical image processing apparatus | |
WO2020131517A1 (en) | 3d handheld ultrasound imaging device | |
US20130018264A1 (en) | Method and system for ultrasound imaging | |
CN103654856A (en) | Small real-time free-arm three-dimensional ultrasound imaging system | |
JP2013169389A (en) | Ultrasonic image composing apparatus, ultrasonic image composing method, and ultrasonic image composing processing program | |
Qiu et al. | Freehand 3D ultrasound reconstruction for image-guided surgery | |
Dai et al. | A qualitative and quantitative interaction technique for freehand 3D ultrasound imaging | |
CN116782850A (en) | Ultrasonic simulation system | |
US20250152139A1 (en) | Automation of transvaginal ultrasound workflow | |
US12089997B2 (en) | System and methods for image fusion | |
US20250124569A1 (en) | Increasing image quality in ultrasound images due to poor facial rendering | |
Lee et al. | 6-DOF free-hand navigation interface for volumetric 3-dimensional ultrasound imaging: Preliminary results |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090114 Termination date: 20210111 |