CN106420055A - Brain tissue deformation correction system based on wireless transmission - Google Patents
Brain tissue deformation correction system based on wireless transmission Download PDFInfo
- Publication number
- CN106420055A CN106420055A CN201610086140.4A CN201610086140A CN106420055A CN 106420055 A CN106420055 A CN 106420055A CN 201610086140 A CN201610086140 A CN 201610086140A CN 106420055 A CN106420055 A CN 106420055A
- Authority
- CN
- China
- Prior art keywords
- cerebral tissue
- module
- straightening
- brain tissue
- deformation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Processing Or Creating Images (AREA)
- Image Processing (AREA)
Abstract
本发明属医学图像处理及应用领域,涉及一种基于无线传输的脑组织变形矫正系统,具体涉及一种神经外科术中脑组织变形矫正系统。该系统包括脑组织变形工作台和三维激光扫描仪工作台。脑组织变形矫正系统工作台搭载脑组织变形矫正软件系统,可以通过无线局域网与神经外科手术导航系统通讯。所述脑组织变形矫正软件系统包含三维可视化模块、标定模块、脑组织提取模块、网格化模块、边界条件获取模块、有限元计算模块、术前图像更新模块以及通讯模块。本系统精度可靠,可集成在现有神经外科手术导航系统中,帮助实现术中软组织变形矫正,从而大幅度提高导航系统精度,有助于临床应用。The invention belongs to the field of medical image processing and application, and relates to a brain tissue deformation correction system based on wireless transmission, in particular to a brain tissue deformation correction system in neurosurgery. The system includes a brain tissue deformation workbench and a 3D laser scanner workbench. The brain tissue deformation correction system workbench is equipped with a brain tissue deformation correction software system, which can communicate with the neurosurgery navigation system through a wireless local area network. The brain tissue deformation correction software system includes a three-dimensional visualization module, a calibration module, a brain tissue extraction module, a meshing module, a boundary condition acquisition module, a finite element calculation module, a preoperative image update module and a communication module. The accuracy of this system is reliable, and it can be integrated into the existing neurosurgery navigation system to help realize the correction of intraoperative soft tissue deformation, thereby greatly improving the accuracy of the navigation system and contributing to clinical application.
Description
技术领域technical field
本发明属医学图像处理及应用领域,涉及一种基于无线传输的脑组织变形矫正系统,尤其是一种神经外科术中脑组织变形矫正系统。该系统包括脑组织变形工作台和三维激光扫描仪工作台,可集成在现有神经外科手术导航系统中,帮助实现术中软组织变形矫正,从而大幅度提高导航系统精度,有助于临床应用。The invention belongs to the field of medical image processing and application, and relates to a brain tissue deformation correction system based on wireless transmission, in particular to a brain tissue deformation correction system in neurosurgery. The system includes a brain tissue deformation workbench and a three-dimensional laser scanner workbench, which can be integrated into the existing neurosurgery navigation system to help achieve intraoperative soft tissue deformation correction, thereby greatly improving the accuracy of the navigation system and contributing to clinical applications.
背景技术Background technique
现有技术公开了神经外科导航系统(Image guided Neurosurgery System,IGNS)有助于改进外科手术质量和减少手术中脑损伤。但是在手术过程中脑组织因为重力、牵拉或者切除作用的影响,会发生变形,导致基于术前图像的神经外科导航系统精度下降。The prior art discloses that a neurosurgery navigation system (Image guided Neurosurgery System, IGNS) is helpful to improve the quality of surgical operation and reduce brain injury during operation. However, during the operation, the brain tissue will be deformed due to the influence of gravity, traction or resection, resulting in a decrease in the accuracy of the neurosurgical navigation system based on preoperative images.
临床实践中采用的,如,术中磁共振成像能够为术中脑组织提供实时图像,被认为一种有效的术中处理脑移位的方法,但是术中磁共振技术价格昂贵,限制了其临床应用;生物力学模型,利用软组织的生物力学属性约束软组织的运动特征,并借助有限元方程以及术中稀疏数据推定整个脑组织变形情况,能够克服术中影像的缺点,Miga[1,2]等采用固结理论模型模拟与矫正开颅后脑组织的变形情况,并通过动物试验证明:固结理论模型可矫正75%左右的脑组织变形误差;另外的4例临床病例证明:改进后固结理论模型平均矫正率可达79%,该方法的缺陷在于边界条件的获取非常困难,这是因为术中脑脊液的流失量是固结理论模型求解的重要参数,亦即,要获得边界条件,就必须知道开颅后脑脊液的变化情况,这也是临床实践中一直想解决而未解决的难题;Ferrant[3]等使用线弹性生物力学模型建模,使用术中磁共振获取边界条件,采用该方法将脑皮层表面位移误差降至1mm左右,该方法最大的缺陷是没有摆脱对术中磁共振的依赖。相对于固结理论模型而言,线弹性模型采用表面力或表面位移为边界条件,若利用三维扫描仪等廉价的术中辅助设备,再结合表面跟踪算法则能够方便地获得边界条件,便于临床应用。基于现有技术的现状,本申请的发明人拟提供一种基于无线传输的脑组织变形矫正系统,尤其是一种神经外科术中脑组织变形矫正系统,进而帮助实现术中软组织变形矫正,从而大幅度提高导航系统精度,有助于临床应用。Used in clinical practice, for example, intraoperative magnetic resonance imaging can provide real-time images of intraoperative brain tissue, and is considered an effective method for intraoperative management of brain displacement, but intraoperative magnetic resonance technology is expensive, which limits its use. Clinical application; biomechanical model, using the biomechanical properties of soft tissue to constrain the motion characteristics of soft tissue, and estimating the deformation of the entire brain tissue with the help of finite element equations and intraoperative sparse data, can overcome the shortcomings of intraoperative imaging, Miga[1,2] used the consolidation theoretical model to simulate and correct the deformation of brain tissue after craniotomy, and proved through animal experiments that: the consolidation theoretical model can correct about 75% of the brain tissue deformation error; another 4 clinical cases proved that: after the improvement, the consolidation The average correction rate of the theoretical model can reach 79%. The disadvantage of this method is that it is very difficult to obtain the boundary conditions. This is because the loss of cerebrospinal fluid during the operation is an important parameter for solving the theoretical model of consolidation. That is, to obtain the boundary conditions, it is necessary to It is necessary to know the changes of cerebrospinal fluid after craniotomy, which is also a difficult problem that has been wanted to be solved in clinical practice; Ferrant[3] et al. use linear elastic biomechanical model to model, and use intraoperative magnetic resonance to obtain boundary conditions, adopt this method The biggest defect of this method is that it does not get rid of the dependence on intraoperative magnetic resonance to reduce the displacement error of the surface of the cerebral cortex to about 1mm. Compared with the consolidation theory model, the linear elastic model uses surface force or surface displacement as the boundary condition. If cheap intraoperative auxiliary equipment such as a 3D scanner is used, combined with the surface tracking algorithm, the boundary condition can be easily obtained, which is convenient for clinical practice. application. Based on the current state of the art, the inventors of the present application intend to provide a system for correcting brain tissue deformation based on wireless transmission, especially a system for correcting brain tissue deformation during neurosurgery, so as to help realize intraoperative soft tissue deformation correction, thereby The accuracy of the navigation system is greatly improved, which is helpful for clinical application.
与本发明有关的参考文献有:References relevant to the present invention are:
[1]M.I.Miga,K.D.Paulsen,P.J.Hoopes,F.E.Kennedy,Jr.,A.Hartov,andD.W.Roberts,"In vivo quantification of a homogeneous brain deformation modelfor updating preoperative images during surgery,"IEEE Trans Biomed Eng,vol.47,pp.266-73,2000.[1] M.I.Miga, K.D.Paulsen, P.J.Hoopes, F.E.Kennedy, Jr., A.Hartov, and D.W.Roberts,"In vivo quantification of a homogeneous brain deformation model for updating preoperative images during surgery,"IEEE Trans Biomed Eng, vol.47,pp.266-73,2000.
[2]M.I.Miga,K.D.Paulsen,J.M.Lemery,S.D.Eisner,A.Hartov,F.E.Kennedy,and D.W.Roberts,"Model-updated image guidance:initial clinical experienceswith gravity-induced brain deformation,"IEEE Trans Med Imaging,vol.18,pp.866-74,1999.[2] M.I.Miga, K.D.Paulsen, J.M.Lemery, S.D.Eisner, A.Hartov, F.E.Kennedy, and D.W.Roberts, "Model-updated image guidance: initial clinical experience with gravity-induced brain deformation," IEEE Trans Med Imaging, vol. 18, pp.866-74, 1999.
[3]M.Ferrant,A.Nabavi,B.Macq,F.A.Jolesz,R.Kikinis,and S.K.Warfield,"Registration of 3-D intraoperative MR images of the brain using a finite-element biomechanical model,"IEEE Trans Med Imaging,vol.20,pp.1384-97,2001.。[3] M.Ferrant, A.Nabavi, B.Macq, F.A.Jolesz, R.Kikinis, and S.K.Warfield,"Registration of 3-D intraoperative MR images of the brain using a finite-element biomechanical model,"IEEE Trans Med Imaging, vol.20, pp.1384-97, 2001.
发明内容Contents of the invention
本发明的目的是克服现有技术的缺陷,提供一种基于无线传输的脑组织变形矫正系统,尤其是一种神经外科术中脑组织变形矫正系统。该系统由脑组织变形工作台和三维激光扫描仪工作台组成,脑组织变形工作台通过无线通讯与神经外科手术导航系统进行数据交换,数据包括术前影像、变换矩阵以及矫正更新后影像;该系统可集成在现有神经外科手术导航系统中,帮助实现术中软组织变形矫正,从而大幅度提高导航系统精度,有助于临床应用。The purpose of the present invention is to overcome the defects of the prior art and provide a system for correcting brain tissue deformation based on wireless transmission, especially a system for correcting brain tissue deformation in neurosurgery. The system consists of a brain tissue deformation workbench and a three-dimensional laser scanner workbench. The brain tissue deformation workbench exchanges data with the neurosurgery navigation system through wireless communication. The data includes preoperative images, transformation matrices, and corrected and updated images; The system can be integrated into the existing neurosurgery navigation system to help achieve intraoperative soft tissue deformation correction, thereby greatly improving the accuracy of the navigation system and contributing to clinical applications.
本发明的基于无线传输的脑组织变形矫正系统,由脑组织变形工作台和三维激光扫描仪组成;脑组织变形工作台搭载脑组织变形矫正软件系统;三维激光扫描仪的扫描分辨率为500微米以上,精度1mm以上。The brain tissue deformation correction system based on wireless transmission of the present invention is composed of a brain tissue deformation workbench and a three-dimensional laser scanner; the brain tissue deformation workbench is equipped with a brain tissue deformation correction software system; the scanning resolution of the three-dimensional laser scanner is 500 microns Above, the accuracy is above 1mm.
本发明中,脑组织变形矫正软件系统包括三维可视化模块、标定模块、脑组织提取模块、网格化模块、边界条件获取模块、有限元计算模块、术前图像更新模块以及通讯模块;其中,三维可视化模块用于对图像序列进行三维可视化显示,标定模块用于获取三维激光扫描仪空间和固定在三维激光扫描仪表面的跟踪工具空间之间的坐标变换关系,脑组织提取模块用于将脑组织从术前图像中提取出来,获得目标组织,网格化模块用于将目标组织离散成为小的网格单元,边界条件获取模块用于获取有限元模型的边界条件,有限元计算模块基于有限元方法计算所有网格节点的位移,术前图像更新模块采用插回算法,基于网格节点位移和术前影像计算得到变形后的术前影像,通讯模块用于实现脑组织变形矫正系统与神经外科导航系统的数据交换。In the present invention, the brain tissue deformation correction software system includes a three-dimensional visualization module, a calibration module, a brain tissue extraction module, a meshing module, a boundary condition acquisition module, a finite element calculation module, a preoperative image update module, and a communication module; wherein, the three-dimensional The visualization module is used for 3D visual display of the image sequence, the calibration module is used to obtain the coordinate transformation relationship between the space of the 3D laser scanner and the space of the tracking tool fixed on the surface of the 3D laser scanner, and the brain tissue extraction module is used to extract the brain tissue Extracted from the preoperative image to obtain the target tissue, the meshing module is used to discretize the target tissue into small grid units, the boundary condition acquisition module is used to obtain the boundary conditions of the finite element model, and the finite element calculation module is based on finite element The method calculates the displacement of all grid nodes. The preoperative image update module adopts the interpolation algorithm to obtain the deformed preoperative image based on the grid node displacement and preoperative image calculation. The communication module is used to realize the brain tissue deformation correction system and neurosurgery. Data exchange for navigation systems.
具体的,本发明中,脑组织变形矫正软件系统,其工作流程如下:Specifically, in the present invention, the brain tissue deformation correction software system has a workflow as follows:
(1)术前对三维激光扫描仪标定,获得三维激光扫描仪空间和固定在三维激光扫描仪表面的跟踪工具空间之间的空间坐标变换关系,将此空间坐标变换关系存储于脑组织变形工作台上;(1) Calibrate the 3D laser scanner before operation to obtain the spatial coordinate transformation relationship between the 3D laser scanner space and the tracking tool space fixed on the surface of the 3D laser scanner, and store this spatial coordinate transformation relationship in the brain tissue deformation work on stage;
(2)将术前图像从神经外科手术导航系统传输到脑组织变形工作台;(2) Transfer preoperative images from the neurosurgery navigation system to the brain tissue deformation workbench;
(3)采用自动分割算法并结合手动分割方法将脑组织从术前图像中提取出来,获得目标组织;(3) Using the automatic segmentation algorithm combined with the manual segmentation method to extract the brain tissue from the preoperative image to obtain the target tissue;
(4)结合类八叉树和MT(Marching Tetrahedron)算法对上述目标进行网格化;(4) Combine the octree-like and MT (Marching Tetrahedron) algorithm to grid the above targets;
(5)建立目标组织的线弹性物理模型,对每一网格单元赋予相应的生物力学属性;(5) Establish a linear elastic physical model of the target tissue, and assign corresponding biomechanical properties to each grid unit;
(6)借助三维激光扫描仪和子块式表面跟踪算法获得边界条件;(6) Obtain boundary conditions with the help of 3D laser scanner and sub-block surface tracking algorithm;
(7)采用有限元方法结合边界条件求解线弹性物理模型,获目标组织任意位置的变形;(7) Using the finite element method combined with boundary conditions to solve the linear elastic physical model, and obtain the deformation of any position of the target tissue;
(8)采用反向插回算法基于获得的全脑变形场,即变形后网格更新术前三维图像数据,并进行三维可视化显示。(8) The reverse interpolation algorithm is used to update the preoperative three-dimensional image data based on the obtained whole-brain deformation field, that is, the deformed grid, and perform three-dimensional visual display.
(9)将预测更新后图像通过通讯模块传输回神经外科导航系统。(9) The predicted updated image is transmitted back to the neurosurgical navigation system through the communication module.
其中,三维激光扫描仪标定过程通过标定模块实现,包含以下步骤:Among them, the calibration process of the 3D laser scanner is realized through the calibration module, including the following steps:
(1)启动三维激光扫描仪扫描校准靶,将扫描所得点云文件存入脑组织变形工作台;(1) Start the 3D laser scanner to scan the calibration target, and save the scanned point cloud file into the brain tissue deformation workbench;
(2)打开点云文件,从标定靶点云图像中选取5-7个特征点;(2) Open the point cloud file and select 5-7 feature points from the calibration target point cloud image;
(3)借助跟踪设备和可被跟踪设备跟踪的探针在标定靶上选取与点云图像中对应的特征点;(3) Select the corresponding feature points in the point cloud image on the calibration target by means of the tracking device and the probe that can be tracked by the tracking device;
(4)使用点配准算法,将二者配准,得到三维激光扫描仪空间到跟踪工具空间之间的坐标变换关系。(4) Use the point registration algorithm to register the two to obtain the coordinate transformation relationship between the 3D laser scanner space and the tracking tool space.
其中,获取术前图像通过通讯模块实现;手术导航系统作为服务器端,脑组织变形矫正系统作为客户端,由客户端首先发出请求,服务器端按照握手命令做出回应;首先通过命令进行握手,然后传输数据,最后通过命令结束传输;所有命令用字符串表示,以CMD开始,其中握手命令为:CMDASKIMG(请求传输术前图像,客户端发出);CMDREQACK(同意传输,服务器端发出);结束命令为CMDSENDFIN(传输结束,服务器端发出)。Among them, the acquisition of preoperative images is realized through the communication module; the surgical navigation system is used as the server, and the brain tissue deformation correction system is used as the client. The client first sends a request, and the server responds according to the handshake command; Transmit data, and finally end the transmission with a command; all commands are represented by character strings, starting with CMD, and the handshake command is: CMDASKIMG (request to transmit preoperative images, sent by the client); CMDREQACK (agreed to transfer, sent by the server); end command It is CMDSENDFIN (end of transmission, issued by the server).
其中,目标脑组织的提取通过脑组织提取模块实现,该模块包含两步:首先使用自动分割算法自动提取脑组织;然后使用手动分割方法对提取出来的脑组织进行精确分割。所述自动分割算法中,首先通过灰度直方图获取图像的上、下限灰度值以及组织与背景的粗略门限值t;然后利用门限值t估计图像中组织重心的大体位置,并估计组织的大致尺寸(以球体表示);之后将组织表面建模成离散三角网格曲面。初始模型为离散三角网格球面,球心位于组织重心,半径为估计组织半径的1/2;最后将初始球面离散三角网格缓慢变形,每次变形一个顶点。当顶点变形至脑组织边界时,需遵循变形力以保证组织表面光滑。Among them, the extraction of the target brain tissue is realized by the brain tissue extraction module, which includes two steps: first, the automatic segmentation algorithm is used to automatically extract the brain tissue; and then the manual segmentation method is used to accurately segment the extracted brain tissue. In the automatic segmentation algorithm, first obtain the upper and lower limit gray values of the image and the rough threshold t of the tissue and the background through the gray histogram; then use the threshold t to estimate the general position of the tissue center of gravity in the image, and estimate The approximate size of the tissue (represented as a sphere); the tissue surface is then modeled as a discrete triangular mesh surface. The initial model is a discrete triangular mesh sphere, the center of which is located at the tissue center of gravity, and the radius is 1/2 of the estimated tissue radius; finally, the initial spherical discrete triangular mesh is deformed slowly, one vertex at a time. When the vertices are deformed to the boundaries of the brain tissue, the deformation force needs to be respected to ensure the smooth surface of the tissue.
其中,对目标脑组织网格化处理通过网格化模块实现,首先,用类八叉树算法将三维图像空间划分为六面体单元的网格后,将每一六面体单元划分为五个四面体单元;然后,采用类MT算法切割网格,去除背景,获得最终仅包含脑组织的三维网格单元。最后,基于FEM可变形网格方法,对已经生成的3D四面体网格形状进行调整,使得网格边界上的节点与对应3D二值图像的边界对齐。Among them, the meshing processing of the target brain tissue is realized through the meshing module. First, the three-dimensional image space is divided into grids of hexahedral units by using the octree-like algorithm, and each hexahedral unit is divided into five tetrahedral units. ; Then, use the MT-like algorithm to cut the grid, remove the background, and finally obtain the 3D grid unit that only contains brain tissue. Finally, based on the FEM deformable mesh method, the shape of the generated 3D tetrahedral mesh is adjusted so that the nodes on the mesh boundary are aligned with the boundary of the corresponding 3D binary image.
其中,建立目标组织的物理模型,对每一网格单元赋予相应的生物力学属性,在有限元模块中实现。由于脑组织变形过程缓慢而且形变小,应变与应力成线性关系,本发明将其模拟为基于线弹性理论的均匀弹性体,所述物理模型表达为一系列偏微分方程:Among them, the physical model of the target tissue is established, and corresponding biomechanical properties are assigned to each grid unit, which is realized in the finite element module. Since the deformation process of the brain tissue is slow and the deformation is small, and the strain and the stress have a linear relationship, the present invention simulates it as a uniform elastic body based on the theory of linear elasticity, and the physical model is expressed as a series of partial differential equations:
其中u为位移矢量,F为力矢量,μ=E/2(1+v),ν为泊松比,E为弹性模量。为每一个网格单元赋予线弹性模型的力学属性:泊松比ν和弹性模量E。Among them, u is the displacement vector, F is the force vector, μ=E/2(1+v), ν is Poisson's ratio, and E is the modulus of elasticity. The mechanical properties of the linear elastic model are assigned to each grid unit: Poisson's ratio ν and elastic modulus E.
其中,借助三维激光扫描仪和子块式表面跟踪算法获得边界条件在边界条件获取模块中完成,首先,提取表面网格节点作为软组织初始表面;第二,通过三维激光扫描仪获取变形后软组织表面点集,作为变形后的软组织表面;第三,使用刚性配准方法将对变形后软组织表面和初始软组织表面进行初配准;第四基于子块式能量函数最小非刚性配准算法来获得两个点集中点与点之间的映射关系。Among them, the acquisition of boundary conditions with the help of 3D laser scanner and sub-block surface tracking algorithm is completed in the boundary condition acquisition module. First, the surface grid nodes are extracted as the initial surface of soft tissue; second, the deformed soft tissue surface points are acquired by 3D laser scanner set, as the deformed soft tissue surface; thirdly, use the rigid registration method to initially register the deformed soft tissue surface and the initial soft tissue surface; fourthly, based on the sub-block energy function minimum non-rigid registration algorithm to obtain two The mapping relationship between points in the point set.
本发明中,获得初始软组织表面和变形后软组织表面后,使用刚性配准方法将对变形后软组织表面和初始软组织表面进行初配准;本发明的一个实施例中,使用不同空间的坐标系转换实现初始软组织表面和变形后软组织表面的刚性配准,包含以下四个空间的坐标变换:(1)将三维激光扫描仪空间变换到跟踪工具空间;(2)将跟踪工具空间变换到跟踪设备空间;(3)将跟踪设备空间变换到参考架空间;(4)将参考架空间变换到图像空间,图像空间为变形前软组织所在空间,其中跟踪工具固定在三维激光扫描仪上,跟踪工具可以被跟踪设备跟踪。参考架固定在病人身体上,参考架也可以被跟踪设备跟踪,第一个空间坐标变换通过术前标定,在标定模块中实现;第二个和第三个空间坐标变换通过跟踪设备的术中跟踪实现;第四个空间坐标变换通过对术前图像和病人空间的标记点刚性配准实现,后三个空间坐标变换在神经外科导航系统中获得,通过通讯模块传输给脑组织变形矫正系统。In the present invention, after the initial soft tissue surface and the deformed soft tissue surface are obtained, the rigid registration method is used to initially register the deformed soft tissue surface and the initial soft tissue surface; in one embodiment of the present invention, the coordinate system conversion of different spaces is used Realize the rigid registration of the initial soft tissue surface and the deformed soft tissue surface, including the coordinate transformation of the following four spaces: (1) Transform the 3D laser scanner space to the tracking tool space; (2) Transform the tracking tool space to the tracking device space ; (3) Transform the space of the tracking device into the space of the reference frame; (4) Transform the space of the reference frame into the image space, the image space is the space where the soft tissue is before deformation, wherein the tracking tool is fixed on the 3D laser scanner, and the tracking tool can be Track device tracking. The reference frame is fixed on the patient's body, and the reference frame can also be tracked by the tracking device. The first spatial coordinate transformation is realized in the calibration module through preoperative calibration; the second and third spatial coordinate transformations are achieved through the intraoperative tracking device. Tracking is realized; the fourth spatial coordinate transformation is realized through the rigid registration of the preoperative image and the marker point in the patient space, and the last three spatial coordinate transformations are obtained in the neurosurgical navigation system and transmitted to the brain tissue deformation correction system through the communication module.
本发明中,完成变形后软组织表面和初始软组织表面进行初配准之后,基于子块式能量函数最小非刚性配准算法来获得两个点集中点与点之间的映射关系,其子块式表面跟踪算法包含步骤:In the present invention, after initial registration between the deformed soft tissue surface and the initial soft tissue surface, the mapping relationship between the two point-concentrated points is obtained based on the sub-block type energy function minimum non-rigid registration algorithm, and the sub-block type The surface tracking algorithm consists of steps:
(1)将需要跟踪的软组织初始表面网格节点X={x,i=1,2,……M}划分成若干小块:P={p,k=1,2,……L},除了小块pL以外,其它每个小块pk包含l个节点,小块pL包含M-(L-1)*l个节点;(1) Divide the initial surface grid node X={x,i=1,2,...M} of the soft tissue to be tracked into several small blocks: P={p,k=1,2,...L}, Except for the small block p L , each other small block p k contains l nodes, and the small block p L contains M-(L-1)*l nodes;
(2)为每个点集小块pk构建能量最小方程获得点其表面位移:(2) Construct the energy minimum equation for each point set small block p k to obtain the surface displacement of the point:
其中pk={p,o=1,2,……l}为点集小块,Y={y,j=1,2,……N}为点云的点集。cjk是定义两个点集之间对应概率的相关性矩阵,λ为权重因子。用薄板样条(Thin-plateSpline)非刚性配准算法计算变形皮层(Y)与未变形皮层(pk)之间映射函数f,从而获得点集小块表面位移Disppk;Where p k ={p,o=1,2,...l} is a point set small piece, Y={y,j=1,2,...N} is a point set of a point cloud. c jk is a correlation matrix defining the corresponding probability between two point sets, and λ is a weighting factor. Use thin-plate spline (Thin-plateSpline) non-rigid registration algorithm to calculate the mapping function f between the deformed cortex (Y) and the undeformed cortex (p k ), so as to obtain the point set small block surface displacement Disp pk ;
(3)集合每个点集小块的位移Disppk,获得所有需要跟踪的软组织表面网格节点的位移Dispx。(3) Gather the displacement Disp pk of each small block of point set, and obtain the displacement Disp x of all soft tissue surface grid nodes that need to be tracked.
其中,采用有限元方法结合边界条件求解线弹性物理模型,获目标组织任意位置的变形在有限元计算模块中实现。线弹性物理模型由一系列偏微分方程组成,可以写成如下形式:Ka=P,其中K为刚性矩阵,a为结点位移,P为结点载荷。K由杨氏弹性模量E和泊松比ν两个参数决定。我们使用了基于PETSc(Portable,Extensible Toolkit for ScientificComputation)构建的线性求解器来实现多处理器并行计算,用以加快运算速度。Among them, the finite element method combined with boundary conditions is used to solve the linear elastic physical model, and the deformation of any position of the target tissue is obtained in the finite element calculation module. The linear elastic physical model consists of a series of partial differential equations, which can be written as follows: Ka=P, where K is the rigid matrix, a is the node displacement, and P is the node load. K is determined by two parameters, Young's modulus of elasticity E and Poisson's ratio ν. We use a linear solver based on PETSc (Portable, Extensible Toolkit for Scientific Computation) to realize multi-processor parallel computing to speed up the computing speed.
其中,更新术前三维图像在更新模块完成。使用反向插值法来更新术前图像:从变形后的网格单元出发,寻找出单元内的整数坐标点,利用形函数获得该点在未变形前的位置,再利用三线性插值获得该点的灰度值,然后更新术前图像的三维数据场。Wherein, updating the preoperative three-dimensional image is completed in the updating module. Use the reverse interpolation method to update the preoperative image: start from the deformed grid unit, find the integer coordinate point in the unit, use the shape function to obtain the position of the point before the deformation, and then use trilinear interpolation to obtain the point The gray value of , and then update the three-dimensional data field of the preoperative image.
其中,三维可视化显示在三维可视化模块中完成,采用反向插回算法基于获得的全脑变形场更新术前三维图像数据后,使用光线投射算法对三维数据场显示,在三维可视化模块中通过设定光照阴影、清晰度、颜色映射、不透明度映射以及重建速度等参数实现三维数据场的体绘制功能。Among them, the 3D visualization display is completed in the 3D visualization module. After the preoperative 3D image data is updated based on the obtained whole-brain deformation field using the reverse interpolation algorithm, the 3D data field is displayed using the ray projection algorithm. In the 3D visualization module, through setting The volume rendering function of the 3D data field can be realized by setting parameters such as light and shadow, sharpness, color mapping, opacity mapping and reconstruction speed.
其中,将预测更新后图像传输回神经外科导航系统在通讯模块中实现。手术导航系统作为服务器端,脑组织变形矫正系统作为客户端。由客户端首先发出请求,服务器端按照握手命令做出回应。首先通过命令进行握手,然后传输数据,最后通过命令结束传输。图像数据放在一个一维数组中,应用层的握手命令如下:CMDSENDREQ(请求传输图像,客户端发出);CMDREQACK(同意接收图像更新后数据,客户端发出);CMDSENDFIN传输结束,客户端发出)。Wherein, the transmission of the predicted updated image back to the neurosurgery navigation system is implemented in the communication module. The surgical navigation system serves as the server, and the brain tissue deformation correction system serves as the client. The client sends out the request first, and the server responds according to the handshake command. The handshake is first performed by command, then the data is transmitted, and finally the transmission is ended by command. The image data is placed in a one-dimensional array, and the handshake commands of the application layer are as follows: CMDSENDREQ (request for image transmission, sent by the client); CMDREQACK (agreed to receive image update data, sent by the client); CMDSENDFIN end of transmission, sent by the client) .
本发明精度可靠,可方便地集成在现有神经外科手术导航系统中,帮助实现术中软组织变形矫正,从而大幅度提高导航系统精度,有助于临床应用。The present invention has reliable precision, can be conveniently integrated into the existing navigation system of neurosurgery, helps to realize soft tissue deformation correction during operation, thus greatly improves the precision of the navigation system, and is helpful for clinical application.
附图说明Description of drawings
图1是脑组织变形矫正系统软件系统模块图。Fig. 1 is a block diagram of the software system of the brain tissue deformation correction system.
图2是脑组织变形矫正系统工作流程图。Fig. 2 is a working flow diagram of the brain tissue deformation correction system.
图3是脑组织变形矫正系统软件系统界面以及三维可视化模块计算结果。Fig. 3 is the software system interface of the brain tissue deformation correction system and the calculation results of the three-dimensional visualization module.
图4是边界条件确定,其中1是三维激光扫描仪获取的皮层表表面点云数据,2是变形后软组织表面和初始软组织表面进行初配准的结果,3是表面跟踪前的结果,4是获取两个点集中点与点之间的映射关系后的结果。Figure 4 is the determination of the boundary conditions, where 1 is the point cloud data of the cortical surface acquired by the 3D laser scanner, 2 is the result of initial registration between the deformed soft tissue surface and the initial soft tissue surface, 3 is the result before surface tracking, and 4 is Get the result of the mapping relationship between points in two point sets.
具体实施方式detailed description
实施例1临床试验Embodiment 1 clinical trial
1.在三维激光扫描仪上安装跟踪工具,并使用标定模块进行标定,获取三维激光扫描仪空间变换到跟踪工具空间的坐标变换关系;1. Install the tracking tool on the 3D laser scanner, and use the calibration module to calibrate to obtain the coordinate transformation relationship from the space transformation of the 3D laser scanner to the space of the tracking tool;
2.脑组织变形矫正工作台与神经外科导航系统进行通讯,请求传输术前影像数据。脑组织变形矫正工作台为客户端,神经外科导航系统为服务器端。客户端首先发送命令码CMDASKIMG;服务器端确认命令码无误,发送CMDREQACK确认;服务器向客户端传送术前影像数据,将240×240×197的三维MRI脑组织数据存放在一个一维数组中;服务器发送CMDSENDFIN停止传输;客户端收到CMDSENDFIN后停止接收,保存术前影像数据;2. The brain tissue deformation correction workbench communicates with the neurosurgical navigation system to request the transmission of preoperative image data. The brain tissue deformation correction workbench is the client, and the neurosurgical navigation system is the server. The client first sends the command code CMDASKIMG; the server confirms that the command code is correct, and sends CMDREQACK to confirm; the server sends the preoperative image data to the client, and stores the 240×240×197 three-dimensional MRI brain tissue data in a one-dimensional array; the server Send CMDSENDFIN to stop the transmission; after receiving CMDSENDFIN, the client stops receiving and saves the preoperative image data;
3.针对240×240×197的三维MRI脑组织数据场采用自动分割和手动分割相结合的算法提取出脑组织,分数灰度阈值设定为0.5;3. For the 240×240×197 three-dimensional MRI brain tissue data field, the brain tissue is extracted by using an algorithm combining automatic segmentation and manual segmentation, and the score gray threshold is set to 0.5;
4.采用四面体网格将提取出的脑组织离散为162650个网格单元,节点数为30150,四面体最大为5×5×5mm3,提取网格表面节点;4. Discrete the extracted brain tissue into 162,650 grid units with a tetrahedron grid, the number of nodes is 30,150, and the maximum tetrahedron size is 5×5×5mm 3 , and the grid surface nodes are extracted;
5.在线弹性模型的每一个单元设置脑组织生物力学属性参数。杨氏模量=3Kpa,泊松比=0.45;5. Set the biomechanical property parameters of the brain tissue for each unit of the online elasticity model. Young's modulus=3Kpa, Poisson's ratio=0.45;
6.将参考架固定在病人头部,参考架可以被跟踪设备跟踪到。将三维激光扫描仪安装在一个具备标准自由度的三脚架上,调整三脚架使其采集镜头位于开颅皮层表面法线方向30到60cm处,扫描获取开颅区域变形后软组织表面点云;6. Fix the reference frame on the patient's head, and the reference frame can be tracked by the tracking device. Install the 3D laser scanner on a tripod with standard degrees of freedom, adjust the tripod so that the acquisition lens is located at 30 to 60 cm in the normal direction of the surface of the craniotomy cortex, and scan to obtain the point cloud of the deformed soft tissue surface in the craniotomy area;
7.扫描同时,借助神经外科导航系统中的光学跟踪设备获得跟踪工具空间到跟踪设备空间坐标变换关系以及跟踪设备空间到参考架空间的坐标变换关系。参考架空间到图像空间坐标变换关系通过对术前图像和病人空间的标记点刚性配准得到;7. At the same time of scanning, the coordinate transformation relationship from the tracking tool space to the tracking equipment space and the coordinate transformation relationship from the tracking equipment space to the reference frame space are obtained by means of the optical tracking equipment in the neurosurgical navigation system. The coordinate transformation relationship from the reference frame space to the image space is obtained through the rigid registration of the preoperative image and the marker points in the patient space;
8.借助通讯模块,将第六步所述三个空间变换关系由神经外科导航系统传输给脑组织变形矫正系统。握手命令为:CMDASKTRANS(请求传输变换矩阵,客户端发出);CMDREQACK(同意传输,服务器端发出);结束命令为CMDSENDFIN(传输结束,服务器端发出);8. With the help of the communication module, the three spatial transformation relationships mentioned in the sixth step are transmitted from the neurosurgical navigation system to the brain tissue deformation correction system. The handshake command is: CMDASKTRANS (request transmission transformation matrix, sent by the client); CMDREQACK (agreed to transfer, sent by the server); the end command is CMDSENDFIN (end of transmission, sent by the server);
9.获得以上四个空间的坐标关系后,脑组织变形矫正系统将变形后脑组织表面和初始脑组织表面配准到统一空间坐标系下,完成初配准;9. After obtaining the coordinate relationship of the above four spaces, the brain tissue deformation correction system will register the deformed brain tissue surface and the initial brain tissue surface under the unified space coordinate system to complete the initial registration;
10.通过人工勾画,得到开颅区域部位的网格表面节点(变形前软组织表面)和变形后脑组织皮层点云(变形后软组织表面),其中网格表面节点包含134节点,点云包含18127节点;10. Obtain the mesh surface nodes of the craniotomy area (soft tissue surface before deformation) and the cortical point cloud of the deformed brain tissue (soft tissue surface after deformation) through manual delineation, where the mesh surface nodes contain 134 nodes, and the point cloud contains 18127 nodes ;
11.将网格表面节点划分为17个小块,前16小块,每个小块包含8个节点,最后一个小块包含6个节点。为每个点集小块pk构建能量最小方程获得点其表面位移:11. Divide the mesh surface nodes into 17 small blocks, the first 16 small blocks contain 8 nodes, and the last small block contains 6 nodes. Construct the energy minimum equation for each point set small block p k to obtain the surface displacement of the point:
其中pk={p,o=1,2,……l}为点集小块,其中前16个小块,l=8,最后一个小块,l=6。Y={y,j=1,2,……N},为点云的点集,其中N=18127。cjk是定义两个点集之间对应概率的相关性矩阵,λ为权重因子。用薄板样条(Thin-plate Spline)非刚性配准算法计算变形皮层(Y)与未变形皮层(pk)之间映射函数f,从而获得点集小块表面位移Disppk;集合每个点集小块的位移Disppk,获得所有需要跟踪的软组织表面网格节点的位移Dispx;Wherein p k ={p,o=1,2,...l} is a point set of small blocks, wherein the first 16 small blocks, l=8, and the last small block, l=6. Y={y,j=1,2,...N}, which is the point set of the point cloud, where N=18127. c jk is a correlation matrix defining the corresponding probability between two point sets, and λ is a weighting factor. Use the Thin-plate Spline non-rigid registration algorithm to calculate the mapping function f between the deformed cortex (Y) and the undeformed cortex (p k ), so as to obtain the surface displacement Disp pk of the point set; collect each point Set the displacement Disp pk of the small block to obtain the displacement Disp x of all soft tissue surface grid nodes that need to be tracked;
12.采用有限元方法将线弹性模型方程化为矩阵形式:Ka=P,其中K为刚性矩阵,a为结点位移,P为结点载荷。K由杨氏弹性模量E和泊松比ν两个参数决定。引入边界条件,消除矩阵K的奇异性,求出位移矢量a,获得脑组织内部任意节点处的位移。我们使用了基于PETSc(Portable,Extensible Toolkit for Scientific Computation)构建的线性求解器来实现多处理器并行计算,用以加快运算速度。在使用戴尔工作站(Intel Core2 DuoE6850,4 GB RAM),Windows XP操作系统,求解时间为50s;12. Use the finite element method to convert the linear elastic model equation into a matrix form: Ka=P, where K is the rigid matrix, a is the node displacement, and P is the node load. K is determined by two parameters, Young's modulus of elasticity E and Poisson's ratio ν. Boundary conditions are introduced, the singularity of the matrix K is eliminated, the displacement vector a is obtained, and the displacement at any node inside the brain tissue is obtained. We use a linear solver based on PETSc (Portable, Extensible Toolkit for Scientific Computation) to realize multi-processor parallel computing to speed up the operation. Using a Dell workstation (Intel Core2 DuoE6850, 4 GB RAM), Windows XP operating system, the solution time is 50s;
13.由变形后的数据场,根据形函数计算出所有对显示有贡献的坐标点(整数坐标点)变形前的位置,利用三线性插值计算出该点的灰度值;13. From the deformed data field, calculate the position of all coordinate points (integer coordinate points) that contribute to the display before deformation according to the shape function, and use trilinear interpolation to calculate the gray value of the point;
14.对所有这些整数坐标点组成的三维数据场采用光线透射法加以可视化,用于导航手术;14. Visualize the three-dimensional data field composed of all these integer coordinate points using the light transmission method for navigation surgery;
15.将预测更新后图像通过通讯模块传输回神经外科导航系统。手术导航系统作为服务器端,脑组织变形矫正系统作为客户端,由客户端首先发出请求,服务器端按照握手命令做出回应,首先通过命令进行握手,然后传输数据,最后通过命令结束传输,图像数据放在一个一维数组中,应用层的握手命令如下:CMDSENDREQ(请求传输图像,客户端发出);CMDREQACK(同意接收图像更新后数据,客户端发出);CMDSENDFIN传输结束,客户端发出)。15. The predicted updated image is transmitted back to the neurosurgical navigation system through the communication module. The surgical navigation system acts as the server, and the brain tissue deformation correction system acts as the client. The client sends a request first, and the server responds according to the handshake command. First, the handshake is performed through the command, and then the data is transmitted. Placed in a one-dimensional array, the handshake commands of the application layer are as follows: CMDSENDREQ (request for image transmission, sent by the client); CMDREQACK (agreed to receive image update data, sent by the client); CMDSENDFIN transmission ends, sent by the client).
试验结果显示,本发明的基于无线传输的脑组织变形矫正系统精度可靠,可方便地集成在现有神经外科手术导航系统中,帮助实现术中软组织变形矫正,从而大幅度提高导航系统精度。The test results show that the wireless transmission-based brain tissue deformation correction system of the present invention has reliable accuracy, and can be easily integrated into the existing neurosurgery navigation system to help realize intraoperative soft tissue deformation correction, thereby greatly improving the accuracy of the navigation system.
Claims (14)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610086140.4A CN106420055A (en) | 2016-02-15 | 2016-02-15 | Brain tissue deformation correction system based on wireless transmission |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610086140.4A CN106420055A (en) | 2016-02-15 | 2016-02-15 | Brain tissue deformation correction system based on wireless transmission |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106420055A true CN106420055A (en) | 2017-02-22 |
Family
ID=58183648
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610086140.4A Pending CN106420055A (en) | 2016-02-15 | 2016-02-15 | Brain tissue deformation correction system based on wireless transmission |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106420055A (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110599529A (en) * | 2019-09-10 | 2019-12-20 | 华中科技大学苏州脑空间信息研究院 | Brain region expansion correction method of microscopic optical image |
CN112330603A (en) * | 2020-10-19 | 2021-02-05 | 浙江省肿瘤医院 | System and method for estimating target motion in tissue based on soft tissue surface deformation |
CN112822981A (en) * | 2018-10-09 | 2021-05-18 | 皇家飞利浦有限公司 | Automatic EEG sensor registration |
CN112867136A (en) * | 2020-12-31 | 2021-05-28 | 杭州思锐迪科技有限公司 | Three-dimensional scanning system and three-dimensional scanning method based on wireless peer-to-peer network |
CN113781630A (en) * | 2021-08-04 | 2021-12-10 | 上海健康医学院 | A brain tissue deformation correction method, storage medium and terminal device based on REIMS |
CN114404039A (en) * | 2021-12-30 | 2022-04-29 | 华科精准(北京)医疗科技有限公司 | Tissue drift correction method and device for three-dimensional model, electronic equipment and storage medium |
CN114631887A (en) * | 2022-04-02 | 2022-06-17 | 华科精准(北京)医疗科技有限公司 | Method and device for correcting tissue deformation based on blood vessels |
CN119203275A (en) * | 2024-11-29 | 2024-12-27 | 中国科学院空天信息创新研究院 | Soft tissue meshless deformation modeling method, device, equipment and medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1582863A (en) * | 2004-06-01 | 2005-02-23 | 复旦大学 | Method for correcting brain tissue deformation in navigation system of neurosurgery |
CN102082627A (en) * | 2010-05-27 | 2011-06-01 | 中国科学院深圳先进技术研究院 | Health data transmission method and system |
CN103443825A (en) * | 2011-03-18 | 2013-12-11 | 皇家飞利浦有限公司 | Tracking brain deformation during neurosurgery |
WO2014138571A3 (en) * | 2013-03-07 | 2014-11-06 | Adventist Health System/Sunbelt, Inc. | Surgical navigation planning system and associated methods |
CN105310776A (en) * | 2014-12-02 | 2016-02-10 | 复旦大学 | Soft tissue surface deformation tracking method based on sub-blocks |
-
2016
- 2016-02-15 CN CN201610086140.4A patent/CN106420055A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1582863A (en) * | 2004-06-01 | 2005-02-23 | 复旦大学 | Method for correcting brain tissue deformation in navigation system of neurosurgery |
CN102082627A (en) * | 2010-05-27 | 2011-06-01 | 中国科学院深圳先进技术研究院 | Health data transmission method and system |
CN103443825A (en) * | 2011-03-18 | 2013-12-11 | 皇家飞利浦有限公司 | Tracking brain deformation during neurosurgery |
WO2014138571A3 (en) * | 2013-03-07 | 2014-11-06 | Adventist Health System/Sunbelt, Inc. | Surgical navigation planning system and associated methods |
CN105310776A (en) * | 2014-12-02 | 2016-02-10 | 复旦大学 | Soft tissue surface deformation tracking method based on sub-blocks |
Non-Patent Citations (2)
Title |
---|
王巍伟: "神经导航中脑组织牵拉变形矫正", 《中国优秀硕士学位论文全文数据库》 * |
穆晓兰: "手术导航中精度问题的探讨", 《中国微创外科杂志》 * |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112822981A (en) * | 2018-10-09 | 2021-05-18 | 皇家飞利浦有限公司 | Automatic EEG sensor registration |
CN110599529A (en) * | 2019-09-10 | 2019-12-20 | 华中科技大学苏州脑空间信息研究院 | Brain region expansion correction method of microscopic optical image |
CN110599529B (en) * | 2019-09-10 | 2022-06-03 | 华中科技大学苏州脑空间信息研究院 | Brain region expansion correction method of microscopic optical image |
CN112330603A (en) * | 2020-10-19 | 2021-02-05 | 浙江省肿瘤医院 | System and method for estimating target motion in tissue based on soft tissue surface deformation |
CN112867136A (en) * | 2020-12-31 | 2021-05-28 | 杭州思锐迪科技有限公司 | Three-dimensional scanning system and three-dimensional scanning method based on wireless peer-to-peer network |
CN113781630A (en) * | 2021-08-04 | 2021-12-10 | 上海健康医学院 | A brain tissue deformation correction method, storage medium and terminal device based on REIMS |
CN114404039A (en) * | 2021-12-30 | 2022-04-29 | 华科精准(北京)医疗科技有限公司 | Tissue drift correction method and device for three-dimensional model, electronic equipment and storage medium |
CN114631887A (en) * | 2022-04-02 | 2022-06-17 | 华科精准(北京)医疗科技有限公司 | Method and device for correcting tissue deformation based on blood vessels |
CN119203275A (en) * | 2024-11-29 | 2024-12-27 | 中国科学院空天信息创新研究院 | Soft tissue meshless deformation modeling method, device, equipment and medium |
CN119203275B (en) * | 2024-11-29 | 2025-02-18 | 中国科学院空天信息创新研究院 | Soft tissue gridless deformation modeling method, device, equipment and medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106420055A (en) | Brain tissue deformation correction system based on wireless transmission | |
CN107811710B (en) | Operation aided positioning system | |
CN102525662B (en) | Three-dimensional visual tissue organ operation navigation system | |
Ferrant et al. | Registration of 3D intraoperative MR images of the brain using a finite element biomechanical model | |
Özgür et al. | Preoperative liver registration for augmented monocular laparoscopy using backward–forward biomechanical simulation | |
US8532359B2 (en) | Biodata model preparation method and apparatus, data structure of biodata model and data storage device of biodata model, and load dispersion method and apparatus of 3D data model | |
CN112614169B (en) | 2D/3D spine CT (computed tomography) level registration method based on deep learning network | |
US8861891B2 (en) | Hierarchical atlas-based segmentation | |
CN105310776B (en) | A kind of soft tissue surfaces deformation method for tracing based on sub-block | |
CN111080778B (en) | Online three-dimensional reconstruction method of binocular endoscope soft tissue image | |
CN117408908B (en) | An automatic fusion method of preoperative and intraoperative CT images based on deep neural network | |
CN103229210A (en) | Image registration apparatus | |
JP6493885B2 (en) | Image alignment apparatus, method of operating image alignment apparatus, and image alignment program | |
JP5967605B2 (en) | Transcranial brain function analysis method | |
WO2011143820A1 (en) | Method for simulating and correcting deformation of cerebral tissue images | |
CN110992431A (en) | A combined three-dimensional reconstruction method of binocular endoscopic soft tissue images | |
CN103908344A (en) | Tractive straightening method based on surgical navigation system | |
JP2014064957A (en) | Organism data model creation method and device, data structure of organism data model, data storage device of organism data model, and load sharing method and device for three-dimensional data model | |
WO2023056877A1 (en) | Method and apparatus for determining femoral line of force of knee joint, electronic device, and storage medium | |
CN110993067A (en) | Medical image labeling system | |
CN104751438B (en) | For the method and apparatus alternatively to medical threedimensional images registration | |
JP5487264B2 (en) | Biological data model creation method and apparatus | |
JP2016209399A (en) | Image processing device and method, and computer program | |
JP2015128669A (en) | Living body data model creation method and device, living body data model data structure, living body data model data storage device, three dimensional data model load distribution method, and device | |
CN114283179A (en) | Real-time acquisition and registration system of fracture distal and proximal spatial pose based on ultrasound images |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170222 |
|
RJ01 | Rejection of invention patent application after publication |