CN110292439A - Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality - Google Patents
Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality Download PDFInfo
- Publication number
- CN110292439A CN110292439A CN201910704951.XA CN201910704951A CN110292439A CN 110292439 A CN110292439 A CN 110292439A CN 201910704951 A CN201910704951 A CN 201910704951A CN 110292439 A CN110292439 A CN 110292439A
- Authority
- CN
- China
- Prior art keywords
- unit
- heart
- augmented reality
- dimensional
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient; User input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/60—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to nutrition control, e.g. diets
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/102—Modelling of surgical devices, implants or prosthesis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Pathology (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Cardiology (AREA)
- Primary Health Care (AREA)
- Physiology (AREA)
- Physics & Mathematics (AREA)
- Biophysics (AREA)
- Epidemiology (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Robotics (AREA)
- Pulmonology (AREA)
- Nutrition Science (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
Description
技术领域technical field
本发明属于智能医学辅助诊疗领域,具体地涉及基于增强现实的心脏支架手术辅助诊疗系统及使用方法。The invention belongs to the field of intelligent medical auxiliary diagnosis and treatment, and in particular relates to an augmented reality-based auxiliary diagnosis and treatment system for heart stent surgery and a use method.
背景技术Background technique
随着经济社会高速的发展,人们生活水平的提高,高蛋白食物摄入越来越多,心脏病人的数量也在快速增加。目前针对心脏病的手术治疗有开放式手术和介入式手术。With the rapid development of economy and society, the improvement of people's living standards, the intake of high-protein food is increasing, and the number of heart disease patients is also increasing rapidly. At present, surgical treatment for heart disease includes open surgery and interventional surgery.
开放式手术风创伤大、风险高易感染、费用高、术后并发症多、愈合时间长。介入式手术创伤小、安全系数高、费用低、术后愈合时间短、病人生活质量高。Open surgery has large trauma, high risk of infection, high cost, many postoperative complications, and long healing time. Interventional surgery has small trauma, high safety factor, low cost, short postoperative healing time, and high quality of life for patients.
心脏支架手术属于介入式手术的一种,主要用于治疗狭窄或者阻塞的管桩动脉,它还可以在心脏病发作后立即改善血流量。目前支架手术被广泛在临床使用。Heart stent surgery is a type of interventional surgery used to treat narrowed or blocked arteries and to improve blood flow immediately after a heart attack. At present, stent surgery is widely used clinically.
特别是涂药支架的出现,降低了心脏绕道手术的与血管成形术的使用。使更多的低收入家庭能够得到治疗。但支架手术是借助造影剂和C臂机和显示器只能呈现出二维图像,不能较好的反映真实心脏状况,降低了手术的可视性,加大了医生的判断的难度。针对要放几个支架的问题,医生往往只能根据经验来判断,增加了手术难度。同时术后病人情况无法很好追踪并提供合理的生活执导。In particular, the advent of drug-coated stents has reduced the use of heart bypass surgery and angioplasty. Make treatment available to more low-income families. However, the stent surgery can only present two-dimensional images with the help of contrast agents, C-arm machines and monitors, which cannot reflect the real heart condition well, reduces the visibility of the surgery, and increases the difficulty of the doctor's judgment. Regarding how many stents need to be placed, doctors often can only make judgments based on experience, which increases the difficulty of surgery. At the same time, the patient's condition after surgery cannot be well tracked and reasonable life guidance can be provided.
发明内容Contents of the invention
基于以上技术不足,本发明提出一种基于增强现实的心脏支架手术辅助诊疗系统及使用方法,其中,一种基于增强现实的心脏支架手术辅助诊疗系统,包括:大数据服务系统、增强现实眼镜、全息交互投影器、数据传输与交换系统、检测手环;Based on the above technical deficiencies, the present invention proposes an augmented reality-based auxiliary diagnosis and treatment system for heart stent surgery and a method for using it, wherein, an augmented reality-based auxiliary diagnosis and treatment system for heart stent surgery includes: a big data service system, augmented reality glasses, Holographic interactive projector, data transmission and exchange system, detection bracelet;
所述大数据服务系统通过数据传输与交换系统分别与增强现实眼镜、全息交互投影器和检测手环进行数据通讯;The big data service system performs data communication with the augmented reality glasses, the holographic interactive projector and the detection bracelet respectively through the data transmission and exchange system;
所述增强现实眼镜,将三维重建后的虚拟心脏模型与现实环境进行融合,辅助导管的插入;The augmented reality glasses fuse the three-dimensionally reconstructed virtual heart model with the real environment to assist catheter insertion;
所述全息交互投影器,将三维重建后的三维心脏模型投影到医生面前,并识别手术过程医生的手势,实时显示手术过程中的三维心脏模型,手势交互能够三百六十度旋转全息心脏,观察心脏堵塞情况;The holographic interactive projector projects the three-dimensional reconstructed three-dimensional heart model in front of the doctor, and recognizes the doctor's gestures during the operation, and displays the three-dimensional heart model during the operation in real time. The gesture interaction can rotate the holographic heart by 360 degrees, Watch for heart blockages;
所述大数据服务系统,包括:存储单元、中央数据处理单元、图像处理单元、智能诊断单元、三维重构单元及激光传输单元;The big data service system includes: a storage unit, a central data processing unit, an image processing unit, an intelligent diagnosis unit, a three-dimensional reconstruction unit and a laser transmission unit;
所述存储单元与中央数据处理单元相连接,中央数据处理单元与图像处理单元相连接,图像处理单元与智能诊断单元相连接,智能诊断单元与激光传输单元相连接,激光传输单元与数据传输与交换系统相连接;The storage unit is connected to the central data processing unit, the central data processing unit is connected to the image processing unit, the image processing unit is connected to the intelligent diagnosis unit, the intelligent diagnosis unit is connected to the laser transmission unit, the laser transmission unit is connected to the data transmission and Switching system is connected;
所述存储单元,用来保存病人的心脏影像信息、心电图信息、以往病史和检测手环传递过来的数据;The storage unit is used to save the patient's heart image information, electrocardiogram information, past medical history and data transmitted by the detection bracelet;
所述中央数据处理单元,对存储单元中数据进行处理后分类,将分类后的数据发送给图像处理单元;The central data processing unit processes and classifies the data in the storage unit, and sends the classified data to the image processing unit;
所述图像处理单元,将分类后的数据生成二维影像信息,并将二维影像信息传递给智能诊断单元;The image processing unit generates two-dimensional image information from the classified data, and transmits the two-dimensional image information to the intelligent diagnosis unit;
所述智能诊断单元,根据二维影像信息,诊断心脏血管阻塞情况,并将阻塞情况传递给三维重构单元;The intelligent diagnosis unit diagnoses the blockage of the heart vessels according to the two-dimensional image information, and transmits the blockage to the three-dimensional reconstruction unit;
所述三维重构单元,结合心脏血管阻塞情况,三维重构单元生成三维心脏模型,并将三维心脏模型传递给激光传输单元;The three-dimensional reconstruction unit generates a three-dimensional heart model in combination with the blockage of the heart vessels, and transmits the three-dimensional heart model to the laser transmission unit;
所述激光传输单元,将三维心脏模型传递到数据传输与交换系统;The laser transmission unit transmits the three-dimensional heart model to the data transmission and exchange system;
所述数据传输与交换系统,将三维心脏模型统一发送给增强现实眼镜及全息交互投影器。The data transmission and exchange system uniformly sends the three-dimensional heart model to the augmented reality glasses and the holographic interactive projector.
所述检测手环,在术后给病人佩戴,监视病人心脏跳动状况,遇到心脏异情况进行提醒,根据体征判断是否启动急救单元拨打救护电话,实时定位和监测病人状况;推荐健康饮食指南、提醒睡觉、运动。将监测的数据通过数据传输与交换系统实时传递到大数据服务系统。The detection wristband is worn by the patient after the operation to monitor the patient's heart beating condition, and reminds the heart when it encounters an abnormal situation. According to the signs, it is judged whether to activate the emergency unit to call the ambulance, locate and monitor the patient's condition in real time; recommend healthy diet guidelines, Remind sleep, exercise. The monitored data is transmitted to the big data service system in real time through the data transmission and exchange system.
所述增强现实眼镜,包括:双目视觉模块、五轴防抖模块、图像处理模块、高清显示模块和无线传输模块;The augmented reality glasses include: a binocular vision module, a five-axis anti-shake module, an image processing module, a high-definition display module and a wireless transmission module;
所述双目视觉模块与五轴防抖模块相连接,五轴防抖模块与图像处理模块相连接,图像处理模块与高清显示模块相连接,高清显示模块与无线传输模块相连接;The binocular vision module is connected with the five-axis anti-shake module, the five-axis anti-shake module is connected with the image processing module, the image processing module is connected with the high-definition display module, and the high-definition display module is connected with the wireless transmission module;
所述双目视觉模块,接收来自外界环境的信息和三维心脏模型信息,并将信息传递给五轴防抖模块;The binocular vision module receives information from the external environment and three-dimensional heart model information, and transmits the information to the five-axis anti-shake module;
所述五轴防抖模块,具有防抖功能,保证双目视觉模块传递过来的信息显示清晰的画面,并将防抖处理后的图像传递给图像处理模块;The five-axis anti-shake module has an anti-shake function to ensure that the information transmitted by the binocular vision module displays a clear picture, and transmits the image after the anti-shake processing to the image processing module;
所述图像处理模块,接收防抖处理后的图像,在增强现实眼镜处于运动中任然能够保证显示清晰的画面,并将图像处理后的画面传递给高清显示模块;The image processing module receives the image after anti-shake processing, and can still guarantee to display a clear picture when the augmented reality glasses are in motion, and transmits the picture after image processing to the high-definition display module;
所述高清显示模块,接收图像处理后的画面,并将该画面生成高清画面,显示在眼镜上,并将高清画面传递给无线传输模块;The high-definition display module receives the picture after image processing, generates a high-definition picture from the picture, displays it on the glasses, and transmits the high-definition picture to the wireless transmission module;
所述无线传输模块,将高清画面无线传递出去;The wireless transmission module transmits the high-definition picture wirelessly;
所述检测手环,包括:心电信号监视单元、预警单元、急救单元、智能语音单元、OLED显示单元。The detection bracelet includes: an electrocardiographic signal monitoring unit, an early warning unit, an emergency unit, an intelligent voice unit, and an OLED display unit.
所述心电信号监视单元,实时监测病人心脏跳动情况,将心脏跳动情况传递给OLED显示单元,并根据已设定的阈值,判断心脏是否有异常情况,若出现心脏异常则将异常信号传递给预警单元;若判断出现急救的情况,将急救信息发送给急救单元;The ECG monitoring unit monitors the beating condition of the patient's heart in real time, transmits the beating condition to the OLED display unit, and judges whether there is any abnormality in the heart according to the set threshold, and transmits the abnormal signal to the Early warning unit; if it is judged that there is a first aid situation, send the first aid information to the first aid unit;
所述预警单元,收到心电信号监视单元发送的心脏异常信号后,发出预警提示音;The early warning unit, after receiving the abnormal heart signal sent by the ECG signal monitoring unit, sends out an early warning prompt tone;
所述急救单元,收到心电信号监视单元发送的急救信息后,自动拨打急救电话,并开启GPS定位功能,随时对病人进行定位;The emergency unit, after receiving the emergency information sent by the ECG signal monitoring unit, automatically dials an emergency call, and turns on the GPS positioning function to locate the patient at any time;
所述智能语音单元,实现人机语音交互;The intelligent voice unit realizes human-machine voice interaction;
所述OLED显示单元,监视病人心脏跳动状况通过OLED屏幕显示。The OLED display unit monitors the beating condition of the patient's heart and displays it on the OLED screen.
所述自外界环境的视频信息,包括:导管、球囊、支架、血栓收集器、高速微型转头医疗器材,将导管、球囊、支架、血栓收集器、高速微型转头医疗器材进行三维扫描,形成三维模型。将三维模型传递到大数据服务系统中进行储存;The video information from the external environment includes: catheters, balloons, stents, thrombus collectors, and high-speed micro-rotor medical equipment, and three-dimensional scanning of catheters, balloons, stents, thrombus collectors, and high-speed micro-rotor medical equipment , forming a three-dimensional model. Transfer the 3D model to the big data service system for storage;
一种基于增强现实的心脏支架手术辅助诊疗系统的使用方法,采用一种基于增强现实的心脏支架手术辅助诊疗系统实现,具体步骤如下:A method for using an augmented reality-based auxiliary diagnosis and treatment system for heart stent surgery is realized by using an augmented reality-based auxiliary diagnosis and treatment system for heart stent surgery. The specific steps are as follows:
步骤1:启动增强现实的心脏支架手术辅助诊疗系统;Step 1: Start the augmented reality assisted diagnosis and treatment system for heart stent surgery;
步骤2:初始化大数据服务系统,中央数据处理单元对存储单元中数据进行处理后分类,将分类后的数据发送给图像处理单元;Step 2: Initialize the big data service system, the central data processing unit processes and classifies the data in the storage unit, and sends the classified data to the image processing unit;
步骤3:将分类后的数据生成二维影像信息,并将二维影像信息传递给智能诊断单元;;Step 3: Generate two-dimensional image information from the classified data, and transmit the two-dimensional image information to the intelligent diagnosis unit;
步骤4:根据二维影像信息,诊断心脏血管阻塞情况,并将阻塞情况传递给三维重构单元;Step 4: According to the two-dimensional image information, diagnose the blockage of the heart vessel, and transmit the blockage to the three-dimensional reconstruction unit;
步骤5:结合心脏血管阻塞情况,三维重构单元生成三维心脏模型,并将三维心脏模型传递给激光传输单元;Step 5: Combined with the occlusion of the heart vessels, the 3D reconstruction unit generates a 3D heart model, and transmits the 3D heart model to the laser transmission unit;
步骤6:激光传输单元将三维心脏模型传递到数据传输与交换系统;Step 6: The laser transmission unit transmits the three-dimensional heart model to the data transmission and exchange system;
步骤7:数据传输与交换系统将三维心脏模型统一发送给增强现实眼镜及全息交互投影器;Step 7: The data transmission and exchange system uniformly sends the 3D heart model to the augmented reality glasses and the holographic interactive projector;
步骤8:医生戴上增强现实眼镜,启动增强现实眼镜,根据显示在眼镜上的自外界环境的视频信息和三维心脏模型视频信息,进行手术,辅助导管的定位;Step 8: The doctor puts on the augmented reality glasses, activates the augmented reality glasses, and performs surgery according to the video information from the external environment and the 3D heart model video information displayed on the glasses to assist in the positioning of the catheter;
步骤9:当导管到达冠状窦底部的时候启动全息交互投影器,摘下增强现实眼镜,使用全息交互投影器手势识别功能,对心脏堵塞情况进行观察,并完成余下的手术;Step 9: Start the holographic interactive projector when the catheter reaches the bottom of the coronary sinus, take off the augmented reality glasses, use the gesture recognition function of the holographic interactive projector to observe the heart blockage, and complete the rest of the operation;
步骤10:手术完成后,病人佩戴检测手环,监视病人心脏跳动状况。遇到心脏异情况进行提醒,根据体征判断是否启动急救单元拨打救护电话,实时定位和监测病人状况;推荐健康饮食指南、提醒睡觉、运动;将监测的数据通过数据传输与交换系统实时传递到大数据服务系统。Step 10: After the operation is completed, the patient wears a detection bracelet to monitor the heartbeat of the patient. Reminders in case of abnormal heart conditions, judge whether to activate the emergency unit to call for ambulance according to physical signs, locate and monitor the patient's condition in real time; recommend healthy diet guidelines, remind sleep and exercise; transmit the monitored data to the university in real time through the data transmission and exchange system data service system.
有益技术效果:Beneficial technical effects:
本系统可以实时显示心脏三维图像,较好的反应心脏真实情况,增加了手术的可视性,降低了医生手术操作难度,对放支架的数量也有了相对好的判断,同时术后病人情况可以很好追踪并提供合理的生活执导。This system can display the three-dimensional image of the heart in real time, better reflect the real situation of the heart, increase the visibility of the operation, reduce the difficulty of the doctor's operation, and have a relatively good judgment on the number of stents placed. At the same time, the patient's condition after surgery can be improved. Well followed and provides reasonable life direction.
附图说明Description of drawings
图1为本发明实施例的一种基于增强现实的心脏支架手术辅助诊疗系统框图;Fig. 1 is a block diagram of a heart stent surgery auxiliary diagnosis and treatment system based on augmented reality in an embodiment of the present invention;
图2为本发明实施例的一种基于增强现实的心脏支架手术辅助诊疗系统使用方法流程图;Fig. 2 is a flow chart of a method for using an augmented reality-based cardiac stent surgery assisted diagnosis and treatment system according to an embodiment of the present invention;
图3为本发明实施例的心脏支架手术过程全局图;Fig. 3 is the overall view of the heart stent operation process of the embodiment of the present invention;
图4为本发明实施例的全息交互投影器;Fig. 4 is a holographic interactive projector according to an embodiment of the present invention;
图5为本发明实施例的病人佩戴检测手环示意图;5 is a schematic diagram of a patient wearing a detection bracelet according to an embodiment of the present invention;
图6为本发明实施例的增强现实眼镜组成框图;FIG. 6 is a block diagram of augmented reality glasses according to an embodiment of the present invention;
图中:1-戴上增强现实眼镜手术的医生,2-增强现实眼镜,3-摘下增强现实眼镜的医生,4-病人,5-X光机,6-显示屏,7-全息交互投影器,8-大数据服务系统,9-远程传输信号,10-传输线,11-手术台,12-虚拟三维心脏模型,13-投影镜头,14-双目镜头1,15-双目镜头2,16.1-USB接口,16.2-HDMI接口,16.3-VGA接口,17-电源,18-散热栅,19-电源按钮,20-网线接口,21-数据传输接口,22-检测手环。In the picture: 1-doctor wearing augmented reality glasses for surgery, 2-augmented reality glasses, 3-doctor taking off augmented reality glasses, 4-patient, 5-X-ray machine, 6-display screen, 7-holographic interactive projection Device, 8-big data service system, 9-remote transmission signal, 10-transmission line, 11-operating table, 12-virtual three-dimensional heart model, 13-projection lens, 14-binocular lens 1, 15-binocular lens 2, 16.1-USB interface, 16.2-HDMI interface, 16.3-VGA interface, 17-power supply, 18-radiation grid, 19-power button, 20-network cable interface, 21-data transmission interface, 22-detection bracelet.
具体实施方式Detailed ways
下面结合附图和具体实施实例对发明做进一步说明,一种基于增强现实的心脏支架手术辅助诊疗系统,如图1所示,包括:大数据服务系统8、增强现实眼镜2、全息交互投影器7、数据传输与交换系统、检测手环22;The invention will be further described below in conjunction with the accompanying drawings and specific implementation examples. An augmented reality-based cardiac stent surgery auxiliary diagnosis and treatment system, as shown in Figure 1, includes: a big data service system 8, augmented reality glasses 2, and a holographic interactive projector 7. Data transmission and exchange system, detection bracelet 22;
所述大数据服务系统8通过数据传输与交换系统分别与增强现实眼镜2、全息交互投影器7和检测手环22进行数据通讯;The big data service system 8 performs data communication with the augmented reality glasses 2, the holographic interactive projector 7 and the detection bracelet 22 respectively through the data transmission and exchange system;
所述增强现实眼镜2,将三维重建后的虚拟心脏模型与现实环境进行融合,辅助导管的插入;The augmented reality glasses 2 fuse the three-dimensionally reconstructed virtual heart model with the real environment to assist catheter insertion;
所述全息交互投影器7,将三维重建后的三维心脏模型投影到医生面前,并识别手术过程医生的手势,实时显示手术过程中的三维心脏模型,手势交互能够三百六十度旋转全息心脏,观察心脏堵塞情况;The holographic interactive projector 7 projects the three-dimensional reconstructed three-dimensional heart model in front of the doctor, and recognizes the doctor's gestures during the operation, and displays the three-dimensional heart model during the operation in real time. Gesture interaction can rotate the holographic heart by 360 degrees , to observe heart blockage;
所述大数据服务系统8,包括:存储单元、中央数据处理单元、图像处理单元、智能诊断单元、三维重构单元及激光传输单元;The big data service system 8 includes: a storage unit, a central data processing unit, an image processing unit, an intelligent diagnosis unit, a three-dimensional reconstruction unit and a laser transmission unit;
所述存储单元与中央数据处理单元相连接,中央数据处理单元与图像处理单元相连接,图像处理单元与智能诊断单元相连接,智能诊断单元与激光传输单元相连接,激光传输单元与数据传输与交换系统相连接;The storage unit is connected to the central data processing unit, the central data processing unit is connected to the image processing unit, the image processing unit is connected to the intelligent diagnosis unit, the intelligent diagnosis unit is connected to the laser transmission unit, the laser transmission unit is connected to the data transmission and Switching system is connected;
所述存储单元,用来保存病人的心脏影像信息、心电图信息、以往病史和检测手环传递过来的数据;The storage unit is used to save the patient's heart image information, electrocardiogram information, past medical history and data transmitted by the detection bracelet;
所述中央数据处理单元对存储单元中数据进行处理后分类,将分类后的数据发送给图像处理单元;The central data processing unit classifies the data in the storage unit after processing, and sends the classified data to the image processing unit;
所述图像处理单元,将分类后的数据生成二维影像信息,并将二维影像信息传递给智能诊断单元;The image processing unit generates two-dimensional image information from the classified data, and transmits the two-dimensional image information to the intelligent diagnosis unit;
所述智能诊断单元,根据二维影像信息,判断心脏血管阻塞情况,并将阻塞情况传递给三维重构单元;The intelligent diagnosis unit judges the blockage of the heart vessels according to the two-dimensional image information, and transmits the blockage to the three-dimensional reconstruction unit;
所述三维重构单元,结合心脏血管阻塞情况,三维重构单元生成三维心脏模型,并将三维心脏模型传递给激光传输单元;The three-dimensional reconstruction unit generates a three-dimensional heart model in combination with the blockage of the heart vessels, and transmits the three-dimensional heart model to the laser transmission unit;
所述激光传输单元,将三维心脏模型传递到数据传输与交换系统;The laser transmission unit transmits the three-dimensional heart model to the data transmission and exchange system;
所述数据传输与交换系统,将三维心脏模型统一发送给增强现实眼镜及全息交互投影器。The data transmission and exchange system uniformly sends the three-dimensional heart model to the augmented reality glasses and the holographic interactive projector.
所述检测手环22,在术后给病人佩戴,监视病人心脏跳动状况通,遇到心脏异情况进行提醒,根据体征判断是否启动急救单元拨打救护电话,实时定位和监测病人状况;推荐健康饮食指南、提醒睡觉、运动。将监测的数据通过数据传输与交换系统实时传递到大数据服务系统。The detection bracelet 22 is worn by the patient after the operation to monitor the patient's heart beating condition, and reminds when encountering a heart abnormality, judges whether to start the emergency unit to call an ambulance according to the signs, locates and monitors the patient's condition in real time; recommends a healthy diet Guide, reminder to sleep, exercise. The monitored data is transmitted to the big data service system in real time through the data transmission and exchange system.
所述增强现实眼镜2,如图6所示,包括:双目视觉模块(索尼IMX586)、五轴防抖模块(索尼)、图像处理模块(高通855)、高清显示模块和无线传输模块(三星);Described augmented reality glasses 2, as shown in Figure 6, comprise: binocular vision module (Sony IMX586), five-axis anti-shake module (Sony), image processing module (Qualcomm 855), high-definition display module and wireless transmission module (Samsung );
所述双目视觉模块与五轴防抖模块相连接,五轴防抖模块与图像处理模块相连接,图像处理模块与高清显示模块相连接,高清显示模块与无线传输模块相连接;The binocular vision module is connected with the five-axis anti-shake module, the five-axis anti-shake module is connected with the image processing module, the image processing module is connected with the high-definition display module, and the high-definition display module is connected with the wireless transmission module;
所述双目视觉模块,接收来自外界环境的信息和三维心脏模型信息,并将信息传递给五轴防抖模块;The binocular vision module receives information from the external environment and three-dimensional heart model information, and transmits the information to the five-axis anti-shake module;
所述五轴防抖模块,具有防抖功能,保证双目视觉模块传递过来的信息显示清晰的画面,并将防抖处理后的图像传递给图像处理模块;The five-axis anti-shake module has an anti-shake function to ensure that the information transmitted by the binocular vision module displays a clear picture, and transmits the image after the anti-shake processing to the image processing module;
所述图像处理模块,接收防抖处理后的图像,在增强现实眼镜处于运动中任然能够保证显示清晰的画面,并将图像处理后的画面传递给高清显示模块;The image processing module receives the image after anti-shake processing, and can still guarantee to display a clear picture when the augmented reality glasses are in motion, and transmits the picture after image processing to the high-definition display module;
所述高清显示模块,接收图像处理后的画面,并将该画面生成高清画面,显示在眼镜上,并将高清画面传递给无线传输模块;The high-definition display module receives the picture after image processing, generates a high-definition picture from the picture, displays it on the glasses, and transmits the high-definition picture to the wireless transmission module;
所述无线传输模块,将高清画面无线传递出去;The wireless transmission module transmits the high-definition picture wirelessly;
所述检测手环,包括:心电信号监视单元、预警单元、急救单元、智能语音单元、OLED显示单元。The detection bracelet includes: an electrocardiographic signal monitoring unit, an early warning unit, an emergency unit, an intelligent voice unit, and an OLED display unit.
所述全息交互投影器7,如图4所示,包括:投影镜头13,双目镜头114,双目镜头215,USB接口16.1,HDMI接口16.2,VGA接口16.3,电源17,散热栅18,电源按钮19,网线接口20,数据传输接口21;The holographic interactive projector 7, as shown in Figure 4, includes: a projection lens 13, a binocular lens 114, a binocular lens 215, a USB interface 16.1, an HDMI interface 16.2, a VGA interface 16.3, a power supply 17, a cooling grid 18, a power supply Button 19, network cable interface 20, data transmission interface 21;
所述心电信号监视单元,实时监测病人心脏跳动情况,将心脏跳动情况传递给OLED显示单元,并根据已设定的阈值,判断心脏是否有异常情况,若出现心脏异常则将异常信号传递给预警单元;若判断出现急救的情况,将急救信息发送给急救单元;The ECG monitoring unit monitors the beating condition of the patient's heart in real time, transmits the beating condition to the OLED display unit, and judges whether there is any abnormality in the heart according to the set threshold, and transmits the abnormal signal to the Early warning unit; if it is judged that there is a first aid situation, send the first aid information to the first aid unit;
所述预警单元,收到心电信号监视单元发送的心脏异常信号后,发出预警提示音;The early warning unit, after receiving the abnormal heart signal sent by the ECG signal monitoring unit, sends out an early warning prompt tone;
所述急救单元,收到心电信号监视单元发送的急救信息后,自动拨打急救电话,并开启GPS定位功能,随时对病人进行定位;The emergency unit, after receiving the emergency information sent by the ECG signal monitoring unit, automatically dials an emergency call, and turns on the GPS positioning function to locate the patient at any time;
所述智能语音单元,实现人机语音交互;The intelligent voice unit realizes human-computer voice interaction;
所述OLED显示单元,监视病人心脏跳动状况通过OLED屏幕显示。The OLED display unit monitors the beating condition of the patient's heart and displays it on the OLED screen.
所述自外界环境的视频信息,包括:导管、球囊、支架、血栓收集器、高速微型转头医疗器材,将导管、球囊、支架、血栓收集器、高速微型转头医疗器材进行三维扫描,形成三维模型。将三维模型传递到大数据服务系统中进行储存;The video information from the external environment includes: catheters, balloons, stents, thrombus collectors, and high-speed micro-rotor medical equipment, and three-dimensional scanning of catheters, balloons, stents, thrombus collectors, and high-speed micro-rotor medical equipment , forming a three-dimensional model. Transfer the 3D model to the big data service system for storage;
一种基于增强现实的心脏支架手术辅助诊疗系统的使用方法,采用一种基于增强现实的心脏支架手术辅助诊疗系统实现,如图2、图3所示,具体步骤如下:A method for using an augmented reality-based auxiliary diagnosis and treatment system for heart stent surgery is implemented by using an augmented reality-based auxiliary diagnosis and treatment system for heart stent surgery, as shown in Figures 2 and 3, and the specific steps are as follows:
步骤1:启动增强现实的心脏支架手术辅助诊疗系统;Step 1: Start the augmented reality assisted diagnosis and treatment system for heart stent surgery;
步骤2:初始化大数据服务系统,中央数据处理单元对存储单元中数据进行处理后分类,将分类后的数据发送给图像处理单元;Step 2: Initialize the big data service system, the central data processing unit processes and classifies the data in the storage unit, and sends the classified data to the image processing unit;
步骤3:将分类后的数据生成二维影像信息,并将二维影像信息传递给智能诊断单元;;Step 3: Generate two-dimensional image information from the classified data, and transmit the two-dimensional image information to the intelligent diagnosis unit;
步骤4:根据二维影像信息,诊断心脏血管阻塞情况,并将阻塞情况传递给三维重构单元;Step 4: According to the two-dimensional image information, diagnose the blockage of the heart vessel, and transmit the blockage to the three-dimensional reconstruction unit;
步骤5:结合心脏血管阻塞情况,三维重构单元生成三维心脏模型,并将三维心脏模型传递给激光传输单元;Step 5: Combined with the occlusion of the heart vessels, the 3D reconstruction unit generates a 3D heart model, and transmits the 3D heart model to the laser transmission unit;
步骤6:激光传输单元将三维心脏模型传递到数据传输与交换系统;Step 6: The laser transmission unit transmits the three-dimensional heart model to the data transmission and exchange system;
步骤7:数据传输与交换系统将三维心脏模型统一发送给增强现实眼镜及全息交互投影器;Step 7: The data transmission and exchange system uniformly sends the 3D heart model to the augmented reality glasses and the holographic interactive projector;
步骤8:医生戴上增强现实眼镜,启动增强现实眼镜,根据显示在眼镜上的自外界环境的视频信息和三维心脏模型视频信息,进行手术,辅助导管的放入;Step 8: The doctor puts on the augmented reality glasses, activates the augmented reality glasses, and performs surgery according to the video information from the external environment and the 3D heart model video information displayed on the glasses to assist in the placement of the catheter;
步骤9:当导管到达冠状窦底部的时候启动全息交互投影器,摘下增强现实眼镜,使用全息交互投影器手势识别功能,对心脏堵塞情况进行观察,辅助支架的放置并完成余下的手术;Step 9: Start the holographic interactive projector when the catheter reaches the bottom of the coronary sinus, take off the augmented reality glasses, use the gesture recognition function of the holographic interactive projector to observe the heart blockage, assist the placement of the stent and complete the rest of the operation;
步骤10:手术完成后,病人佩戴检测手环,监视病人心脏跳动状况,如图5所示,遇到心脏异情况进行提醒,根据体征判断是否启动急救单元拨打救护电话,实时定位和监测病人状况;推荐健康饮食指南、提醒睡觉、运动;将监测的数据通过数据传输与交换系统实时传递到大数据服务系统。Step 10: After the operation is completed, the patient wears a detection bracelet to monitor the patient's heart beating condition, as shown in Figure 5, a reminder will be given if the heart is abnormal, and the emergency unit will be activated to make an ambulance call according to the signs, and the patient's condition will be located and monitored in real time ;Recommend healthy diet guidelines, remind sleep, exercise; transmit the monitored data to the big data service system in real time through the data transmission and exchange system.
将病人的心脏影像信息、心电图信息、和以往病史输送大数据服务系统中。系统快速分析和建立高清心脏三位模型并将信息块传送到数据传输与交换系统。Send the patient's heart image information, electrocardiogram information, and past medical history to the big data service system. The system quickly analyzes and builds a high-definition three-dimensional model of the heart and transmits the information blocks to the data transmission and exchange system.
由数据交换服务系统将数据统一发送给无线可穿戴眼睛,全息交互投影仪。将需要的导管、球囊、支架、血栓收集器、高速微型转头医疗器材进行三维扫描,形成三维模型。将模型输入大数据服务系统中储存。The data is uniformly sent to wireless wearable eyes and holographic interactive projectors by the data exchange service system. Three-dimensional scanning is performed on the required catheters, balloons, stents, thrombus collectors, and high-speed micro-rotor medical equipment to form a three-dimensional model. The model is input into the big data service system for storage.
病人经过手动脉插入导管,当医生带上可穿戴眼镜时,系统自动启动,可穿戴眼镜的无线模块一方面接收来自的数据交换服务系统的信息,并将其显示出来三维心脏模型。The patient inserts the catheter through the manual artery. When the doctor puts on the wearable glasses, the system starts automatically. On the one hand, the wireless module of the wearable glasses receives information from the data exchange service system and displays it as a three-dimensional heart model.
另方面双目视觉模块接受来自外界环境的视频信息,自动对相机标定,并对标记点进行跟踪。五轴防抖防抖配合高清显示模块,图像处理模块在无限可穿戴眼睛处于运动中任然能够保证显示画面的清晰度。On the other hand, the binocular vision module receives video information from the external environment, automatically calibrates the camera, and tracks the marker points. The five-axis anti-shake and anti-shake are combined with a high-definition display module, and the image processing module can still ensure the clarity of the display screen when the infinite wearable eyes are in motion.
在校准后,双目视觉系统开始识别导管,会给大数据服务系统发送传输指令,缓存在数据行中的导管模型通过交换机发送到眼镜上,并进行心脏增强实现显示。After calibration, the binocular vision system starts to recognize the catheter, and sends a transmission command to the big data service system. The catheter model cached in the data line is sent to the glasses through the switch, and the heart is enhanced for display.
打入造影剂,结合C臂机和插入导管的长度,对导管头部进行定位。通过增强现实眼镜可以观看导管在身体所处的位置。在导管通过血管送入冠状窦底部前,眼镜都会实时增强现实显示,这一过程系统会自动对血管分析和建模。分析出血管的大致的直径和模型。以便后续对放入支架数量的评估和进入全息显示环节做准备。当导管到冠状窦底部,系统会自动启动全息投影器。The contrast agent is injected, and the catheter head is positioned by combining the C-arm machine and the length of the inserted catheter. Through augmented reality glasses, it is possible to see where the catheter is on the body. Before the catheter is sent through the blood vessel to the bottom of the coronary sinus, the glasses will display real-time augmented reality, and the system will automatically analyze and model the blood vessel during this process. Analyze the approximate diameter and model of blood vessels. In order to prepare for the subsequent evaluation of the number of stents placed and the holographic display link. When the catheter reaches the bottom of the coronary sinus, the system will automatically activate the holographic projector.
全息的三维交互式投影。全息交互投影装置将接收的三维心脏模型通过激光全息投影仪投射出来。手势交互可以六自由度旋转全息心脏,观察心脏特征。全息影像和手术进程同步。这得益于大数据服务系统,能够及时快速处理生成有用的影像并迅速传输给数据传输交换系统,通过全息投影可可以以观看到,血管堵塞程度,是否出现钙化这类问题。Holographic 3D interactive projection. The holographic interactive projection device projects the received three-dimensional heart model through a laser holographic projector. Gesture interaction can rotate the holographic heart in six degrees of freedom and observe the characteristics of the heart. The holographic image is synchronized with the operation process. This is due to the big data service system, which can process and generate useful images in a timely manner and quickly transmit them to the data transmission and exchange system. Through holographic projection, you can see the degree of blood vessel blockage and whether there is calcification.
已经钙化的部分,先把血栓收集器放在钙化部分前端,再用旋转铁头对钙化部分彻底粉碎,这样既可以清理血栓,又能防止血栓流经血液里。For the part that has been calcified, first place the thrombus collector on the front of the calcified part, and then use the rotating iron head to completely crush the calcified part, which can not only clean the thrombus, but also prevent the thrombus from flowing into the blood.
系统通过分析通过建模并通过语音告诉医生放入支架的个数。在放入之前,须将血栓收集器放在堵塞部位的前面,再将球囊放到堵塞部位,加压冲开堵塞部位的血管,在放入所需的支架。这些都是都过观察全息投影操作的。The system tells the doctor the number of stents to put in through analysis, modeling and voice. Before putting in, the thrombus collector must be placed in front of the blockage, and then the balloon is placed in the blockage, pressurized to open the blood vessels at the blockage, and then put in the required stent. These are all through the operation of observation holographic projection.
术后给病人佩检测手环。通过检测单元监视病人心脏跳动状况并通过OLED屏幕显示出来。支持语音输入、电话服务、GPS服务。遇到心脏异情况报警单元发出红色提醒,提醒病人注意身体异常。根据体征判断系统是否启动急救单元拨打救护电话,系统配备GPS定位系统,对病人进行定位,监测病人同时发出语音向周围求助。在平时生活方面推荐健康饮食指南显示提醒睡觉、运动。将监测的数据通过数据交换服务系统与大数据系统同步,形成物联网效用。Postoperatively, the patient is given a detection bracelet. Monitor the beating condition of the patient's heart through the detection unit and display it on the OLED screen. Support voice input, telephone service, GPS service. The alarm unit sends out a red reminder in case of a heart abnormality, reminding the patient to pay attention to the abnormality of the body. According to the signs to judge whether the system activates the emergency unit to call the ambulance, the system is equipped with a GPS positioning system to locate the patient, monitor the patient and at the same time send out a voice to ask for help around. In daily life, it recommends a healthy diet guideline and displays reminders for sleeping and exercising. Synchronize the monitored data with the big data system through the data exchange service system to form the utility of the Internet of Things.
Claims (4)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910704951.XA CN110292439A (en) | 2019-07-31 | 2019-07-31 | Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality |
| PCT/CN2019/099012 WO2021017019A1 (en) | 2019-07-31 | 2019-08-02 | Augmented reality-based auxiliary diagnosis and treatment system for coronary angioplasty surgery, and use method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910704951.XA CN110292439A (en) | 2019-07-31 | 2019-07-31 | Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110292439A true CN110292439A (en) | 2019-10-01 |
Family
ID=68032447
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910704951.XA Pending CN110292439A (en) | 2019-07-31 | 2019-07-31 | Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110292439A (en) |
| WO (1) | WO2021017019A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111053598A (en) * | 2019-12-03 | 2020-04-24 | 天津大学 | Augmented reality system platform based on projector |
| CN111150490A (en) * | 2020-01-15 | 2020-05-15 | 陈挺 | Intelligent assistant system for cardiac radiofrequency ablation based on AR and AI technology |
| CN113303806A (en) * | 2021-04-24 | 2021-08-27 | 华中科技大学同济医学院附属协和医院 | Wireless holographic display electrocardiogram monitoring system and monitoring method |
| CN113616333A (en) * | 2021-09-13 | 2021-11-09 | 上海微创医疗机器人(集团)股份有限公司 | Catheter movement assistance method, catheter movement assistance system, and readable storage medium |
| CN113761776A (en) * | 2021-08-24 | 2021-12-07 | 中国人民解放军总医院第一医学中心 | Simulation system and method of heart hemorrhage and hemostasis model based on augmented reality |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2536650A (en) | 2015-03-24 | 2016-09-28 | Augmedics Ltd | Method and system for combining video-based and optic-based augmented reality in a near eye display |
| US12521201B2 (en) | 2017-12-07 | 2026-01-13 | Augmedics Ltd. | Spinous process clamp |
| US12458411B2 (en) | 2017-12-07 | 2025-11-04 | Augmedics Ltd. | Spinous process clamp |
| US11980507B2 (en) | 2018-05-02 | 2024-05-14 | Augmedics Ltd. | Registration of a fiducial marker for an augmented reality system |
| US11766296B2 (en) | 2018-11-26 | 2023-09-26 | Augmedics Ltd. | Tracking system for image-guided surgery |
| US12178666B2 (en) | 2019-07-29 | 2024-12-31 | Augmedics Ltd. | Fiducial marker |
| US11980506B2 (en) | 2019-07-29 | 2024-05-14 | Augmedics Ltd. | Fiducial marker |
| US11382712B2 (en) | 2019-12-22 | 2022-07-12 | Augmedics Ltd. | Mirroring in image guided surgery |
| US11389252B2 (en) | 2020-06-15 | 2022-07-19 | Augmedics Ltd. | Rotating marker for image guided surgery |
| US12239385B2 (en) | 2020-09-09 | 2025-03-04 | Augmedics Ltd. | Universal tool adapter |
| US12502163B2 (en) | 2020-09-09 | 2025-12-23 | Augmedics Ltd. | Universal tool adapter for image-guided surgery |
| RU2749289C1 (en) * | 2020-09-25 | 2021-06-08 | Федеральное государственное бюджетное учреждение "Национальный медицинский исследовательский центр терапии и профилактической медицины" Министерства здравоохранения Российской Федерации (ФГБУ "НМИЦ ТПМ" Минздрава России) | Method for non-invasive diagnostics of coronary atherosclerosis using visual scale |
| US11896445B2 (en) | 2021-07-07 | 2024-02-13 | Augmedics Ltd. | Iliac pin and adapter |
| US12150821B2 (en) | 2021-07-29 | 2024-11-26 | Augmedics Ltd. | Rotating marker and adapter for image-guided surgery |
| WO2023021451A1 (en) | 2021-08-18 | 2023-02-23 | Augmedics Ltd. | Augmented reality assistance for osteotomy and discectomy |
| EP4511809A1 (en) | 2022-04-21 | 2025-02-26 | Augmedics Ltd. | Systems and methods for medical image visualization |
| WO2024057210A1 (en) | 2022-09-13 | 2024-03-21 | Augmedics Ltd. | Augmented reality eyewear for image-guided medical intervention |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1914617A (en) * | 2004-02-03 | 2007-02-14 | 美国西门子医疗解决公司 | Systems and methods for automated diagnosis and decision support for heart related diseases and conditions |
| CN105615831A (en) * | 2015-12-18 | 2016-06-01 | 李占和 | Medical image holographic AR (augmented reality) display system |
| CN105657370A (en) * | 2016-01-08 | 2016-06-08 | 李昂 | Closed wearable panoramic photographing and processing system and operation method thereof |
| CN105748029A (en) * | 2016-02-18 | 2016-07-13 | 深圳开立生物医疗科技股份有限公司 | Imaging system of endoscope |
| CN105852847A (en) * | 2016-04-26 | 2016-08-17 | 胡冬硕 | Heart and vital sign monitoring and analyzing system |
| WO2017060106A1 (en) * | 2015-10-07 | 2017-04-13 | Koninklijke Philips N.V. | Mobile ffr simulation |
| CN106901834A (en) * | 2016-12-29 | 2017-06-30 | 陕西联邦义齿有限公司 | The preoperative planning of minimally invasive cardiac surgery and operation virtual reality simulation method |
| CN106999053A (en) * | 2014-12-08 | 2017-08-01 | 皇家飞利浦有限公司 | Patient education for percutaneous coronary intervention (pci) |
| CN107296650A (en) * | 2017-06-01 | 2017-10-27 | 西安电子科技大学 | Intelligent operation accessory system based on virtual reality and augmented reality |
| CN206995246U (en) * | 2017-01-26 | 2018-02-13 | 宿迁学院 | A kind of real-time positioning salvage system based on electrocardio and figure |
| CN108324246A (en) * | 2018-01-19 | 2018-07-27 | 上海联影医疗科技有限公司 | Medical diagnosis auxiliary system and method |
| CN108882854A (en) * | 2016-03-21 | 2018-11-23 | 华盛顿大学 | Virtual reality or augmented reality visualization of 3D medical images |
| CN109036548A (en) * | 2018-06-19 | 2018-12-18 | 黑龙江拓盟科技有限公司 | Assisting in diagnosis and treatment system based on mixed reality three-dimensional visualization |
| CN109223121A (en) * | 2018-07-31 | 2019-01-18 | 广州狄卡视觉科技有限公司 | Based on medical image Model Reconstruction, the cerebral hemorrhage puncturing operation navigation system of positioning |
| CN109907758A (en) * | 2019-03-15 | 2019-06-21 | 脑玺(上海)智能科技有限公司 | Image annotation method and system for intracranial blood flow delay |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104382576A (en) * | 2014-12-19 | 2015-03-04 | 王常松 | Medical intelligent monitoring ring system |
| CN106580361B (en) * | 2016-12-08 | 2018-03-23 | 王国良 | A kind of portable orthopaedics detection means based on AR VR technologies 4D imagings |
| US11350994B2 (en) * | 2017-06-19 | 2022-06-07 | Navlab Holdings Ii, Llc | Surgery planning |
| CN109730768A (en) * | 2019-01-10 | 2019-05-10 | 黄德荣 | A kind of cardiac thoracic surgery supplementary controlled system and method based on virtual reality |
| CN109730771A (en) * | 2019-03-19 | 2019-05-10 | 安徽紫薇帝星数字科技有限公司 | A kind of operation guiding system based on AR technology |
-
2019
- 2019-07-31 CN CN201910704951.XA patent/CN110292439A/en active Pending
- 2019-08-02 WO PCT/CN2019/099012 patent/WO2021017019A1/en not_active Ceased
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1914617A (en) * | 2004-02-03 | 2007-02-14 | 美国西门子医疗解决公司 | Systems and methods for automated diagnosis and decision support for heart related diseases and conditions |
| CN106999053A (en) * | 2014-12-08 | 2017-08-01 | 皇家飞利浦有限公司 | Patient education for percutaneous coronary intervention (pci) |
| WO2017060106A1 (en) * | 2015-10-07 | 2017-04-13 | Koninklijke Philips N.V. | Mobile ffr simulation |
| CN105615831A (en) * | 2015-12-18 | 2016-06-01 | 李占和 | Medical image holographic AR (augmented reality) display system |
| CN105657370A (en) * | 2016-01-08 | 2016-06-08 | 李昂 | Closed wearable panoramic photographing and processing system and operation method thereof |
| CN105748029A (en) * | 2016-02-18 | 2016-07-13 | 深圳开立生物医疗科技股份有限公司 | Imaging system of endoscope |
| CN108882854A (en) * | 2016-03-21 | 2018-11-23 | 华盛顿大学 | Virtual reality or augmented reality visualization of 3D medical images |
| CN105852847A (en) * | 2016-04-26 | 2016-08-17 | 胡冬硕 | Heart and vital sign monitoring and analyzing system |
| CN106901834A (en) * | 2016-12-29 | 2017-06-30 | 陕西联邦义齿有限公司 | The preoperative planning of minimally invasive cardiac surgery and operation virtual reality simulation method |
| CN206995246U (en) * | 2017-01-26 | 2018-02-13 | 宿迁学院 | A kind of real-time positioning salvage system based on electrocardio and figure |
| CN107296650A (en) * | 2017-06-01 | 2017-10-27 | 西安电子科技大学 | Intelligent operation accessory system based on virtual reality and augmented reality |
| CN108324246A (en) * | 2018-01-19 | 2018-07-27 | 上海联影医疗科技有限公司 | Medical diagnosis auxiliary system and method |
| CN109036548A (en) * | 2018-06-19 | 2018-12-18 | 黑龙江拓盟科技有限公司 | Assisting in diagnosis and treatment system based on mixed reality three-dimensional visualization |
| CN109223121A (en) * | 2018-07-31 | 2019-01-18 | 广州狄卡视觉科技有限公司 | Based on medical image Model Reconstruction, the cerebral hemorrhage puncturing operation navigation system of positioning |
| CN109907758A (en) * | 2019-03-15 | 2019-06-21 | 脑玺(上海)智能科技有限公司 | Image annotation method and system for intracranial blood flow delay |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111053598A (en) * | 2019-12-03 | 2020-04-24 | 天津大学 | Augmented reality system platform based on projector |
| CN111150490A (en) * | 2020-01-15 | 2020-05-15 | 陈挺 | Intelligent assistant system for cardiac radiofrequency ablation based on AR and AI technology |
| CN111150490B (en) * | 2020-01-15 | 2021-01-29 | 陈挺 | Intelligent assistant system for cardiac radio frequency ablation surgery based on AR and AI technologies |
| CN113303806A (en) * | 2021-04-24 | 2021-08-27 | 华中科技大学同济医学院附属协和医院 | Wireless holographic display electrocardiogram monitoring system and monitoring method |
| CN113761776A (en) * | 2021-08-24 | 2021-12-07 | 中国人民解放军总医院第一医学中心 | Simulation system and method of heart hemorrhage and hemostasis model based on augmented reality |
| CN113761776B (en) * | 2021-08-24 | 2023-03-14 | 中国人民解放军总医院第一医学中心 | Simulation system and method of heart hemorrhage and hemostasis model based on augmented reality |
| CN113616333A (en) * | 2021-09-13 | 2021-11-09 | 上海微创医疗机器人(集团)股份有限公司 | Catheter movement assistance method, catheter movement assistance system, and readable storage medium |
| CN113616333B (en) * | 2021-09-13 | 2023-02-10 | 上海微创微航机器人有限公司 | Catheter movement assistance method, catheter movement assistance system, and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021017019A1 (en) | 2021-02-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110292439A (en) | Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality | |
| US11297285B2 (en) | Dental and medical loupe system for lighting control, streaming, and augmented reality assisted procedures | |
| CA3095287C (en) | Augmented reality systems for time critical biomedical applications | |
| CN110448378B (en) | Immersive intervention operation integrated console | |
| WO2022251715A3 (en) | Improved systems and methods of navigating a medical device in a body lumen using fuzzy logic combined with device parameters, direct user inputs, and distributed anonymized data | |
| CN111554391A (en) | Medical first-aid dispatching system device based on Internet of things | |
| CN110403585A (en) | A kind of armband with sports health monitoring function | |
| US20240282220A1 (en) | Catheterization training device | |
| CN113838354A (en) | Vascular interventional surgery training system platform with simulated DSA function | |
| US20240335215A1 (en) | Wearable ultrasound | |
| US12260730B2 (en) | Visualization monitoring glasses | |
| CN118280173A (en) | Endoscope handle signal simulator and injection type digestive endoscope diagnosis and treatment simulation system | |
| CN215227511U (en) | Otolithiasis auxiliary device that resets | |
| CN216135864U (en) | BPPV diagnoses treatment auxiliary device | |
| JP2025035459A (en) | Information processing system, information processing method, and information processing program | |
| CN112914730B (en) | A remote interventional therapy system based on VR technology | |
| CN113470464A (en) | Medical clinical emergency training system based on mixed reality | |
| JP2023115768A (en) | Treatment support system, control method for treatment support system, and control program for treatment support system | |
| CN115227409A (en) | Intervention operation robot system capable of fusing DSA images | |
| CN114783259A (en) | Cesarean section simulation equipment based on virtual technology | |
| CN113069078A (en) | BPPV diagnoses treatment auxiliary device | |
| CN222804286U (en) | A wearable mask for monitoring critically ill patients | |
| CN222281595U (en) | Diagnosis and treatment information display system | |
| CN120585378B (en) | An integrated platform for acoustic interventional diagnosis and treatment | |
| CN205459113U (en) | Special headstock of heart surgical department operation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191001 |