[go: up one dir, main page]

CN109044530A - A kind of multi-modal sensory perceptual system and data fusion method of operation on prostate robot - Google Patents

A kind of multi-modal sensory perceptual system and data fusion method of operation on prostate robot Download PDF

Info

Publication number
CN109044530A
CN109044530A CN201810786647.XA CN201810786647A CN109044530A CN 109044530 A CN109044530 A CN 109044530A CN 201810786647 A CN201810786647 A CN 201810786647A CN 109044530 A CN109044530 A CN 109044530A
Authority
CN
China
Prior art keywords
prostate
data fusion
puncture needle
puncture
force sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810786647.XA
Other languages
Chinese (zh)
Inventor
张永德
刘博健
姜金刚
张贯
张贯一
杨智康
代雪松
路明月
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin University of Science and Technology
Original Assignee
Harbin University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin University of Science and Technology filed Critical Harbin University of Science and Technology
Priority to CN201810786647.XA priority Critical patent/CN109044530A/en
Publication of CN109044530A publication Critical patent/CN109044530A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3403Needle locating or guiding means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3494Trocars; Puncturing needles with safety means for protection against accidental cutting or pricking, e.g. limiting insertion depth, pressure sensors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/06Measuring instruments not otherwise provided for
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2051Electromagnetic tracking systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2065Tracking using image or pattern recognition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/06Measuring instruments not otherwise provided for
    • A61B2090/064Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension
    • A61B2090/065Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension for measuring contact or contact pressure

Landscapes

  • Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biomedical Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Robotics (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

本发明专利涉及一种前列腺手术机器人的多模态感知系统及数据融合方法,它包括电磁定位系统,用以测量穿刺针的实时位置信息;超声图像导航系统,用以测量穿刺针与组织的实时位置关系;六维力传感器系统,用以测量穿刺针受力情况,进行预警监测;数据融合系统,用以融合相关数据,进针穿刺针的实时定位。采用该结构的前列腺介入手术机器人的多模态感知系统及其数据融合方法,可以将前列腺介入手术机器人穿刺前列腺组织时针尖的实时位置采用贝叶斯数据融合算法和卡尔曼滤波算法输出精确的位置坐标,为前列腺介入手术机器人提供更加精确的位置反馈系统,同时还可以根据穿刺针末端的力传感器进行预警监测,防止前列腺介入手术机器人进行手术时出现危险。

The patent of the present invention relates to a multi-modal sensing system and data fusion method of a prostate surgery robot, which includes an electromagnetic positioning system for measuring the real-time position information of the puncture needle; an ultrasonic image navigation system for measuring the real-time position information of the puncture needle and the tissue Positional relationship; the six-dimensional force sensor system is used to measure the force of the puncture needle for early warning monitoring; the data fusion system is used to fuse relevant data and real-time positioning of the puncture needle. The multimodal perception system and data fusion method of the prostate interventional surgery robot with this structure can output the precise position of the needle tip when the prostate interventional surgery robot punctures the prostate tissue using the Bayesian data fusion algorithm and the Kalman filter algorithm. Coordinates provide a more accurate position feedback system for prostate interventional surgery robots. At the same time, it can also perform early warning and monitoring based on the force sensor at the end of the puncture needle to prevent danger during prostate interventional surgery robots.

Description

A kind of multi-modal sensory perceptual system and data fusion method of operation on prostate robot
Technical field
The present invention relates to a kind of multi-modal sensory perceptual system of operation on prostate robot and data fusion methods, belong to medical treatment Instrument area of computer aided field of locating technology.
Background technique
Traditional prostate intervention operation carries out puncture intervention by doctor, but due to the influence of the factors such as doctors experience, wears Needle-holding hand art needs multiple inserting needle and constantly change inserting needle orientation, leads to that puncturing operation precision is low, the time is long, and doctor is easy tired Labor, patient are more painful.The accuracy that prostate intervenes robot arrival target spot is higher, operating time is shorter, the labour of doctor Intensity is lower, therefore is with a wide range of applications.
The mode that existing operation on prostate robot mostly uses single ultrasound image to navigate carries out tissue positioning and wears Needle-holding hand art, it is this using single ultrasound image navigation by the way of carry out ultrasound image needle point identification when, often will appear super Sound can not receive reflection signal and reflect the situation of signal inaccuracy, this has resulted in the knowledge that ultrasound image navigates to puncture needle Certain error is not generated and random identification does not occur as to the accuracy and safety of the operation of operation on prostate robot puncturing Property causes large effect.
Summary of the invention
In view of the disadvantages mentioned above of the prior art, experiment purpose of the invention is to provide a kind of operation on prostate robot Multi-modal sensory perceptual system and data fusion method, it is intended to solve that existing single navigation system accuracy is not high, safety is low The problem of.
To achieve the above object, the present invention provides a kind of multi-modal sensory perceptual system of operation on prostate robot and data Fusion method, which is characterized in that the system includes: electromagnetic positioning system, to measure the real-time position information of puncture needle; Ultrasound image navigation system, to measure the real time position relationship of puncture needle and tissue;Six-dimension force sensor system, to measure Puncture needle stress condition carries out early warning and monitoring;Data fusion system, in conjunction with the electromagnetic positioning system, ultrasound image Navigation system and six-dimension force sensor system carry out puncture needle using bayesian data fusion algorithm and Kalman filtering algorithm Positioning in real time.
Preferably, the method includes following after prostate intervention operation robot punctures and enters tissue Step:
(1) electromagnetic positioning system described in obtains the position coordinates of prostate intervention operation robot tip penetration needle;
(2) the ultrasound image navigation system described in obtains the position coordinates of prostate intervention operation robot tip penetration needle;
(3) the six-dimension force sensor systematic survey puncture needle described in carries out the six-dimensional force being subject to when puncturing operation;
(4) data fusion system described in is when carrying out data fusion for the first time, in conjunction with the electromagnetic positioning system, ultrasound image Navigation system, six-dimension force sensor system, using bayesian data fusion algorithm, prostate high-precision puncture force model, to next Convergence analysis is carried out from the data of electromagnetic positioning system, ultrasound image navigation system and six-dimension force sensor system, output punctures Pin position coordinate, tissue ultrasound image and puncture pre-warning signal.
(5) data fusion system described in is when carrying out second and data fusion thereafter, in conjunction with the electromagnetic location The output of system, ultrasound image navigation system, six-dimension force sensor system and last moment data fusion system, using Bayes Data anastomosing algorithm, Kalman filtering algorithm and prostate high-precision puncture force model, it is fixed to the electromagnetism inputted from this moment The puncture needle real time position of position system, the data of ultrasound image navigation system and six-dimension force sensor system and last moment output Coordinate carries out fusion treatment, output puncture needle position coordinates, tissue ultrasound image and puncture pre-warning signal.
Preferably, puncture force early warning threshold values is arranged, works as six-dimension force sensor according to precedent gland high-precision puncture force model Input power be more than current time early warning threshold values when, send alarm signal simultaneously stop puncturing operation at once.
The invention has the benefit that
(1) present invention detects the puncture process of puncture needle in such a way that multiple modalities sensor measures simultaneously, reduces The larger disadvantage of uncertainty when single-sensor measurement, by blending algorithm identifies the higher tip position of accuracy Coordinate.
(2) mechanical model is punctured using precedent gland high-precision in the present invention, to suffered by puncture needle end in puncture process Power is detected, and punctured error during puncturing operation is prevented, and is caused the damage of tissue, is led to operative failure.
(3) Kalman filtering algorithm is used in the present invention, and the last moment of data fusion system output is punctured into pin position Coordinate is merged with the position coordinates that merge at this moment, abandons the big coordinate of error, and utilize the sheet of Kalman filtering algorithm Body characteristic predicts the path of puncture needle according to prostate biopsy mechanism, the control of puncture needle when realizing system to puncturing operation.
Detailed description of the invention:
Come to carry out detailed description to the present invention below in conjunction with attached drawing.It should be appreciated, however, that attached drawing has been provided only preferably Understand the present invention, they should not be interpreted as limitation of the present invention.
Fig. 1 is the Technology Roadmap of the multi-modal sensory perceptual system of operation on prostate robot of the invention
Specific embodiment:
To achieve the above object, the present invention provides a kind of multi-modal sensory perceptual system of operation on prostate robot and data fusions Method, which is characterized in that the system includes: electromagnetic positioning system, to measure the real-time position information of puncture needle;Ultrasound Image-guidance system, to measure the real time position relationship of puncture needle and tissue;Six-dimension force sensor system is punctured to measure Needle stress condition carries out early warning and monitoring;Data fusion system, in conjunction with the electromagnetic positioning system, ultrasound image navigation System and six-dimension force sensor system carry out puncture needle using bayesian data fusion algorithm and Kalman filtering algorithm real-time Positioning.
Further, after prostate intervention operation robot, which punctures, enters tissue, the method includes following Step:
(1) electromagnetic positioning system described in obtains the position coordinates of prostate intervention operation robot tip penetration needle;
(2) the ultrasound image navigation system described in obtains the position coordinates of prostate intervention operation robot tip penetration needle;
(3) the six-dimension force sensor systematic survey puncture needle described in carries out the six-dimensional force being subject to when puncturing operation;
(4) data fusion system described in is when carrying out data fusion for the first time, in conjunction with the electromagnetic positioning system, ultrasound image Navigation system, six-dimension force sensor system, using bayesian data fusion algorithm, prostate high-precision puncture force model, to next Convergence analysis is carried out from the data of electromagnetic positioning system, ultrasound image navigation system and six-dimension force sensor system, output punctures Pin position coordinate, tissue ultrasound image and puncture pre-warning signal.
(5) data fusion system described in is when carrying out second and data fusion thereafter, in conjunction with the electromagnetic location The output of system, ultrasound image navigation system, six-dimension force sensor system and last moment data fusion system, using Bayes Data anastomosing algorithm, Kalman filtering algorithm and prostate high-precision puncture force model, it is fixed to the electromagnetism inputted from this moment The puncture needle real time position of position system, the data of ultrasound image navigation system and six-dimension force sensor system and last moment output Coordinate carries out fusion treatment, output puncture needle position coordinates, tissue ultrasound image and puncture pre-warning signal.
Further, according to precedent gland high-precision puncture force model, puncture force early warning threshold values is set, six-dimension force sensor is worked as Input power be more than current time early warning threshold values when, send alarm signal simultaneously stop puncturing operation at once.
In conclusion the present invention enters working condition when prostate operating robot carries out puncturing operation, electromagnetism is utilized Puncture needle state when positioning system, ultrasound image navigation system and six-dimension force sensor system are by puncturing operation, tissue Structure and needle-tissue stress condition carry out perception measurement, while utilizing the real-time coordinates of data fusion system output puncture needle Feed back to operation on prostate robot.When carrying out puncturing operation, ultrasound image is exported to man-machine interface.The puncture of output is pre- Alert signal, which is worked as, to be reached the progress alarm of early warning threshold values and stops procedure at once.
The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention.The technology of the industry Personnel are it should be appreciated that the present invention is not limited to the above embodiments, and the above embodiments and description only describe this The principle of invention, without departing from the spirit and scope of the present invention, various changes and improvements may be made to the invention, these changes Change and improvement all fall within the protetion scope of the claimed invention.The claimed scope of the invention by appended claims and its Equivalent thereof.

Claims (3)

1. the multi-modal sensory perceptual system and data fusion method of a kind of operation on prostate robot, which is characterized in that described is System includes:
Electromagnetic positioning system, to measure the real-time position information of puncture needle;
Ultrasound image navigation system, to measure the real time position relationship of puncture needle and tissue;
Six-dimension force sensor system carries out early warning and monitoring to measure puncture needle stress condition;
Data fusion system, in conjunction with the electromagnetic positioning system, ultrasound image navigation system and six-dimension force sensor system System positions puncture needle using bayesian data fusion algorithm and Kalman filtering algorithm in real time.
2. the multi-modal sensory perceptual system and data fusion method of a kind of operation on prostate robot according to claim 1, It is characterized in that, when prostate intervention operation robot puncture enter tissue after, the method the following steps are included:
The electromagnetic positioning system obtains the position coordinates of prostate intervention operation robot tip penetration needle;
The ultrasound image navigation system obtains the position coordinates of prostate intervention operation robot tip penetration needle;
The six-dimension force sensor systematic survey puncture needle carries out the six-dimensional force being subject to when puncturing operation;
The data fusion system is led when carrying out data fusion for the first time in conjunction with the electromagnetic positioning system, ultrasound image Boat system, six-dimension force sensor system, using bayesian data fusion algorithm, prostate high-precision puncture force model, to coming from The data of electromagnetic positioning system, ultrasound image navigation system and six-dimension force sensor system carry out convergence analysis, export puncture needle Position coordinates, tissue ultrasound image and puncture pre-warning signal;
The data fusion system in conjunction with the electromagnetic positioning system, surpasses when carrying out second and data fusion thereafter The output of acoustic image navigation system, six-dimension force sensor system and last moment data fusion system, is melted using bayesian data Hop algorithm, Kalman filtering algorithm and prostate high-precision puncture force model, to the electromagnetic positioning system inputted from this moment, The puncture needle real-time location coordinates of the data and last moment output of ultrasound image navigation system and six-dimension force sensor system, into Row fusion treatment, output puncture needle position coordinates, tissue ultrasound image and puncture pre-warning signal.
3. the multi-modal sensory perceptual system and data fusion method of a kind of operation on prostate robot according to claim 1, It is characterized in that, puncture force early warning threshold values is arranged, when the input of six-dimension force sensor according to precedent gland high-precision puncture force model Power be more than current time early warning threshold values when, send alarm signal simultaneously stop puncturing operation at once.
CN201810786647.XA 2018-07-17 2018-07-17 A kind of multi-modal sensory perceptual system and data fusion method of operation on prostate robot Pending CN109044530A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810786647.XA CN109044530A (en) 2018-07-17 2018-07-17 A kind of multi-modal sensory perceptual system and data fusion method of operation on prostate robot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810786647.XA CN109044530A (en) 2018-07-17 2018-07-17 A kind of multi-modal sensory perceptual system and data fusion method of operation on prostate robot

Publications (1)

Publication Number Publication Date
CN109044530A true CN109044530A (en) 2018-12-21

Family

ID=64816962

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810786647.XA Pending CN109044530A (en) 2018-07-17 2018-07-17 A kind of multi-modal sensory perceptual system and data fusion method of operation on prostate robot

Country Status (1)

Country Link
CN (1) CN109044530A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109998684A (en) * 2019-05-07 2019-07-12 艾瑞迈迪科技石家庄有限公司 Based on the guidance method for early warning and device apart from dynamic quantization
CN110215239A (en) * 2019-05-05 2019-09-10 清华大学 The intervention surgical instrument load recognition device and method of blending image and force signal
CN110448359A (en) * 2019-08-02 2019-11-15 中国人民解放军总医院 Improve operation navigation device and its application of transjugular intrahepatic portosystemic shunt success rate
CN112890957A (en) * 2021-01-14 2021-06-04 北京美迪云机器人科技有限公司 Magnetic induction remote positioning system and method
CN113576667A (en) * 2021-07-20 2021-11-02 北京理工大学 Force feedback method for percutaneous puncture surgery, electronic device and robot

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222882A (en) * 2005-05-16 2008-07-16 直观外科手术公司 Methods and system for performing 3-D tool tracking by fusion of sensor and/or camera derived data during minimally invasive robotic surgery
US20090234217A1 (en) * 2003-01-30 2009-09-17 Surgical Navigation Technologies, Inc. Method And Apparatus For Preplanning A Surgical Procedure
CN203341820U (en) * 2013-06-27 2013-12-18 中国科学院沈阳自动化研究所 Robot-assisted oblique tip flexible needle puncture system
CN105636541A (en) * 2013-03-15 2016-06-01 圣纳普医疗(巴巴多斯)公司 Planning, navigation and simulation systems and methods for minimally invasive therapy
CN107049370A (en) * 2017-05-26 2017-08-18 北京龙慧珩医疗科技发展有限公司 A kind of prostate biopsy external member

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090234217A1 (en) * 2003-01-30 2009-09-17 Surgical Navigation Technologies, Inc. Method And Apparatus For Preplanning A Surgical Procedure
CN101222882A (en) * 2005-05-16 2008-07-16 直观外科手术公司 Methods and system for performing 3-D tool tracking by fusion of sensor and/or camera derived data during minimally invasive robotic surgery
CN105636541A (en) * 2013-03-15 2016-06-01 圣纳普医疗(巴巴多斯)公司 Planning, navigation and simulation systems and methods for minimally invasive therapy
CN203341820U (en) * 2013-06-27 2013-12-18 中国科学院沈阳自动化研究所 Robot-assisted oblique tip flexible needle puncture system
CN107049370A (en) * 2017-05-26 2017-08-18 北京龙慧珩医疗科技发展有限公司 A kind of prostate biopsy external member

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110215239A (en) * 2019-05-05 2019-09-10 清华大学 The intervention surgical instrument load recognition device and method of blending image and force signal
CN110215239B (en) * 2019-05-05 2021-02-26 清华大学 Interventional surgical instrument load identification device and method fusing image and force signal
CN109998684A (en) * 2019-05-07 2019-07-12 艾瑞迈迪科技石家庄有限公司 Based on the guidance method for early warning and device apart from dynamic quantization
CN110448359A (en) * 2019-08-02 2019-11-15 中国人民解放军总医院 Improve operation navigation device and its application of transjugular intrahepatic portosystemic shunt success rate
CN112890957A (en) * 2021-01-14 2021-06-04 北京美迪云机器人科技有限公司 Magnetic induction remote positioning system and method
CN113576667A (en) * 2021-07-20 2021-11-02 北京理工大学 Force feedback method for percutaneous puncture surgery, electronic device and robot
CN113576667B (en) * 2021-07-20 2023-12-22 北京理工大学 Force feedback method for percutaneous puncture operation, electronic device and robot

Similar Documents

Publication Publication Date Title
CN109044530A (en) A kind of multi-modal sensory perceptual system and data fusion method of operation on prostate robot
US12239398B2 (en) Surgical robotic system and control of surgical robotic system
US8738181B2 (en) Methods, devices, and systems for automated movements involving medical robots
CN107209003B (en) Laser measuring instrument for robot calibration and monitoring
JP5543331B2 (en) Method, apparatus, and system for non-mechanically limiting and / or programming movement along one axis of a manipulator tool
US20120271173A1 (en) Automatic ultrasonic scanning system and scanning method thereof
US10470838B2 (en) Surgical system for spatial registration verification of anatomical region
US20140114480A1 (en) Methods, Devices, and Systems for Non-Mechanically Restricting and/or Programming Movement of a Tool of a Manipulator Along a Single Axis
JP5288447B2 (en) Surgery support system, approach state detection device and program thereof
KR20170093200A (en) System for robot-assisted medical treatment
CN106344153A (en) Automatic tracking device and method for flexible puncture needle tip
JP2010525838A5 (en)
CN105082161A (en) Robot vision servo control device of binocular three-dimensional video camera and application method of robot vision servo control device
WO2017098505A1 (en) Autonomic system for determining critical points during laparoscopic surgery
US12064184B2 (en) System and method for installing bone hardware outside an end-effectors tool path
US10347380B2 (en) Intra-operative registration of anatomical structures
JP2023511272A (en) Systems and methods for monitoring offset during navigation-assisted surgery
CN113662665A (en) Accuracy detection method and device for robotic system in knee replacement surgery
CN110786929A (en) Surgical assistance system and method for acquiring surface information using the same
US20160183903A1 (en) Input device, method, and system for generating a control signal for a medical device
CN113766868A (en) System for determining bends and patient movement during medical procedures
CN108366832B (en) Navigation assistance system
US20240390160A1 (en) System and method for determining if hardware installed in a bone is located within a volume of bone to be removed
GB2533394A (en) Method and system for generating a control signal for a medical device
WO2024108139A1 (en) Object detection and visual feedback system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20181221

WD01 Invention patent application deemed withdrawn after publication