[go: up one dir, main page]

CN113558735A - Robot puncture positioning method and device for biliary tract puncture - Google Patents

Robot puncture positioning method and device for biliary tract puncture Download PDF

Info

Publication number
CN113558735A
CN113558735A CN202110951194.3A CN202110951194A CN113558735A CN 113558735 A CN113558735 A CN 113558735A CN 202110951194 A CN202110951194 A CN 202110951194A CN 113558735 A CN113558735 A CN 113558735A
Authority
CN
China
Prior art keywords
puncture
needle
positioning
needle insertion
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110951194.3A
Other languages
Chinese (zh)
Inventor
陈静涛
周寿军
钱程
曾泉
林晓锋
温铁祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Advanced Technology of CAS
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Priority to CN202110951194.3A priority Critical patent/CN113558735A/en
Publication of CN113558735A publication Critical patent/CN113558735A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3403Needle locating or guiding means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods
    • A61B17/34Trocars; Puncturing needles
    • A61B17/3403Needle locating or guiding means
    • A61B2017/3413Needle locating or guiding means guided by ultrasound
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/107Visualisation of planned trajectories or target regions

Landscapes

  • Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Robotics (AREA)
  • Pathology (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

The invention relates to the field of intelligent medical equipment, in particular to a robot puncture positioning method and a robot puncture positioning device for biliary tract puncture, wherein the method comprises the following steps: receiving a scanning request, and scanning a scanning target; acquiring an ultrasonic image during scanning, and establishing a one-to-one correspondence relationship between the ultrasonic image and a spatial position during acquisition of the ultrasonic image; defining the ultrasonic image which is most consistent with the planning image layer in the ultrasonic image as a puncture layer; if the puncture layer surface has no barrier, taking the point with the shortest distance between the scanning target and the puncture target point as a needle entering point, and taking a connecting line between the needle entering point and the puncture target point as a planned needle entering track; and then, when the needle inserting positioning channel is not collinear with the planned needle inserting track, the needle inserting positioning channel is adjusted to be collinear with the planned needle inserting track, and positioning of the needle inserting positioning channel is completed. The invention is used for positioning the puncture channel, improves the precision of puncture positioning and reduces the times of needle threading.

Description

Robot puncture positioning method and device for biliary tract puncture
Technical Field
The invention relates to the field of intelligent medical equipment, in particular to a robot puncture positioning method and device for biliary tract puncture.
Background
The biliary tract intervention operation is an important operation type for treating biliary tract related diseases such as biliary tract radiography, biliary tract internal and external drainage, biliary tract malignant obstruction and the like, and whether the puncture operation can successfully penetrate into a specific part of the biliary tract is crucial to the whole treatment. Accurate targeting of the planned target in the biliary tract means smooth establishment of the interventional channel, and subsequent treatment means including a balloon dilatation catheter, an dilatation stent, a radioactive particle stent and the like can be smoothly performed. Prior to the puncture procedure, the physician plans the needle travel plane based on the patient's CT or MRI images. In the puncture surgery, a doctor needs to specify a target position for puncture by means of an image guidance device. The ultrasound can realize the real-time image guidance without radiation, and the Doppler image can be used for distinguishing the biliary tract from other cavity structures with liquid flowing rapidly, thereby being widely applied to the biliary tract puncture surgery.
When the walking plane of the puncture needle is consistent with the preoperative image scanning layer, the puncture is coplanar. Planning of the coplanar puncture needle insertion path, avoidance of important tissue structures and selection of material taking areas are easy to control. Therefore, after the biliary tract target region is determined by using ultrasound or CT, the puncture is preferentially carried out on the imaging layer. However, the layer may be obstructed by bony structures, blood vessels in chest wall, blood vessels in chest or other normal tissue structures, and is limited by the experience and manipulation of the operator, the influence of the soft tissue deformation of the patient (passive), the change of the muscle tension of the patient (active), the interference of the respiratory motion (active), and other factors, a non-coplanar puncture technique is often required, that is, after the cross section of the human body where the target is located is determined, the head side or the foot side is selected to be deviated, a proper needle insertion point is searched, and a needle insertion path is planned.
In coplanar and non-coplanar puncture, under the guidance of ultrasonic images, doctors can observe the relative relation between the target area of the biliary tract and the puncture needle in real time. However, the relation between the puncture path and the surrounding tissues is difficult to judge only by means of the two-dimensional ultrasonic image, and the hand shaking or the puncture needle bending easily causes the puncture needle to exceed the imaging plane, so that the puncture needle is lost, the puncture difficulty is increased, and the injury of a patient is increased. In the non-coplanar puncture process, the needle body and the needle point are invisible, so that the problems of separation of the puncture needle and puncture of blood vessels, complications and the like are easy to occur. In addition, in the two puncture scenes, when the puncture needle inserting point and the puncture needle inserting angle are determined, the doctor determines according to experience, and the distribution of the thoracic wall and the blood vessels in the chest in the puncture path cannot be mastered in time, so that the puncture accuracy and the puncture risk are difficult to control, and great hidden danger is brought.
The existing manual puncture mainly depends on the experience of doctors and a puncture frame to determine the needle inserting point, the needle inserting angle and the needle inserting depth. With CT imaging, intraoperative radiation is large, and thus it is difficult to apply real-time guidance techniques in non-coplanar punctures. Ultrasound can be used for real-time puncture guidance, but the scanning plane of the ultrasound is consistent with the puncture needle running plane to ensure that the puncture needle running path is detected in real time. In order to keep the running plane of the puncture needle consistent with the ultrasonic scanning plane, the ultrasonic probe and the puncture needle are fixed on the same plane by the conventional puncture frame, so that no important blood vessel and focus area in the running path of the puncture needle can be punctured. The puncture frame can be used for adjusting the needle inserting angle of the puncture needle, but the adjustment amplitude still depends on the experience of a clinician. In addition to using a puncture frame, there is a 3D printed personalized template for assisting puncture in combination with CT imaging, but once the puncture target position is inconsistent with the preoperative one, the puncture error is also increased.
Therefore, the prior art has shortcomings and needs to be improved and developed in response to the above circumstances.
The invention aims to automatically adjust the needle inserting point and the needle inserting angle of a puncture needle positioning channel and control the automatic scanning of an ultrasonic probe to track the needle point of the puncture needle by utilizing the provided mechanical structure and the control mechanism. The doctor pierces the puncture needle into the patient body through the puncture positioning channel, thereby realizing accurate puncture and reducing the damage and complication caused by mistaken puncture.
Disclosure of Invention
The embodiment of the invention provides a robot puncture positioning method and device facing biliary tract puncture, which at least solve the technical problem of low puncture positioning precision facing biliary tract puncture in the prior art.
According to an embodiment of the present invention, there is provided a robot puncture positioning method for biliary puncture, including the steps of:
receiving a scanning request, and scanning a scanning target, wherein the scanning request at least carries a scanning signal;
acquiring an ultrasonic image during scanning based on the scanning signal, and establishing a one-to-one correspondence relationship between the ultrasonic image and a spatial position during acquisition of the ultrasonic image;
transmitting the ultrasonic image to a display terminal for displaying so as to define the ultrasonic image which is most consistent with the planning image layer in the ultrasonic image as a puncture layer;
marking a puncture target point in the puncture layer, and if no barrier exists on the puncture layer, taking a point with the shortest distance between the scanning target and the puncture target point as a needle entering point, wherein a connecting line between the needle entering point and the puncture target point is a planned needle entering track;
and calculating the position information of the needle insertion positioning channel which needs to move when the needle insertion positioning channel is not collinear with the planned needle insertion track, and adjusting the needle insertion positioning channel to be collinear with the planned needle insertion track based on the position information to complete the positioning of the needle insertion positioning channel.
Further, after displaying the ultrasound image on the display terminal to define the ultrasound image in the ultrasound image that most fits the planning image layer as the puncture layer, the method further includes:
marking a puncture target point in the puncture layer, and if a barrier exists on the target image layer, moving the scanning area to a selected area;
performing in-situ rotation scanning in the selected area, acquiring an ultrasonic image in real time, and recording the spatial position of the acquired ultrasonic image;
displaying the ultrasonic image on a display terminal in a three-dimensional image mode;
selecting a puncture layer and a puncture target point from an ultrasonic image displayed in a three-dimensional image mode;
selecting and planning a needle inserting track based on the puncture layer surface and the puncture target point;
and calculating that when the needle insertion positioning passage is not collinear with the planned needle insertion track, the needle insertion positioning passage is adjusted to be collinear with the planned needle insertion track, and positioning the needle insertion positioning passage.
Further, after the positioning of the needle inserting positioning channel, the method also comprises the following steps:
performing puncture needle inserting operation by using a puncture needle inserting track, wherein the puncture needle inserting track is a needle inserting track after the positioning of the needle inserting positioning channel is completed;
monitoring the working state of the puncture needle in the puncture needle track in real time;
when the puncture needle is bent in the puncture layer surface, calculating the bending direction of the puncture needle;
when the puncture needle is bent in the left and right directions of the puncture layer surface, scanning rotation is performed to detect the needle head position of the puncture needle.
Further, before transmitting the ultrasound image to a display terminal for displaying, so as to define an ultrasound image in the ultrasound image that most coincides with the planning image layer as a puncture layer, the method further includes:
a planning image layer for comparison with the puncture layer is planned in advance.
Further, after the positioning of the needle entering positioning channel is completed, the method further comprises the following steps:
and detecting the planned needle inserting track to determine whether an interference object exists in the planned needle inserting track.
A robot puncture positioning device facing biliary tract puncture comprises: the system comprises a mechanical arm, an image acquisition module, a target identification module, a state calculation module and a motion control module;
the motion control module is used for controlling the six-degree-of-freedom motion of the manipulator, controlling the manipulator to scan a scanning target based on receiving a scanning request, wherein the scanning request at least carries a scanning signal;
the image acquisition module is used for acquiring ultrasonic images during scanning based on the scanning signals and establishing a one-to-one correspondence relationship between the ultrasonic images and the spatial positions during the acquisition of the ultrasonic images;
the target identification module is used for transmitting the ultrasonic images to the display terminal for displaying so as to define the ultrasonic images which are most consistent with the planning image layer in the ultrasonic images as puncture layers;
the state calculation module is used for calculating the position information of the needle insertion positioning channel needing to be moved when the needle insertion positioning channel is not collinear with the planned needle insertion track, adjusting the needle insertion positioning channel to be collinear with the planned needle insertion track based on the position information and completing the positioning of the needle insertion positioning channel; wherein, the planning needle-inserting track is selected from the puncture layer;
and the mechanical arm is used for scanning the scanning target and performing puncture work, and the ultrasonic image is acquired by the image processing module through scanning.
Further, the apparatus further comprises:
and the puncture needle detection module is used for monitoring the working state of the puncture needle in the puncture needle track in real time and monitoring the needle head position of the puncture needle when the puncture needle is bent.
Further, the apparatus further comprises:
and the collision detection module is used for detecting the planned needle inserting track so as to determine whether an interference object exists in the planned needle inserting track.
Further, the manipulator comprises a mechanical arm and a probe positioning mechanism arranged on the mechanical arm.
Furthermore, the probe positioning mechanism comprises a needle insertion angle adjusting mechanism, and a first flange plate, a second flange plate, a servo motor, a probe fixing frame and an ultrasonic probe which are sequentially connected;
the first flange plate is rotatably connected with the mechanical arm, and the needle inserting angle adjusting mechanism is connected to the first flange plate;
the first flange and the second flange are rotatably connected with each other.
Further, the needle insertion angle adjusting mechanism comprises a steering engine fixing piece, a servo steering engine, a steering engine gear, a sliding block fixing piece, a sliding block, a rack, a sliding rail and a needle guide;
the servo steering engine is arranged on the steering engine fixing piece, and the steering engine gear is arranged on the servo steering engine;
the sliding block is connected with the steering engine fixing piece, the sliding rail is connected with the sliding block, and steel balls are arranged in the sliding block so that the sliding block can move in the sliding rail conveniently;
the rack is arranged on the sliding rail, the steering gear is meshed with the rack, the servo motor drives the steering gear to rotate, and the steering gear drives the rack to move;
the needle guide is mounted on the rack, and the needle guide is driven by movement of the rack to adjust the angle of the needle guide.
Furthermore, the needle inserting angle adjusting mechanism also comprises a guider frame, the guider frame is arranged on the rack, and the needle guider is detachably arranged on the guider frame.
Further, the motion control module includes:
the mechanical arm control submodule is used for controlling the movement of the mechanical arm in different directions so as to realize that the ultrasonic probe scans a target;
and the motor control submodule is used for controlling the rotation of the servo motor and the servo steering engine.
The invention provides a robot puncture positioning method and device facing biliary tract puncture, wherein the method comprises the following steps: receiving a scanning request, and scanning a scanning target; acquiring an ultrasonic image during scanning, and establishing a one-to-one correspondence relationship between the ultrasonic image and a spatial position during acquisition of the ultrasonic image; defining the ultrasonic image which is most consistent with the planning image layer in the ultrasonic image as a puncture layer; if the puncture layer surface has no barrier, taking the point with the shortest distance between the scanning target and the puncture target point as a needle entering point, and taking a connecting line between the needle entering point and the puncture target point as a planned needle entering track; and then, when the needle inserting positioning channel is not collinear with the planned needle inserting track, the needle inserting positioning channel is adjusted to be collinear with the planned needle inserting track, and positioning of the needle inserting positioning channel is completed. The invention is used for positioning the puncture channel, improves the precision of puncture positioning and reduces the times of needle threading.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a flow chart of a robot puncture positioning method facing biliary tract puncture according to the present invention;
FIG. 2 is a schematic diagram of the biliary puncture-oriented robotic puncture positioning device of the present invention;
FIG. 3 is a view showing the structure of a robot according to the present invention;
FIG. 4 is a block diagram of the probe positioning mechanism of the present invention;
FIG. 5 is another block diagram of the probe positioning mechanism of the present invention.
Reference numerals: 1-a first flange plate, 2-a second flange plate, 3-a servo motor, 4-a probe fixing device, 5-an ultrasonic probe, 6-a steering engine fixing device, 7-a servo steering engine, 8-a steering engine gear, 9-a sliding block fixing device, 10-a sliding block, 11-a rack, 12-a sliding rail, 13-a needle guide, 14-a guide frame, 100-a puncture needle detection module, 200-an image acquisition module, 300-a target identification module, 400-a collision detection module, 500-a state calculation module, 600-a mechanical arm control submodule, 700-a motor control submodule, 800-a mechanical arm and 900-a probe positioning mechanism.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
According to an embodiment of the present invention, a robot puncture positioning method facing a biliary tract puncture is provided, referring to fig. 1 and 2, including the following steps:
s101: receiving a scanning request, and scanning a scanning target, wherein the scanning request at least carries a scanning signal;
s102: acquiring an ultrasonic image during scanning based on the scanning signal, and establishing a one-to-one correspondence relationship between the ultrasonic image and a spatial position during acquisition of the ultrasonic image;
s103: transmitting the ultrasonic image to a display terminal for displaying so as to define the ultrasonic image which is most consistent with the planning image layer in the ultrasonic image as a puncture layer;
s104: marking a puncture target point in the puncture layer, and if no barrier exists on the puncture layer, taking a point with the shortest distance between the scanning target and the puncture target point as a needle entering point, wherein a connecting line between the needle entering point and the puncture target point is a planned needle entering track;
s105: and calculating the position information of the needle insertion positioning channel which needs to move when the needle insertion positioning channel is not collinear with the planned needle insertion track, and adjusting the needle insertion positioning channel to be collinear with the planned needle insertion track based on the position information to complete the positioning of the needle insertion positioning channel.
The invention provides a robot puncture positioning method and device facing biliary tract puncture, wherein the method comprises the following steps: receiving a scanning request, and scanning a scanning target; acquiring an ultrasonic image during scanning, and establishing a one-to-one correspondence relationship between the ultrasonic image and a spatial position during acquisition of the ultrasonic image; defining the ultrasonic image which is most consistent with the planning image layer in the ultrasonic image as a puncture layer; if the puncture layer surface has no barrier, taking the point with the shortest distance between the scanning target and the puncture target point as a needle entering point, and taking a connecting line between the needle entering point and the puncture target point as a planned needle entering track; and then, when the needle inserting positioning channel is not collinear with the planned needle inserting track, the needle inserting positioning channel is adjusted to be collinear with the planned needle inserting track, and positioning of the needle inserting positioning channel is completed. The invention is used for positioning the puncture channel, improves the precision of puncture positioning and reduces the times of needle threading.
Furthermore, compared with the prior art, the multi-degree-of-freedom ultrasonic scanning and real-time positioning can be realized, when the multi-degree-of-freedom ultrasonic scanning and real-time positioning device is used for puncture, if coplanar puncture is difficult, such as rib obstruction exists, the ultrasonic probe 5 and the puncture positioning device can independently rotate to realize non-coplanar puncture, and if the puncture needle is bent out of a plane, the ultrasonic probe 5 can independently move and detect the position of the needle point of the puncture needle, so that the relative position of the needle point of the puncture needle and a puncture target can be more accurately evaluated; the invention also adds an image processing unit and a collision detection function, and can be used for providing multi-decision information for doctors in the process of determining the focus and positioning the puncture channel, thereby improving the positioning precision and reducing the number of times of needle puncture.
The following describes in detail a method for positioning a robot for biliary tract puncture according to the present invention with reference to specific embodiments:
the method comprises the following steps: the mechanical arm 800 for positioning by controlling puncture moves to the upper part of the area of the punctured target, the autonomous scanning switch is pressed, and then the motion control module controls the ultrasonic probe 5 on the mechanical arm 800 to move downwards, so that the ultrasonic probe 5 contacts the skin of the scanned target to scan.
Step two: the contact force between the ultrasonic probe 5 and the skin of the scanned target is stabilized at a fixed value, an ultrasonic image is acquired through the image acquisition module 200, and the condition of the inside of the punctured tissue is observed in real time by displaying a clear image on the human-computer interaction target identification module 300. The human-computer interaction target recognition module 300 is mainly used for calibrating the straight line where the punctured target point and the needle inserting track are located on the computer screen by a doctor.
The biliary tract and other surrounding blood vessels appear as black hollow structures on the ultrasound image, and the flow of fluid in the biliary tract is very slow relative to the blood flow in the blood vessels, so that the biliary tract still appears black on the doppler image, and the doctor can identify the biliary tract by the surrounding blood vessel structure.
Step three: the ultrasonic probe 5 scans a rectangular area including a target point, and moves at a fixed speed while scanning.
In the scanning process, the image acquisition module 200 acquires an ultrasound image of the region of interest, and records the position of the end of the mechanical arm 800 at the same time, so as to establish a one-to-one correspondence relationship between the layer plane of the ultrasound image and the spatial position. The mechanical arm 800 controls the ultrasonic probe 5 to cling to the skin in a fixed direction for scanning until the boundary of the region of interest.
Step four: after scanning is finished, a doctor views an ultrasonic image formed by scanning by utilizing a human-computer interaction target recognition function, selects an ultrasonic image which is most consistent with a preoperative planned puncture layer, and defines the imaging plane as the layer where the punctured target is located, namely the puncture layer.
Step five: marking a puncture target on an ultrasonic image of a puncture layer, and determining whether coplanar puncture or non-coplanar puncture is adopted; checking whether barriers such as ribs exist on the ultrasonic image layer of the puncture target; if there is no barrier, coplanar piercing is used, and if there is a barrier, non-coplanar piercing is used.
The coplanar puncturing of the present invention is described in detail below with specific examples:
the distribution condition of the ribs and the great vessels in the scanning layer of the punctured target can be obtained based on the CT scanning before the operation of the patient. If the puncture layer surface has no rib and great vessel, the coplanar puncture can be carried out;
the first step is as follows: if the puncture layer surface has no barrier, the point on the body surface closest to the puncture target is the needle inserting point; and if so, the connecting line of the needle entering point and the target point is the needle entering track.
The second step is that: the collision detection module 400 detects needle entry trajectory safety.
Specifically, a straight line is dragged by using the man-machine interaction function of the target recognition module 300, and the straight line is defined as a needle insertion path of the puncture needle. This path is subjected to collision detection by collision detection module 400 in order to find out whether an interference with the important blood vessel occurs in the planned puncture path.
Specifically, after the doctor selects the needle insertion plane, the motion control module controls the mechanical arm 800 to move to the corresponding position according to the spatial position of each ultrasound image recorded in the previous image acquisition module 200. After the ultrasonic probe 5 is positioned to the puncture layer surface, the left and right sides of the human body in the plane move, and scanning is carried out to determine whether the needle insertion point is safe.
The third step: the state calculation function in the motion planning unit 102 calculates the angle that the servo steering engines 7 of the mechanical arm 800 and the mechanical arm 800 need to rotate when the central axis of the puncture needle positioning channel at the tail end of the mechanical arm 800 is collinear with the planned puncture needle trajectory, and installs the calculation result to make the axis of the puncture needle positioning channel collinear with the planned puncture needle trajectory.
Specifically, a motion control module controls a servo steering engine 7, the servo steering engine 7 drives a gear to rotate, and the gear drives a rack 11 to rotate, so that a puncture needle positioning channel is adjusted to a specified position, puncture positioning is completed, and a doctor starts puncturing by holding a puncture needle.
The fourth step: during the puncture process, if the puncture needle is bent, the needle point and part of the needle body will disappear. While the puncture needle is inserted, the puncture needle detection module 100 detects or monitors the puncture needle in real time, divides the shape of the puncture needle, and calculates the curvature. If the needle bends in the plane of the puncture, the computer extracts the needle profile and prompts the operator in the direction of the needle bend. If the puncture needle is bent towards the left side and the right side of the puncture plane, the motion control module controls the servo motor 3 to rotate and drives the ultrasonic probe 5 to rotate so as to detect the position of the needle point.
In an embodiment, after displaying the ultrasound image on the display terminal to define an ultrasound image in the ultrasound image that most coincides with the planning image layer as the puncture layer, the method further includes:
marking a puncture target point in the puncture layer, and if a barrier exists on the target image layer, moving the scanning area to a selected area;
performing in-situ rotation scanning in the selected area, acquiring an ultrasonic image in real time, and recording the spatial position of the acquired ultrasonic image;
displaying the ultrasonic image on a display terminal in a three-dimensional image mode;
selecting a puncture layer and a puncture target point from an ultrasonic image displayed in a three-dimensional image mode;
selecting and planning a needle inserting track based on the puncture layer surface and the puncture target point;
and calculating that when the needle insertion positioning passage is not collinear with the planned needle insertion track, the needle insertion positioning passage is adjusted to be collinear with the planned needle insertion track, and positioning the needle insertion positioning passage.
The invention can aim at coplanar puncture, but the puncture layer surface is usually sampling non-coplanar puncture when the separation object of bone structure, chest wall blood vessel, intrathoracic blood vessel or other normal tissue structure is probably; in addition, due to the limitation of the experienced manipulations of the operator, the influence of the soft tissue deformation of the patient (passive), the change of the muscle tension of the patient (active), and the interference of the respiratory motion (active), it is often necessary to adopt the non-coplanar puncture technique, i.e. after determining the cross section of the human body where the target is located, selecting the deviation towards the head side or the foot side, searching for the proper needle insertion point, and planning the needle insertion path.
The non-coplanar piercing of the present invention is described in detail below with specific examples:
the distribution condition of the ribs and the great vessels in the scanning layer of the punctured target can be obtained based on the CT scanning before the operation of the patient. If the puncture layer surface has barriers such as ribs and great vessels, or the needle insertion track is difficult to avoid passing through the great vessels, non-coplanar puncture is adopted.
The first step is as follows: the ultrasonic probe 5 controls the mechanical arm 800 to move to the cross section of the human body where the target selected by the doctor is located by the motion control module. And then, performing rotary scanning by taking the central axis of the ultrasonic probe 5 as a rotary central line to determine a walking plane of the puncture needle during non-coplanar puncture. An image acquisition module 200 in the image processing unit acquires the ultrasound image in real time and records the spatial position of the ultrasound image.
The second step is that: the three-dimensional graph mode is displayed in the human-computer interaction target recognition module 300, and the target and the puncture layer are selected. The selected puncture layer surface is transferred to a servo motor 3 at the tail end of the mechanical arm 800 controlled by the motion control module to rotate so as to drive the ultrasonic probe 5 to rotate to the selected puncture layer surface.
The third step: and selecting a puncture target point and a puncture needle inserting track on a puncture layer. It should be noted that, in order to avoid inaccurate selection of the needle insertion trajectory, the scanning target (the person to be punctured, or the patient) is required to hold his breath during the real-time imaging of the ultrasound probe 5, so as to prevent the puncture target from moving due to physiological motion.
The fourth step: the generated needle entering track can be directly transmitted to the motion control module, and the servo steering engine 7 is controlled to drive the sliding rail 12, so that the axis of the puncture needle entering positioning channel is superposed with the needle entering track.
The fifth step: the puncture needle is held by the doctor, inserted into the needle positioning channel and punctured into the scanning target.
And a sixth step: if the needle is bent in the ultrasound plane or out of the plane, the location of its tip is detected by the needle detection module 100 with reference to the in-plane puncture condition detection.
In an embodiment, after the positioning of the needle insertion positioning channel, the method further comprises:
performing puncture needle inserting operation by using a puncture needle inserting track, wherein the puncture needle inserting track is a needle inserting track after the positioning of the needle inserting positioning channel is completed;
monitoring the working state of the puncture needle in the puncture needle track in real time;
when the puncture needle is bent in the puncture layer surface, calculating the bending direction of the puncture needle;
when the puncture needle is bent in the left and right directions of the puncture layer surface, scanning rotation is performed to detect the needle head position of the puncture needle.
The puncturing operation is performed after the positioning of the needle inserting positioning channel, and the coplanar puncturing operation and the non-coplanar puncturing operation are described in detail above and will not be described herein again.
In an embodiment, before transmitting the ultrasound image to a display terminal for displaying, so as to define an ultrasound image in the ultrasound image that most coincides with the planning image layer as a puncture layer, the method further includes:
a planning image layer for comparison with the puncture layer is planned in advance.
And after scanning is finished, using a human-computer interaction target identification function to check ultrasonic images formed by scanning, selecting the ultrasonic image which is most consistent with the preoperative planned puncture layer, and defining the imaging plane as the layer where the punctured target is located.
In an embodiment, after completing the positioning of the needle insertion positioning channel, the method further comprises:
and detecting the planned needle inserting track to determine whether an interference object exists in the planned needle inserting track.
Needle entry trajectory safety is detected by the collision detection module 400. Specifically, an ultrasonic image is checked by utilizing a human-computer interaction function, a straight line is dragged, and a needle inserting path of the puncture needle is defined. The path is subjected to collision detection by a motion planning module so as to find whether the planned puncture path interferes with an important blood vessel or not.
Example 2
According to another embodiment of the present invention, there is provided a robotic puncture positioning device for biliary puncture, referring to fig. 2 to 5, including: the system comprises a manipulator, an image acquisition module 200, a target recognition module 300, a collision detection module 400, a state calculation module 500 and a motion control module;
the motion control module is used for controlling the six-degree-of-freedom motion of the manipulator, controlling the manipulator to scan a scanning target based on receiving a scanning request, wherein the scanning request at least carries a scanning signal;
the image acquisition module 200 is configured to acquire an ultrasound image during scanning based on the scanning signal, and establish a one-to-one correspondence relationship between the ultrasound image and a spatial position during the acquisition of the ultrasound image;
the target identification module 300 is configured to transmit the ultrasound image to a display terminal for displaying, so as to define an ultrasound image in the ultrasound image that most coincides with the planning image layer as a puncture layer;
the state calculation module 500 is used for calculating the position information that the needle insertion positioning channel needs to move when the needle insertion positioning channel is not collinear with the planned needle insertion track, adjusting the needle insertion positioning channel to be collinear with the planned needle insertion track based on the position information, and completing the positioning of the needle insertion positioning channel; wherein, the planning needle-inserting track is selected from the puncture layer;
and the mechanical arm is used for scanning the scanning target and performing puncture work, and the ultrasonic image is acquired by the image processing module through scanning.
The invention provides a robot puncture positioning method and device facing biliary tract puncture, wherein the method comprises the following steps: receiving a scanning request, and scanning a scanning target; acquiring an ultrasonic image during scanning, and establishing a one-to-one correspondence relationship between the ultrasonic image and a spatial position during acquisition of the ultrasonic image; defining the ultrasonic image which is most consistent with the planning image layer in the ultrasonic image as a puncture layer; if the puncture layer surface has no barrier, taking the point with the shortest distance between the scanning target and the puncture target point as a needle entering point, and taking a connecting line between the needle entering point and the puncture target point as a planned needle entering track; and then, when the needle inserting positioning channel is not collinear with the planned needle inserting track, the needle inserting positioning channel is adjusted to be collinear with the planned needle inserting track, and positioning of the needle inserting positioning channel is completed. The invention is used for positioning the puncture channel, improves the precision of puncture positioning and reduces the times of needle threading.
Compared with the prior art, the multi-degree-of-freedom ultrasonic scanning and real-time positioning can be realized, when the multi-degree-of-freedom ultrasonic scanning and real-time positioning device is used for puncture, if the coplanar puncture difficulty is high, the ultrasonic probe 5 and the puncture positioning device can independently rotate to realize non-coplanar puncture, and if the puncture needle is bent out of the plane, the ultrasonic probe 5 can independently move and detect the position of the needle point of the puncture needle, so that the relative position of the needle point of the puncture needle and a puncture target can be more accurately evaluated; the invention also adds an image processing unit and a collision detection function, and can be used for providing multi-decision information for doctors in the process of determining the focus and positioning the puncture channel, thereby improving the positioning precision and reducing the number of times of needle puncture.
Specifically, the biliary tract puncture positioning device provided by the invention mainly comprises an image processing unit, a motion planning unit and a motion control module; the mechanical structure part mainly comprises: the six-degree-of-freedom needle inserting positioning device comprises a six-degree-of-freedom mechanical arm 800, a six-degree-of-freedom main control end, a rotating motor, a needle inserting angle adjusting mechanism, an ultrasonic probe clamping mechanism and a needle inserting positioning channel of a puncture needle.
The image processing unit comprises an ultrasonic image acquisition module 200, a human-computer interaction target identification module 300 and a puncture needle detection module 100.
The image acquisition module 200: the ultrasonic imaging device is mainly used for acquiring ultrasonic images in an operation and enabling an operator to observe the condition of the interior of a punctured tissue in real time;
the object recognition module 300: the method is mainly used for calibrating the straight line where the punctured target point and the needle inserting track are located on a computer screen. The biliary tract and other surrounding blood vessels appear as black hollow structures on the ultrasound image, and the flow of fluid in the biliary tract is very slow relative to the blood flow in the blood vessels, so that the biliary tract still appears black on the doppler image, and the surrounding blood vessels appear red or blue, so that the doctor can identify the biliary tract.
The motion planning unit includes a collision detection module 400 and a puncture needle state calculation module 500.
The collision detection module 400: the method is mainly used for detecting whether the planned needle insertion track and the important organ have the interferent or not;
the state calculation module 500: the needle inserting device is mainly used for adjusting the posture of the puncture needle to enable the puncture needle to be collinear with a straight line where a planned needle inserting track is located.
The motion control module mainly includes a robot arm control sub-module 600 and a motor control sub-module.
The mechanical arm control sub-module 600: the mechanical arm 800 and the ultrasonic probe 5 carried thereon are mainly controlled to move in different directions in space, so that the ultrasonic probe 5 is stably contacted with the skin of a patient, and the ultrasonic probe 5 scans a target so as to obtain a stable ultrasonic image;
a motor control submodule: the needle inserting positioning mechanism is mainly used for controlling the servo motor 3 and the servo steering engine 7 which are arranged on the probe positioning mechanism 900 at the tail end of the mechanical arm 800 to move the puncture needle inserting positioning channel to a preset position, so that a doctor can accurately insert a human body along the puncture needle inserting positioning channel by using the puncture needle.
In the aspect of a mechanical structure, the manipulator is arranged on the movable machine table and is mainly responsible for relatively fixing the whole mechanism and the ground. The six-degree-of-freedom mechanical arm 800 is connected to a mobile station, and a doctor remotely controls the mechanical arm 800 by operating the mobile station equipment, so that the ultrasonic probe 5 is moved above a scanning target disease. The servo motor 3 is responsible for rotating the ultrasonic probe clamping device directly connected with the servo motor, so that the rotation of the ultrasonic scanning surface is realized. The probe positioning mechanism 900 on the six degree-of-freedom robotic arm 800 may spin about its central axis.
If the puncture is performed in the same plane, the servo motor 3 does not rotate, so that the ultrasonic probe 5 and the probe positioning mechanism 900 rotate together with the rotary joint at the tail end of the mechanical arm 800, and the plane scanned by the ultrasonic probe 5 is ensured to be consistent with the plane where the puncture needle positioning channel of the puncture needle is located.
If the puncture is performed in a non-coplanar manner, the probe positioning mechanism 900 at the tail end of the mechanical arm 800 rotates around the axis of the probe positioning mechanism, so that the puncture needle positioning channel walking plane rotates, and the purpose of changing the puncture path is achieved. At the same time, the servo motor 3 rotates in the opposite direction, thereby keeping the ultrasonic probe 5 stationary with respect to the scanning target. The puncture needle inserting angle adjusting mechanism is used for adjusting the angle of the puncture needle penetrating into the human body. The ultrasonic probe 5 clamping mechanism is used for fixing the ultrasonic probe 5 at the tail end of the mechanical arm 800. The puncture needle inserting positioning channel is used for ensuring that the extension line of the puncture needle and the planned puncture needle inserting track are on the same straight line.
In an embodiment, the apparatus further comprises:
and the puncture needle detection module 100 is used for monitoring the working state of the puncture needle in a puncture needle track in real time and monitoring the needle head position of the puncture needle when the puncture needle is bent.
During the puncture process, if the puncture needle is bent, the needle point and part of the needle body will disappear. While the puncture needle is inserted, the puncture needle detection module 100 detects or monitors the puncture needle in real time, divides the shape of the puncture needle, and calculates the curvature. If the needle bends in the plane of the puncture, the computer extracts the needle profile and prompts the operator in the direction of the needle bend. If the puncture needle is bent towards the left side and the right side of the puncture plane, the motion control module controls the servo motor 3 to rotate and drives the ultrasonic probe 5 to rotate so as to detect the position of the needle point.
As shown in fig. 4 and 5, in an embodiment, the robot comprises a robot arm 800 and a probe positioning mechanism 900 mounted on the robot arm 800.
The mechanical control sub-module controls the movement of the mechanical arm 800 to move the probe positioning mechanism 900 at the end of the mechanical arm 800 to a spatially specified position for scanning and puncturing.
In the embodiment, the probe positioning mechanism 900 comprises a needle angle adjusting mechanism, and a first flange plate 1, a second flange plate 2, a servo motor 3, a probe fixing frame 4 and an ultrasonic probe 5 which are connected in sequence;
the first flange plate 1 is rotatably connected with the mechanical arm 800, and the needle inserting angle adjusting mechanism is fixedly connected to the first flange plate 1;
the first flange 1 and the second flange 2 are rotatably connected with each other.
The probe positioning mechanism 900 mainly comprises a servo motor 3, a probe fixing support, a servo steering engine 7, a gear rack 11 movement mechanism consisting of a steering engine gear 8 and a rack 11, and a positioning sheath consisting of a needle guider 13 and a guider frame. The probe positioning mechanism 900 for puncture can be compatible with ultrasound medical image information; wherein, the probe fixing bracket is used for fixing the ultrasonic probe 5; when the ultrasonic scanning is finished, the human-computer interaction target recognition module 300 of the robot visualization finishes scanning target positioning according to the scanning result, provides puncture path planning information, determines puncture points and needle insertion angles, finishes pose adjustment by the probe positioning mechanism 900, establishes an extracorporeal channel so as to insert needles from the needle insertion positioning channel, and can reduce the problems of multiple and repeated needle insertion caused by inaccurate positioning and improve the puncture accuracy.
In the embodiment, the needle insertion angle adjusting mechanism comprises a steering engine fixing piece 6, a servo steering engine 7, a steering engine gear 8, a sliding block 10 fixing piece 9, a sliding block 10, a rack 11, a sliding rail 12 and a needle guide 13;
the steering engine fixing piece 6 is connected with the first flange plate 1, the servo steering engine 7 is installed on the steering engine fixing piece 6, and the steering engine gear 8 is installed on the servo steering engine 7;
the sliding block 10 is connected with the steering engine fixing piece 6, the sliding rail 12 is connected with the sliding block 10, and steel balls are arranged in the sliding block 10 so that the sliding block 10 can move in the sliding rail 12;
the rack 11 is arranged on the sliding rail 12, the steering gear 8 is meshed with the rack 11, the servo motor 3 drives the steering gear 8 to rotate, and the steering gear 8 drives the rack 11 to move;
the needle guide 13 is mounted on the rack 11, and the needle guide 13 is driven by the movement of the rack 11 to adjust the angle of the needle guide 13.
In an embodiment, the needle insertion angle adjusting mechanism further comprises a guide frame 14, the guide frame 14 is mounted on the rack 11, and the needle guide 13 is detachably mounted on the guide frame 14.
Specifically, the probe positioning mechanism 900 and the steering engine fixing part 6 are connected with the mechanical arm 800 through the first flange plate 1; wherein, first ring flange 1 and arm 800 end are threaded bolt connection, and first ring flange 1 and steering wheel mounting 6 are rigid connection, and this connected mode makes whole needle inserting angle adjustment mechanism can be along with arm 800 end carry out 360 degrees rotations, realizes the non-coplane puncture in many planes.
The second flange plate 2 is connected with the first flange plate 1 and the servo motor 3 through threaded bolts, and then the servo motor 3 is indirectly connected with a rotary joint at the tail end of the mechanical arm 800; the probe fixing support is connected with the servo motor 3 through a threaded bolt, and the ultrasonic probe 5 is rigidly fixed on the probe fixing support. When the rotating joint at the tail end of the mechanical arm 800 drives the needle inserting angle adjusting mechanism to rotate, the servo motor 3 can provide rotating motion in the opposite direction to offset, so as to ensure that the scanning plane of the ultrasonic probe 5 is kept unchanged.
In the needle insertion angle adjusting mechanism, a servo steering engine 7 is rigidly fixed in a steering engine fixing piece 6, and a steering engine gear 8 is connected to the servo steering engine 7 and driven by the servo steering engine 7; the sliding block 10 is rigidly connected with the steering engine fixing piece 6 through a threaded bolt, the sliding rail 12 is non-rigidly connected to the sliding block 10, a ball structure is arranged in the sliding block 10 so that the sliding rail 12 and the sliding block 10 can move relatively, and the rack 11 is rigidly fixed on the sliding rail 12; after the steering engine gear 8 is meshed with the rack 11, the gear rack 11 kinematic pair can be driven by the servo steering engine 7 to realize the motion of the rack 11 and the sliding rail 12;
the needle guide 13 is connected to the guide frame 14 by a detachable pin connection mode, the guide frame 14 is rigidly fixed on the rack 11, and when the rack 11 moves and the pinion moves, the needle guide 13 can complete the angle adjustment of the needle insertion channel, and the angle adjustment range is 0-90 degrees.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that it is obvious to those skilled in the art that various modifications and improvements can be made without departing from the principle of the present invention, and these modifications and improvements should also be considered as the protection scope of the present invention.

Claims (13)

1.一种面向胆道穿刺的机器人穿刺定位方法,其特征在于,包括以下步骤:1. a robot puncture positioning method for bile duct puncture, is characterized in that, comprises the following steps: 接收扫描请求,对扫描目标进行扫描,所述扫描请求至少携带有扫描信号;Receive a scan request, and scan the scan target, where the scan request at least carries a scan signal; 基于所述扫描信号,在进行扫描时采集超声图像,并将所述超声图像与采集所述超声图像时的空间位置建立一一对应的关系;Based on the scanning signal, collecting an ultrasound image during scanning, and establishing a one-to-one correspondence between the ultrasound image and the spatial position when collecting the ultrasound image; 将所述超声图像传输至显示终端进行显示,以将所述超声图像中与规划图像层最吻合的超声图像定义为穿刺层面;transmitting the ultrasound image to the display terminal for display, so as to define the ultrasound image that best matches the planned image layer as the puncture level in the ultrasound image; 在所述穿刺层面中标出穿刺目标点,若所述穿刺层面上没有阻隔物,则将所述扫描目标与所述穿刺目标点距离最近的一点作为入针点,其中,所述入针点与所述穿刺目标点之间的连线即为规划入针轨迹;The puncture target point is marked on the puncture layer, and if there is no barrier on the puncture layer, the point closest to the scanning target and the puncture target point is used as the needle entry point, wherein the needle entry point is the same as the puncture target point. The connecting line between the puncture target points is the planned needle insertion trajectory; 计算出当入针定位通道与所述规划入针轨迹不共线时,所述入针定位通道需要移动的位置信息,基于所述位置信息将所述入针定位通道调整至与规划入针轨迹共线,完成入针定位通道的定位。Calculate the position information that the needle insertion positioning channel needs to move when the needle insertion positioning channel is not collinear with the planned needle insertion trajectory, and adjust the needle insertion positioning channel to the planned needle insertion trajectory based on the position information. Collinear to complete the positioning of the needle insertion positioning channel. 2.根据权利要求1所述的面向胆道穿刺的机器人穿刺定位方法,其特征在于,在将所述超声图像在显示终端进行显示,以将所述超声图像中与规划图像层最吻合的超声图像定义为穿刺层面之后还包括:2 . The robot puncture positioning method for biliary puncture according to claim 1 , wherein the ultrasonic image is displayed on a display terminal to display the ultrasonic image that best matches the planned image layer in the ultrasonic image. 3 . After being defined as the puncture level, it also includes: 在所述穿刺层面中标出穿刺目标点,若所述目标图像层上存在有阻隔物,则将所述扫描区域移动到选定区域;Mark the puncture target point in the puncture layer, and move the scanning area to the selected area if there is a barrier on the target image layer; 在所述选定区域进行原位旋转扫描,实时采集超声图像,并记录采集的所述超声图像的空间位置;Perform an in-situ rotational scan in the selected area, acquire an ultrasound image in real time, and record the spatial position of the acquired ultrasound image; 将所述超声图像以三维图像的模式在显示终端进行显示;displaying the ultrasound image on a display terminal in a three-dimensional image mode; 从所述三维图像模式显示的所述超声图像中,选择穿刺层面及穿刺目标点;From the ultrasound image displayed in the three-dimensional image mode, select a puncture level and a puncture target point; 基于所述穿刺层面及穿刺目标点选择规划入针轨迹;Based on the puncture level and the puncture target point, select and plan the needle insertion trajectory; 计算出当入针定位通过与所述规划入针轨迹不共线时,将所述入针定位通道调整至与规划入针轨迹共线,完成入针定位通道的定位。It is calculated that when the needle insertion positioning pass is not collinear with the planned needle insertion trajectory, the needle insertion positioning channel is adjusted to be collinear with the planned needle insertion trajectory to complete the positioning of the needle insertion positioning channel. 3.根据权利要求1或2所述的面向胆道穿刺的机器人穿刺定位方法,其特征在于,在所述入针定位通道的定位之后还包括:3. The robot puncture positioning method for biliary puncture according to claim 1 or 2, characterized in that, after the positioning of the needle insertion positioning channel, the method further comprises: 以穿刺入针轨迹进行穿刺针入针操作,所述穿刺入针轨迹为所述入针定位通道完成定位后的入针轨迹;The puncture needle insertion operation is performed according to the puncture insertion needle trajectory, and the puncture needle insertion trajectory is the needle insertion trajectory after the positioning of the needle insertion positioning channel is completed; 实时监测所述穿刺针在所述穿刺入针轨迹的工作状态;Real-time monitoring of the working state of the puncture needle on the trajectory of the puncture needle; 当所述穿刺针在所述穿刺层面内发生了弯曲,则计算出所述穿刺针的弯曲的方向;When the puncture needle is bent in the puncture plane, calculating the bending direction of the puncture needle; 当所述穿刺针在所述穿刺层面的左右方向发生了弯曲,则进行扫描旋转,以检测所述穿刺针的针头位置。When the puncture needle is bent in the left and right directions of the puncture plane, scanning rotation is performed to detect the position of the needle head of the puncture needle. 4.根据权利要求3所述的面向胆道穿刺的机器人穿刺定位方法,其特征在于,在将所述超声图像传输至显示终端进行显示,以将所述超声图像中与规划图像层最吻合的超声图像定义为穿刺层面之前还包括:4 . The robot puncture positioning method for biliary puncture according to claim 3 , wherein the ultrasonic image is transmitted to a display terminal for display to display the ultrasonic image that best matches the planned image layer in the ultrasonic image. 5 . Before the image is defined as a puncture slice, it also includes: 预先规划一个用于与穿刺层面对比的规划图像层。A planning image layer is pre-planned for comparison with the puncture layer. 5.根据权利要求1所述的面向胆道穿刺的机器人穿刺定位方法,其特征在于,在所述完成入针定位通道的定位之后还包括:5. The robot puncture positioning method for biliary puncture according to claim 1, wherein after the positioning of the needle insertion positioning channel is completed, the method further comprises: 对所述规划入针轨迹进行检测,以确定所述规划入针轨迹中是否存在干涉物。The planned needle insertion trajectory is detected to determine whether there is an interference object in the planned needle insertion trajectory. 6.一种面向胆道穿刺的机器人穿刺定位装置,其特征在于,包括:机械手、图像采集模块、目标识别模块、状态计算模块及运动控制模块;6. A robotic puncture positioning device for bile duct puncture, characterized in that it comprises: a manipulator, an image acquisition module, a target recognition module, a state calculation module and a motion control module; 所述运动控制模块,用于控制所述机械手六自由度的运动,基于接收扫描请求,控制所述机械手对扫描目标进行扫描,所述扫描请求至少携带有扫描信号;The motion control module is configured to control the motion of the manipulator with six degrees of freedom, and based on receiving a scan request, control the manipulator to scan the scan target, and the scan request at least carries a scan signal; 所述图像采集模块,用于基于所述扫描信号,在进行扫描时采集超声图像,并将所述超声图像与采集所述超声图像时的空间位置建立一一对应的关系;The image acquisition module is configured to acquire an ultrasonic image during scanning based on the scanning signal, and establish a one-to-one correspondence between the ultrasonic image and the spatial position when the ultrasonic image is acquired; 所述目标识别模块,用于将所述超声图像传输至显示终端进行显示,以将所述超声图像中与规划图像层最吻合的超声图像定义为穿刺层面;the target identification module, configured to transmit the ultrasound image to a display terminal for display, so as to define the ultrasound image that best matches the planned image layer as the puncture level in the ultrasound image; 状态计算模块,用于计算出当入针定位通道与所述规划入针轨迹不共线时,所述入针定位通道需要移动的位置信息,基于所述位置信息将所述入针定位通道调整至与规划入针轨迹共线,完成入针定位通道的定位;其中,所述规划入针轨迹为在所述穿刺层面中选出;The state calculation module is used to calculate the position information that the needle insertion positioning channel needs to move when the needle insertion positioning channel is not collinear with the planned needle insertion trajectory, and adjust the needle insertion positioning channel based on the position information To be collinear with the planned needle insertion trajectory, the positioning of the needle insertion positioning channel is completed; wherein, the planned needle insertion trajectory is selected from the puncture level; 所述机械手,用于对扫描目标进行扫描及用于进行穿刺工作,通过扫描以便所述图像处理模块采集所述超声图像。The manipulator is used for scanning the scanning target and for performing puncture work, so that the image processing module can acquire the ultrasonic image by scanning. 7.根据权利要求6所述的面向胆道穿刺的机器人穿刺定位装置,其特征在于,所述装置还包括:7. The robotic puncture positioning device for biliary puncture according to claim 6, wherein the device further comprises: 穿刺针检测模块,用于实时监测所述穿刺针在所述穿刺入针轨迹的工作状态,当所述穿刺针发生弯曲时监测出所述穿刺针的针头位置。The puncture needle detection module is used to monitor the working state of the puncture needle in the puncture needle trajectory in real time, and monitor the position of the needle head of the puncture needle when the puncture needle is bent. 8.根据权利要求6所述的面向胆道穿刺的机器人穿刺定位装置,其特征在于,所述装置还包括:8. The robotic puncture positioning device for biliary puncture according to claim 6, wherein the device further comprises: 碰撞检测模块,用于对所述规划入针轨迹进行检测,以确定所述规划入针轨迹中是否存在干涉物。The collision detection module is used for detecting the planned needle insertion trajectory to determine whether there is an interference object in the planned needle insertion trajectory. 9.根据权利要求6所述的面向胆道穿刺的机器人穿刺定位装置,其特征在于,所述机械手包括机械臂及安装在所述机械臂上的探头定位机构。9 . The robotic puncture positioning device for biliary puncture according to claim 6 , wherein the manipulator comprises a mechanical arm and a probe positioning mechanism mounted on the mechanical arm. 10 . 10.根据权利要求9所述的面向胆道穿刺的机器人穿刺定位装置,其特征在于,所述探头定位机构包括进针角度调整机构及依次连接的第一法兰盘、第二法兰盘、伺服电机、探头固定架、超声探头;10. The robotic puncture positioning device for biliary puncture according to claim 9, wherein the probe positioning mechanism comprises a needle insertion angle adjustment mechanism and a first flange, a second flange, a servo Motor, probe holder, ultrasonic probe; 所述第一法兰盘可旋转的与所述机械臂连接,所述进针角度调整机构连接在所述第一法兰盘上;The first flange is rotatably connected to the mechanical arm, and the needle insertion angle adjustment mechanism is connected to the first flange; 所述第一法兰盘和所述第二法兰盘之间可相互旋转的连接。The first flange and the second flange are rotatably connected to each other. 11.根据权利要求10所述的面向胆道穿刺的机器人穿刺定位装置,其特征在于,所述进针角度调节机构包括舵机固定件、伺服舵机、舵机齿轮、滑块固定件、滑块、齿条、滑轨及针导向器;11 . The robotic puncture positioning device for bile duct puncture according to claim 10 , wherein the needle insertion angle adjustment mechanism comprises a steering gear fixing member, a servo steering gear, a steering gear gear, a slider fixing member, and a sliding block. 12 . , racks, slide rails and needle guides; 所述舵机固定件与所述第一法兰盘连接,所述伺服舵机安装在所述舵机固定件上,所述舵机齿轮安装在所述伺服舵机上;The steering gear fixing piece is connected with the first flange, the servo steering gear is mounted on the steering gear fixing piece, and the steering gear gear is mounted on the servo steering gear; 所述滑块与所述舵机固定件连接,所述滑轨与所述滑块连接,所述滑块内设置有钢珠,以便所述滑块在所述滑轨内运动;The sliding block is connected with the steering gear fixing part, the sliding rail is connected with the sliding block, and steel balls are arranged in the sliding block, so that the sliding block can move in the sliding rail; 所述齿条安装在滑轨上,所述舵机齿轮与所述齿条啮合,所述伺服电机驱动所述舵机齿轮转动,所述舵机齿轮带动所述齿条运动;The rack is installed on the slide rail, the steering gear is meshed with the rack, the servo motor drives the steering gear to rotate, and the steering gear drives the rack to move; 所述针导向器安装在所述齿条上,通过所述齿条的运动带动所述针导向器,以调整所述针导向器的角度。The needle guide is installed on the rack, and the needle guide is driven by the movement of the rack to adjust the angle of the needle guide. 12.根据权利要求11所述的面向胆道穿刺的机器人穿刺定位装置,其特征在于,所述进针角度调节机构还包括导向器架,所述导向器架安装在所述齿条上,所述针导向器可拆卸的安装在所述导向器架上。12 . The robotic puncture positioning device for biliary puncture according to claim 11 , wherein the needle insertion angle adjustment mechanism further comprises a guide frame, the guide frame is mounted on the rack, and the The needle guide is detachably mounted on the guide frame. 13.根据权利要求10所述的面向胆道穿刺的机器人穿刺定位装置,其特征在于,所述运动控制模块包括:13. The robotic puncture positioning device for biliary puncture according to claim 10, wherein the motion control module comprises: 机械臂控制子模块,用于控制所述机械臂不同方向的运动,以实现所述超声探头对所述目标进行扫描;a robotic arm control sub-module for controlling the movement of the robotic arm in different directions, so as to enable the ultrasound probe to scan the target; 电机控制子模块,用于控制所述伺服电机及伺服舵机的转动。The motor control sub-module is used to control the rotation of the servo motor and the servo steering gear.
CN202110951194.3A 2021-08-18 2021-08-18 Robot puncture positioning method and device for biliary tract puncture Pending CN113558735A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110951194.3A CN113558735A (en) 2021-08-18 2021-08-18 Robot puncture positioning method and device for biliary tract puncture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110951194.3A CN113558735A (en) 2021-08-18 2021-08-18 Robot puncture positioning method and device for biliary tract puncture

Publications (1)

Publication Number Publication Date
CN113558735A true CN113558735A (en) 2021-10-29

Family

ID=78172168

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110951194.3A Pending CN113558735A (en) 2021-08-18 2021-08-18 Robot puncture positioning method and device for biliary tract puncture

Country Status (1)

Country Link
CN (1) CN113558735A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114287997A (en) * 2021-12-17 2022-04-08 上海卓昕医疗科技有限公司 Medical puncture robot
CN114668496A (en) * 2022-03-10 2022-06-28 深圳高性能医疗器械国家研究院有限公司 Skeleton resetting device, skeleton positioning method, skeleton positioning device, computer equipment and medium
CN114711964A (en) * 2022-04-29 2022-07-08 华力创科学(深圳)有限公司 Operation navigation system and method based on robot ultrasonic scanning
CN114711907A (en) * 2022-03-08 2022-07-08 浙江大学 Puncture needle cylinder fixing 3D printing system and method based on double-mechanical-arm operation
CN115054333A (en) * 2022-06-20 2022-09-16 中国医学科学院北京协和医院 Ultrasonic puncture device
CN115253098A (en) * 2022-07-29 2022-11-01 上海微创医疗机器人(集团)股份有限公司 Auxiliary insertion device for brachytherapy, control method and readable storage medium
CN115770104A (en) * 2022-11-24 2023-03-10 中国医学科学院北京协和医院 Method for positioning thoracic dorsal root ganglion and presetting puncture path
CN119205922A (en) * 2024-11-14 2024-12-27 宁波大学 A high-precision micromanipulation control method and system based on visual servoing
CN119257706A (en) * 2024-12-09 2025-01-07 深圳惟德精准医疗科技有限公司 Puncture method based on two-dimensional image and related products
WO2025007229A1 (en) * 2023-07-03 2025-01-09 深圳华大智造云影医疗科技有限公司 Remote interventional robotic system, control method, and device
WO2025082249A1 (en) * 2023-10-19 2025-04-24 珠海横乐医疗科技有限公司 End effector, surgical robot and control method for end effector
CN115253098B (en) * 2022-07-29 2025-07-25 上海微创医疗机器人(集团)股份有限公司 Brachytherapy auxiliary transplanting device, control method and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1636520A (en) * 2003-08-19 2005-07-13 株式会社东芝 Ultrasonic diagnostic apparatus
CN106572836A (en) * 2014-10-31 2017-04-19 株式会社丝蓓 Ultrasonic probe injection device using rcm
CN111035437A (en) * 2019-05-28 2020-04-21 上海交通大学医学院附属第九人民医院 Blood vessel auxiliary puncture system, robot, method and storage medium
CN111297448A (en) * 2020-02-24 2020-06-19 东软医疗系统股份有限公司 Puncture positioning method, device and system
CN215874870U (en) * 2021-08-18 2022-02-22 中国科学院深圳先进技术研究院 A robotic puncture positioning device for biliary puncture

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1636520A (en) * 2003-08-19 2005-07-13 株式会社东芝 Ultrasonic diagnostic apparatus
CN106572836A (en) * 2014-10-31 2017-04-19 株式会社丝蓓 Ultrasonic probe injection device using rcm
CN111035437A (en) * 2019-05-28 2020-04-21 上海交通大学医学院附属第九人民医院 Blood vessel auxiliary puncture system, robot, method and storage medium
CN111297448A (en) * 2020-02-24 2020-06-19 东软医疗系统股份有限公司 Puncture positioning method, device and system
CN215874870U (en) * 2021-08-18 2022-02-22 中国科学院深圳先进技术研究院 A robotic puncture positioning device for biliary puncture

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114287997A (en) * 2021-12-17 2022-04-08 上海卓昕医疗科技有限公司 Medical puncture robot
CN114287997B (en) * 2021-12-17 2023-10-03 上海卓昕医疗科技有限公司 Medical puncture robot
CN114711907A (en) * 2022-03-08 2022-07-08 浙江大学 Puncture needle cylinder fixing 3D printing system and method based on double-mechanical-arm operation
CN114668496A (en) * 2022-03-10 2022-06-28 深圳高性能医疗器械国家研究院有限公司 Skeleton resetting device, skeleton positioning method, skeleton positioning device, computer equipment and medium
CN114711964A (en) * 2022-04-29 2022-07-08 华力创科学(深圳)有限公司 Operation navigation system and method based on robot ultrasonic scanning
CN114711964B (en) * 2022-04-29 2024-10-01 华力创科学(深圳)有限公司 Surgical navigation system and method based on ultrasonic scanning of robot
CN115054333A (en) * 2022-06-20 2022-09-16 中国医学科学院北京协和医院 Ultrasonic puncture device
CN115253098B (en) * 2022-07-29 2025-07-25 上海微创医疗机器人(集团)股份有限公司 Brachytherapy auxiliary transplanting device, control method and readable storage medium
CN115253098A (en) * 2022-07-29 2022-11-01 上海微创医疗机器人(集团)股份有限公司 Auxiliary insertion device for brachytherapy, control method and readable storage medium
CN115770104A (en) * 2022-11-24 2023-03-10 中国医学科学院北京协和医院 Method for positioning thoracic dorsal root ganglion and presetting puncture path
WO2025007229A1 (en) * 2023-07-03 2025-01-09 深圳华大智造云影医疗科技有限公司 Remote interventional robotic system, control method, and device
WO2025082249A1 (en) * 2023-10-19 2025-04-24 珠海横乐医疗科技有限公司 End effector, surgical robot and control method for end effector
CN119205922A (en) * 2024-11-14 2024-12-27 宁波大学 A high-precision micromanipulation control method and system based on visual servoing
CN119257706A (en) * 2024-12-09 2025-01-07 深圳惟德精准医疗科技有限公司 Puncture method based on two-dimensional image and related products
CN119257706B (en) * 2024-12-09 2025-02-25 深圳惟德精准医疗科技有限公司 Puncture path determining method based on two-dimensional image and related product

Similar Documents

Publication Publication Date Title
CN113558735A (en) Robot puncture positioning method and device for biliary tract puncture
CN215874870U (en) A robotic puncture positioning device for biliary puncture
JP7588069B2 (en) Ultrasound-guided positioning and insertion of a percutaneous cannulation device
US11576746B2 (en) Light and shadow guided needle positioning system and method
JP5103658B2 (en) Controlled operation of flexible needle
CN104274194B (en) Insertion type imaging system
CA2772679C (en) Manual instrumented medical tool system
KR101758741B1 (en) Guiding method of interventional procedure using medical images and system for interventional procedure for the same
CN107970060A (en) Surgical robot system and its control method
US20090082784A1 (en) Interventional medical system
US12208220B2 (en) Active distal tip drive
WO2017050201A1 (en) Minimally invasive medical robot system
CN117083022A (en) Device and method for brain biopsy
CN208573801U (en) Surgical robot system
KR101758740B1 (en) Guiding method of interventional procedure using medical images and system for interventional procedure for the same
KR20230058119A (en) Robotic controllable field generator
EP3831328A1 (en) Method for maintaining localization of distal catheter tip to target during ventilation and/or cardiac cycles
CN117615724A (en) Medical instrument guidance system and associated methods
CN115003235A (en) Planning and updating 3D trajectories of medical instruments in real time
WO2023019479A1 (en) Robot puncture positioning method and apparatus for biliary tract puncture
CN103957814B (en) The method of the assisted control of instrument and the assisted group piece installing of association
US20240206862A1 (en) Intelligent articulation management for endoluminal devices
CN118695821A (en) Systems and methods for integrating intraoperative image data with minimally invasive medical techniques
CN116096313B (en) Puncture positioning system and control method thereof
KR20170030688A (en) Guiding method of interventional procedure using medical images and system for interventional procedure for the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination