US10555781B2 - High bandwidth and low latency hybrid communication techniques for a navigation system - Google Patents
High bandwidth and low latency hybrid communication techniques for a navigation system Download PDFInfo
- Publication number
- US10555781B2 US10555781B2 US16/189,241 US201816189241A US10555781B2 US 10555781 B2 US10555781 B2 US 10555781B2 US 201816189241 A US201816189241 A US 201816189241A US 10555781 B2 US10555781 B2 US 10555781B2
- Authority
- US
- United States
- Prior art keywords
- tracker
- transmitter
- communication
- localization device
- receiver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004891 communication Methods 0.000 title claims abstract description 299
- 238000000034 method Methods 0.000 title claims abstract description 292
- 230000004807 localization Effects 0.000 claims abstract description 224
- 238000001228 spectrum Methods 0.000 claims abstract description 83
- 230000005540 biological transmission Effects 0.000 claims description 73
- 238000002329 infrared spectrum Methods 0.000 claims description 19
- 230000003287 optical effect Effects 0.000 description 17
- 210000003484 anatomy Anatomy 0.000 description 14
- 230000008901 benefit Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 6
- 230000001133 acceleration Effects 0.000 description 5
- 210000000988 bone and bone Anatomy 0.000 description 5
- 238000001444 catalytic combustion detection Methods 0.000 description 5
- 238000005520 cutting process Methods 0.000 description 5
- 239000007943 implant Substances 0.000 description 5
- 238000001356 surgical procedure Methods 0.000 description 5
- 238000005259 measurement Methods 0.000 description 4
- 238000005070 sampling Methods 0.000 description 4
- 210000001519 tissue Anatomy 0.000 description 4
- 230000009977 dual effect Effects 0.000 description 3
- 239000013589 supplement Substances 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000004913 activation Effects 0.000 description 2
- 230000007123 defense Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 210000003127 knee Anatomy 0.000 description 2
- 238000002044 microwave spectrum Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 210000004417 patella Anatomy 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000008054 signal transmission Effects 0.000 description 2
- 210000002303 tibia Anatomy 0.000 description 2
- 210000000689 upper leg Anatomy 0.000 description 2
- 241000269586 Ambystoma 'unisexual hybrid' Species 0.000 description 1
- 238000004566 IR spectroscopy Methods 0.000 description 1
- 238000002679 ablation Methods 0.000 description 1
- 230000037182 bone density Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000009849 deactivation Effects 0.000 description 1
- 238000011143 downstream manufacturing Methods 0.000 description 1
- 239000012636 effector Substances 0.000 description 1
- 238000002567 electromyography Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000010304 firing Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000002513 implantation Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000000399 orthopedic effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 210000004872 soft tissue Anatomy 0.000 description 1
- 241000894007 species Species 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
- G01C21/1656—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with passive imaging devices, e.g. cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/66—Tracking systems using electromagnetic waves other than radio waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
- G01S5/0294—Trajectory determination or predictive filtering, e.g. target tracking or Kalman filtering
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/16—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/02—Transmitters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
- H04B10/114—Indoor or close-range type systems
- H04B10/1141—One-way transmission
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2048—Tracking techniques using an accelerometer or inertia sensor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2055—Optical tracking systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2055—Optical tracking systems
- A61B2034/2057—Details of tracking cameras
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2068—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis using pointers, e.g. pointers having reference marks for determining coordinates of body points
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
- A61B2090/3937—Visible markers
- A61B2090/3945—Active visible markers, e.g. light emitting diodes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
- G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
Definitions
- the disclosure relates generally to a navigation system that tracks objects in space, and more specifically, techniques for improving bandwidth and latency for data transmission used by the navigation system.
- Navigation systems assist users in precisely locating objects. For instance, navigation systems are used in industrial, aerospace, defense, and medical/surgical applications. In the surgical field, navigation systems assist surgeons in precisely placing surgical instruments relative to a patient's anatomy.
- Surgeries in which navigation systems are used include neurosurgery and orthopedic surgery. Often the instrument and the anatomy are tracked together with their relative movement shown on a display.
- the navigation system may display the instrument moving in conjunction with a preoperative image or an intraoperative image of the anatomy.
- Navigation systems often employ optical transmission means to track the pose of the instrument and anatomy.
- Optical navigation systems are widely used due to the accuracy of such systems.
- Prior art optical navigation systems typically include optical trackers attached to the instrument and to the anatomy and a localization camera that includes one or more optical sensors for detecting light from the optical trackers.
- the optical trackers often include light emitting diodes (LEDs) that periodically transmit light to the optical sensors to enable the localization camera to determine the position of the LEDs.
- LEDs light emitting diodes
- the positions of the LEDs on the instrument tracker typically correlate to the coordinates of a working end of the instrument relative to a camera coordinate system.
- the positions of the LEDs on the anatomy tracker(s) typically correlate to the coordinates of a target area of the anatomy in three-dimensional space relative to the camera coordinate system.
- the position and/or orientation of the working end of the instrument relative to the target area of the anatomy can be tracked and displayed.
- Two-way communication is often needed between the camera and instrument trackers for synchronization, command, control, and data exchange. This two-way communication must be low latency and deterministic for system accuracy and stability.
- optical trackers have been equipped with sensors, such as gyroscopes and accelerometers. These sensors are sometimes used to generate data relating to the rotational and translational movement of the instrument or the anatomy. Communication of such data to the localization camera requires high bandwidth. To accommodate high bandwidth transmission, prior techniques have connected the trackers to the localization camera system using a cable physically connected between each tracker and the localization camera.
- RF communication is faster than IR communication
- RF communication is not as robust as IR communication.
- RF communication is often subject to electromagnetic interference from nearby devices or objects.
- RF communication often occurs over networks such as Wi-Fi, which are subject to significant latency.
- using RF communication in a bi-directional fashion consumes much bandwidth due to the time required to switch communication directions.
- Certain types of RF communication, such as Bluetooth often require many steps for pairing devices. Even when paired, such RF communication methods are commonly affected by pairing errors. Therefore, RF communication, alone, is also not well suited to communicate data wirelessly to the localization camera in a high-speed, low latency, and deterministic fashion.
- the navigation system comprises a tracker configured to couple to the object and a localization device configured to track the tracker.
- the tracker and the localization device are configured to wirelessly communicate using a first communication method operable on a first spectrum and to wirelessly communicate using a second communication method operable on a second spectrum different from the first spectrum.
- the localization device is configured to utilize the first communication method to track the object and to utilize the first communication method to manage an operating parameter of the tracker with respect to the second communication method.
- the navigation system comprises a tracker configured to couple to the object and a localization device configured to track the tracker.
- the tracker and the localization device are configured to wirelessly communicate using a first communication method operable on a first spectrum and to wirelessly communicate using a second communication method operable on a second spectrum different from the first spectrum.
- the method comprises utilizing, with the localization device, the first communication method to track the object.
- the method comprises utilizing, with the localization device, the first communication method to manage an operating parameter of the tracker with respect to the second communication method.
- the navigation system comprises a tracker including an RF transmitter, an IR receiver, and one or more tracking markers and with the navigation system comprising a localization device including an RF receiver, an IR transmitter, and one or more tracking sensors.
- the method comprises detecting a position of the one or more tracking markers of the tracker with the one or more tracking sensors of the localization device using IR communication.
- the tracker generates data.
- the IR transmitter of the localization device communicates with the IR receiver of the tracker for managing an operating parameter of the tracker with respect to RF communication.
- the RF receiver of the localization device wirelessly receives the data generated by the tracker and transmitted by the RF transmitter of the tracker using RF communication in accordance with the operating parameter of the tracker managed using IR communication.
- the systems, methods and techniques described herein for the above embodiments address issues of the prior art by providing high-speed, low latency and deterministic communication between the localization device and tracker, thereby improving system accuracy and stability.
- the techniques utilize two different communication methods for wirelessly communicating with the tracker without requiring a cable physically connected between the tracker and the localization device. In turn, the surgical workspace is less cluttered by cables.
- the techniques described herein free-up bandwidth for the second communication method. Freeing up bandwidth for the second communication method enables high-speed wireless transmission of data between the localization device and the tracker. Such data can be, for example, sensor data, which often requires much bandwidth.
- the systems, methods and techniques described herein for the above embodiments exploit the advantages of different communication methods to provide robust command and control to wireless trackers that are being tracked by the localization device as well as a high-speed, low latency method of reporting data back the localization device.
- the navigation system comprises a tracker including an IR transmitter, an IR receiver, one or more tracking markers, and one or more inertial sensors configured to generate inertial data.
- the navigation system comprises a localization device including an IR receiver, an IR transmitter, and one or more tracking sensors.
- the localization device is configured to utilize IR communication according to a first modulation method to detect a position of the one or more tracking markers of the tracker with the one or more tracking sensors and to utilize IR communication according to the first modulation method to communicate, using the IR transmitter, with the IR receiver of the tracker to manage an operating parameter of the tracker.
- the localization device is configured to utilize IR communication according to a second modulation method different from the first modulation method to wirelessly receive, with the IR receiver, the inertial data generated by the tracker and transmitted by the IR transmitter of the tracker in accordance with the managed operating parameter of the tracker.
- the navigation system comprises a tracker including an IR transmitter, an IR receiver, one or more tracking markers, and one or more inertial sensors.
- the navigation system comprises a localization device including an IR receiver, an IR transmitter, and one or more tracking sensors.
- the method comprises utilizing IR communication according to a first modulation method for detecting a position of the one or more tracking markers of the tracker with the one or more tracking sensors of the localization device.
- the method comprises generating inertial data with the one or more inertial sensors of the tracker.
- the method comprises utilizing IR communication according to the first modulation method for communicating, using the IR transmitter of the localization device, with the IR receiver of the tracker for managing an operating parameter of the tracker.
- the method comprises utilizing IR communication according to a second modulation method different from the first modulation method for wirelessly receiving, with the IR receiver of the localization device, the inertial data generated by the tracker and transmitted by the IR transmitter of the tracker in accordance with the managed operating parameter of the tracker.
- the systems, methods and techniques described herein for the above embodiments address issues of the prior art by providing high-speed, low latency and deterministic communication between the localization device and tracker, thereby improving system accuracy and stability.
- the techniques utilize two different modulation methods for wirelessly communicating with the tracker without requiring a cable physically connected between the tracker and the localization device. In turn, the surgical workspace is less cluttered by cables.
- the techniques described herein free-up bandwidth on the communication spectrum. Freeing up bandwidth enables high-speed wireless transmission of data between the localization device and the tracker. Such data can be, for example, sensor data, which often requires much bandwidth.
- the systems, methods and techniques described herein for the above embodiments exploit the advantages of different modulation methods to provide robust command and control to wireless trackers that are being tracked by the localization device as well as a high-speed, low latency method of reporting data back the localization device.
- FIG. 1 is a perspective view of one example of a navigation system including a localization device for wirelessly tracking a plurality of objects using trackers.
- FIG. 2 is a block diagram of the navigation system of FIG. 1 wherein the localization device and the trackers comprise components for implementing hybrid IR/RF communication and control.
- FIG. 3 is a method sequence diagram illustrating events/transmissions performed by the localization device and/or the tracker in accordance with hybrid communication techniques described herein.
- FIG. 4 is a method sequence diagram illustrating events/transmissions performed by the localization device and/or the tracker in accordance with one example of a hybrid IR/RF communication technique described herein.
- FIG. 5A is a block diagram of the localization device and the tracker and components thereof according to one example wherein the localization device is implementing spatial diversity techniques for receiving RF transmissions from the tracker.
- FIG. 5B is a block diagram of FIG. 5A wherein the localization device is further implementing spectrum diversity techniques for receiving RF transmissions from the tracker.
- FIGS. 6 and 7 are method sequence diagrams illustrating events/transmissions performed by the localization device and/or the tracker in accordance with dual modulation communication techniques.
- the navigation system 20 is shown in a surgical setting such as an operating room of a medical facility.
- the navigation system 20 is configured to track movement of various objects in the operating room.
- objects include, for example, an anatomy (e.g., femur and tibia) of a patient, an instrument 22 , such as a surgical instrument, a pointer (P) instrument, a robotic manipulator base 58 , or any other component or subject of a surgical system.
- the navigation system 20 tracks these objects for purposes such as controlling the instrument 22 , and in some cases, controlling or constraining movement of the instrument 22 relative to a predefined path or anatomical boundary.
- the navigation system 22 may display a tracked position and orientation of the object to the surgeon.
- the instrument 22 is an end effector of a robotic manipulator 56 .
- the instrument 22 of the robotic manipulator 56 may be used for cutting away material from a patient's anatomy, such as bone or soft tissue.
- a patient's anatomy such as bone or soft tissue.
- the navigation system 20 and robotic manipulator 56 , and techniques for controlling the instrument 22 can be like those described in U.S. patent application Ser. No. 15/840,278, entitled “Techniques for Modifying Tool Operation in a Surgical Robotic System Based on Comparing Actual and Commanded States of the Tool Relative to a Surgical Site,” the entire disclosure of which is hereby incorporated by reference in its entirety.
- the instrument 22 has a cutting tool that is movable in three degrees of freedom relative to a handheld housing and is manually positioned by the hand of the surgeon, without the aid of cutting jig, guide arm or other constraining mechanism, such as a manipulator or robot.
- a surgical instrument is described in U.S. patent application Ser. No. 13/600,888, entitled “Surgical Instrument Including Housing, a Cutting Accessory that Extends from the Housing and Actuators that Establish the Position of the Cutting Accessory Relative to the Housing”, hereby incorporated by reference.
- the instrument 22 can be used to prepare bone for surgical implants such as hip and knee implants, including unicompartmental, bicompartmental, or total knee implants. Some of these types of implants are shown in U.S. patent application Ser. No. 13/530,927, entitled, “Prosthetic Implant and Method of Implantation”, the disclosure of which is hereby incorporated by reference.
- the navigation system 20 includes a computer cart assembly 24 that houses a navigation computer 26 .
- One or more navigation interfaces are in operative communication with the navigation computer 26 .
- the navigation interfaces include a display 28 adapted to be situated outside of the sterile field and a display 29 adapted to be situated inside the sterile field.
- the displays 28 , 29 are adjustably mounted to the computer cart assembly 24 .
- One or more input devices 30 can be used to input information into the navigation computer 26 or otherwise select/control certain aspects of the navigation computer 26 .
- the input device 30 is a touchscreen device.
- other input devices 30 are fully contemplated, such as a mouse, keyboard, voice-activation device, gesture control device, etc.
- the navigation system 20 may include a camera unit 36 for facilitating wireless reception/transmission of signals for localization/tracking.
- the camera unit 36 has an outer casing 38 that houses various components, as will be described below.
- the computer cart assembly 24 , display 28 , and camera unit 36 may be like those described in U.S. Pat. No. 7,725,162 to Malackowski, et al. issued on May 25, 2010, entitled “Surgery System”, hereby incorporated by reference.
- the navigation system 20 includes a localization device 34 and one or more trackers 44 , 46 , 48 , 49 , PT.
- the trackers 44 , 46 , 48 , 49 , PT are configured to couple to, attach to, or otherwise be integrated with the object being tracked.
- the navigation system 20 uses the localization device 34 to track the position and/or orientation of one or more of the trackers 44 , 46 , 48 , 49 . PT.
- the navigation system 20 is able to track the respective object by tracking the position and/or orientation of the respective tracker 44 , 46 , 48 , 49 . PT.
- the localization device 34 communicates with the navigation computer 26 .
- position and orientation signals, control signals, and/or data are transmitted to/from the navigation computer 26 from/to the trackers 44 , 46 , 48 , 49 , PT for purposes of tracking the objects.
- the navigation computer 26 can be a personal computer or laptop computer.
- Navigation computer 26 has a central processing unit (CPU) and/or other processors as well as non-transitory computer memory.
- the navigation computer 26 may be loaded with software modules, as described below.
- the software modules convert the signals received from the camera unit 36 into data representative of the position and/or orientation of the objects being tracked.
- one tracker 44 is coupled to the femur of the patient and another tracker 46 is coupled to the tibia of the patient.
- Trackers 44 , 46 may be firmly affixed to sections of bone. Trackers 44 , 46 may be attached to the bone in the manner shown in U.S. Pat. No. 7,725,162, hereby incorporated by reference.
- an additional tracker (not shown) is coupled to the patella to track a position and orientation of the patella.
- the trackers 44 , 46 could be mounted to other tissue types or parts of the anatomy.
- An instrument tracker 48 may be coupled to the instrument 22 .
- the instrument tracker 48 may be integrated into the instrument 22 during manufacture or may be separately mounted to the instrument 22 in preparation for a procedure.
- a working end of the instrument 22 may be the subject of tracking, and may be a rotating bur, sagittal saw, electrical ablation device, or the like.
- Tracker 49 may be coupled a base 58 of the robotic manipulator 56 .
- the base 58 is generally a portion of the robotic manipulator 56 that is stationary during usage thereby providing a fixed reference coordinate system (i.e., a virtual zero pose) for other components of the robotic manipulator 56 or the system in general.
- the base 58 may be defined with respect to a manipulator cart 59 , such as where the robotic manipulator 56 is physically attached to the cart 59 .
- Examples of a tracker for the base 58 of the robotic manipulator 56 can be like those described in U.S.
- a tracker PT may be coupled to a pointer instrument P, such as disclosed in U.S. Pat. No. 7,725,162 to Malackowski, et al., hereby incorporated by reference.
- the pointer instrument P may be used to map the anatomy coordinate system to pre-operative images for registration purposes.
- any of the trackers 44 , 46 , 48 , 49 . PT can be self-powered with an internal power supply or may receive power through the host object, if available. Trackers other than the trackers 44 , 46 , 48 , 49 , PT specifically shown in the figures are fully contemplated. Such other trackers may be provided for purposes of tracking any object other than those shown in FIG. 1 . For example, such objects may be objects to be avoided during surgery.
- the localization device 34 and the trackers 44 , 46 , 48 , 49 , PT are in wireless communication with one another.
- any data/signals transmitted to the localization device 34 from any of the trackers 44 , 46 , 48 , 49 , PT, or vice-versa are transmitted wirelessly, without cable connection between the localization device 34 and the trackers 44 , 46 , 48 , 49 , PT.
- wired, cable connection may be utilized in addition to wireless communication.
- the localization device 34 includes tracking sensors 40 for tracking the respective positions of the trackers 44 , 46 , 48 , 49 , PT.
- the tracking sensors 40 are embodied by the camera unit 36 .
- the camera unit 36 includes one or more tracking sensors 40 .
- the tracking sensors 40 are configured to detect the position of tracking markers 50 of the respective trackers 44 , 46 , 48 , 49 , PT.
- the camera unit 36 may include any number of tracking sensors 40 . In some embodiments, at least two tracking sensors 40 are employed.
- the tracking sensors 40 may be separate high-resolution charge-coupled devices (CCD). In one embodiment three, one-dimensional CCDs are employed. In other embodiments, separate camera units, each with a separate CCD, or two or more CCDs, could also be arranged around the operating room.
- the tracking sensors 40 may be positioned in areas other than on the camera unit 36 .
- the tracking sensors 40 are optical sensors, and more specifically, IR sensors. Each of the tracking sensors 40 is configured to detect IR signals through the IR spectrum.
- the localization device 34 may comprise configurations or devices for detecting IR signals for tracking purposes using devices other than optical sensors or CCDs.
- the camera unit 36 may be mounted on an adjustable arm to position the tracking sensors 40 above a zone in which the procedure is to take place to provide the camera unit 36 with a field of view that is ideally free from obstructions. An unobstructed field of view helps the camera unit 36 detect trackers 44 , 46 , 48 , 49 without interference.
- the localization device 34 and components thereof, may be embodied in a configuration physically and functionally different from that shown in FIG. 1 .
- the trackers 44 , 46 , 48 , 49 , PT may include one or more tracking markers 50 .
- the tracking markers 50 may be passive, active, or combinations thereof.
- the tracking sensors 40 of the localization device 34 receive reflected or radiated light signals from tracking markers 50 of any of the trackers 44 , 46 , 48 , 49 , PT for tracking the same. Any number of tracking markers 50 may be utilized for any given tracker 44 , 46 , 48 , 49 , PT.
- Examples of active tracking markers 50 include, but are not limited to IR emitters, e.g., IR emitting LEDs, or the like. In one embodiment, at least three active tracking markers 50 are used for a tracker. The active tracking markers 50 may be sequentially fired, for transmitting light signals to the tracking sensors 40 .
- Examples of passive tracking markers 50 include reflective elements to reflect light radiated from the tracking sensors 40 , or the like. The reflected light is then received by the tracking sensors 40 for tracking purposes.
- the tracking sensors 40 may have sampling rates in excess of 100 Hz, 300 Hz, or 500 Hz. In some embodiments, the tracking sensors 40 have sampling rates of 1000 Hz.
- the sampling rate is the rate at which the tracking sensors 40 receive light signals from sequentially fired tracking markers 50 .
- the signals from the tracking markers 50 may be fired at different rates for each tracker.
- IR signals can be sent every frame or frame groups (e.g., every 10 frames) for higher localization rates.
- the tracker 48 and the localization device 34 are configured to wirelessly communicate using a first communication method or link.
- the term “communication method” refers to a type of communication as defined by the electromagnetic spectrum.
- the electromagnetic spectrum includes a radio (wave) spectrum defined approximately between 3 Hz to 300 MHz, a microwave spectrum defined approximately between 300 MHz to 300 GHz, an infrared spectrum defined approximately between 300 GHz and 430 THz, etc.
- the first communication method is operable on one of these spectrums.
- the first communication method may comprise radio frequency (RF) communication, microwave communication, or infrared (IR) communication.
- the first communication method comprises IR communication such that the tracker 48 and the localization device 34 wirelessly communicate using IR communication.
- the tracker 48 and the localization device 34 are equipped with components to enable IR communication.
- the first communication method is other than IR (as will be described below)
- the tracker 48 and the localization device 34 may be alternatively, or additionally be equipped with components to enable such other methods of communication.
- the localization device 34 may comprise one or more IR receivers 90 (IR Rx), which may be housed by a camera unit 36 , as shown in FIGS. 1 and 2 .
- the IR receiver 90 may located in areas other than on the camera unit 36 .
- the IR receiver 90 enables IR communication with the tracker 48 .
- the IR receiver 90 is configured to wirelessly receive IR signals and data from the tracker 48 over the IR spectrum.
- the IR receiver 90 may comprise Light Emitting Diode (LED) IR detectors, photodetectors, and the like.
- LED Light Emitting Diode
- the localization device 34 may include an IR transmitter 98 (IR Tx) for transmitting signals or data using IR communication.
- the IR transmitter 98 may be housed by the camera unit 36 or may be located elsewhere.
- the IR transmitter 98 is configured to wirelessly transmit IR signals to the tracker 48 over the IR spectrum.
- the IR transmitter 98 may comprise one or more IR emitters, such as IR emitting LEDs, or the like.
- the IR transmitter 98 may include any number of IR emitters.
- the IR receiver 90 and the IR transmitter 98 are embodied as separated devices. Alternatively, the IR receiver 90 and the IR transmitter 98 may be combined into a single IR transceiver that performs all IR transmission and IR reception for the localization device 34 .
- the tracking sensors 40 may supplement or implement the IR receiver 90 . Moreover, the IR receiver 90 may supplement the tracking sensors 40 for tracking the position of the tracker 48 .
- IR communication with the localization device 34 may be enabled by providing the tracker 48 with an IR transmitter 51 (IR Tx) and an IR receiver 80 (IR Rx).
- the IR transmitter 51 and IR receiver 80 are coupled to, attached to, or otherwise integrated with the tracker 48 .
- the IR receiver 80 of the tracker 48 is configured to wirelessly receive IR signals from the IR transmitter 98 of the localization device 34 over the IR spectrum.
- the IR receiver 80 of the tracker 48 may include one or more optical sensors, such as LED IR detectors, photodetectors, CCDs, or the like.
- the IR receiver 80 of the tracker 48 may comprise configurations for detecting IR signals other than tracking sensors 40 or CCDs.
- the IR transmitter 51 of the tracker 48 is configured to wirelessly transmit IR signals to the IR receiver 90 of the localization device 34 over the IR spectrum.
- the IR transmitter 51 of the tracker 48 may comprise one or more IR emitters, such as IR emitting LEDs. or the like.
- the IR transmitter 51 may include any number of IR emitters.
- the active tracking markers 50 may supplement or implement the IR transmitter 51 .
- the IR transmitter 51 is connected to a tracker controller 62 located in a housing (not shown) of the associated tracker 48 .
- the tracker controller 62 may comprise any suitable microcontroller, processor, integrated circuits, and the like, for executing functionality of the tracker 48 described herein.
- the tracker controller 62 may be coupled to a tracker memory, which may store data related to the tracker 48 , and software instructions, which may be executed by the tracker controller 62 .
- Pairing between the localization device 34 and the tracker 48 can be performed using IR communication. Such pairing can be done automatically and in a robust fashion, because IR signals remain in the general area in which they are transmitted. IR communication between the localization device 34 and the tracker 48 can be master-slave, time synchronized, or a combination of both.
- the tracker 48 and the localization device 34 are configured to wirelessly communicate using a second communication method or link.
- the second communication method is similarly a type of communication as defined by the electromagnetic spectrum.
- the second communication method is different from the first communication method.
- the second communication method is operable on a second spectrum different from the first spectrum of the first communication method.
- the second communication method can be RF communication or microwave communication.
- the first communication method is RF communication
- the second communication method can be IR communication or microwave communication, etc.
- the navigation system 20 employs a multi or hybrid form of communication between the tracker 48 and the localization device 34 .
- any of the communication methods described herein may include various channels operable on the respective spectrum.
- IR communication may occur on any one of a plurality of selectable IR channels on the IR spectrum
- RF communication may occur on any one of a plurality of selectable RF channels on the RF spectrum
- microwave communication may occur on any one of a plurality of selectable microwave channels on the microwave spectrum.
- the channels for any given communication method are distinguished from one another by different frequencies within the respective spectrum. Examples of how these selectable channels may be utilized are described below.
- the second communication method comprises RF communication.
- the tracker 48 and the localization device 34 also wirelessly communicate using RF communication.
- the tracker 48 and the localization device 34 are equipped with components to enable RF communication over the RF spectrum.
- the localization device 34 may include an RF transmitter 94 (RF Tx) and an RF receiver 96 (RF Rx).
- the RF transmitter 94 is configured to wirelessly transmit RF signals to the tracker 48 over the RF spectrum.
- the RF receiver 96 is configured to wirelessly receive RF signals from the tracker 48 over the RF spectrum.
- the RF transmitter and receiver 94 , 96 may utilize one or more antennas 112 ( FIG. 5 ) to propagate and/or receive RF signals.
- the RF transmitter and receiver 94 , 96 are embodied as separated devices.
- the RF transmitter and receiver 94 , 96 may be combined into a single RF transceiver that performs all RF transmission and reception for the localization device 34 .
- the RF transmitter and receiver 94 , 96 may be configured to communicate according to any suitable frequency or frequency range within the RF spectrum, such as frequencies in excess of 2.4 GHz.
- the RF transmitter and receiver 94 , 96 may be housed by the camera unit 36 , as shown in FIG. 1 . Because RF communication is not sensitive to line-of-sight issues like IR communication, the RF transmitter and receiver 94 , 96 may be provided at locations other than at the camera unit 36 . For instance, the RF transmitter and receiver 94 , 96 may be coupled to the cart 24 , and/or may be remotely coupled to the navigation computer 26 using any suitable wireless or wired connection.
- RF communication may be enabled by providing the tracker 48 with an RF transmitter 74 (RF Tx) and an RF receiver 76 (RF Rx), as shown in FIG. 2 .
- the RF transmitter 74 and RF receiver 76 are coupled to, attached to, or otherwise integrated with the tracker 48 .
- the RF transmitter 74 of the tracker 48 is configured to wirelessly transmit RF signals to the localization device 34 over the RF spectrum.
- the RF receiver 76 of the tracker 48 is configured to wirelessly receive RF signals from the localization device 34 over the RF spectrum.
- the RF transmitter and receiver 74 , 76 of the tracker 48 may utilize one or more antennas 110 ( FIG. 5 ) to propagate and/or receive RF signals.
- the RF transmitter and receiver 74 , 76 are embodied as separated devices.
- the RF transmitter and receiver 74 , 76 may be combined into a single RF transceiver that performs all RF transmission and reception for the tracker 48 .
- the RF transmitter and receiver 74 , 76 of the tracker 48 may be configured to communicate according to any suitable frequency or frequency range within the RF spectrum.
- such RF communication between the tracker 48 and the localization device 34 may be uni-directional (i.e., from the tracker 48 to the localization device 34 ) or may be bi-directional. Aspects of command, control, and other data exchange between the tracker 48 and the localization device 34 using wireless RF communication are described in detail below.
- components of IR and RF communication have been described above, it should be understood that components for the tracker 48 and the localization device 34 for enabling microwave communication are fully contemplated, and such components include, but are not limited to microwave transmitters, microwave receivers, and microwave antennas.
- the localization device 34 includes a camera controller 42 in communication with and configured to control the tracking sensors 40 , IR receiver and transmitter 90 , 98 and the RF transmitter and receiver 94 , 96 of the localization device 34 .
- the camera controller 42 is configured to process IR signals received by the tracking sensors 40 and/or IR receiver 90 , and to instruct transmission of IR signals from the IR transmitter 98 .
- the camera controller 42 is configured to process RF signals received by the RF receiver 96 , and to instruct transmission of RF signals from the RF transmitter 94 .
- the camera controller 42 may comprise a separate controller disposed remote from the localization device 34 in instances where the RF transmitter and receiver 94 , 96 are remotely located.
- the camera controller 42 may communicate with any of the aforementioned components of the localization device 34 using wired or wireless connection. In other embodiments, the aforementioned components may communicate directly with the navigation computer 26 .
- the camera controller 42 communicates with the navigation computer 26 using wired or wireless connection.
- One such connection may be an IEEE 1394 interface, which is a serial bus interface standard for high-speed communications and isochronous real-time data transfer. Connection may also use a company specific protocol.
- the tracker 48 comprises one or more sensors configured to generate data.
- the sensors are inertial sensors embodied as one or more gyroscope sensors 60 and/or one or more accelerometers 70 .
- Other types of inertial sensors may be utilized. Examples of inertial sensors and uses for the same can be like those described in U.S. Pat. No. 9,008,757, entitled “Navigation System Including Optical and Non-optical Sensors,” the entire disclosure of which is hereby incorporated by reference in its entirety.
- the gyroscope sensors 60 may be 3-dimensional gyroscope sensors that measure angular velocities of the tracker 48 .
- the gyroscope sensors 60 output readings indicative of the angular velocities relative to x-, y-, and z-axes of a gyroscope coordinate system. These measurements can then be converted to an angular velocity vector defined in radians/second.
- the accelerometers 70 may be 3-axis accelerometers that measure acceleration along each of x-, y-, and z-axes of an accelerometer coordinate system.
- the angular velocities measured by the gyroscope sensors 60 and the accelerations measured by the accelerometers 70 provide additional kinematic data for the navigation system 20 to further facilitate tracking of the tracker 48 .
- the tracker 48 additionally, or alternatively, may include sensors configured to perform tissue identification, e.g., when coupled to the anatomy.
- the generated data related to the identified tissue may be transmitted back to the localization device 34 .
- Other examples of sensors that may be included with the tracker 48 include, but are not limited to, any one or more of camera/imaging/endoscopic sensors for visual object detection, biological sensors, bone density sensors, electromyography (EMG) sensors, nerve sensory sensors, ultrasonic sensors, electromagnetic sensors, environmental sensors (e.g., temperature, humidity, etc.), impedance, voltage, current sensors, pressure sensors, or the like.
- Data generated from any of the sensors is herein referred to as “sensor data” may be transmitted back to the localization device 34 from the tracker 48 .
- the sensors may be utilized for navigation, anatomical registration, verification, calibration, instrument 22 control purposes, or the like.
- the sensor data transmitted by the tracker 48 may be generated by the tracker 48 itself or data otherwise received by the tracker 48 from an external source, e.g., a sensor external to and remotely communicating with the tracker 48 .
- the localization device 34 is configured to wirelessly receive the sensor data from the tracker 48 using one of the communication methods described herein.
- the sensor data may be transmitted using RF communication such that the RF receiver 96 of the localization device 34 is configured to receive sensor data wirelessly from the RF transmitter 74 of the tracker 48 .
- the navigation computer 26 includes a navigation processor 52 .
- the camera unit 36 receives signals from the tracking sensors 40 and outputs to the navigation processor 52 signals relating to the position of the tracking markers 50 of the tracker 48 relative to the localization device 34 .
- the RF receiver 94 receives data measured by the gyroscope sensors 60 and accelerometers 70 , and outputs to the processor 52 signals relating to the measured angular velocities and/or accelerations. Based on the received IR and RF signals, navigation processor 52 generates data indicating the relative positions and orientations of the tracker 48 relative to the localization device 34 .
- the navigation processor 52 can include one or more processors to control operation of the navigation computer 26 .
- the processors can be any type of microprocessor or multi-processor system.
- the term processor is not limited to a single processor.
- navigation processor 52 Prior to the start of a surgical procedure, additional data may be loaded into the navigation processor 52 . Based on the position and orientation of the tracker 48 and the previously loaded data, the navigation processor 52 may determine, for example, the position of the working end of the instrument 22 and the orientation of the instrument 22 relative to the tissue against which the working end is to be applied. In some embodiments, navigation processor 52 forwards these data to a manipulator controller 54 . The manipulator controller 54 can then use the data to control the robotic manipulator 56 as described in U.S. patent application Ser. No. 13/958,834, entitled, “Navigation System for use with a Surgical Manipulator Operable in Manual or Semi-Autonomous Mode”, the disclosure of which is hereby incorporated by reference.
- the navigation processor 52 may include software modules such as a localization engine 100 and a coordinate transformer 102 . These software modules 100 , 102 collaborate to process the signals transmitted according to the first and second communication methods (e.g., IR and RF) to transform coordinate systems of the tracker 48 , and consequently the object being tracked, into a coordinate system of the localization device 34 for purposes such as determining relative position of the instrument 22 working end to the surgical site (e.g., the bone of the patient). Other signals representative of this data can be forwarded to the manipulator controller 54 from the navigation processor 52 to control the manipulator 56 and corresponding movement of the instrument 22 .
- the first and second communication methods e.g., IR and RF
- the navigation processor 52 may also process and generate image signals that indicate the relative position of the instrument 22 working end to the surgical site. These image signals may be transmitted to the displays 28 , 29 . The displays 28 , 29 , based on these signals, generate images that enable the surgeon and staff to view the position of the instrument 22 working end relative to the surgical site.
- Examples of transformation techniques relating to coordinate systems of trackers 48 , the object being tracked, and the localization device 34 can be like those described in U.S. Pat. No. 9,008,757, entitled “Navigation System Including Optical and Non-optical Sensors,” the entire disclosure of which is hereby incorporated by reference in its entirety.
- the localization device 34 and the tracker 48 communicate using the first and second communication methods.
- the techniques herein provide high-speed, low latency communication by exploiting the first communication method for primary tracking and control and the second communication method for high-bandwidth data transmission.
- the system 20 is optimized to take advantage of the individual benefits of both communication methods to solve overall system issues that are not met by using either communication method on its own.
- FIG. 3 is a method sequence diagram illustrating events/transmissions performed by the localization device 34 and/or the tracker 48 using the two different methods of communication. It should be understood that the sequence of steps shown in FIG. 3 are illustrative and are not limited specifically to the order shown, but rather may occur in a different order depending on a given situation.
- the localization device 34 and the tracker 48 are operable according to the first and second communication methods (demarcated by dashed lines). Such dual communication may be concurrent or non-concurrent.
- the localization device 34 is configured to utilize the first communication method to track the tracker 48 .
- the localization device 34 may employ communication on the first spectrum to obtain a position of the tracker 48 , using any suitable tracking technique, such as those described above.
- the localization device 34 further utilizes the first communication method to transmit a command signal to configure operation of the tracker 48 with respect to the second communication method.
- Such cross-communication configurations are represented generally at 204 . As will be described below, these configurations dictate how the tracker 48 may behave with respect to the second communication method.
- the first communication method is utilized as the primary control and configuration channel for transmissions occurring with second communication method.
- the second communication method is utilized to provide a one-way secondary channel to transmit high bandwidth information from the tracker 48 to the localization device 34 , as shown at 206 .
- the second communication method in a uni-directional mode, the time required to switch directions is eliminated and greater bandwidth is achieved. In other words, control/configuration of the tracker 48 with respect to the second communication method is accomplished without requiring the localization device 34 to utilize the second communication method for control/configuration.
- Transmission with the second communication method between the localization device 34 and tracker 48 may be bi-directional, while still realizing the advantages provided by hybrid communication control.
- FIG. 4 is a method sequence diagram illustrating events/transmissions performed by the localization device 34 and/or the tracker 48 , wherein the first communication method is more specifically IR communication and the second communication method is more specifically RF communication.
- the techniques described with respect to FIG. 4 primarily focus on IR and RF communication for implementing hybrid control, the disclosure can be equivalently applied to microwave communication, which can substitute either IR or RF communication as a communication method. Again, the steps shown in FIG. 4 are not limited to the sequences shown.
- the localization device 34 and the tracker 48 are operable according to the IR communication and RF communication.
- the localization device 34 is configured to utilize the IR communication to track the tracker 48 , using, e.g. the IR tracking techniques described above.
- the tracking sensors 40 of the localization device 34 obtain a position of the tracker 48 from the tracking markers 50 of the tracker 48 through the IR spectrum.
- IR signals received by the tracking sensors 40 of the localization device 34 are passed to the navigation computer 26 for object detection processing, as described.
- the localization device 34 For IR communication related to configuration/control, the localization device 34 utilizes the IR receiver 90 and the IR transmitter 98 and the tracker 48 utilizes the IR receiver 80 and the IR transmitter 51 . Thus, the localization device 34 may further utilize IR communication to communicate IR control signals to the tracker 48 .
- the IR transmitter 98 of the localization device 34 may communicate the IR control signals 304 to the IR receiver 80 of the tracker 48 to manage operation of the tracker 48 with respect to IR communication.
- the localization device 34 may initialize the tracker 48 , configure the appropriate IR channel for the tracker 48 , and/or control and command transmissions from the tracking markers 50 of the tracker 48 (as represented by loop 306 ).
- the IR control signal 304 may dictate sequential firing of IR emitters of the tracker 48 , if present.
- the tracker 48 may transmit IR signals from the IR transmitter 51 to the IR receiver 90 of the localization device 34 for certain communication/control purposes.
- the tracker 48 is configured to utilize the IR transmitter 51 for both communication as well as tracking.
- the localization device 34 may also use the IR control signal 304 to manage IR transmissions from the IR transmitter 51 of the tracker 48 (as represented by loop 307 ).
- IR communication from the tracker 48 may include operational status data of the tracker 48 , identification data, calibration data, or any operational parameters of the tracker 48 that may be utilized, e.g., for synchronization or coordination with the localization device 34 .
- the IR transmitter 51 of the tracker 48 sends an IR control signal back to the IR receiver 90 of the localization device 34 .
- IR communication between the tracker 48 and localization device 34 for communication/control occurs on a first IR channel (IR channel 1 ) operating on a first frequency or frequency range.
- signal transmission for tracking the tracker 48 occurs on a second IR channel (IR Channel 2 ) operating on a second frequency or frequency range that is different than IR Channel 1 .
- the IR channel used for localization and the IR channel used for control/communication are different. These IR channels may be on different frequencies of the IR spectrum to avoid signal interference and to provide a more robust communication link. Alternatively, IR communication and tracking may occur on the same IR channel by employing, for example, timing schemes for avoiding signal interference.
- IR communication has been utilized by the localization device 34 for two purposes, namely, localization and communication/control of the tracker 48 with respect to IR communication.
- the localization device 34 may further utilize IR communication for a third purpose, i.e., communication/control of the tracker 48 with respect to RF communication.
- the localization device 34 utilizes IR communication to control/configure the tracker 48 with respect RF communication.
- the IR transmitter 98 of the localization device 34 is configured to transmit a control signal 308 to the IR receiver 80 of the tracker for configuring an operating parameter of the tracker 48 with respect to the RF communication.
- these operating parameters dictate how the tracker 48 may behave with respect to RF communication.
- the localization device 34 transmits this control signal 308 for RF communication using IR channel 1 to avoid interference with localization signals on IR channel 2 .
- the control signal 308 for RF communication using any IR channel, including IR channel 1 , as described above.
- Examples of some operating parameters of the tracker 48 that can be configured with the RF control signal 308 are represented at 310 , 312 , 313 and 314 . Operating parameters of the tracker 48 with respect to RF communication other than those described herein are possible and contemplated.
- the operating parameter at 310 manages transmissions from the RF transmitter 74 of the tracker 48 to the RF receiver 96 of the localization device 34 .
- RF timing parameters that may be managed through IR communication include, but are not limited to, transmission time, sequence, duration, interval, start and end times, etc. Such timing parameters may be controlled to synchronize RF communications between the tracker 48 and the localization device 34 .
- the operating parameter 310 manages RF transmission for sensor data being transmitted by the tracker 48 .
- the sensor data transmitted by the tracker 48 may be any data needful of a high bandwidth and low latency wireless link.
- the operating parameter 310 may manage when to transmit sensor data, how long to transmit sensor data, and what/how much sensor data to transmit from the tracker 48 .
- data transmitted by the tracker 48 using RF communication may include, but is not limited to, non-sensor data, such as status data, error data, configuration data, identification data, etc.
- the RF transmitter 74 of the tracker 48 transmits the data to the RF receiver 96 of the localization device 34 .
- the RF receiver 94 receives the inertial data and outputs signals to the processor 52 relating to the measured angular velocities and/or accelerations.
- navigation processor 52 Based on the received IR signals (at 300 , 302 ) and RF signals (at 316 , 318 ), navigation processor 52 generates data indicating the relative positions and orientations of the tracker 48 relative to the localization device 34 for tracking the object.
- RF communication is utilized in a uni-directional fashion to transmit high bandwidth information from the tracker 48 to the localization device 34 .
- RF communication uni-directionally, the time required for switching RF transmission directions between the RF tracker 48 and the localization device 34 is eliminated and greater bandwidth is achieved for RF communications.
- control/configuration of the tracker 48 with respect to the RF communication is accomplished without requiring the localization device 34 to utilize the RF communication for control/configuration.
- the methods described herein, however, are not limited to uni-directional RF transmission, as shown in FIG. 4 . Instead, RF transmission between the localization device 34 and the tracker 48 may be bi-directional, while still realizing the advantages provided by hybrid communication control.
- RF communication direction may be switched (i.e., so that the localization device 34 transmits to the tracker 48 ) when the localization device 34 knows that the tracker 48 is not transmitting data.
- RF communication direction may be switched (i.e., so that the localization device 34 transmits to the tracker 48 ) when the localization device 34 knows that the tracker 48 is not transmitting data.
- Another operating parameter that can be managed with the control signal 308 is a parameter, at 312 , that coordinates RF transmission from the tracker 48 and operation of the tracking markers 50 of the tracker 48 .
- This operating parameter 312 can coordinate wireless transmission of the sensor data from the RF transmitter 74 of the tracker and activation of the active tracking markers 50 .
- the relative sampling rates of the gyroscope sensors 60 and accelerometers 70 and the tracking sensors 40 of the localization device 34 may be established or timed so that for each optical measurement of position there is a corresponding non-optical measurement of angular velocity or acceleration.
- the localization device 34 is configured to receive IR and RF signals from the tracker 48 at known or predictable times to increase tracking accuracy of the object. Return of sensor data from the tracker 48 may be synchronized by IR frame commands.
- the operating parameter at 313 coordinates transmissions from the RF transmitter 74 and the IR transmitter 51 of the tracker 48 .
- IR tracker communication/control signals ( 305 ) transmitted from the tracker 48 may need to be coordinated with respect to the timing of sensor data transmitted by the RF transmitter 74 .
- the localization device 34 may ping the tracker 48 to send coordinated RF and IR signals for confirming proper RF and IR link.
- Other operating parameters of the tracker 48 relative to RF communication that can be controlled by the control signal 308 include RF channel frequency and RF transmission power, as shown at 314 .
- the RF spectrum comprises a plurality of RF channels with each RF channel operating on a different channel frequency.
- the tracker 48 should be tuned or otherwise configured to operate on the RF channel specified by the localization device 34 .
- each separate tracker 48 may operate on a different RF channel specified by the localization device 34 .
- more than one tracker 48 may operate on the same RF channel, and the respective RF transmitter 74 of each tracker 48 can be coordinated to transmit RF signals according to a sequential time-slicing scheme coordinated by the localization device 34 .
- the time-slicing scheme may set a repeating period of time, and each tracker 48 sequentially transmits, in turn, during each period.
- Each tracker 48 may transmit a specified number of times, or for a specified duration during each time slice of the period of time.
- the localization device 34 By sending the control signal 308 , the localization device 34 utilizes IR communication to inform the tracker 48 to select, or otherwise configure the tracker 48 to operate on, the RF channel specified by the localization device 34 . As represented at 314 , the RF transmitter 74 of the tracker 48 then operates at the frequency for the specified RF channel. The RF channel may continue to change depending on, for example, the activation/deactivation of various trackers 48 , etc.
- the control signal 308 may be sent to modify the RF transmission power of the tracker 48 at 314 . More specifically, the operating parameter specifies transmission power of the RF transmitter 74 of the tracker 48 . Transmission power may be modified for various purposes, such as to accommodate changes in RF channel frequency, to increase RF signal strength of the tracker 48 , e.g., when interference is present, to increase battery life of the tracker 48 , etc. Other examples of RF transmission parameters that may be modified using the control signal 308 include, but are not limited to, any variation of effective radiated power, nominal power, signal strength, attenuation, sensitivity, antenna gain, impedance, radiation pattern, and the like. Operating parameters of the tracker 48 with respect to RF communication other than those described herein are possible and fully contemplated.
- operating parameters 310 , 312 , 313 , 314 described above have been discussed in relation to modifying operation of the tracker 48 with respect to RF communication, it should be understood that such operating parameters may control operation of the tracker 48 with respect to a different method of communication if the system 20 is so configured. For instance, if the second method of communication is microwave communication, the operating parameters may control microwave transmission, microwave frequency, microwave channel, etc.
- the system 20 may employ any number of different communication methods greater than two.
- the system 20 may employ IR communication, RF communication and microwave communication.
- the purpose of each communication method can be different from the others, or partially the same as others.
- IR communication may be utilized for localization and configuration/control while RF and microwave communication are utilized for high-bandwidth data transmission.
- IR and RF communication may be utilized for localization and configuration/control while microwave communication is utilized for high-bandwidth data transmission.
- the system 20 may further implement features for maximizing robustness of communication using diversity techniques.
- Diversity techniques include, but are not limited to antenna diversity, spectrum diversity, transmit/receive diversity, time diversity, spatial diversity, frequency diversity, pattern diversity, or any combination thereof. Such techniques are employed to improve the quality and reliability of the wireless link between the tracker 48 and the localization device 34 .
- diversity is utilized for the second communication method, rather than the first communication method used for localization. In another example, diversity is utilized for both the first and second communication methods.
- the system 20 may employ antenna (spatial) diversity for RF communication.
- antenna diversity scheme is illustrated in FIG. 5A .
- Antenna diversity may involve utilizing more than one RF receiver 96 and/or antenna 112 at the localization device 34 to improve the RF wireless link.
- one RF receiver 96 and one antenna 112 may be utilized with a time-slicing scheme, as described above.
- the localization device 34 is equipped with two RF receivers 96 a , 96 b , each having a dedicated antenna 112 a , 112 b , respectively.
- two antennas 112 a , 112 b may be utilized with a common RF receiver 96 , rather than two dedicated RF receivers 96 a . 96 b .
- the antennas 112 a , 112 b are placed at different locations relative to one another such that each antenna 112 a , 112 b can receive RF signals from the tracker 48 according to a different transmission path.
- one antenna 112 a may be placed on the camera unit 36 while the other antenna 112 b is placed elsewhere on the computer cart assembly 24 or even the manipulator cart 59 .
- the camera controller 42 , and/or the navigation processor (controller) 52 are configured to control and operate the RF receivers 96 a , 96 b for implementing diversity techniques.
- the tracker controller 62 instructs the RF transmitter 74 of the tracker 48 to transmit an RF signal S(t) for any purpose, such as for transmitting tracker sensor data, or more specifically inertial data, as described above.
- the RF signal S(t) is transmitted at a first frequency F 1 .
- the RF signal S(t) may be transmitted through a single RF channel.
- the RF signal S(t) propagates through the air at frequency F 1 and reaches each of the antennas 112 a , 112 b at the localization device 34 according to different transmission paths.
- Each of the antennas 112 a , 112 b is configured for the same RF channel for receiving the RF signal S(t) at the first frequency F 1 .
- Each of the RF receivers 96 a , 96 b receive the RF signal, i.e., S(t)′ and S(t)′′ differently because of the different transmission paths and spatial diversity positioning of the antennas 112 a . 112 b .
- One or more of the controllers 42 , 52 processes the RF signals S(t)′ and S(t)′′ and determines which of the RF signals S(t)′ and S(t)′′ are most optimal for downstream tracking determinations.
- One or more of the controllers 42 , 52 selects the optimal one of the RF signals S(t)′ and S(t)′′ that is most representative of the originally transmitted RF signal S(t), and disregards the other.
- the optimal signal S(t) can be processed by the navigation processor 52 to generate data indicating the relative positions and orientations of the tracker 48 relative to the localization device 34 for tracking the object.
- Such antenna diversity techniques may be utilized with any communication method described herein.
- the hybrid control techniques described above may be utilized to control the tracker 48 to implement spatial diversity.
- the localization device 34 may command the tracker 48 using IR communication to repeatedly transmit data according to the first frequency F 1 on the RF channel.
- the operating parameter in this instance may specify the first frequency F 1 for the RF transmitter 74 of the tracker 48 as well as how often to transmit the RF signal at the first frequency F 1 .
- Any of the other operating parameters 310 , 312 , 313 , 314 relating to transmission timing, power, coordination, etc., may be additionally utilized to implement spatial diversity.
- the system 20 exploits the antenna diversity scheme of FIG. 5A by further utilizing spectrum diversity.
- the tracker controller 62 instructs the RF transmitter 74 of the tracker 48 to transmit an RF signal S(t), as described above.
- the RF signal S(t) is transmitted at a first frequency F 1 as well as a second frequency F 2 that is different from the first frequency F 1 .
- the RF signal S(t) carries the same data for transmission. There may be short time delay between transmissions the RF signal S(t) at the two frequencies F 1 , F 2 .
- the tracker 48 may simultaneously transmit these signals.
- the RF signal S(t) at the two frequencies F 1 , F 2 may be transmitted according to two different RF channels.
- Antenna 112 a and receiver 96 a may be configured for one RF channel and antenna 112 b and receiver 96 b may be configured for the second RF channel.
- the RF signals S(t) propagate through the air and the antenna 112 a receives the RF signal S(t) at frequency F 1 and the antenna 112 b receives the RF signal S(t) at frequency F 2 .
- Each of the RF receivers 96 a . 96 b receive a different version of the RF signal, i.e., S(t)′ and S(t)′′ at the respective frequencies F 1 , F 2 .
- One or more of the controllers 42 , 52 processes the RF signals S(t)′ and S(t)′′ and determines which of the RF signals S(t)′ and S(t)′′ are most optimal for downstream processing.
- One or more of the controllers 42 , 52 selects the optimal one of the RF signals S(t)′ and S(t)′′ that is most representative of the originally transmitted RF signal S(t) and disregards the other.
- the optimal signal S(t) can be processed by the navigation processor 52 to generate data indicating the relative positions and orientations of the tracker 48 relative to the localization device 34 for tracking the object.
- spectrum diversity may instead be implemented using one RF receiver 96 and one antenna 112 utilizing a sequential time-slicing scheme, as described above. Such spectrum diversity techniques may be utilized with any communication method described herein.
- the hybrid control techniques described above may be utilized to control the tracker 48 to implement spectrum diversity.
- the localization device 34 may command the tracker 48 using IR communication to transmit data according to the first frequency F on the first RF channel and according to the second frequency F 2 on the second RF channel.
- the operating parameter in this instance specifies the first and second frequencies F 1 , F 2 , for the RF transmitter 74 of the tracker 48 and manages RF transmitter 74 switching between the first and second frequencies F 1 , F 2 to implement spectrum diversity.
- Any of the other operating parameters 310 , 312 , 313 , 314 relating to transmission timing, power, coordination, etc., may be additionally utilized to implement spectrum diversity.
- one or more of the controllers 42 , 52 is configured to operate one of the RF receivers 96 a to receive data wirelessly from the RF transmitter 74 of the tracker 48 and to operate the other one of the RF receivers 96 b to detect availability of, or otherwise evaluate, one or more other RF channels on the RF spectrum.
- Data can be received on one RF channel concurrently while other RF channels are detected or evaluated. If one of the RF channels is occupied, or otherwise exhibits interference above a specified threshold, the localization device 34 can select other RF channels.
- the localization device 34 can command switching of RF transmission to the more optimal RF channel. The RF channel that previously was receiving data can then be utilized to detect and evaluate other RF channels, and so on. Such switching can be implemented by using the command signal 308 transmitted from the localization device 34 on the IR spectrum.
- any number of antennas 112 and receivers 96 can be employed for these various methods. For instance, this technique can be implemented with a single RF receiver 96 and a single antenna 112 with sequential time slicing. Additionally, spatial or spectrum diversity can be implemented by certain receivers 96 while other receivers search for available channels. These techniques can utilized with any one or more of the communication methods described herein, or equivalents thereof.
- the examples above focus on high bandwidth, low latency communication techniques for the navigation system 20 by utilizing communication according to the first spectrum for tracking and configuration control (managing the operating parameter) of the tracker while using the second spectrum for transmitting the tracker sensor data. It is possible to achieve the technical solutions described above for the navigation system 20 by utilizing communication according to an additional or alternative technique, both involving different first and second methods of modulation. These techniques are described in subsections A and B below.
- the systems, methods and techniques described herein address issues of the prior art by providing high-speed, low latency and deterministic communication between the localization device and tracker, thereby improving system accuracy and stability.
- the techniques utilize two different modulation methods for wirelessly communicating with the tracker without requiring a cable physically connected between the tracker and the localization device. In turn, the surgical workspace is less cluttered by cables.
- the techniques described herein free-up bandwidth on the communication spectrum. Freeing up bandwidth enables high-speed wireless transmission of data between the localization device and the tracker. Such data can be, for example, sensor data, which often requires much bandwidth.
- the systems, methods and techniques described herein exploit the advantages of different modulation methods to provide robust command and control to wireless trackers that are being tracked by the localization device as well as a high-speed, low latency method of reporting data back the localization device.
- the first modulation method comprises one of amplitude modulation, frequency modulation, phase modulation, pulse width modulation, pulse position modulation, pulse duration modulation, trellis-coded modulation, and on-off keying modulation. Since the second modulation is different from the first modulation method, the second modulation method comprises a different one of amplitude modulation, frequency modulation, phase modulation, pulse width modulation, pulse position modulation, pulse duration modulation, trellis-coded modulation, and on-off keying modulation.
- the navigation system 20 can utilize variations, or species, of the modulation methods described herein as well as modulation methods that may not expressly be recited herein.
- Communication according to the first modulation method comprises modulating a first carrier signal
- communication according the second modulation method comprises modulating a second carrier signal.
- the carrier signal is a waveform that is modulated according to the methods described herein for conveying data.
- a frequency of the first carrier signal is different from a frequency of the second carrier signal.
- the second carrier frequency may be 10 times, 100 times, 1000 times the first carrier frequency.
- the second modulation method is capable transmitting higher bandwidth as compared with the first communication method.
- the frequency of the first carrier signal may be 1 MHz and the frequency of the second carrier signal may be 10 MHz.
- the frequency of the first carrier signal may be 1 GHz and the frequency of the second carrier signal may be 10 GHz.
- the carrier frequencies described herein are not limiting and other carrier frequencies besides those listed herein may be utilized.
- the navigation system 20 can employ any number of different modulation methods greater than two.
- the navigation system 20 can employ four, six or eight different modulation methods.
- this example further utilizes a first modulation method for communication on the first spectrum while utilizing a second modulation method for communication on the second spectrum.
- the navigation system 20 can utilize communication according to the different spectrums (e.g., IR and RF), as described above, however, the navigation system 20 can further utilize the first modulation method for tracking and configuration control (managing the operating parameter) of the tracker according to communication on the first spectrum, while using a second modulation method for transmitting the tracker sensor data according to communication on the second spectrum.
- the first modulation method for tracking and configuration control managing the operating parameter of the tracker according to communication on the first spectrum
- a second modulation method for transmitting the tracker sensor data according to communication on the second spectrum.
- the localization device 34 and the tracker 48 are operable according to the first and second communication spectrums (demarcated by dashed lines).
- the localization device 34 may employ communication on the first spectrum to obtain a position of the tracker 48 and at 202 , the localization device 34 further utilizes the first communication spectrum to transmit a command signal to configure operation of the tracker 48 .
- steps 200 and 202 occur not only the first spectrum, but also by utilizing the first modulation method.
- the tracker transmits high bandwidth information to the localization device 34 using communication according to communication on the second spectrum.
- step 206 occurs not only the second spectrum, but also by utilizing a second modulation method that is different from the first modulation method.
- the navigation system 20 can utilize communication according to one spectrum (e.g., IR or RF), instead of two different spectrums.
- one spectrum e.g., IR or RF
- high bandwidth, low latency hybrid communication can be implemented by utilizing different modulation methods.
- the navigation system 20 can utilize a first modulation method for tracking and configuration control (managing the operating parameter) of the tracker while using a second modulation method for transmitting the tracker sensor data.
- the first and second modulation methods are different from one another but are employed on the same spectrum of communication.
- the localization device 34 and the tracker 48 communicate according to one communication spectrum.
- the localization device 34 employs communication according to a first modulation method to obtain a position of the tracker 48 (step 200 ) and to transmit a command signal to configure operation of the tracker 48 (at 202 ′, 204 ′).
- the tracker transmits high bandwidth information to the localization device 34 using communication on the same spectrum, but by employing a second modulation method.
- the spectrum is IR communication.
- the navigation system 20 comprises the tracker 44 , 46 , 48 , 49 , PT and the localization device 34 .
- PT includes the IR transmitter 51 , the IR receiver 80 , one or more tracking markers 50 , and one or more sensors configured to generate sensor data.
- the sensors are one or more gyroscope sensors 60 and/or one or more accelerometers 70 configured to generate inertial data.
- the localization device 34 comprises the IR receiver 90 , the IR transmitter 98 , and one or more tracking sensors 40 .
- the localization device 34 is configured to utilize IR communication according to the different first and second modulation methods, as shown.
- the localization device 34 detects (at 300 ) a position of the one or more tracking markers 50 of the tracker 44 , 46 , 48 , 49 , PT with the one or more tracking sensors 40 .
- the localization device 34 also communicates (at 308 ′), using the IR transmitter 98 , with the IR receiver 80 of the tracker to manage an operating parameter of the tracker with respect to IR communication.
- the IR transmitter 98 of the localization device 34 may communicate the IR control signals 304 to the IR receiver 80 of the tracker 48 to manage operation of the tracker 48 with respect to IR communication.
- Step 304 occurs on the IR spectrum using the first modulation method.
- Example functionality of the IR control signals are the same as those described in the previous sections.
- the IR transmitter 51 of the tracker 48 can send an IR control signal back to the IR receiver 90 of the localization device 34 on the IR spectrum using the first modulation method.
- the localization device 34 is configured to wirelessly receive (at 316 ′), with the IR receiver 90 , the inertial data generated by the tracker and transmitted by the IR transmitter 51 of the tracker in accordance with the managed operating parameter of the tracker.
- the spectrum is RF communication.
- the tracker can comprise the RF transmitter 74 and an RF receiver, and the RF receiver and the localization device 34 can comprise the RF receiver 96 and an RF transmitter.
- the tracking sensors 40 can be modified as RF tracking sensors 40 .
- the RF receiver 96 itself can operate as a tracking sensor to track RF tracking markers on the tracker.
- the localization device 34 may be configured to utilize RF communication according to the first modulation method and the second modulation method. By utilizing RF communication according to the first modulation method, the localization device 34 is configured to detect a position of the one or more RF tracking markers of the tracker with the one or more tracking sensors 40 .
- the localization device 34 is further configured to communicate, using the RF transmitter, with the RF receiver of the tracker to manage an operating parameter of the tracker with respect to RF communication.
- the localization device 34 is configured to wirelessly receive, with the RF receiver 96 , the inertial data generated by the tracker and transmitted by the RF transmitter 74 of the tracker in accordance with the managed operating parameter of the tracker.
- IR and RF examples are described above, the different modulation methods can be utilized for any other spectrum of communication described herein.
- the modulation methods can be reversed during operation of the navigation system 20 .
- the navigation system 20 can utilize the first modulation method for tracking and configuration control (managing the operating parameter) of the tracker while using the second modulation method for transmitting the tracker sensor data.
- the navigation system 20 can utilize the second modulation method for tracking and configuration control (managing the operating parameter) of the tracker while using the first modulation method for transmitting the tracker sensor data.
- the different pairs of modulation methods can be employed at different stages. For example, at a first stage, the navigation system 20 can utilize the first modulation method for tracking and configuration control (managing the operating parameter) of the tracker while using the second modulation method for transmitting the tracker sensor data. At a second stage, the navigation system 20 can utilize a third modulation method for tracking and configuration control (managing the operating parameter) of the tracker while using a fourth modulation method for transmitting the tracker sensor data. The third and fourth modulation methods can be different from the first and second modulation methods. Examples of such variations/selections of modulation methods are possible other than those expressly recited herein.
- the modulation methods can be preconfigured into the tracker and localization system 34 , e.g., based on optimal performance given the hardware and operational considerations of the navigation system 20 .
- an operator of the navigation system 20 can select and manipulate the modulation methods by using software on the navigation system 20 display 29 .
- the modulation methods can be dynamically changed during operation of the navigation system 20 .
- the navigation system 20 can detect performance metrics according to a modulation method to assess whether a different modulation method would perform more optimally.
- the localization device 34 can treat selection of the modulation method as one of the operating parameters.
- the localization device 34 can internally configure its transmitter/receiver for a selected modulation method and utilize the transmitter to communicate with the receiver of the tracker to configure communication according to the selected modulation method so that coding/decoding of data will be properly synchronized.
- the operating parameter that is managed can be the same as of the operating parameters described in the previous sections, e.g., for managing transmission power, transmission channel, transmission frequency, transmission timing, coordination of transmission/reception for tracking, etc.
- the operating parameter in this technique may be specific to the one spectrum.
- the operating parameter can specify IR transmission timing, IR channel selection, IR channel frequency, IR transmission power, or coordination of IR transmission and IR reception of the tracker.
- the operating parameter can specify RF transmission timing, RF channel selection, RF channel frequency, RF transmission power, or coordination of RF transmission and RF reception of the tracker.
- the operating parameter can also include selection of a modulation method, selection of decoding/encoding schemes, or other behavior of the tracker to enable or coordinate communication according to the different modulation methods. All other description regarding operating parameters in the sections described above can be fully applied to the embodiment of this section, and are not repeated for simplicity in description. Hence, such descriptions should be considered fully incorporated in this section by reference.
- the localization device 34 may further comprise a second IR receiver 90 ′ and a controller for operating the IR receivers 90 , 90 ′.
- the controller can operate the IR receivers using spatial diversity such that both IR receivers receive data wirelessly from the IR transmitter of the tracker.
- the controller can operate one of the IR receivers to receive data wirelessly from the IR transmitter of the tracker and operate the other one of the IR receivers for detecting availability of one or more IR channels on the IR spectrum.
- the controller can further operate the IR receivers 90 , 90 ′ of the localization device 34 using spectrum diversity such that one of the IR receivers receives data wirelessly from the IR transmitter of the tracker through a first RF channel at a first frequency on the IR spectrum and such that the other one of the IR receivers receives data wirelessly from the IR transmitter of the tracker through a second IR channel at a second frequency that is different from the first frequency on the IR spectrum.
- the operating parameter can specify the first and second frequencies for the IR transmitter of the tracker and manages switching between the first and second frequencies for the IR transmitter of the tracker to implement spectrum diversity.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Surgery (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Signal Processing (AREA)
- Robotics (AREA)
- Automation & Control Theory (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Pathology (AREA)
- Position Fixing By Use Of Radio Waves (AREA)
- Manipulator (AREA)
- Selective Calling Equipment (AREA)
Abstract
Description
Claims (34)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/189,241 US10555781B2 (en) | 2017-11-15 | 2018-11-13 | High bandwidth and low latency hybrid communication techniques for a navigation system |
US16/730,105 US12127796B2 (en) | 2017-11-15 | 2019-12-30 | High bandwidth and low latency hybrid communication techniques for a navigation system |
US18/911,693 US20250032194A1 (en) | 2017-11-15 | 2024-10-10 | High Bandwidth And Low Latency Hybrid Communication Techniques For A Navigation System |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762586340P | 2017-11-15 | 2017-11-15 | |
US16/189,241 US10555781B2 (en) | 2017-11-15 | 2018-11-13 | High bandwidth and low latency hybrid communication techniques for a navigation system |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/730,105 Continuation US12127796B2 (en) | 2017-11-15 | 2019-12-30 | High bandwidth and low latency hybrid communication techniques for a navigation system |
Publications (2)
Publication Number | Publication Date |
---|---|
US20190142525A1 US20190142525A1 (en) | 2019-05-16 |
US10555781B2 true US10555781B2 (en) | 2020-02-11 |
Family
ID=64572069
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/189,241 Active US10555781B2 (en) | 2017-11-15 | 2018-11-13 | High bandwidth and low latency hybrid communication techniques for a navigation system |
US16/730,105 Active 2042-07-15 US12127796B2 (en) | 2017-11-15 | 2019-12-30 | High bandwidth and low latency hybrid communication techniques for a navigation system |
US18/911,693 Pending US20250032194A1 (en) | 2017-11-15 | 2024-10-10 | High Bandwidth And Low Latency Hybrid Communication Techniques For A Navigation System |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/730,105 Active 2042-07-15 US12127796B2 (en) | 2017-11-15 | 2019-12-30 | High bandwidth and low latency hybrid communication techniques for a navigation system |
US18/911,693 Pending US20250032194A1 (en) | 2017-11-15 | 2024-10-10 | High Bandwidth And Low Latency Hybrid Communication Techniques For A Navigation System |
Country Status (2)
Country | Link |
---|---|
US (3) | US10555781B2 (en) |
EP (3) | EP3835827A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US12127796B2 (en) | 2017-11-15 | 2024-10-29 | Stryker Corporation | High bandwidth and low latency hybrid communication techniques for a navigation system |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3424459B1 (en) | 2013-01-16 | 2023-12-13 | Stryker Corporation | Navigation systems for indicating line-of-sight errors |
US9993273B2 (en) | 2013-01-16 | 2018-06-12 | Mako Surgical Corp. | Bone plate and tracking device using a bone plate for attaching to a patient's anatomy |
US10537395B2 (en) | 2016-05-26 | 2020-01-21 | MAKO Surgical Group | Navigation tracker with kinematic connector assembly |
JP7189743B2 (en) * | 2018-11-21 | 2022-12-14 | 株式会社アドバンテスト | Measurement result receiving device, measuring device, method, program and recording medium thereof |
CN110047262A (en) * | 2019-05-20 | 2019-07-23 | 帷幄匠心科技(杭州)有限公司 | A kind of infrared position detecting system of sales field SKU |
DE102019007290A1 (en) * | 2019-10-21 | 2021-04-22 | Karl Storz Se & Co. Kg | Sensor-based surgery set and procedure |
EP4011317B1 (en) * | 2020-12-10 | 2023-12-27 | Stryker European Operations Limited | Tracker with switchable radiation characteristics |
WO2022165561A1 (en) * | 2021-02-08 | 2022-08-11 | Vivid Surgical Pty Ltd | Intraoperative stereotaxic navigation systems |
EP4085865A1 (en) * | 2021-05-04 | 2022-11-09 | Stryker European Operations Limited | Surgical tracker with emitters triggered by electromagnetic radiation |
CN114184181B (en) * | 2021-12-06 | 2023-08-01 | 长春理工大学 | Active target device with infrared tracking and beacon light pointing functions |
CN115173582A (en) * | 2022-06-27 | 2022-10-11 | 东南大学 | Wireless energy transmission system with self-powered and beam self-tracking capabilities |
Citations (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE4225112C1 (en) | 1992-07-30 | 1993-12-09 | Bodenseewerk Geraetetech | Instrument position relative to processing object measuring apparatus - has measuring device for measuring position of instrument including inertia sensor unit |
US20050131426A1 (en) | 2003-12-10 | 2005-06-16 | Moctezuma De La Barrera Jose L. | Adapter for surgical navigation trackers |
US20050256391A1 (en) * | 2004-05-14 | 2005-11-17 | Canon Kabushiki Kaisha | Information processing method and apparatus for finding position and orientation of targeted object |
US7158118B2 (en) * | 2004-04-30 | 2007-01-02 | Hillcrest Laboratories, Inc. | 3D pointing devices with orientation compensation and improved usability |
US20070081695A1 (en) * | 2005-10-04 | 2007-04-12 | Eric Foxlin | Tracking objects with markers |
US7725162B2 (en) | 2000-01-27 | 2010-05-25 | Howmedica Leibinger Inc. | Surgery system |
US7942745B2 (en) * | 2005-08-22 | 2011-05-17 | Nintendo Co., Ltd. | Game operating device |
US8041536B2 (en) * | 2006-03-28 | 2011-10-18 | Nintendo Co., Ltd. | Inclination calculation apparatus and inclination calculation program, and game apparatus and game program |
US20120038549A1 (en) * | 2004-01-30 | 2012-02-16 | Mandella Michael J | Deriving input from six degrees of freedom interfaces |
US20120083705A1 (en) * | 2010-09-30 | 2012-04-05 | Shelten Gee Jao Yuen | Activity Monitoring Systems and Methods of Operating Same |
US8295909B2 (en) | 2005-06-16 | 2012-10-23 | Brainlab Ag | Medical tracking system with infrared data transfer |
US20130147838A1 (en) * | 2011-12-07 | 2013-06-13 | Sheridan Martin Small | Updating printed content with personalized virtual data |
US8805528B2 (en) | 2009-03-31 | 2014-08-12 | Medtronic, Inc. | Channel assessment and selection for wireless communication between medical devices |
US20140320667A1 (en) | 2010-08-31 | 2014-10-30 | Cast Group Of Companies Inc. | System and Method for Tracking |
US20150002507A1 (en) * | 2013-06-28 | 2015-01-01 | Anthony J. Ambrus | Space carving based on human physical data |
US9008757B2 (en) | 2012-09-26 | 2015-04-14 | Stryker Corporation | Navigation system including optical and non-optical sensors |
US20160098095A1 (en) * | 2004-01-30 | 2016-04-07 | Electronic Scripting Products, Inc. | Deriving Input from Six Degrees of Freedom Interfaces |
WO2016081931A1 (en) | 2014-11-21 | 2016-05-26 | Think Surgical, Inc. | Visible light communication system for transmitting data between visual tracking systems and tracking markers |
US9381085B2 (en) | 2011-06-23 | 2016-07-05 | Stryker Corporation | Prosthetic implant and method of implantation |
US9480534B2 (en) | 2012-08-03 | 2016-11-01 | Stryker Corporation | Navigation system and method for removing a volume of tissue from a patient |
US9642529B1 (en) * | 2013-03-17 | 2017-05-09 | eMobileCare Corporation | Proactive and preventive health care system using remote monitoring and notifications |
US9707043B2 (en) | 2011-09-02 | 2017-07-18 | Stryker Corporation | Surgical instrument including housing, a cutting accessory that extends from the housing and actuators that establish the position of the cutting accessory relative to the housing |
US20170343361A1 (en) * | 2016-05-26 | 2017-11-30 | Apple Inc. | Correcting Compass View Using Map Data |
US20170372524A1 (en) * | 2012-06-14 | 2017-12-28 | Position Imaging, Inc. | Rf tracking with active sensory feedback |
US20180168750A1 (en) | 2016-12-16 | 2018-06-21 | Mako Surgical Corp. | Techniques for modifying tool operation in a surgical robotic system based on comparing actual and commanded states of the tool relative to a surgical site |
US20180325608A1 (en) * | 2017-05-10 | 2018-11-15 | Mako Surgical Corp. | Robotic Spine Surgery System And Methods |
US20190192044A1 (en) * | 2016-09-09 | 2019-06-27 | Sunnybrook Research Institute | System and method for magnetic occult lesion localization and imaging |
US20190228859A1 (en) * | 2018-01-25 | 2019-07-25 | Mako Surgical Corp. | Workflow Systems And Methods For Enhancing Collaboration Between Participants In A Surgical Procedure |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000207679A (en) * | 1999-01-19 | 2000-07-28 | Equos Research Co Ltd | Information communication equipment for traveling object |
US20070225595A1 (en) * | 2006-01-17 | 2007-09-27 | Don Malackowski | Hybrid navigation system for tracking the position of body tissue |
US9220573B2 (en) | 2007-01-02 | 2015-12-29 | Medtronic Navigation, Inc. | System and method for tracking positions of uniform marker geometries |
US9179984B2 (en) | 2007-02-19 | 2015-11-10 | Medtronic Navigation, Inc. | Multi-configuration tracking array and related method |
US9055226B2 (en) * | 2010-08-31 | 2015-06-09 | Cast Group Of Companies Inc. | System and method for controlling fixtures based on tracking data |
US11045267B2 (en) * | 2012-06-21 | 2021-06-29 | Globus Medical, Inc. | Surgical robotic automation with tracking markers |
EP3424459B1 (en) * | 2013-01-16 | 2023-12-13 | Stryker Corporation | Navigation systems for indicating line-of-sight errors |
JP6461082B2 (en) * | 2013-03-13 | 2019-01-30 | ストライカー・コーポレイション | Surgical system |
US20170311843A1 (en) | 2016-04-27 | 2017-11-02 | Brent Andrew BAILEY | Medical instrument tracking indicator system |
US10765480B2 (en) | 2016-08-17 | 2020-09-08 | Synaptive Medical (Barbados) Inc. | Wireless active tracking fiducials |
US9794942B1 (en) * | 2016-09-07 | 2017-10-17 | Emergence Oy | System and method for saving energy in a locator apparatus |
US11432879B2 (en) * | 2017-08-18 | 2022-09-06 | Siemens Healthcare Gmbh | Method and apparatus for wide area multi-body 6D pose tracking system |
US10555781B2 (en) | 2017-11-15 | 2020-02-11 | Stryker Corporation | High bandwidth and low latency hybrid communication techniques for a navigation system |
-
2018
- 2018-11-13 US US16/189,241 patent/US10555781B2/en active Active
- 2018-11-14 EP EP21155486.0A patent/EP3835827A1/en active Pending
- 2018-11-14 EP EP18206117.6A patent/EP3486684B1/en active Active
- 2018-11-14 EP EP20157547.9A patent/EP3680682B1/en active Active
-
2019
- 2019-12-30 US US16/730,105 patent/US12127796B2/en active Active
-
2024
- 2024-10-10 US US18/911,693 patent/US20250032194A1/en active Pending
Patent Citations (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE4225112C1 (en) | 1992-07-30 | 1993-12-09 | Bodenseewerk Geraetetech | Instrument position relative to processing object measuring apparatus - has measuring device for measuring position of instrument including inertia sensor unit |
US7725162B2 (en) | 2000-01-27 | 2010-05-25 | Howmedica Leibinger Inc. | Surgery system |
US20050131426A1 (en) | 2003-12-10 | 2005-06-16 | Moctezuma De La Barrera Jose L. | Adapter for surgical navigation trackers |
US20120038549A1 (en) * | 2004-01-30 | 2012-02-16 | Mandella Michael J | Deriving input from six degrees of freedom interfaces |
US20160098095A1 (en) * | 2004-01-30 | 2016-04-07 | Electronic Scripting Products, Inc. | Deriving Input from Six Degrees of Freedom Interfaces |
US7158118B2 (en) * | 2004-04-30 | 2007-01-02 | Hillcrest Laboratories, Inc. | 3D pointing devices with orientation compensation and improved usability |
US20050256391A1 (en) * | 2004-05-14 | 2005-11-17 | Canon Kabushiki Kaisha | Information processing method and apparatus for finding position and orientation of targeted object |
US8295909B2 (en) | 2005-06-16 | 2012-10-23 | Brainlab Ag | Medical tracking system with infrared data transfer |
US7942745B2 (en) * | 2005-08-22 | 2011-05-17 | Nintendo Co., Ltd. | Game operating device |
US20070081695A1 (en) * | 2005-10-04 | 2007-04-12 | Eric Foxlin | Tracking objects with markers |
US8041536B2 (en) * | 2006-03-28 | 2011-10-18 | Nintendo Co., Ltd. | Inclination calculation apparatus and inclination calculation program, and game apparatus and game program |
US8805528B2 (en) | 2009-03-31 | 2014-08-12 | Medtronic, Inc. | Channel assessment and selection for wireless communication between medical devices |
US20140320667A1 (en) | 2010-08-31 | 2014-10-30 | Cast Group Of Companies Inc. | System and Method for Tracking |
US20120083705A1 (en) * | 2010-09-30 | 2012-04-05 | Shelten Gee Jao Yuen | Activity Monitoring Systems and Methods of Operating Same |
US9381085B2 (en) | 2011-06-23 | 2016-07-05 | Stryker Corporation | Prosthetic implant and method of implantation |
US9707043B2 (en) | 2011-09-02 | 2017-07-18 | Stryker Corporation | Surgical instrument including housing, a cutting accessory that extends from the housing and actuators that establish the position of the cutting accessory relative to the housing |
US20130147838A1 (en) * | 2011-12-07 | 2013-06-13 | Sheridan Martin Small | Updating printed content with personalized virtual data |
US20170372524A1 (en) * | 2012-06-14 | 2017-12-28 | Position Imaging, Inc. | Rf tracking with active sensory feedback |
US9480534B2 (en) | 2012-08-03 | 2016-11-01 | Stryker Corporation | Navigation system and method for removing a volume of tissue from a patient |
US9008757B2 (en) | 2012-09-26 | 2015-04-14 | Stryker Corporation | Navigation system including optical and non-optical sensors |
US9642529B1 (en) * | 2013-03-17 | 2017-05-09 | eMobileCare Corporation | Proactive and preventive health care system using remote monitoring and notifications |
US20150002507A1 (en) * | 2013-06-28 | 2015-01-01 | Anthony J. Ambrus | Space carving based on human physical data |
US20170245945A1 (en) | 2014-11-21 | 2017-08-31 | Think Surgical, Inc. | Visible light communication system for transmitting data between visual tracking systems and tracking markers |
WO2016081931A1 (en) | 2014-11-21 | 2016-05-26 | Think Surgical, Inc. | Visible light communication system for transmitting data between visual tracking systems and tracking markers |
US20170343361A1 (en) * | 2016-05-26 | 2017-11-30 | Apple Inc. | Correcting Compass View Using Map Data |
US20190192044A1 (en) * | 2016-09-09 | 2019-06-27 | Sunnybrook Research Institute | System and method for magnetic occult lesion localization and imaging |
US20180168750A1 (en) | 2016-12-16 | 2018-06-21 | Mako Surgical Corp. | Techniques for modifying tool operation in a surgical robotic system based on comparing actual and commanded states of the tool relative to a surgical site |
US20180325608A1 (en) * | 2017-05-10 | 2018-11-15 | Mako Surgical Corp. | Robotic Spine Surgery System And Methods |
US20190228859A1 (en) * | 2018-01-25 | 2019-07-25 | Mako Surgical Corp. | Workflow Systems And Methods For Enhancing Collaboration Between Participants In A Surgical Procedure |
Non-Patent Citations (1)
Title |
---|
English language abstract and machine-assisted English translation for DE 42 25 112 extracted from espacenet.com database on Dec. 20, 2018, 11 pages. |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US12127796B2 (en) | 2017-11-15 | 2024-10-29 | Stryker Corporation | High bandwidth and low latency hybrid communication techniques for a navigation system |
Also Published As
Publication number | Publication date |
---|---|
EP3680682A1 (en) | 2020-07-15 |
EP3835827A1 (en) | 2021-06-16 |
US20250032194A1 (en) | 2025-01-30 |
EP3486684A1 (en) | 2019-05-22 |
US12127796B2 (en) | 2024-10-29 |
EP3680682B1 (en) | 2021-03-17 |
US20200129245A1 (en) | 2020-04-30 |
EP3486684B1 (en) | 2020-10-21 |
US20190142525A1 (en) | 2019-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20250032194A1 (en) | High Bandwidth And Low Latency Hybrid Communication Techniques For A Navigation System | |
US12213747B2 (en) | Optical communication system | |
AU2019200725B2 (en) | Navigation system including optical and non-optical sensors | |
US8435171B2 (en) | Interface between a surgeon and an automated assistant and method thereof | |
EP2208463A1 (en) | Interface between a surgeon and an automated assistant and method thereof | |
US20240138926A1 (en) | Systems and methods for enhanced registration using radar-based tracking probe | |
US20230123013A1 (en) | Systems and methods for medical object tracking in obstructed environments | |
KR101907989B1 (en) | Medical 3D image processing system using augmented reality and short distance location tracking | |
US20250120773A1 (en) | Visible light communication system for transmitting data between visual tracking systems and tracking markers | |
WO2024137797A1 (en) | Systems and methods for medical object tracking in obstructed environments | |
CN116829097A (en) | System and method for medical object tracking | |
JP2019017479A (en) | Surgery support system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
AS | Assignment |
Owner name: STRYKER CORPORATION, MICHIGAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MALACKOWSKI, DONALD W.;HOEKSTRA, PAUL;WU, CHUNWU;REEL/FRAME:048506/0077 Effective date: 20190218 |
|
AS | Assignment |
Owner name: STRYKER CORPORATION, MICHIGAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TWISTHINK, LLC;REEL/FRAME:048612/0831 Effective date: 20181101 Owner name: TWISTHINK, LLC, MICHIGAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SHINEW, MATT;REEL/FRAME:048612/0792 Effective date: 20181031 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
AS | Assignment |
Owner name: STRYKER CORPORATION, MICHIGAN Free format text: CHANGE OF ADDRESS;ASSIGNOR:STRYKER CORPORATION;REEL/FRAME:069737/0184 Effective date: 20241217 |