CN113749772A

CN113749772A - Enhanced near-infrared 4K fluorescence navigation system

Info

Publication number: CN113749772A
Application number: CN202111013719.5A
Authority: CN
Inventors: 岳永亮
Original assignee: Shanghai Gelian Medical Technology Co ltd
Current assignee: Shanghai Gelian Medical Technology Co ltd
Priority date: 2021-04-22
Filing date: 2021-08-31
Publication date: 2021-12-07

Abstract

The invention relates to an enhanced near-infrared 4K fluorescence navigation system which comprises a near-infrared 4K fluorescence navigation device, a 4K excitation light source system, a filter set, an imaging lens set and a spectroscope, wherein the near-infrared 4K fluorescence navigation device is used for exciting and capturing 4K fluorescence signals, converting the 4K fluorescence signals into fluorescence images and then processing the fluorescence images to generate 4K projection images. And the 4K projection module is used for receiving the generated 4K projection image and generating projection light according to the 4K projection image, and the generated projection light is focused by the imaging lens group and imaged on an observation tissue after penetrating through the spectroscope. Through outputting 4K resolution 3840x2160 fluorescence projection image, effectively solved when 2K image can not satisfy the higher resolution demand, the operator can't see the dissected boundary of fine tissue, the problem such as fine tissue fluorescence development is unclear.

Description

Enhanced near-infrared 4K fluorescence navigation system

Technical Field

The invention relates to the technical field of internal fluorescence imaging, in particular to a near-infrared 4K fluorescence enhancement navigation system.

Background

Fluorescence imaging systems on the market currently capture fluorescence signals by using an imaging original, and directly display fluorescence images on a medical display, or display fluorescence images on the display after image processing such as fusion with white light images, and operators need to repeatedly observe fluorescence identification positions through images of the display to perform dissection operations.

In the prior art, the effective pixel resolution of fluorescence output in the market mostly takes 1920 × 1080 as a main factor, however, in the endoscopic surgery, a higher output resolution or a clear 4K resolution is required to display the boundary of a fine tissue and the development of a tiny blood vessel, and the conventional fluorescence image is not beneficial to the surgical operation, so the prior art needs to be improved and promoted.

Disclosure of Invention

Aiming at the defects in the prior art, the invention aims to provide an enhanced near-infrared 4K fluorescence navigation system, which effectively solves the problems that an operator cannot see the dissection boundary of fine tissues and the fluorescence development of the fine tissues is not clear when a 2K image cannot meet the requirement of higher resolution by outputting a 4K resolution 3840x2160 fluorescence projection image.

The above object of the present invention is achieved by the following technical solutions:

an enhanced near-infrared 4K fluorescence navigation system comprises a near-infrared 4K fluorescence navigation device, a 4K fluorescence image acquisition device and a 4K fluorescence image processing device, wherein the near-infrared 4K fluorescence navigation device is used for exciting and capturing 4K fluorescence signals, converting the 4K fluorescence signals into fluorescence images and then processing the fluorescence images to generate 4K projection images and comprises a 4K excitation light source system, a filter set, an imaging lens group and a spectroscope;

and the 4K projection module is used for receiving the generated 4K projection image and generating projection light according to the 4K projection image, and the generated projection light is focused by the imaging lens group and imaged on an observation tissue after penetrating through the spectroscope.

The present invention in a preferred example may be further configured to: the optical filter group comprises a first optical filter and a second optical filter;

exciting light emitted by the 4K excitation light source system reaches an observation tissue, near-infrared fluorescence is excited, the near-infrared fluorescence penetrates through the first optical filter and is collected and focused by the imaging lens group, the focused near-infrared fluorescence is reflected by the spectroscope, and the focused near-infrared fluorescence is imaged on the 4K near-infrared camera after penetrating through the second optical filter;

the 4K near-infrared camera converts the fluorescence signal into an image signal and transmits the image signal to the 4K image processing unit, and the 4K image processing unit processes the fluorescence image signal to generate a 4K projection image and inputs the 4K projection image into the 4K projection module.

The present invention in a preferred example may be further configured to: the first filter is a notch filter.

The present invention in a preferred example may be further configured to: the second optical filter is a long-wave pass optical filter.

The present invention in a preferred example may be further configured to: the beam splitter is a dichroic beam splitter.

The present invention in a preferred example may be further configured to: the 4K excitation light source system comprises a CCD imaging module, a brightness adjusting module, a switch module, a power supply module and a CCD lens, wherein the CCD lens is arranged on the CCD imaging module, a plurality of LED lamps are arranged around the CCD lens, and an optical interference filter is arranged at the front end of the CCD lens;

the power module is electrically connected with the LED lamp through the switch module, the brightness adjusting module is electrically connected with the LED lamp, the CCD imaging module is connected with a PC through a data acquisition card, and the PC is used for acquiring video signals output by the CCD imaging module.

The present invention in a preferred example may be further configured to: the operation image navigation system in the PC comprises a user login module, a medical record data management module, a file establishing module, an acquisition parameter setting module and an image navigation function module, wherein the medical record data management module is connected with the user login module;

the medical record data management module is used for modifying, checking, printing and deleting all medical record information stored in the system by an administrator, and the file establishing module is used for inputting operation information;

the acquisition parameter setting module is used for realizing image acquisition frame rate setting, compression format setting, text superposition setting, time superposition setting, window size setting and file storage directory setting, and meanwhile, the module integrates a light source switching function and realizes the switching state of an excitation light source through software control;

the image navigation function module is used for displaying the imaging area image acquired by the CCD imaging module after the parameter setting is carried out on the imaging instrument, and capturing pictures and videos and displaying the captured pictures and videos.

In conclusion, the beneficial technical effects of the invention are as follows:

according to the enhanced near-infrared 4K fluorescence navigation system, the 4K projection module outputs the 4K resolution 3840x2160 fluorescence projection image, so that the problems that an operator cannot see the dissection boundary of the fine tissue and the fluorescence development of the fine tissue is not clear when the 2K image cannot meet the requirement of higher resolution are effectively solved, the precision and the efficiency of the operation are improved, and the enhanced near-infrared 4K fluorescence navigation system has higher economic popularization value.

Drawings

FIG. 1 is a schematic diagram of the present invention.

Fig. 2 is a schematic diagram showing a 4K excitation light source system according to the present invention.

FIG. 3 is a block diagram of the surgical image guidance system according to the present invention.

FIG. 4 is a flowchart illustrating steps of an image projection method according to the present invention.

Reference numerals: 1. 4K excitation light source system; 11. a CCD imaging module; 12. a brightness adjustment module; 13. a switch module; 14. a power supply module; 15. a CCD lens; 16. an LED lamp; 17. an optical interference filter; 18. a data acquisition card; 2. a PC machine; 3. an imaging lens group; 4. a beam splitter; 5. a 4K projection module; 6. a 4K near-infrared camera; 7. a 4K image processing unit; 8. a first optical filter; 81. a second optical filter; 9. a user login module; 91. a medical record data management module; 92. establishing a file module; 93. a collection parameter setting module; 94. and an image navigation function module.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings.

Referring to fig. 1, the near-infrared 4K fluorescence enhancement navigation system disclosed by the invention comprises a near-infrared 4K fluorescence navigation device, a 4K excitation light source system 1, a filter set, an imaging lens group 3 and a spectroscope 4, wherein the near-infrared 4K fluorescence navigation device is used for exciting and capturing 4K fluorescence signals, converting the 4K fluorescence signals into fluorescence images and then processing the fluorescence images to generate 4K projection images. And the 4K projection module 5 is used for receiving the generated 4K projection image and generating projection light according to the 4K projection image, and the generated projection light passes through the spectroscope 4 and then is focused and imaged on the observation tissue by the imaging lens group 3.

It is through providing an enhancement near-infrared 4K fluorescence navigation, through 4K projection module 5 output 4K resolution ratio 3840x2160 fluorescence projection image, when effectively having solved 2K image and can not satisfying the higher resolution ratio demand, the operator can't see the fine tissue and dissect the boundary, and the fine tissue fluorescence develops unclear scheduling problem, has improved the precision and the efficiency of operation, has stronger economic spreading value.

In some embodiments, the near-infrared fluorescence navigation device further comprises a 4K near-infrared camera 6 and a 4K image processing unit 7, and the filter set comprises a first filter 8 and a second filter 81. Excitation light emitted by the 4K excitation light source system 1 reaches an observation tissue, near-infrared fluorescence is excited, the near-infrared fluorescence passes through the first optical filter 8 and is collected and focused by the imaging lens group 3, and the focused near-infrared fluorescence is reflected by the spectroscope 4, passes through the second optical filter 81 and is imaged on the 4K near-infrared camera 6.

The 4K near infrared camera 6 converts the fluorescence signal into an image signal and transmits the image signal to the 4K image processing unit 7, and the 4K image processing unit 7 generates a 4K projection image by processing the fluorescence image signal and inputs the 4K projection image to the 4K projection module 5. In some embodiments, the first filter 8 is a notch filter for filtering the excitation light. In some embodiments, the second filter 81 is a long-wave pass filter to further filter stray light except for fluorescence. In some embodiments, the beamsplitter 4 is a dichroic beamsplitter 4.

Referring to fig. 2, the 4K excitation light source system 1 includes a CCD imaging module 11, a brightness adjusting module 12, a switch module 13, a power module 14 and a CCD lens 15, the CCD lens 15 is installed on the CCD imaging module 11, a plurality of LED lamps 16 are disposed around the CCD lens 15, and an optical interference filter 17 is installed at the front end of the CCD lens 15. The power module 14 is electrically connected with the LED lamp 16 through the switch module 13, the brightness adjusting module 12 is electrically connected with the LED lamp 16, the CCD imaging module 11 is connected with the PC 2 through the data acquisition card 18, and the PC 2 is used for acquiring the video signal output by the CCD imaging module 11.

In the present embodiment, the light source section employs an LED array having a center wavelength of 750 nm. The photodiode spectral response range can meet the requirements of the system, and the cost is much lower than that of a semiconductor laser. Meanwhile, the LED array is easy to integrate at a CCD end, has good temperature characteristic and good stability, so that a photodiode is selected as an excitation light source. However, since the output power of the photodiode is low and the radiation power per unit area is small, a photodiode array composed of 24 photodiodes is used. In the brightness adjusting module 12, the LED array is driven by a constant current circuit, and the output power and brightness can be adjusted by adjusting the resistance of the constant current. In the switch module 13, the data acquisition card 18 is controlled by a control function to alarm the IO port, so as to control the on/off of the light source part on the software.

In order to filter the exciting light of the LED at the imaging end and reduce the influence of a natural light source and other impurity light sources on imaging, an optical interference filter is arranged at the front end of the CCD lens 15, and the filter is a long-wave pass filter. The signal output by the CCD imaging module 11 is collected and processed by a data acquisition card 18, the data acquisition card 18 is a model number space sensitive SDK3000, the card is provided with a high-speed PCI bus, is compatible with plug and play (PNP), and provides a secondary development kit (hereinafter referred to as SDK). The input port of the image, the input signals of image brightness, contrast, chroma, gray scale and the like can be controlled through the SDK, the image is dynamically intercepted, and the video recording is carried out in AVI format, and the video recording can reach 30(NTSC) frames and 25(PAL) frames per second. SECAM system, display resolution can reach 3840x2160(PAL), and the card has IO alarm function to provide IO output and IO input port.

Referring to fig. 3, the surgical image navigation system in the PC 2 includes a user login module 9, a medical record data management module 91 connected to the user login module 9, a file creation module 92, an acquisition parameter setting module 93, and an image navigation function module 94.

The medical record data management module 91 is used for the administrator to modify, view, print and delete all medical record information stored in the system, and the file establishing module 92 is used for inputting operation information. The acquisition parameter setting module 93 is used for realizing image acquisition frame rate setting, compression format setting, text superposition setting, time superposition setting, window size setting and file storage directory setting, and meanwhile, the module integrates a light source switching function and realizes the switching state of an excitation light source through software control.

The image navigation function module 94 is used for displaying the imaging area image collected by the CCD imaging module 11 after the parameter setting on the imaging instrument, and capturing and displaying the captured image and video.

Referring to fig. 4, an image projection method of the enhanced near-infrared 4K fluorescence navigation system includes the following steps:

s1: the near-infrared 4K fluorescence navigation device is used for exciting and capturing 4K fluorescence signals, converting the 4K fluorescence signals into fluorescence images, processing the fluorescence images to generate 4K projection images and feeding the 4K projection images back to the 4K projection module 5;

s2: the 4K projection module 5 generates projection light according to the 4K projection image;

s3: the projection light passes through the spectroscope 4 and is focused and imaged on the observation tissue by the imaging lens group 3.

In some embodiments, S1 specifically includes the following steps: the switch module 13 is turned on, so that the power supply module 14 supplies power to the plurality of LED lamps 16, the brightness of the laser is adjusted by the brightness adjusting module 12, the exciting light emitted by the exciting light source of the CCD imaging module 11 reaches the tissue to be observed, and the near-infrared 4K fluorescence is excited; the near-infrared 4K fluorescence is collected and focused by the imaging lens group 3 after passing through the notch filter;

the focused near-infrared 4K fluorescence is reflected by the spectroscope 4, passes through the long-wave pass filter and is imaged on the 4K near-infrared camera 6; the 4K near infrared camera 6 converts the 4K fluorescent signal into a fluorescent image signal and transmits the fluorescent image signal to the 4K image processing unit 7; the 4K image processing unit 7 processes the fluorescence image, generates a 4K projection image, and inputs the 4K projection image to the 4K projection module 5.

In some specific embodiments, the imaging picture of the 4K near-infrared camera 6 and the projection picture of the 4K projection module 5 are subjected to spatial coincidence matching processing, so that the originally invisible 4K near-infrared fluorescence signal in the biological tissue of the operation is visualized by the projection image and can be visually observed with naked eyes.

The embodiments of the present invention are preferred embodiments of the present invention, and the scope of the present invention is not limited by these embodiments, so: all equivalent changes made according to the structure, shape and principle of the invention are covered by the protection scope of the invention.

Claims

1. An enhanced near-infrared 4K fluorescence navigation system is characterized in that: the system comprises a near-infrared 4K fluorescence navigation device, a 4K fluorescence image acquisition device and a 4K fluorescence image acquisition device, wherein the near-infrared 4K fluorescence navigation device is used for exciting and capturing 4K fluorescence signals, converting the 4K fluorescence signals into fluorescence images and then processing the fluorescence images to generate 4K projection images, and comprises a 4K excitation light source system (1), a filter set, an imaging lens group (3) and a spectroscope (4);

and the 4K projection module (5) is used for receiving the generated 4K projection image and generating projection light according to the 4K projection image, and the generated projection light is focused and imaged on observation tissues by the imaging lens group (3) after passing through the spectroscope (4).

2. The system of claim 1, wherein the system comprises: the system also comprises a 4K near-infrared camera (6) and a 4K image processing unit (7), wherein the filter set wave comprises a first filter (8) and a second filter (81);

excitation light emitted by the 4K excitation light source system (1) reaches an observation tissue, near-infrared fluorescence is excited, the near-infrared fluorescence penetrates through the first optical filter (8), is collected and focused by the imaging lens group (3), is reflected by the spectroscope (4), and is imaged on the 4K near-infrared camera (6) after penetrating through the second optical filter (81);

the 4K near-infrared camera (6) converts the fluorescence signals into image signals and transmits the image signals to the 4K image processing unit (7), and the 4K image processing unit (7) processes the fluorescence image signals to generate 4K projection images and inputs the 4K projection images into the 4K projection module (5).

3. The system of claim 2, wherein the system comprises: the first filter (8) is a notch filter.

4. The system of claim 2, wherein the system comprises: the second optical filter (81) is a long-wave pass optical filter.

5. The system of claim 2, wherein the system comprises: the spectroscope (4) is a dichroic spectroscope (4).

6. The system of claim 1, wherein the system comprises: the 4K excitation light source system (1) comprises a CCD imaging module (11), a brightness adjusting module (12), a switch module (13), a power supply module (14) and a CCD lens (15), wherein the CCD lens (15) is installed on the CCD imaging module (11), a plurality of LED lamps (16) are arranged on the periphery of the CCD lens (15), and an optical interference filter (17) is installed at the front end of the CCD lens (15);

the power module (14) passes through switch module (13) with LED lamp (16) electric connection, brightness control module (12) with LED lamp (16) electric connection, CCD imaging module (11) are connected with PC (2) through data acquisition card (18), PC (2) are used for the video signal's of CCD imaging module (11) output collection.

7. The system of claim 6, wherein the system comprises: the operation image navigation system in the PC (2) comprises a user login module (9), a medical record data management module (91) connected with the user login module (9), a file establishing module (92), an acquisition parameter setting module (93) and an image navigation function module (94);

the medical record data management module (91) is used for modifying, viewing, printing and deleting all medical record information stored in the system by an administrator, and the file establishing module (92) is used for inputting operation information;

the acquisition parameter setting module (93) is used for realizing image acquisition frame rate setting, compression format setting, text superposition setting, time superposition setting, window size setting and file storage directory setting, and meanwhile, the module integrates a light source switching function and realizes the switching state of an excitation light source through software control;

the image navigation function module (94) is used for displaying the imaging area image collected by the CCD imaging module (11) after the parameter setting on the imaging instrument, and capturing pictures and videos and displaying the captured pictures and videos.