CN104116496B - Medical three dimension vein blood vessel augmented reality device and method - Google Patents

Abstract

The invention relates to a medical three-dimensional venous vessel augmented reality device and method. The device includes: a spectacle body, the spectacle body includes a spectacle frame and lenses installed in the spectacle frame; a light source module, mounted on the spectacle frame, is used to alternately emit red, green and blue light to irradiate the target area; an optical imaging module, installed on the spectacle frame of the spectacle main body, used to collect images of veins and blood vessels in the target area illuminated by different light sources; a micro-processing module, used to control the light source module to emit light alternately receiving images containing veins and blood vessels illuminated by different light sources collected by the optical imaging module, performing fusion and enhancement processing on the images, and reconstructing the images after fusion and enhancement processing to obtain a three-dimensional depth image; two sets of displays The modules are installed on the left and right lenses respectively, and are used to display the reconstructed three-dimensional depth image. It is convenient for doctors to wear and flexible to operate.

Description

Medical three-dimensional venous vessel augmented reality device and method

technical field

The invention relates to medical equipment, in particular to a medical three-dimensional venous vessel augmented reality device and method.

Background technique

In the clinical diagnosis and treatment process, intravenous injection, venous blood collection, and blood transfusion are common medical methods. The key step in the implementation of this process is to first find the blood vessels of the human body before puncturing the blood vessels for subsequent operations. But for some patients with inconspicuous veins, such as infants, children, obese patients, patients with edema, malnutrition and patients with dark skin diseases, it is difficult to find the position of the veins accurately even for experienced nurses.

In order to locate the venous vessels on the patient's body quickly and accurately, some venous vessel locating devices have occurred. In the traditional vein positioning device, near-infrared light is projected onto the skin area to be tested, the returned reflected light and backscattered light are collected, and the visible light is projected on the skin area of the detected area through silicon-based liquid crystal modulation. It is necessary to place the instrument near the patient, and the doctor The operating space is limited and the convenience of operation is low.

Contents of the invention

Based on this, it is necessary to provide a medical three-dimensional venous vessel augmented reality device and method that can improve the operational convenience for the problem of low operational convenience of the traditional venous vessel positioning device.

A medical three-dimensional venous vessel augmented reality device, comprising:

A spectacle body, the spectacle body comprising a spectacle frame, a lens installed in the spectacle frame and two temples connected to the spectacle frame;

The light source module is installed on the glasses frame, and the light source module includes three kinds of light sources of red, green and blue, which are used to alternately emit three kinds of lights of red, green and blue to illuminate the target area;

An optical imaging module, installed on the spectacle frame of the spectacle main body, is used to collect images of veins and blood vessels in the target area illuminated by different light sources;

The micro-processing module is connected with the optical imaging module and the light source module respectively, and is used to control the light source module to emit light alternately, receive images containing veins and blood vessels illuminated by different light sources collected by the optical imaging module, and convert the images to Perform fusion enhancement processing, and reconstruct according to the image after fusion enhancement processing to obtain a three-dimensional depth image;

Two sets of display modules are connected with the micro-processing module and respectively installed on the left and right lenses for displaying the reconstructed three-dimensional depth image.

In one of the embodiments, the light source module includes at least five groups of LED light sources, and each group of LED light sources includes three kinds of LED light sources, red, green and blue, and the time collected by the optical imaging module when the LED light source emitting red light is irradiated The length is longer than the time length collected by the optical imaging module when illuminated by the green and blue LED light sources.

In one of the embodiments, the light source module is an array light source.

In one of the embodiments, the optical imaging module includes three cameras, and the three cameras are respectively installed on the two sides and the middle of the spectacle frame.

In one of the embodiments, the camera includes a CMOS or CCD image sensor, a visible light filter and a lens arranged in sequence.

In one embodiment, the micro-processing module is used to output the reconstructed two-way images with parallax to the left and right display modules for display, so as to obtain a three-dimensional depth image.

A medical three-dimensional venous vessel augmented reality method, comprising:

A glasses body, a light source module, an optical imaging module, a micro-processing module and two sets of display modules are provided, the glasses body includes a glasses frame, a lens installed in the glasses frame and two temples connected to the glasses frame, the The light source module is mounted on the spectacle frame, the optical imaging module is mounted on the spectacle frame of the spectacle body, the micro-processing module is connected to the optical imaging module and the light source module respectively, and the two sets of display modules It is connected with the micro-processing module and installed on the left and right lenses respectively;

The light source module alternately emits red, green and blue lights to illuminate the target area;

collecting images of veins and blood vessels in the target area illuminated by different light sources through an optical imaging module;

performing fusion and enhancement processing on the collected images containing veins and blood vessels through a micro-processing module, and reconstructing a three-dimensional depth image according to the fusion and enhancement processed images;

The reconstructed three-dimensional depth image is displayed by two sets of display modules.

In one of the embodiments, it includes: the light source module includes at least five groups of LED light sources, and each group of LED light sources includes three kinds of LED light sources, red, green and blue, and the LED light source that emits red light is captured by the optical imaging module The time length is longer than the time length collected by the optical imaging module when the green and blue LED light sources are irradiated.

In one of the embodiments, the optical imaging module includes three cameras, and the three cameras are respectively installed on the two sides and the middle of the spectacle frame.

In one of the embodiments, the step of displaying the reconstructed 3D depth image through two sets of display modules includes:

The reconstructed two-way images with parallax are output to two sets of left and right display modules for display to obtain a three-dimensional depth image.

The above-mentioned medical three-dimensional venous vessel augmented reality device installs the light source module, optical imaging module, micro-processing module, and display module on the spectacle frame, which is convenient for doctors to wear, flexible in operation, and improves the convenience of operation, and adopts multi-spectral irradiation to realize Image enhancement, reconstructing the collected image to obtain a three-dimensional depth image, providing depth information. And the doctor wears glasses, and the doctor's glasses and the lighting position are in the same space, so the hand-eye coordination is better, which is beneficial to the doctor's operation. In addition, the medical three-dimensional vein augmented reality device has a wide range of applications and can be applied to different parts of the human body. It is not limited by the space of the parts. The three-dimensional display can better visualize the veins and blood vessels, which can effectively help the medical staff to distinguish the blood vessels that are difficult to distinguish with the naked eye. Accurate and rapid positioning of the patient's venous vessels under certain conditions.

Description of drawings

Fig. 1 is a structural block diagram of an embodiment of a traditional Chinese medicine three-dimensional venous vessel augmented reality device;

Fig. 2 is a flow chart of an embodiment of a method for augmenting reality of medical three-dimensional veins and blood vessels.

detailed description

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

Fig. 1 is a structural block diagram of a medical three-dimensional venous vessel augmented reality device according to an embodiment. As shown in FIG. 1 , the medical three-dimensional vein augmented reality device includes a glasses main body 110 , a light source module 120 , an optical imaging module 130 , a microprocessing module 140 and two sets of display modules 150 . in:

The spectacle main body includes a spectacle frame, a lens installed in the spectacle frame and two mirror legs connected with the spectacle frame.

The light source module 120 is installed on the spectacle frame, and the light source module 120 includes three kinds of light sources of red, green and blue for alternately emitting three kinds of light of red, green and blue to illuminate the target area. The target area can be different parts of the human body, such as the head, arms or legs.

In this embodiment, the light source module 120 includes at least five groups of LED light sources, and each group of LED light sources includes three types of LED light sources: red, green and blue. The length of time collected by the optical imaging module when the green and blue LED light sources are irradiated. The LED light source that emits red light has a wavelength of 850nm (nanometer). The blue and green illumination adopts low illumination to achieve the purpose of enhancing the veins. Low illumination refers to light levels below the threshold. The threshold value may be 0˜15 lux (lux) or the like. The light source module 120 is an array light source, and the array light source can avoid the scattering caused by the curved surface.

The optical imaging module 130 is installed on the spectacle frame of the spectacle body, and is used for collecting images of veins and blood vessels in the target area illuminated by different light sources.

The optical imaging module 130 includes three cameras, and the three cameras are respectively installed on the two sides and the middle of the glasses frame. The camera includes a CMOS (Complementary Metal Oxide Semiconductor, Complementary Metal Oxide Semiconductor) or CCD (Charge-coupled Device, Charge-Coupled Device) image sensor, a visible light filter and a lens arranged in sequence.

The micro-processing module 140 is connected to the optical imaging module 130 and the light source module 120 respectively, and is used to control the light source module to emit light alternately, receive images containing veins under different light sources collected by the optical imaging module, and fuse the images Enhancement processing, and reconstruction according to the image after fusion and enhancement processing to obtain a three-dimensional depth image. The micro-processing module 140 processes images, including processing such as image denoising, image enhancement, and image stereoscopic display. The micro-processing module 140 adopts a low-power consumption miniature DSP chip. Specifically, the micro-processing module 140 performs fusion and enhancement processing on images, including performing wavelet transformation on images under three types of illumination to obtain low-frequency and high-frequency images, and then adopting different fusion criteria according to different wavelet coefficients in different channels. The wavelet coefficients are processed, and the processed new wavelet coefficients preserve more frequency band characteristics intact. Finally, the wavelet inverse transform is performed on the new wavelet coefficients to obtain the fused image.

Two sets of display modules 150 are connected to the micro-processing module 140 and installed on the left and right lenses respectively for displaying the reconstructed 3D depth image.

The display module 150 can be composed of a liquid crystal on silicon projection module and a display prism module.

The micro-processing module 140 is used to output the reconstructed two-way images with parallax to the left and right display modules 150 for display to obtain a three-dimensional depth image. The micro-processing module 140 is respectively connected to the two sets of display modules 150 by wires.

The above-mentioned medical three-dimensional venous vessel augmented reality device installs the light source module, optical imaging module, micro-processing module, and display module on the spectacle frame, which is convenient for doctors to wear, flexible in operation, and improves the convenience of operation, and uses multi-spectral irradiation to achieve Image enhancement, reconstructing the collected image to obtain a three-dimensional depth image, providing depth information. And the doctor wears glasses, the doctor's glasses and the light position are in the same space, the hand-eye coordination is better, and the doctor's operation is used. In addition, the medical three-dimensional venous vessel augmented reality device has a wide range of applications, and can be applied to different parts of the human body. It is not limited by the space of the part, and the three-dimensional display can better visualize the venous vessels, which can effectively help the medical staff to distinguish the blood vessels that are difficult to distinguish with the naked eye. Accurate and rapid positioning of the patient's venous blood vessels.

In addition, a medical three-dimensional venous vessel augmented reality method is also provided. Fig. 2 is a flow chart of an embodiment of a method for augmenting reality of medical three-dimensional veins and blood vessels. The medical three-dimensional vein augmented reality method in FIG. 2 is the workflow of the medical three-dimensional vein augmented reality device in FIG. 1 . As shown in Figure 2, the medical three-dimensional venous vessel augmented reality method includes:

Step 202, provide a glasses body, a light source module, an optical imaging module, a micro-processing module and two sets of display modules, the glasses body includes a glasses frame, a lens installed in the glasses frame and two temples connected to the glasses frame, the glasses The light source module is mounted on the spectacle frame, the optical imaging module is mounted on the spectacle frame of the spectacle body, the microprocessing module is connected to the optical imaging module and the light source module respectively, and the two sets of display modules are connected to the microprocessing module, Installed on the left and right lenses respectively.

The light source module includes at least five groups of LED light sources, and each group of LED light sources includes three kinds of LED light sources, red, green and blue, and the time length of the LED light source that emits red light is collected by the optical imaging module is longer than that of the LED light sources that emit green and blue The length of time collected by the optical imaging module when the light source is irradiated; the optical imaging module includes three cameras, and the three cameras are respectively installed on both sides and the middle of the spectacle frame.

The light source module includes at least five groups of LED light sources, and each group of LED light sources includes three kinds of LED light sources, red, green and blue, and the time length of the LED light source that emits red light is collected by the optical imaging module is longer than that of the LED light sources that emit green and blue The length of time collected by the optical imaging module when the light source is illuminated.

In step 204, the light source module alternately emits three kinds of light, red, green and blue, to irradiate the target area.

In step 206, the optical imaging module collects images including veins in the target area illuminated by different light sources.

In step 208, the micro-processing module performs fusion and enhancement processing on the collected images including veins, and reconstructs a three-dimensional depth image according to the fusion-enhanced images.

Step 210, displaying the reconstructed 3D depth image through a display module.

In one embodiment, the step of displaying the reconstructed image through the display module includes: outputting the reconstructed two-way image with parallax to the left and right display modules for display, so as to obtain a three-dimensional depth image.

The above medical three-dimensional venous vessel augmented reality method installs the light source module, optical imaging module, micro-processing module, and display module on the spectacle frame, which is convenient for doctors to wear and flexible in operation, and uses multi-spectral irradiation to achieve image enhancement. The three-dimensional depth image is reconstructed to provide depth information, which is convenient for quickly and accurately locating the patient's veins.

The above-mentioned embodiments only express several implementation modes of the present invention, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present invention. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent for the present invention should be based on the appended claims.

Claims (8)

1. a medical three dimension vein blood vessel augmented reality device, it is characterised in that including:

Lens body, described lens body includes eye glass frame, the eyeglass that is arranged in described eye glass frame and two temples being connected with described picture frame；

Light source module, is arranged on described eye glass frame, and described light source module includes three kinds of light sources of RGB, for alternately sending three kinds of light of RGB to irradiate target area；

Optical imagery module, is arranged on the eye glass frame of described lens body, for gathering the image comprising vein blood vessel in the described target area under different light source irradiation；

Micro treatment module, it is connected with described optical imagery module and light source module respectively, for controlling the alternately luminescence of described light source module, receive the image comprising vein blood vessel under the different light source irradiation of described optical imagery module collection, and described image carries out merging enhancement process, and carry out reconstruction according to the image after described fusion enhancement process and obtain three dimensional depth image；

Two set display modules, are connected with described micro treatment module, are separately mounted on two eyeglasses in left and right, are used for the three dimensional depth image after showing reconstruction；

Described light source module includes at least five group LED light sources, and often group LED light source includes three kinds of LED light sources of RGB and the time span gathered by described optical imagery module when being irradiated more than the LED light source sending green and blueness by the time span of described optical imagery module collection when the LED light source sending HONGGUANG irradiates。

2. medical three dimension vein blood vessel augmented reality device according to claim 1, it is characterised in that described light source module is array light source。

3. medical three dimension vein blood vessel augmented reality device according to claim 1, it is characterised in that described optical imagery module includes three photographic head, and described three photographic head are separately mounted to both sides and the centre of described eye glass frame。

4. medical three dimension vein blood vessel augmented reality device according to claim 3, it is characterised in that described photographic head includes the CMOS or ccd image sensor, visible filter and the lens that set gradually。

5. medical three dimension vein blood vessel augmented reality device according to claim 1, it is characterised in that described micro treatment module overlaps display module display for the two-way image with parallax that obtains after rebuilding exports left and right two, obtains three dimensional depth image。

6. a medical three dimension vein blood vessel augmented reality method, it is characterised in that including:

Lens body, light source module, optical imagery module, micro treatment module and two set display modules are provided, described lens body includes eye glass frame, be arranged in described eye glass frame eyeglass and two temples being connected with described picture frame, described light source module is arranged on described eye glass frame, described optical imagery module is arranged on the eye glass frame of described lens body, described micro treatment module is connected with described optical imagery module and light source module respectively, described two set display modules are connected with described micro treatment module, are separately mounted on two eyeglasses in left and right；

Alternately three kinds of target illuminated regions of RGB are sent by light source module；

By the optical imagery module collection described target area under different light source irradiation comprises the image of vein blood vessel；

Undertaken merging enhancement process by the image comprising vein blood vessel of described collection by micro treatment module, carry out reconstruction according to the image after described fusion enhancement process and obtain three dimensional depth image；

The three dimensional depth image after display module shows described reconstruction is overlapped by two；

Described light source module includes at least five group LED light sources, and often group LED light source includes three kinds of LED light sources of RGB and the time span gathered by described optical imagery module when being irradiated more than the LED light source sending green and blueness by the time span of described optical imagery module collection when the LED light source sending HONGGUANG irradiates。

7. medical three dimension vein blood vessel augmented reality method according to claim 6, it is characterised in that described optical imagery module includes three photographic head, and described three photographic head are separately mounted to both sides and the centre of described eye glass frame。

8. medical three dimension vein blood vessel augmented reality method according to claim 6, it is characterised in that described show described reconstruction by two set display modules after the step of three dimensional depth image include:

The two-way image with parallax that obtains after rebuilding exports left and right two overlap display module and display, obtain three dimensional depth image。