CN102846301B - Intelligent adjusting device of endoscope illumination - Google Patents
Intelligent adjusting device of endoscope illumination Download PDFInfo
- Publication number
- CN102846301B CN102846301B CN201210057074.XA CN201210057074A CN102846301B CN 102846301 B CN102846301 B CN 102846301B CN 201210057074 A CN201210057074 A CN 201210057074A CN 102846301 B CN102846301 B CN 102846301B
- Authority
- CN
- China
- Prior art keywords
- image
- output
- light source
- signal
- cold light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000005286 illumination Methods 0.000 title claims abstract description 20
- 238000012937 correction Methods 0.000 claims abstract description 23
- 238000000034 method Methods 0.000 claims abstract description 11
- 230000003287 optical effect Effects 0.000 claims abstract description 10
- 230000008569 process Effects 0.000 claims abstract description 6
- 230000008859 change Effects 0.000 claims abstract description 5
- 238000012545 processing Methods 0.000 claims description 19
- 239000013307 optical fiber Substances 0.000 claims description 18
- 239000000835 fiber Substances 0.000 claims description 17
- 230000005540 biological transmission Effects 0.000 claims description 15
- 238000005452 bending Methods 0.000 claims description 9
- 229910000831 Steel Inorganic materials 0.000 claims description 7
- 210000000056 organ Anatomy 0.000 claims description 7
- 239000010959 steel Substances 0.000 claims description 7
- 239000003086 colorant Substances 0.000 claims description 5
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000003993 interaction Effects 0.000 claims description 3
- 230000001105 regulatory effect Effects 0.000 claims 6
- 238000012512 characterization method Methods 0.000 claims 2
- 238000003702 image correction Methods 0.000 claims 2
- 241001062009 Indigofera Species 0.000 claims 1
- 230000001276 controlling effect Effects 0.000 claims 1
- 230000005693 optoelectronics Effects 0.000 claims 1
- 230000000007 visual effect Effects 0.000 claims 1
- 238000003384 imaging method Methods 0.000 description 11
- 238000013461 design Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 210000001072 colon Anatomy 0.000 description 4
- 210000003128 head Anatomy 0.000 description 4
- 230000003902 lesion Effects 0.000 description 4
- 210000001835 viscera Anatomy 0.000 description 4
- 238000003745 diagnosis Methods 0.000 description 3
- 210000002784 stomach Anatomy 0.000 description 3
- 101100129500 Caenorhabditis elegans max-2 gene Proteins 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 2
- 238000003759 clinical diagnosis Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 210000003238 esophagus Anatomy 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000005684 electric field Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000009472 formulation Methods 0.000 description 1
- 230000002496 gastric effect Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 230000020169 heat generation Effects 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000000968 medical method and process Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 210000000214 mouth Anatomy 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 244000144985 peep Species 0.000 description 1
- 230000008855 peristalsis Effects 0.000 description 1
- 230000004962 physiological condition Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000010187 selection method Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000009278 visceral effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Landscapes
- Endoscopes (AREA)
Abstract
本发明公开一种内窥镜照度的智能调节装置,包括医用内窥镜、图像采集卡、信号处理器、控制器、开关电源模块和冷光源;冷光源发出的光送入医用内窥镜,医用内窥镜将光信号转变成图像信号,并通过其图像输出接口将图像信号经图像采集卡传送给信号处理器;信号处理器接收图像采集卡传送的图像信号并进行处理,通过建立经典彩色图像及其色彩特征数据库,对实时采集的图像进行偏色校正、图像亮度校正,并将冷光源照度输出控制指令传送给控制器;控制器根据接收到的信号处理器控制指令,改变开关控制信号输出相位,使得开关电源模块输出的直流电压产生相应的变化,进而改变了冷光源的工作电压,冷光源输出照度获得优化调节。
The invention discloses an intelligent adjustment device for the illuminance of an endoscope, which includes a medical endoscope, an image acquisition card, a signal processor, a controller, a switching power supply module and a cold light source; the light emitted by the cold light source is sent into the medical endoscope, The medical endoscope converts the optical signal into an image signal, and transmits the image signal to the signal processor through the image acquisition card through its image output interface; the signal processor receives and processes the image signal transmitted by the image acquisition card, and establishes a classic color The image and its color feature database perform color cast correction and image brightness correction on the images collected in real time, and send the cold light source illumination output control command to the controller; the controller changes the switch control signal according to the received signal processor control command The output phase causes the DC voltage output by the switching power supply module to change accordingly, thereby changing the working voltage of the cold light source, and the output illuminance of the cold light source is optimally adjusted.
Description
技术领域 technical field
本发明涉及的是一种医疗器械自动控制技术领域的装置,具体是一种内窥镜照度的智能调节装置。 The invention relates to a device in the technical field of automatic control of medical equipment, in particular to an intelligent adjustment device for endoscope illumination. the
背景技术 Background technique
近年来,医用内窥镜系统在临床医学中得到广泛应用。医用内窥镜是一种可以将摄像头放入人体内的微型摄像系统,在自备光源照射下,通过光学系统将被观察目标成像在图像传感器的靶面上,由光信号转变为电信号,经放大、图像处理后在显示器上显示清晰的放大图像。在内窥镜系统的协助下,医生能更好地发现人体内软硬组织上发生的病变,并能让患者直观地、全面地了解自己身体中存在的各种问题。这些图像还能通过相应的通信接口存储在患者的数据库中,与文字、图形、X射线片图像等信息共同组成新一代的电子病历,能很方便地调阅和用于会诊,学术报告等场合,是新医疗模式的一个重要特点。 In recent years, medical endoscope systems have been widely used in clinical medicine. Medical endoscope is a miniature camera system that can put the camera into the human body. Under the illumination of its own light source, the observed target is imaged on the target surface of the image sensor through the optical system, and the optical signal is converted into an electrical signal. After magnification and image processing, a clear magnified image is displayed on the monitor. With the assistance of the endoscope system, doctors can better discover the lesions that occur on the soft and hard tissues in the human body, and allow patients to intuitively and comprehensively understand various problems in their own bodies. These images can also be stored in the patient's database through the corresponding communication interface, together with text, graphics, X-ray film images and other information to form a new generation of electronic medical records, which can be easily accessed and used in consultations, academic reports, etc. , is an important feature of the new medical model. the
尽管内窥镜作为人体内器官诊疗的医疗器械在临床上已经日益显示出其重要的医学意义和作用,但是,根据内窥镜不同的制造工艺,其技术性能却存在着极大的差别。其中,借助冷光源通过导光束来提供合适的亮度以便达到诊断和治疗的效果是医生进行临床观察时竭力追求的技术境界,然而,也是当前内窥镜配套工艺技术尚未真正解决的技术难题。这是因为人体内器官生理条件极为复杂、多变,如:病人可能存在积水、积便、内压波动、内脏蠕动等,造成被观察病灶处于非常复杂的运动状态,被观察部位往往相对内窥镜的采像点处于不稳定状况,一旦冷光源亮度不足,远处病灶可能会模糊不清,反之,亮度过强又容易引起泛光反射与衍射等现象,同样会影响图像的清晰度。要在内器官复杂的生理环境条件下取得良好的观察效果,冷光源输出光照度的智能化自动调节技术成为一项至关内窥镜临床诊断准确性的关键技术。 Although the endoscope, as a medical device for the diagnosis and treatment of human internal organs, has increasingly shown its important medical significance and role in clinical practice, but there are great differences in its technical performance according to the different manufacturing processes of the endoscope. Among them, using the cold light source to provide appropriate brightness through the light guide to achieve the effect of diagnosis and treatment is the technical realm that doctors strive to pursue when conducting clinical observations. However, it is also a technical problem that has not yet been truly solved by the current supporting technology of endoscopes. This is because the physiological conditions of the internal organs of the human body are extremely complex and changeable. For example, the patient may have water accumulation, stool accumulation, internal pressure fluctuations, visceral peristalsis, etc., causing the observed lesions to be in a very complicated state of motion, and the observed parts are often relatively internal. The image collection point of the speculum is in an unstable state. Once the brightness of the cold light source is insufficient, the distant lesions may be blurred. On the contrary, if the brightness is too strong, it will easily cause flood reflection and diffraction, which will also affect the clarity of the image. In order to obtain good observation results under the complex physiological environment conditions of internal organs, the intelligent automatic adjustment technology of the output light intensity of the cold light source has become a key technology for the accuracy of endoscopic clinical diagnosis. the
当前较为流行的方法是通过CCD内置的自动增益来实现成像清晰度的适度补偿,然而,此类方法并不具备调光功能,加上CCD自动增益调节范围小,增益调节模块已经集成于CCD内置的DSP模块上,无法进行修改或二次开发,这就极大程度地限制了临床使用的环境与条件,还必须要求病人的高度配合。显而易见,当前使用的内窥镜所配备的冷 光源输出光照度不具备智能化调节功能严重制约了内窥镜的临床使用效果。本发明不但能够极大限度地提高现有内窥镜技术水平,而且能够有效实现内窥镜照度的智能化调节。 The current more popular method is to achieve moderate compensation for imaging clarity through the built-in automatic gain of the CCD. However, this method does not have a dimming function. In addition, the automatic gain adjustment range of the CCD is small, and the gain adjustment module has been integrated into the built-in CCD. It cannot be modified or redeveloped on the existing DSP module, which greatly limits the environment and conditions of clinical use, and requires a high degree of cooperation from patients. Obviously, the output illuminance of the cold light source equipped with the currently used endoscope does not have the intelligent adjustment function, which seriously restricts the clinical use effect of the endoscope. The invention can not only greatly improve the technical level of the existing endoscope, but also can effectively realize the intelligent adjustment of the illuminance of the endoscope. the
经对现有技术文献的检索发现,专利“口腔显微内窥镜”(申请号:200810052271.6,尚未授权)介绍“一种口腔显微内窥镜,有电源,显微成像单元和照明单元,以及对应设置在显微成像单元的末端的图像传感器,分别与图像传感器的输出端相连的控制单元和监视器,电源分别连接图像传感器和照明单元。显微成像单元有接收待观测目标的第一组成像物镜和与图像传感器的输入端衔接,将所接收到的图像送到图像传感器的第二组成像物镜,设置在第一组成像物镜和第二组成像物镜之间的转向装置。照明单元有与电源相连的光纤冷光源,与光纤冷光源相连的耦合透镜,以及一端与耦合透镜相连,另一端用于照明待观测目标的照明光纤束。本发明可以随意观察牙齿的任意细节,也可以进行不同尺寸细节的连续观察,具有发热低,连续工作,调节色温,改变光纤出光照度等特点。”但是,该专利所述的“改变光纤出光照度”是通过人工观察显微图像效果,再由人工调节“色温滤光片”来改变“光纤出光照度”。专利技术说明书中所述“控制单元”也仅仅是用于处理“采用反射镜时,因为经过奇数次反射,存在镜像问题”。因此,该项技术在“光纤出光照度”的调节存在较大的技术不足。 After searching the existing technical literature, it was found that the patent "oral microendoscope" (application number: 200810052271.6, not yet authorized) introduces "an oral microendoscope, which has a power supply, a microscopic imaging unit and a lighting unit, And the corresponding image sensor arranged at the end of the microscopic imaging unit, the control unit and the monitor connected to the output end of the image sensor respectively, the power supply is respectively connected to the image sensor and the lighting unit.The microscopic imaging unit has the first to receive the target to be observed The group imaging objective lens is connected with the input end of the image sensor, and the received image is sent to the second group imaging objective lens of the image sensor, and the steering device is arranged between the first group imaging objective lens and the second group imaging objective lens. Lighting unit There is an optical fiber cold light source connected with the power supply, a coupling lens connected with the optical fiber cold light source, and one end is connected with the coupling lens, and the other end is used for illuminating the illumination fiber bundle of the target to be observed. The present invention can observe any details of teeth at will, and can also Continuous observation of details of different sizes has the characteristics of low heat generation, continuous work, adjustment of color temperature, and change of optical fiber output light intensity." However, the "changing optical fiber output light intensity" described in this patent is through manual observation of microscopic image effects, and then by Manually adjust the "color temperature filter" to change the "optical fiber output light intensity". The "control unit" mentioned in the patent specification is only used to deal with "when using a mirror, there is a mirror problem because of an odd number of reflections". Therefore, this technology has a large technical deficiency in the adjustment of "optical fiber output light intensity". the
又经对现有技术文献的检索发现,刘涛的“口腔微腔成像系统的设计与实现”(2008年,天津大学工学硕士学位论文)“针对牙科医生临床诊断的实际需要设计观察口腔内微小细节的口腔微腔成像系统,进行口腔内窥镜仪器的研制,主要包括口腔内窥镜仪器的总体设计方案的制定、口腔微腔成像光学系统设计、仪器照明系统设计、产品的机械设计以及样机产品的实验测试等部分”,其中,对照明系统的设计给出了较为详尽的方案,并口腔内窥镜系统的照明提供了光源及光纤的选择方法。但是,该论文始终未涉及内窥镜系统的光纤照度调节技术问题。 After searching the existing technical literature, it was found that Liu Tao's "Design and Implementation of Oral Microcavity Imaging System" (2008, Master's Degree Thesis of Tianjin University) "Designed to observe the tiny details in the oral cavity according to the actual needs of dentists for clinical diagnosis. Oral microcavity imaging system for the research and development of oral endoscopic instruments, mainly including the formulation of the overall design scheme of oral endoscopic instruments, the design of oral microcavity imaging optical system, the design of instrument lighting system, the mechanical design of products and prototype products The experimental test and other parts of ", among which, the design of the lighting system is given a more detailed plan, and the lighting of the oral endoscope system provides the selection method of the light source and optical fiber. However, this paper has never involved the optical fiber illumination adjustment technology of the endoscope system. the
发明内容 Contents of the invention
本发明的目的在于针对上述现有技术中的不足,提供一种内窥镜照度的智能调节装置,能够通过信号处理器对接收到的图像信息进行智能判断来优化冷光源照度的输出强度。 The purpose of the present invention is to provide an intelligent adjustment device for endoscope illuminance in view of the deficiencies in the prior art above, which can optimize the output intensity of cold light source illuminance by intelligently judging received image information through a signal processor. the
本发明是通过以下技术方案实现的,本发明包括:医用内窥镜、图像采集卡、信号处理器、控制器、开关电源模块、冷光源。医用内窥镜的图像输出接口与图像采集卡的输入接口连接,图像采集卡的输出接口与信号处理器的输入接口连接, 信号处理器的输出接口与控制器的输入接口连接,控制器的输出接口与开关电源模块的控制信号输入接口连接,开关电源模块的电源输入接口与直流电输出接口连接,开关电源模块的输出接口与冷光源的输入接口连接。冷光源发出的光照度射入医用内窥镜,医用内窥镜将光信号转变成图像信号,并通过其图像输出接口将图像信号经图像采集卡传送给信号处理器;信号处理器接收图像采集卡传送的图像信号并进行处理,通过建立经典彩色图像及其色彩特征数据库,对实时采集的图像进行偏色校正、图像亮度校正,并将冷光源照度输出控制指令传送给控制器;控制器根据接收到的信号处理器控制指令,改变开关控制信号输出相位,使得开关电源模块输出的直流电压产生相应的变化,进而改变了冷光源的工作电压,因此冷光源输出照度获得优化调节。 The present invention is realized through the following technical solutions, and the present invention includes: a medical endoscope, an image acquisition card, a signal processor, a controller, a switching power supply module, and a cold light source. The image output interface of the medical endoscope is connected to the input interface of the image acquisition card, the output interface of the image acquisition card is connected to the input interface of the signal processor, the output interface of the signal processor is connected to the input interface of the controller, and the output interface of the controller The interface is connected to the control signal input interface of the switching power supply module, the power input interface of the switching power supply module is connected to the DC output interface, and the output interface of the switching power supply module is connected to the input interface of the cold light source. The illuminance emitted by the cold light source is injected into the medical endoscope, and the medical endoscope converts the light signal into an image signal, and transmits the image signal to the signal processor through the image acquisition card through its image output interface; the signal processor receives the image acquisition card The transmitted image signal is processed, through the establishment of a classic color image and its color feature database, color cast correction and image brightness correction are performed on the real-time collected image, and the cold light source illuminance output control command is sent to the controller; the controller receives the The received signal processor control command changes the output phase of the switch control signal, so that the DC voltage output by the switching power supply module changes accordingly, and then changes the working voltage of the cold light source, so the output illuminance of the cold light source is optimally adjusted. the
所述医用内窥镜,由头端部、弯曲部、主软管、操作部、微型CCD、图像输出接口、导光插头构成机电一体化部件。头端部,包括:微型凸透物镜、传像光纤始端、传光光纤末端;微型凸透物镜设置于头端部的前端,用于接收来自物体表面的反射光;弯曲部是头端部与主软管的中段机械连接部件,头端部的后端与弯曲部的前端连接,弯曲部的后端与主软管的前端连接,主软管中的传像光纤后端与微型CCD的输入端口连接;微型CCD即微型电荷耦合图像传感器,制作时在其输入接口已经将微型凸透目镜与CCD芯片集成、固化在一起;微型CCD的输出端口与图像输出接口连接;主软管除了包裹传像光纤和传光光纤之外,还包含一根调节内窥镜头端部窥视角度的微细钢丝,微细钢丝的前端与头端部的前端机械紧固,微细钢丝的后端与操作部的调节旋钮连接,随着操作部调节旋钮的转动能够改变微细钢丝在主软管中的长短尺寸,进而改变弯曲部的曲率,因此能够达到头端部窥视角度的变化;主软管中的传光光纤后端与导光插头光输出端口连接。从冷光源发出的光,由导光插头光输入端口将冷光源光束送入传光光纤,经传光光纤将冷光源光束传输到头端部照明被观察物体或视场。为使整个视场照度均匀,传光光纤照明范围应大于视场角,因此不仅要求传光光纤的直径尽量小,柔软性好,而且要求有较高的数值孔径,才能达到提高视场光照度的要求。被观察物体的反射光经过头端部得微型凸透物镜汇聚后,成像于传像光纤的端面上,经过传像光纤传出,再经过微型凸透目镜放大后,投射到CCD的靶面上通过光电转换,把光信号转变成图像像素序列电信号,通过图像输出接口将图像信号经图像采集卡传输到信号处理器。 The medical endoscope is composed of a head end, a bending part, a main hose, an operating part, a micro-CCD, an image output interface, and a light guide plug to form a mechatronic component. The head part includes: a micro-convex objective lens, the beginning end of the image transmission fiber, and the end of the light-transmission fiber; the micro-convex objective lens is arranged at the front end of the head part to receive reflected light from the surface of the object; the bending part is the head part and the The middle part of the mechanical connection part of the main hose, the rear end of the head end is connected to the front end of the bending part, the rear end of the bending part is connected to the front end of the main hose, the rear end of the image transmission fiber in the main hose is connected to the input of the micro CCD port connection; micro CCD is a micro charge-coupled image sensor, and the micro convex eyepiece and CCD chip have been integrated and solidified at its input interface during production; the output port of the micro CCD is connected to the image output interface; In addition to optical fiber and optical fiber, it also includes a fine steel wire to adjust the viewing angle of the end of the endoscopic lens. The front end of the fine steel wire is mechanically fastened to the front end of the head end, and the rear end of the fine steel wire is connected to the adjustment knob of the operation part. Connection, with the rotation of the adjustment knob of the operation part, the length of the fine steel wire in the main hose can be changed, and then the curvature of the bending part can be changed, so that the peep angle of the head end can be changed; the light-transmitting optical fiber in the main hose The end is connected with the light output port of the light guide plug. The light emitted from the cold light source is sent to the light-transmitting optical fiber by the light input port of the light guide plug, and the cold light source beam is transmitted to the head end to illuminate the observed object or field of view through the light-transmitting optical fiber. In order to make the illuminance of the entire field of view uniform, the illumination range of the light-transmitting fiber should be larger than the viewing angle. Therefore, not only the diameter of the light-transmitting fiber is required to be as small as possible, the flexibility is good, but also a higher numerical aperture is required to improve the illuminance of the field of view. Require. After the reflected light of the observed object is converged by the micro-convex objective lens at the end of the head, it is imaged on the end face of the image-transmitting fiber, transmitted through the image-transmitting fiber, and then magnified by the micro-convex eyepiece and projected onto the target surface of the CCD. Through photoelectric conversion, the optical signal is converted into an image pixel sequence electrical signal, and the image signal is transmitted to the signal processor through the image acquisition card through the image output interface. the
所述信号处理器,包括:输入接口、信号处理模块、数据库模块、输出接口。输入接口输入端口接收来自图像采集卡输出的数字图像信号,输入接口输出端口与信号处理模块的输入端口连接;信号处理模块的输出端口与输出接口的输入端口连接;数据库模块作为信号处理器的内存模块通过数据总线与信号处理模块进行数据交互;输出接口的输出端口与控制器的输入接口连接。 The signal processor includes: an input interface, a signal processing module, a database module, and an output interface. The input port of the input interface receives the digital image signal output from the image acquisition card, and the output port of the input interface is connected with the input port of the signal processing module; the output port of the signal processing module is connected with the input port of the output interface; the database module is used as the memory of the signal processor The module performs data interaction with the signal processing module through the data bus; the output port of the output interface is connected with the input interface of the controller. the
所述数据库模块,其结构由区构成,每个区存储人体器官内部经典彩色图像及其色彩特征数据,如:食道区存储食道内窥镜经典彩色图像及其色彩特征数据,胃区存储胃壁内窥镜经典彩色图像及其色彩特征数据,结肠区存储结肠壁内窥镜经典彩色图像及其色彩特征数据等。所述色彩特征,包括:RGB彩色空间三基色R(红)、G(绿)、B(蓝)的像素值R0(u,v)、G0(u,v)、B0(u,v)及其匹配比例系数、均值 和三均值之间的最大与最小值。 The structure of the database module is composed of areas, and each area stores classic color images of human organs and their color feature data, such as: the esophagus area stores classic color images of esophageal endoscopes and their color feature data, and the stomach area stores the internal color images of the stomach wall. The classic color image of the endoscope and its color feature data, and the colon area stores the classic color image of the colon wall endoscope and its color feature data. The color features include: pixel values R 0 (u,v), G 0 (u,v), B 0 (u, v) and its matching ratio coefficient, mean The maximum and minimum values between and the three means.
R0(u,v)、G0(u,v)、B0(u,v)又被称为经典图像像素值,其均值为 R 0 (u,v), G 0 (u,v), and B 0 (u,v) are also called classical image pixel values, and their average values are
及其综合均值J0为 and its comprehensive mean value J 0 is
其中,m、n分别为图像坐标的行、列数;r、g、b分别为三基色R、G、B的匹配比例系数。 Among them, m and n are the number of rows and columns of the image coordinates respectively; r, g and b are the matching ratio coefficients of the three primary colors R, G and B respectively. the
三均值之间的最大与最小值为 The maximum and minimum values among the three means are
其中,(u,v)为内窥镜所采集到图像的像素坐标,u、v分别表示图像的列与行坐标值。 Among them, (u, v) are the pixel coordinates of the image collected by the endoscope, and u and v represent the column and row coordinate values of the image respectively. the
I0max(u,v)、I0min(u,v)又被分别称为经典图像的最大、最小亮度输出。 I 0max (u,v) and I 0min (u,v) are respectively called the maximum and minimum luminance output of the classic image.
所述信号处理模块对接收到的图像信号进行处理,首先分别获取RGB实时彩色图像的R、G、B三基色像素值及其均值,然后对实时采集的图像进行偏色校正,再选取偏色校正后的三基色像素值中的最大与最小值,进行图像亮度校正,接着求取图像亮度校正后的图像像素均值及其综合均值,通过比较图像亮度校正后的图像像素综合均值与数据库中经典图像像素综合均值的大小,最终将调节冷光源照度的控制指令输出给控制器。 The signal processing module processes the received image signal, first respectively obtains the R, G, B three primary color pixel values and their mean values of the RGB real-time color image, then performs color cast correction on the real-time collected image, and then selects the color cast The maximum and minimum values of the corrected three primary color pixel values are corrected for image brightness, and then the average value of image pixels after image brightness correction and its comprehensive average are calculated, and the comprehensive average value of image pixels after image brightness correction is compared with the classic The size of the comprehensive average value of the image pixels will finally output the control command to adjust the illuminance of the cold light source to the controller. the
与现有技术相比,本发明具有如下有益效果: Compared with prior art, the present invention has following beneficial effect:
①使得内窥镜临床操作十分简便,临床医生能够全神贯注地寻找与观察病灶,不必为调节照度而费神、费力;②无论内窥镜如何弯曲,其照度能够实现智能调节并达到优化效果。因此,本发明既是能够省时省事、提高医疗诊断效果与效率的一项新技术。 ①It makes the clinical operation of the endoscope very simple, and the clinician can concentrate on finding and observing the lesion without having to worry about adjusting the illumination; ②No matter how the endoscope is bent, the illumination can be intelligently adjusted and optimized. Therefore, the present invention is a new technology that can save time and trouble, and improve the effect and efficiency of medical diagnosis. the
附图说明 Description of drawings
图1是本发明的系统结构示意图; Fig. 1 is a schematic diagram of the system structure of the present invention;
图2是本发明中信号处理器的结构框图。 Fig. 2 is a structural block diagram of the signal processor in the present invention. the
具体实施方式 Detailed ways
下面结合附图对本发明的实施例作详细说明:本实施例在以本发明技术方案为前提下进行实施,给出了详细的实施方式和具体的操作过程,但本发明的保护范围不限于下述的实施例。 The embodiments of the present invention are described in detail below in conjunction with the accompanying drawings: this embodiment is implemented on the premise of the technical solution of the present invention, and detailed implementation methods and specific operating procedures are provided, but the protection scope of the present invention is not limited to the following the described embodiment. the
如图1所示,本实施例包括:医用内窥镜1、图像采集卡2、信号处理器3、控制器4、开关电源模块5、冷光源6。医用内窥镜1的图像输出接口与图像采集卡2的输入接口连接,图像采集卡2的输出接口与信号处理器3的输入接口连接,信号处理器3的输出接口与控制器4的输入接口连接,控制器4的输出接口与开关电源模块5的控制信号输入接口连接,开关电源模块5的电源输入接口与12V直流电输出接口连接,开关电源模块5的输出接口与冷光源6的输入接口连接。从冷光源6发出的光,由导光插头光输入端口将冷光源6光束送入传光光纤,经传光光纤将冷光源6光束传输到头端部照明被观察物体或视场。
As shown in FIG. 1 , this embodiment includes: a medical endoscope 1 , an
所述医用内窥镜,采用规格型号为0°/φ4×170(mm)的内窥镜,即头端部的物镜平面与弯曲部断面平行,或者说交角为0°,外径为4mm,软管长度(即弯曲 部与主软管的总长)为170mm。被观察体的反射光经过头端部得微型凸透物镜汇聚后,成像于传像光纤的端面上,经过传像光纤传出,再经过微型凸透目镜放大后,投射到CCD的靶面上通过光电转换,把光信号转变成图像像素序列电信号,通过图像输出接口将图像信号经图像采集卡2传输到信号处理器3。
The medical endoscope adopts an endoscope with a specification model of 0°/φ4×170 (mm), that is, the plane of the objective lens at the head end is parallel to the section of the curved part, or the angle of intersection is 0°, and the outer diameter is 4mm. The hose length (that is, the total length of the bend and the main hose) is 170mm. After the reflected light of the observed object is converged by the micro-convex objective lens at the head end, it is imaged on the end face of the image-transmitting fiber, transmitted through the image-transmitting fiber, and then magnified by the micro-convex eyepiece, and then projected onto the target surface of the CCD Through photoelectric conversion, the optical signal is converted into an image pixel sequence electrical signal, and the image signal is transmitted to the
如图2所示,所述信号处理器3,包括:输入接口31、信号处理模块32、数据库模块33、输出接口34。输入接口31输入端口接收来自图像采集卡2输出的数字图像信号,输入接口31输出端口与信号处理模块32的输入端口连接;信号处理模块32的输出端口与输出接口34的输入端口连接;数据库模块33作为信号处理器3的内存模块通过数据总线与信号处理模块32进行数据交互;输出接口34的输出端口与控制器4的输入接口连接。
As shown in FIG. 2 , the
所述数据库模块33,其结构由区构成,每个区存储人体器官内部经典彩色图像及其色彩特征数据。所述经典图像,即由内窥镜图像传感器获取的色彩与清晰度俱佳的人体器官内部彩色图像,称之为人体器官内部经典彩色图像,简称经典图像,如:食道区存储食道内窥镜经典彩色图像及其色彩特征数据,胃区存储胃壁内窥镜经典彩色图像及其色彩特征数据,结肠区存储结肠壁内窥镜经典彩色图像及其色彩特征数据等。所述色彩特征,包括:RGB彩色空间三基色R(红)、G(绿)、B(蓝)的像素值R0(u,v)、G0(u,v)、B0(u,v)及其匹配比例系数、均值 和三均值之间的最大与最小值。 The structure of the database module 33 is composed of areas, and each area stores classic color images inside human organs and their color feature data. The classic image, that is, the internal color image of human organs with excellent color and clarity obtained by the endoscope image sensor, is called the classic color image inside human organs, referred to as classic image, such as: esophageal endoscope stored in the esophagus The classic color image and its color feature data, the stomach area stores the classic color image of the gastric wall endoscope and its color feature data, the colon area stores the classic color image of the colon wall endoscope and its color feature data, etc. The color features include: pixel values R 0 (u,v), G 0 (u,v), B 0 (u, v) and its matching ratio coefficient, mean The maximum and minimum values between and the three means.
R0(u,v)、G0(u,v)、B0(u,v)又被称为经典图像像素值,其均值为 R 0 (u,v), G 0 (u,v), and B 0 (u,v) are also called classical image pixel values, and their average values are
及其综合均值J0为 and its comprehensive mean value J 0 is
其中,m、n分别为图像坐标的行、列数;r、g、b分别为三基色R、G、B的匹配比例系数。 Among them, m and n are the number of rows and columns of the image coordinates respectively; r, g and b are the matching ratio coefficients of the three primary colors R, G and B respectively. the
三均值之间的最大与最小值为 The maximum and minimum values among the three means are
其中,(u,v)为内窥镜所采集到图像的像素坐标,u、v分别表示图像的列与行坐标值。 Among them, (u, v) are the pixel coordinates of the image collected by the endoscope, and u and v respectively represent the column and row coordinate values of the image. the
I0max(u,v)、I0min(u,v)又被分别称为经典图像的最大、最小亮度输出。 I 0max (u,v) and I 0min (u,v) are respectively called the maximum and minimum luminance output of the classic image.
所述信号处理模块32对接收到的图像信号进行处理,首先分别获取RGB实时彩色图像的R、G、B三基色像素值及其均值,然后对实时采集的图像进行偏色校正,再选取偏色校正后的三基色像素值中的最大与最小值,进行图像亮度校正,接着求取图像亮度校正后的图像像素均值及其综合均值,通过比较图像亮度校正后的图像像素综合均值与数据库中经典图像像素综合均值的大小,最终调节冷光源照度输出。具体详细的实现过程如下: The signal processing module 32 processes the received image signal, first respectively obtains the R, G, B three primary color pixel values and their mean values of the RGB real-time color image, then performs color cast correction to the image collected in real time, and then selects the color cast The maximum and minimum values of the three primary color pixel values after color correction are used to correct the image brightness, and then the mean value of the image pixels after image brightness correction and its comprehensive mean are calculated, and the comprehensive mean value of the image pixels after image brightness correction is compared with The size of the comprehensive mean value of the classic image pixels, and finally adjust the illuminance output of the cold light source. The detailed implementation process is as follows:
(1)、根据内窥镜图像传感器输出的实时彩色图像,分别获取RGB彩色图像的R、G、B三基色像素值R1(u,v)、G1(u,v)、B1(u,v),并求取整个图像三基色像素均值 即 (1) According to the real-time color image output by the endoscope image sensor, obtain the R, G, and B three primary color pixel values R 1 (u,v), G 1 (u,v), B 1 ( u, v), and calculate the average value of the three primary color pixels of the entire image Right now
R1(u,v)、G1(u,v)、B1(u,v)又被称为实时图像三基色像素值。 R 1 (u,v), G 1 (u,v), and B 1 (u,v) are also called real-time image three primary color pixel values.
(2)、对实时采集的图像进行偏色校正,即 (2) Perform color cast correction on the images collected in real time, namely
R2(u,v)、G2(u,v)、B2(u,v)被称为偏色校正后的三基色像素值。 R 2 (u,v), G 2 (u,v), and B 2 (u,v) are called three primary color pixel values after color cast correction.
(3)、选取偏色校正后的三基色像素均值中的最大与最小值,即 (3) Select the maximum and minimum values of the average values of the three primary color pixels after color cast correction, namely
其中,偏色校正后的三基色像素均值为 Among them, the average value of the three primary color pixels after color cast correction is
I2max(u,v)、I2min(u,v)又被分别称为偏色校正后图像的最大、最小亮度输出。 I 2max (u,v) and I 2min (u,v) are respectively called the maximum and minimum luminance output of the image after color cast correction.
(4)、图像亮度校正,即 (4), image brightness correction, namely
被分别称为亮度校正后的图像像素值。 are respectively referred to as brightness-corrected image pixel values.
(5)、求取图像亮度校正后的图像像素均值 即 (5) Calculate the average value of image pixels after image brightness correction Right now
求取其综合均值为J: Find its comprehensive mean value J:
(6)、比较J与数据库中J0的大小,调节冷光源照度输出。 (6) Compare J with the size of J 0 in the database, and adjust the illuminance output of the cold light source.
当J-J0≠0时,向冷光源发送控制指令,调节冷光源照度输出,具体控制方法如下, When JJ 0 ≠0, send a control command to the cold light source to adjust the illuminance output of the cold light source. The specific control method is as follows,
其中,V(t)为当前时刻冷光源工作电压,V(t+1)为下一时刻冷光源工作电压,Vmax、Vmin分别为冷光源额定最高与最低工作电压。 Among them, V(t) is the working voltage of the cold light source at the current moment, V(t+1) is the working voltage of the cold light source at the next moment, V max and V min are the rated maximum and minimum working voltages of the cold light source respectively.
因此在内窥镜整个医疗过程始终实现其照度的智能调节,使得观察和计算机处理、分析人体内部器官图像时能够获得照度的优化效果。 Therefore, the intelligent adjustment of the illuminance of the endoscope is always realized throughout the medical process, so that the optimization effect of the illuminance can be obtained when observing and computer processing and analyzing the images of the internal organs of the human body. the
所述控制器4,根据接收到的信号处理器3控制指令,改变其输出开关信号的前沿出现时刻,即开关控制信号输出相位,因而使得开关电源模块5输出的直流电压产生相应的变化,进而改变了冷光源6的工作电压,冷光源6输出照度获得相应调节。
The
所述开关电源模块5,由电力电子开关器件构成的输出电压可控的直-直开关电源电路。控制器4能够根据信号处理器3控制指令产生脉冲控制信号,并将该脉冲控制信号传输给开关电源模块5控制信号输入端;开关电源模块5就能够根据该脉冲控制信号对其中的直流电压输入信号进行斩波,经斩波后的信号具有相应占空比,通过其中的滤波、平滑作用,便输出了对应信号处理器3控制指令的直流电压输出。
The switching
所述冷光源,冷光源是利用化学能、电能、生物能激发的光源,具有十分优良的光学变闪特性。由于其发光温度低于环境温度,故称其为冷发光,并称此类光源叫做冷光源。冷光源的发光原理是是在电场作用下,产生电子碰撞激发荧光材料产生发光现象。冷光源的特点是把其他的能量几乎全部转化为可见光。本实施例中所述冷光源6,采用XD-300系列医用内窥镜冷光源。
As for the cold light source, the cold light source is a light source excited by chemical energy, electric energy, and biological energy, and has very good optical flickering characteristics. Because its luminous temperature is lower than the ambient temperature, it is called cold light, and this type of light source is called cold light source. The luminescent principle of the cold light source is that under the action of an electric field, electrons collide to excite the fluorescent material to produce luminescence. The cold light source is characterized by converting almost all other energies into visible light. The cold
本实施例中,冷光源发出的光送入医用内窥镜,医用内窥镜将光信号转变成图像信号,并通过其图像输出接口将图像信号经图像采集卡传送给信号处理器;信号处理器接收图像采集卡传送的图像信号并进行处理,通过建立经典彩色图像及其色彩特征数据库,对实时采集的图像进行偏色校正、图像亮度校正,并将冷光源照度输出控制指令传送给控制器;控制器根据接收到的信号处理器控制指令,改变开关控制信号输出相位,使得开关电源模块输出的直流电压产生相应的变化,进而改变了冷光源的工作电压,冷光源输出照度获得优化调节。 In this embodiment, the light emitted by the cold light source is sent into the medical endoscope, and the medical endoscope converts the light signal into an image signal, and transmits the image signal to the signal processor through the image acquisition card through its image output interface; the signal processing The receiver receives and processes the image signal transmitted by the image acquisition card, and performs color cast correction and image brightness correction on the real-time collected image by establishing a classic color image and its color feature database, and sends the cold light source illumination output control command to the controller The controller changes the output phase of the switch control signal according to the received signal processor control instruction, so that the DC voltage output by the switching power supply module changes accordingly, and then changes the working voltage of the cold light source, and the output illuminance of the cold light source is optimally adjusted. the
本发明能够通过信号处理器对接收到的图像信息进行智能判断来优化冷光源照度的 输出强度,实现内窥镜照度的智能调节:①内窥镜临床操作十分简便,临床医生不必为调节照度而费神、费力;②无论内窥镜如何弯曲,其照度能够实现智能调节并达到优化效果,无论人工观察还是计算机处理均能获得优质、清晰的内窥镜图像。 The present invention can optimize the output intensity of the illuminance of the cold light source through the intelligent judgment of the received image information by the signal processor, and realize the intelligent adjustment of the illuminance of the endoscope: ①The clinical operation of the endoscope is very simple, and the clinician does not need to adjust the illuminance No matter how the endoscope bends, its illumination can be intelligently adjusted and optimized, and high-quality and clear endoscopic images can be obtained regardless of manual observation or computer processing. the
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210057074.XA CN102846301B (en) | 2011-07-08 | 2012-03-06 | Intelligent adjusting device of endoscope illumination |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201110191033.5 | 2011-07-08 | ||
CN201110191033 | 2011-07-08 | ||
CN201210057074.XA CN102846301B (en) | 2011-07-08 | 2012-03-06 | Intelligent adjusting device of endoscope illumination |
Publications (2)
Publication Number | Publication Date |
---|---|
CN102846301A CN102846301A (en) | 2013-01-02 |
CN102846301B true CN102846301B (en) | 2014-07-02 |
Family
ID=47393582
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201210057074.XA Expired - Fee Related CN102846301B (en) | 2011-07-08 | 2012-03-06 | Intelligent adjusting device of endoscope illumination |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102846301B (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104398231B (en) * | 2014-12-04 | 2017-01-25 | 中国科学院深圳先进技术研究院 | System and method for adjusting stereoscopic endoscope light source brightness |
CN104568971B (en) * | 2015-02-05 | 2018-02-02 | 昆山软龙格自动化技术有限公司 | A kind of image detection device based on data statistics data mining |
CN106419807B (en) * | 2016-10-30 | 2018-08-03 | 富兰肯(上海)医疗科技有限公司 | A kind of intelligent medical endoscope |
CN109247905B (en) * | 2018-10-29 | 2022-05-06 | 重庆金山医疗技术研究院有限公司 | Method for judging whether light guide part is pulled out from host machine by endoscope system and endoscope system |
CN110779692B (en) * | 2019-11-06 | 2021-08-17 | 浙江大学医学院附属妇产科医院 | A kind of medical endoscope optical performance detection method |
CN117017188A (en) * | 2023-08-24 | 2023-11-10 | 华伦医疗用品(深圳)有限公司 | Imaging system and method of uterine cavity endoscope |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4502577B2 (en) * | 2002-12-19 | 2010-07-14 | Hoya株式会社 | Electronic endoscope device |
JP5173120B2 (en) * | 2005-05-23 | 2013-03-27 | オリンパスメディカルシステムズ株式会社 | Endoscope device |
CN201039381Y (en) * | 2007-05-11 | 2008-03-19 | 西安北方光电有限公司 | CCD processing device for interior peeping mirror |
CN101380225B (en) * | 2007-09-04 | 2011-01-12 | 北京大学 | A method and device for collecting blood vessel images illuminated by near-infrared light |
CN101219045A (en) * | 2008-02-03 | 2008-07-16 | 天津大学 | Oral Microscope |
CN101480335A (en) * | 2009-02-05 | 2009-07-15 | 上海交通大学 | Device for automatically regulating illumination intensity of capsule endoscope |
-
2012
- 2012-03-06 CN CN201210057074.XA patent/CN102846301B/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
CN102846301A (en) | 2013-01-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102846301B (en) | Intelligent adjusting device of endoscope illumination | |
CN210472105U (en) | Endoscopic systems and endoscopes with an off-center field of view | |
US11219359B2 (en) | Endoscope system | |
US8197399B2 (en) | System and method for producing and improving images | |
US7316647B2 (en) | Capsule endoscope and a capsule endoscope system | |
JP3224391U (en) | Endoscope tip and endoscope | |
CN107822585B (en) | A kind of multi-functional endoscopic system | |
US20060004258A1 (en) | Image-type intubation-aiding device | |
CN104042179A (en) | Integrated medical endoscope system | |
JP6401800B2 (en) | Image processing apparatus, operation method of image processing apparatus, operation program for image processing apparatus, and endoscope apparatus | |
CN102641109B (en) | Method for intelligently adjusting endoscope illuminance | |
CN107205629A (en) | Image processing apparatus and imaging system | |
CN207768343U (en) | A kind of endoscopic system | |
CN101219045A (en) | Oral Microscope | |
CN109788891A (en) | Endoscope mirror body, endoscope processor and endoscope-use adapter | |
CN201316255Y (en) | Medical celoscope | |
WO2019203006A1 (en) | Endoscope device, endoscope processor device, and endoscope image display method | |
JP6308673B2 (en) | Image processing apparatus for electronic endoscope and electronic endoscope system | |
CN208017468U (en) | A kind of medical miniature integrated chip type fujinon electronic video endoscope | |
CN106068644B (en) | Conveyer system and processing unit | |
US12075982B2 (en) | Light source device having illumination controller controlling multiple light sources in multiple states, control method of the light source, and endoscope system having the light source | |
JP3714636B2 (en) | Endoscope device | |
CN206641837U (en) | A kind of electronic colonoscope | |
CN112438695A (en) | Laparoscope system based on panoramic VR technology | |
CN202277323U (en) | Wireless capsule endoscope with annular lens |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C41 | Transfer of patent application or patent right or utility model | ||
TR01 | Transfer of patent right |
Effective date of registration: 20161226 Address after: 223001 science and Technology Industrial Park, Jiangsu, Huaian science and technology road, No. 18 Patentee after: North Jiangsu Institute of Shanghai Jiaotong University Address before: 200240 Minhang District, Shanghai, Dongchuan Road, No. 800, No. Patentee before: SHANGHAI JIAO TONG University |
|
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140702 |