CN106937036B

CN106937036B - Image data transmission apparatus and endoscope system including the same

Info

Publication number: CN106937036B
Application number: CN201610574692.XA
Authority: CN
Inventors: 姜旭; 申一亨
Original assignee: Inthesmart Co Ltd
Current assignee: Inthesmart Co Ltd
Priority date: 2015-12-29
Filing date: 2016-07-19
Publication date: 2020-10-30
Anticipated expiration: 2036-07-19
Also published as: CN106937036A; KR101786840B1; KR20170078489A

Abstract

The invention discloses an image data transmission apparatus and an endoscope system including the same, the endoscope system including: an image sensor generating image data and including a first image port and a second image port for transmitting at least a part of the image data; the image data transmission apparatus includes: the first optical fiber module and the second optical fiber module are respectively connected to the first image port and the second image port; an image data input part which is connected with the image data transmission equipment and transmits the image data output by the image data transmission equipment to a set path; and an image processing unit that executes image processing on the image data transmitted by the image data input unit under control of a CPU. The system can overcome the problem of bandwidth limitation in image data transmission.

Description

Image data transmission apparatus and endoscope system including the same

Technical Field

The present invention relates to an image data transmission apparatus and an endoscope system including the image data transmission apparatus.

Background

The endoscope system provides the image of the inside of the human body to the doctor during the operation or the examination, and the doctor can confirm the image, so that the operation or the examination can be stably and correctly performed.

Recently, there is an increasing demand for endoscope systems to provide not only a simple image but also various functions to the endoscope.

Therefore, research is underway on an endoscope system capable of processing images at high speed and providing various functions.

Documents of the prior art

Patent document

Korean laid-open patent No. 10-2007-0071556 (published: 2007, 7, 4)

Disclosure of Invention

Technical problem

An object according to the present invention is to provide an image data transmission apparatus and an endoscope system including the image data transmission apparatus, which are capable of overcoming the problem of bandwidth limitation in image data transmission.

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood from the following description by a person of ordinary skill in the art to which the present invention pertains.

Means for solving the problems

An image data transmission apparatus according to an embodiment of the present invention includes: an image sensor generating image data and including a first image port and a second image port for transmitting at least a part of the image data; and the first optical fiber module and the second optical fiber module are respectively connected to the first image port and the second image port.

The first optical fiber module is connected to the first image port and the third image port, the second optical fiber module is connected to the second image port and the fourth image port, and the first optical fiber module and the second optical fiber module transmit the image data in a differential mode.

The first optical fiber module and the second optical fiber module transmit the image data in a single-ended mode.

And transmitting at least a part of the image data through the first optical fiber module and the second optical fiber module without a serialization process of the image data.

The first optical fiber module and the second optical fiber module are directly connected to the first image port and the second image port or connected to the first image port and the second image port through connectors.

The image data transmission apparatus of the present invention further includes: the system comprises an additional image sensor, a first additional optical fiber module and a second additional optical fiber module; the additional image sensor senses light with a different wavelength from the light sensed by the image sensor and generates additional image data, and includes a first additional image port and a second additional image port for transmitting at least a portion of the additional image data; the first additional fiber optic module and the second additional fiber optic module are respectively connected to the first additional image port and the second additional image port.

The first additional optical fiber module is connected to a third additional image port while being connected to the first additional image port, the second additional optical fiber module is connected to a fourth additional image port while being connected to the second additional image port, and the first additional optical fiber module and the second additional optical fiber module transmit the additional image data in a differential mode.

The first additional fiber optic module and the second additional fiber optic module transmit the additional image data in a single-ended mode.

And transmitting at least a portion of the additional image data through the first additional fiber optic module and the second additional fiber optic module without performing a serialization process on the additional image data.

An endoscope system according to an embodiment of the present invention includes: the image data transmission device comprises an image sensor, a first optical fiber module and a second optical fiber module, wherein the image sensor generates image data and comprises a first image port and a second image port, the first image port and the second image port are used for transmitting at least one part of image data, and the first optical fiber module and the second optical fiber module are respectively connected to the first image port and the second image port; an image data input part which is connected with the image data transmission equipment and transmits the image data output by the image data transmission equipment according to a set path; and an image processing unit that performs image processing on the image data transmitted by the image data input unit under control of a CPU.

The CPU performs user interface processing on the image data, and the image processing unit overlaps the user interface with the image data.

The first fiber optic module and the second fiber optic module transmit the image data in a differential mode or in a single-ended mode.

The endoscope system of an embodiment of the present invention further includes an additional image sensor, a first additional optical fiber module, and a second additional optical fiber module, wherein the additional image sensor senses light with a wavelength different from that of the light sensed by the image sensor and generates additional image data, and includes a first additional image port and a second additional image port, and the first additional image port and the second additional image port are used for transmitting at least a part of the additional image data; the first additional optical fiber module and the second additional optical fiber module are respectively connected to the first additional image port and the second additional image port, and transmit the additional image data in a differential mode or a single-ended mode.

The image data input part receives the image data and additional image data, transmits the additional image data to the CPU, and transmits the image data to the image processing part, and the image processing part receives the additional image data transmitted by the CPU and overlaps the additional image data.

The image sensor also comprises a first clock port; the image data transmission device also comprises a clock optical fiber module connected to the first clock port; the fiber optic clock module transmits a clock signal in a differential mode or in a single-ended mode.

The transmission direction of the image data transmitted by the first optical fiber module and the second optical fiber module is the same as the transmission direction of the clock signal transmitted by the clock optical fiber module.

The image data transmission equipment also comprises a simulation optical fiber module; the simulation optical fiber module may transmit a signal in a direction opposite to a transmission direction of the image data and the clock signal.

The additional image sensor further comprises a first additional clock port; the image data transmission equipment also comprises an additional optical fiber module for a clock; the additional optical fiber module for the clock is connected to the first additional port for the clock; the clock uses an additional fiber optic module to transmit a clock signal in either differential mode or single-ended mode.

The transmission directions of the additional image data and the clock signal of the first additional optical fiber module, the second additional optical fiber module, and the additional optical fiber module for clock are the same as each other.

The endoscope system of an embodiment of the present invention further includes an additional simulation fiber module; the additional simulation fiber optic module may transmit a signal in a direction opposite to a transmission direction of the additional image data and the clock signal.

The image data transmission equipment also comprises an optical fiber module for synchronous confirmation; the synchronization confirmation fiber optic module transmits a synchronization confirmation signal in a differential mode or in a single-ended mode.

The image data transmission direction of the first optical fiber module and the second optical fiber module is opposite to the transmission direction of the synchronization confirmation signal of the synchronization confirmation optical fiber module.

The endoscope system of an embodiment of the present invention further includes a simulation fiber module; and the simulation optical fiber module transmits signals to the direction same as the transmission direction of the image data.

When one of the first optical fiber module and the second optical fiber module is an abnormal optical fiber module which cannot transmit the image data, the simulation optical fiber module replaces the abnormal optical fiber module to transmit the image data.

The image data transmission equipment also comprises an additional optical fiber module for synchronous confirmation; the additional fiber optic module for synchronization confirmation transmits a synchronization confirmation signal in a differential mode or in a single-ended mode.

The additional image data transmission direction of the first additional optical fiber module and the second additional optical fiber module and the transmission direction of the synchronization confirmation signal of the synchronization confirmation additional optical fiber module are opposite to each other.

The endoscope system of an embodiment of the present invention further includes an additional simulation fiber module; the additional simulation optical fiber module transmits signals to the same direction as the transmission direction of the additional image data.

When one of the first additional optical fiber module and the second additional optical fiber module is an abnormal additional optical fiber module which cannot transmit the image data, the additional simulation optical fiber module replaces the abnormal additional optical fiber module to transmit the image data.

The endoscope system of an embodiment of the present invention further includes an input section, an MCU, and a third optical fiber module; the input part can be operated by a user; the MCU encodes the data signal of the input part; the third optical fiber module is connected to the MCU and transmits an input signal coded by the MCU; the number of third fibre-optic modules transmitting the encoded input signal is less than the number of input pins of the MCU receiving the input signal from the input section.

The endoscope system of an embodiment of the present invention further includes an additional image sensor, an MCU, and a third optical fiber module; the additional image sensor senses light with different wavelengths of light from the image sensor and generates additional image data, the MCU outputs and inputs control signals and action information to the image sensor and the additional image sensor, and the third optical fiber module is connected to the MCU and transmits and receives the control signals and the action information to the CPU; the number of the third optical fiber modules is equal to or less than the number of pins of the MCU for inputting and outputting the control signal and the motion information.

The image data transmission device further comprises a protection part; the protection unit protects optical fibers of the first optical fiber module and the second optical fiber module; the protection part is made of a material that can withstand high-pressure steam treatment for sterilizing medical instruments.

The endoscope system according to an embodiment of the present invention further includes a monitoring section; the monitoring part monitors at least one of the image data input part, the CPU and the image processing part in real time, and resets the at least one according to the state value of the at least one.

The image sensor and the CPU communicate through a communication bus, the communication bus comprises an output bus and an input bus, and the output bus and the input bus are respectively connected to the control optical fiber module.

ADVANTAGEOUS EFFECTS OF INVENTION

The image data transmission apparatus and the endoscope system including the image data transmission apparatus of the present invention include the optical fiber module, and thus have an advantageous effect that the limitation of the bandwidth can be overcome.

The effects of the present invention are not limited to the above-described effects, and other effects not mentioned can be clearly understood from the description of the scope of the present invention by those skilled in the art to which the present invention pertains.

Drawings

Fig. 1 to 6 illustrate an image data transmission apparatus according to an embodiment of the present invention.

Fig. 7 is an example diagram showing an appearance of an endoscope system according to an embodiment of the present invention.

Fig. 8 and 14 are block diagrams showing an endoscope according to an embodiment of the present invention.

Fig. 9 to 12 show various modifications of the image data transmission device of the endoscope system according to the present invention.

Fig. 13 is an example diagram of a communication chip and a control fiber module of an endoscope system according to an embodiment of the present invention.

Fig. 15 is an example diagram of the MCU and the third fiber optic module of the endoscope system of the embodiment of the present invention.

Detailed Description

Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The drawings are only for the purpose of illustrating the invention in a simplified manner, and it will be apparent to those skilled in the art that the scope of the invention is not limited to the scope of the drawings.

And the words used herein are words of description for the particular embodiments only, and are not intended to limit the invention. The singular references may also include the plural references unless it is clear that they include other meanings.

In the present invention, the words "including" or "having" are used to designate a specific number, stage, operation, component, or component described in the specification or a combination thereof, and do not exclude one or more features or the presence or addition of a number, stage, operation, component, or component or a combination thereof in advance.

Next, a data transmission device and an endoscope system according to an embodiment of the present invention will be described with reference to the drawings.

Fig. 1 and 2 show an image data transmission apparatus according to an embodiment of the present invention. Referring to fig. 1 and 2, the image data transmission apparatus according to the embodiment of the invention includes an image sensor 100, a first fiber optic module 200, and a second fiber optic module 300.

The image sensor 100 generates image data and includes a first image port T1 and a second image port T2. The video sensor 100 can generate video data according to a specification that can be processed by an ap (application processor) that is a CPU for a mobile device.

For example, the image sensor 100 may generate image data according to mipi (mobile Industry Processor Interface), LVDS (Low-Voltage Differential Signaling) and parallell Interface, but the invention is not limited thereto. The MIPI standard can be used for mobile devices such as smart phones (smart phones) to transfer image data at high speed.

The first and second

fiber optic modules

200 and 300 are connected to the first and second video ports T1 and T2, respectively. The number of the first video port T1 and the second video port T2 in fig. 1 and 2 and fig. 3 to 6 to be described later may vary according to the transmission specification of the video data.

As shown in fig. 1 and 2, the first and second

optical fiber modules

200 and 300 include a light emitting portion LT, an optical fiber OF, and a light receiving portion LR. The light emitting unit LT converts an electronic signal into an optical signal, the optical fiber OF transmits the converted optical signal, and the light receiving unit LR converts the optical signal transmitted through the optical fiber OF back into an electronic signal.

The first optical fiber module 200 and the second optical fiber module 300 may include a light emitting portion LT, an optical fiber OF, and a light receiving portion LR, as well as a plurality OF types OF optical fiber modules described later.

As shown in fig. 1 and 2, a fiber optic module is connected to an image port of the image sensor 100. Therefore, the image data transmission apparatus according to the embodiment of the present invention has various advantages with respect to the manner of transmitting image data through the coaxial line.

Unlike the embodiment of the present invention, when all the image ports of the image sensor 100 are connected to one coaxial line (coaxial cable) and transmit image data, a serializer (serializer) and a deserializer (deserializer) are required.

The serializer serializes the video data output from the plurality of video ports by switching (switching) and transmits the serialized video data through one coaxial line, and the deserializer switches the serialized video data transmitted through the coaxial line and restores the original state.

Thus, the bandwidth of the serializer and deserializer is greater than the bandwidth of the shadow ports multiplied by the number of shadow ports. In which case the serializer and deserializer would be loaded too much.

That is, since the serializer and the deserializer have a large bandwidth, a clock (clock) becomes fast and power consumption becomes large, and thus the serializer and the deserializer generate excessive heat. The lifetime of the heat-generating multi-serializer and deserializer is shortened and the reliability of the operation is lowered.

Also, the serializer and the deserializer require time to process the image data and thus the image data transfer time may increase. For example, when a doctor grasps the inside of a patient body by an endoscope system and performs an operation, images including the operation behavior of the doctor need to be displayed in real time.

When the time for transmitting the image data through the serializer and the deserializer increases, the display of the image delays the doctor from confirming his/her operation after a certain time, and thus an unexpected medical accident may occur.

In particular, when the image data to be processed is large, such as full HD (hereinafter, FHD) or ultra HD (hereinafter, UHD) images, the operation load of the serializer and the deserializer is increased.

In addition, the coaxial line is connected to the serializer and the deserializer, and thus the coaxial line also requires a large bandwidth. The maximum bandwidth of a coaxial line is 10Gbps, but if UHD-level video is to be transmitted at 60 data frames per second, the bandwidth of the transmission line needs to be 12.5 Gbps. Therefore, the coaxial transmission of high-resolution images is limited.

Therefore, when transmitting high-resolution video data through the coaxial line, the video data needs to be compressed by an encoder (encoder) and transmitted to a serializer, and the compressed video data passing through the deserializer is restored to an original state by a decoder (decoder).

Thus, problems such as transmission delay of image data, heat generation, and complicated structure of the encoder and the decoder may occur. Furthermore, since the electromagnetic wave of the ultra-high speed image data transmitted through the coaxial line increases, the possibility of distortion or noise generation of the image data also increases.

In contrast, when an image port is connected to a fiber module according to an embodiment of the present invention, the image data can be transmitted through the fiber module without the serializer or the deserializer. Therefore, problems such as heat generation, complicated structure, and deterioration in reliability of operation due to the serializer, the deserializer, the encoder, and the decoder can be solved.

Thus, since one image port is connected to one optical fiber module, the bandwidth limitation of the coaxial line generated when FHD-level image data or UHD-level image data is transmitted can be overcome.

That is, the image data transmission apparatus according to the embodiment of the present invention does not need a serialization process for the image data, and transmits at least a portion of the image data through the first optical fiber module and the second optical fiber module.

As shown in fig. 1, the first fiber optic module 200 is connected to the third video port T3 while being connected to the first video port T1, and the second fiber optic module 300 is connected to the fourth video port T4 while being connected to the second video port T2. At this time, the first fiber optic module 200 and the second fiber optic module 300 can transmit the image data in the differential mode.

That is, the first fiber optic module 200 transmits the video data through the voltage difference between the first video port T1 and the third video port T3, and the second fiber optic module 300 also transmits the video data through the voltage difference between the second video port T2 and the fourth video port T4.

For example, when the light Emitting part LT includes a VCSEL (vertical Cavity Surface Emitting laser), the input part of the VCSEL includes two ports (P port and N port). At this time, the VCSEL implements a differential mode. That is, light is discharged when a voltage difference is generated between the two ports, and light is not discharged when no voltage difference is generated.

The light receiving portion LR includes a photo Transistor (Optical Transistor) that generates a voltage between a source (source) and a drain (drain) when the photo Transistor receives light. The light-receiving portion LR amplifies the voltage to generate a differential voltage (differential voltage) of a desired magnitude.

As shown in fig. 2, the first fiber module and the second fiber module transmit image data in a Single-ended mode (Single-ended mode). For example, the P-port of each VCSEL is connected to the first image port T1 or the second image port T2, and the N-ports of the VCSELs are grounded (ground).

The VCSEL emits light when a voltage difference is generated between the N-port and the P-port, and thus, even if the N-port is grounded, input image data can be converted into an optical signal through the P-port.

In addition, as shown in fig. 1 and 2, the first fiber optic module 200 and the second fiber optic module 300 can be directly connected to the first video port T1 and the second video port T2. Alternatively, as shown in fig. 3 and 4, the first fiber optic module 200 and the second fiber optic module 300 are connected to the first video port T1 and the second video port T2 by Connectors (CON).

As shown in fig. 5 and 6, the image data transmission apparatus according to the embodiment of the present invention further includes an additional image sensor 150, a first additional fiber module 250, and a second additional fiber module 350. The additional image sensor 150 senses light having a different wavelength from that of the light sensed by the image sensor 100 and generates additional image data, and includes a first additional image port AT1 and a second additional image port AT2 for transmitting AT least a portion of the additional image data.

AT this time, the first additional fiber module 250 and the second additional fiber module 350 are connected to the first additional image port AT1 and the second additional image port AT2, respectively.

For example, the image sensor 100 may sense visible light, and the additional image sensor 150 may sense infrared rays or ultraviolet rays, but is not limited thereto, and the additional image sensor 150 will be described in detail later.

As shown in fig. 5, the first additional fiber module 250 is connected to the third additional video port AT3 AT the same time as the first additional video port AT 1.

The second additional fiber module 350 is connected to the fourth additional video port AT4 in addition to the second additional video port AT 2.

At this time, the first additional fiber module 250 and the second additional fiber module 350 transmit the image data in the differential mode.

Thus, the first additional optical fiber module transmits additional image data through a voltage difference between the first additional image port AT1 and the third additional image port AT 3. Also, the second additional optical fiber module transmits the image data through the voltage difference between the second additional image port AT2 and the fourth image port AT 4.

In addition, as shown in fig. 6, the first additional fiber module 250 and the second additional fiber module 350 transmit image data through a single-ended mode. That is, the light emitting portions LT of the first additional fiber optic module 250 and the second additional fiber optic module 350 have two ports, one of which is grounded. Therefore, the light emitting portion LT can emit light according to the voltage difference when the voltage difference is generated between the two ports.

As described above, at least a portion of the additional image data is transmitted through the first additional fiber module 250 and the second additional fiber module 350 without performing a serialization process for the additional image data.

An endoscope system according to an embodiment of the present invention will be described below with reference to the drawings.

Fig. 7 and 8 show an endoscope system according to the present invention. Fig. 7 shows an example of the appearance of an endoscope system of the embodiment of the present invention.

The endoscope system of the embodiment of the present invention may include an image generating section 20 connected to one end of the image data transmitting apparatus 10. The image generating unit 20 may include at least one of the image sensor 100 and the additional image sensor 150. At this time, the image data transmission apparatus 10 may include a protection portion OFP covering the plurality OF optical fibers OF. The protection portion OFP will be described in detail later with reference to fig. 8.

The image generating unit 20 is connected to an extension arm (telescope) having a lens group (lens array) therein. The body 30 may include at least one of hardware (hardware) or software (software) connected to the other end of the image data transfer apparatus 10 to process image data or additional image data.

The illustration of fig. 7 is merely one example of the appearance of an endoscopic system according to an embodiment of the present invention and is not limited thereto.

As shown in fig. 8, the endoscope system according to the embodiment of the present invention includes an image data transmission apparatus 10, an image data input section 500, and an image processing section 510. The dashed arrows in fig. 8 indicate signals for controlling the video data input unit 500, the video processing unit 510, and the monitoring unit 570, which will be described later, by the CPU 520.

The image data transmission apparatus 10 generates image data and includes an image sensor 100 and first and second

optical fiber modules

200 and 300, the image sensor 100 includes first and second image ports T1 and T2 for transmitting at least a portion of the image data, and the first and second

optical fiber modules

200 and 300 are respectively connected to the first and second image ports T1 and T2.

The image data transmission apparatus 10 has already been described in detail and therefore, the description thereof will be omitted.

The image data input unit 500 is connected to the image data transmission device 10 and transmits the image data output from the image data transmission device 10 to a predetermined path. For example, the image data input unit 500 transmits the image data to the image processing unit 510.

Also, the image data input section 500 may perform simple processing (e.g., contrast adjustment, zoom-in, zoom-out, etc.) on the image data, which may be controlled by the CPU 520.

The image processing unit 510 performs image processing on the image data transmitted from the image data input unit 500 under the control of the CPU 520.

As described above, the video sensor 100 can generate video data generated in accordance with a specification that can be processed by the ap (application processor) for the CPU of the mobile device.

Thus, when the image data complies with the signal specification used by the mobile device, the CPU520 also includes a mobile chip (mobile chip) such as an ARM core.

Thus, the CPU520 may support a mobile OS such as an android OS (operating system) or an iOS, and may apply various functions provided by the mobile OS to the endoscope system of the embodiment of the present invention.

For example, the endoscope system of embodiments of the present invention may provide a variety of (rich) user interfaces and facilitate updating of functions proposed by a user, such as a physician.

The CPU520 of the present invention is not limited to the CPU for mobile devices. Thus, CPU520 can operate under a windows-type OS or a general OS such as OS X.

At this time, the CPU520 may output a user interface (user interface) process for the image data and an operation control signal according to the user operation on the user interface. The user interface may include a directory, which may be, but is not limited to, operation control of the endoscope system and operation of the image displayed on the display portion DIS.

The operation on the video data through the user interface may be an operation on enlarging or reducing the video, a sharpness (sharpness), a luminance change, or the like, but is not limited thereto.

Although not shown in the figure, the CPU520 may include a memory (not shown) for storing data or intelligence of the user interface.

The video processing unit 510 superimposes (overlays) the user interface on the video data output from the video data input unit 500, and processes the video data in accordance with the operation control signal.

At least one of the video data input unit 500 and the video processing unit 510 is embodied by an FPGA (field-programmable gate array), but is not limited thereto.

The FPGA is a programmable type of non-storage semiconductor, and unlike a general semiconductor in which a loop cannot be changed, the loop can be changed again according to the purpose. The FPGA can realize a desired circuit by the operation of a switching (switching) unit as a hardware element, whereby video data can be transmitted or processed at a higher speed than when the video data is transmitted or processed by software.

The video processing unit 510 transmits the superimposed video data and user interface to the display unit DIS through the video port vp (video port). The video port VP may be VGA (video Graphics array), DVI (Digital visual interface), HDMI (high Definition Multimedia interface) or LVDS (Low Voltage differential signaling), SDI (Serial Digital interface), but is not limited thereto.

As described above, the processing path of the user interface of the endoscope system according to the embodiment of the present invention may be different from the processing path of the image data. That is, in the endoscope system according to the embodiment of the present invention, the CPU520 processes the user interface, and the image data input unit 500 and the image processing unit 510 can process the image data.

A doctor performs an operation on a patient by viewing an image generated by an endoscope system, and thus the doctor needs to view the situation inside the human body to be operated through a timely image in order to correctly perform the operation.

If the doctor can not watch the timely images of the internal conditions of the human body in the operation process, the doctor can not timely know the errors even if the doctor has errors. Therefore, the endoscope system needs to process image data of the inside of the human body at high speed and display the image data on the display portion DIS (e.g., a display screen).

On the contrary, even if the processing speed of the user interface is slower than that of the image data of the inside of the human body, the operation process is not greatly affected.

Unlike the endoscope system according to the embodiment of the present invention, when image data and a user interface are processed by one image processing path, the processing of the image data is delayed due to the processing of the user interface, and thus may have a bad influence on the operation.

In the endoscope system according to the embodiment of the present invention, the image data input unit 500 and the image processing unit 510 can process the image data at a high speed and the CPU520 can process the user interface at a low speed so that the image processing unit 510 overlaps the image data with the user interface.

Accordingly, the doctor can view the overlapped image data and the user interface through the display portion DIS, thereby less feeling a time delay occurring along with the image data processing process and using various functions of the endoscope system through the manipulation of the user interface.

Meanwhile, since the endoscope system of the embodiment of the present invention includes the above-described image data transmission apparatus 10, it is possible to transmit high-resolution or ultra-high-resolution image data while overcoming the limitation of the bandwidth.

Furthermore, the endoscope system of the embodiment of the present invention can transmit the image data without an encoder, a serializer, a deserializer, or a decoder, and thus can provide a simple structure to reduce the transmission time delay of the image data.

That is, the endoscope system according to the embodiment of the present invention can transmit at least a part of the image data through the first optical fiber module and the second optical fiber module without requiring a serial number for the image data.

Although not shown in fig. 8, a memory may be provided between the CPU520 and the image processing unit 510 to perform data processing on the user interface.

In addition, the first fiber optic module 200 is connected to the third video port T3 while being connected to the first video port T1, and the second fiber optic module 300 is connected to the fourth video port T4 while being connected to the second video port T2. The first fiber optic module 200 and the second fiber optic module 300 transmit image data in a differential mode. A detailed description thereof has been given and thus a description thereof will be omitted.

In contrast, one of the ports of the light emitting portion LT of the image data transmission apparatus 10 is grounded, so that the image data transmission apparatus 10 can transmit image data in the single-ended mode. A detailed description thereof has been given and thus a description thereof will be omitted.

In addition, the first and second

fiber optic modules

200 and 300 are directly connected to the first and second video ports T1 and T2 or connected to the first and second video ports T1 and T2 through the connector CON. A detailed description thereof has been given and thus a description thereof will be omitted.

The image data transmission apparatus 10 of the endoscope system of the embodiment of the present invention further includes an additional image sensor 150, a first additional fiber module 250, and a second additional fiber module 350.

The additional image sensor 150 senses light having a different wavelength from that of the light sensed by the image sensor 100 and generates additional image data, and includes a first additional image port AT1 and a second additional image port AT2 for transmitting AT least a portion of the additional image data.

The first additional fiber module 250 and the second additional fiber module 350 are respectively connected to the first additional image port AT1 and the second additional image port AT2 and transmit additional image data in a differential mode or a single-ended mode. A detailed description thereof has been given and thus a description thereof will be omitted.

The video data input unit 500 receives video data and additional video data, transmits the additional video data to the CPU520, and transmits the video data to the video processing unit 510. At this time, the video processor 510 receives additional video data from the CPU520 and superimposes the additional video data on the video data.

The image sensor 100 generates n frames per second of image data of the inside of the human body, and the additional image sensor 150 generates m frames per second of additional image data.

As described above, the additional image data is data of an image of a wavelength band other than visible light (for example, near infrared ray, ultraviolet ray, or the like) or an image of a fluorescent substance used in fluorescence endoscopy or fluorescence endoscopic surgery, and may be an image of a specific target other than an affected part.

The video data input unit 500 may transmit the video data and the additional video data according to a predetermined path. That is, the video data input unit 500 transmits the video data to the video processing unit 510 via the first transmission path, and transmits the additional video data to the CPU520 via the second transmission path.

At this time, the video data input unit 500 may transmit the video data to the CPU520 through the second transmission path. The CPU520 may transmit the additional image data at a slower speed than the transmission speed of the image data of the first transmission path.

The video processing unit 510 superimposes the video data transmitted through the first transmission path and the additional video data output from the CPU 520. The video data can be a background image (background image), and the display unit DIS can display additional video data superimposed on the background image.

As described above, the image data can be processed at high speed with respect to the additional image data. Since the image data shows the state of the inside of the human body, the shorter the time delay from the generation of the image data to the display by the display unit DIS, the more accurate information can be provided to the doctor.

Since the additional image data is an image of a fluorescent substance or an image of another wavelength band, the additional image data is generated slower than the image data. For example, since the amount of light of the fluorescent substance or the amount of light of the wavelength band other than the visible light is small, the additional image sensor 150 is exposed to the light of the fluorescent substance or the light of the wavelength band other than the visible light for a relatively long time in order to obtain a complete image of the additional image data.

Unlike the endoscope system according to the embodiment of the present invention, if the image data and the additional image data are processed through the same path, the processing of the image data is affected, and thus the image data cannot be quickly and accurately displayed through the display portion DIS.

The endoscope system according to the embodiment of the present invention processes the image data and the additional image data through different paths, and the image data is processed at a high speed with respect to the additional image data, so that the image of the inside of the human body can be displayed quickly and accurately.

The endoscope system according to the embodiment of the present invention may include a memory (not shown) connected to the image data input unit 500 and the CPU520, and a memory (not shown) connected to the image processing unit 510 and the CPU 520. The video data input unit 500 and the video processing unit 510 respectively include standard i/o port logic such as dma (direct Memory access) logic, hdmi (high definition multimedia interface) logic, DVI logic, etc., and are connected to the memories of the video data input unit 500 and the video processing unit 510 at high speed.

The standard i/o port logic of the image data input unit 500 and the image processing unit 510 may back up (dump) the image data and the additional image data into the memory, and the DMA logic of the image processing unit 510 may read the additional image data or the overlapped ui and additional image data from the memory. At this time, the memories of the video data input unit 500 and the video processing unit 510 can transmit and receive information of read/write data to and from each other through a synchronous (sync) communication line.

As described above, the image processing unit 510 superimposes the image data on at least one of the additional image data and the user interface.

As shown in fig. 9, the image sensor 100 further includes a first clock port CT 1. The video data transmission apparatus 10 further includes a clock fiber module 610 connected to the first clock port. At this time, the clock fiber module 610 transmits a clock signal in a differential mode or a single-ended mode. For example, the video data transmission device 10 includes 2 first optical fiber modules 200, 2 second optical fiber modules 300, and 1 clock optical fiber module 610.

When the fiber optic module for clock 610 operates in the differential mode, the fiber optic module for clock 610 can be connected to the first port for clock CT1 and the second port for clock CT 2. Although not shown in fig. 9, when the clock fiber module 610 operates in the single-ended mode, one port of the light emitting portion of the clock fiber module 610 is connected to the first clock port CT1, and the other port may be grounded.

The image sensor 100 and the additional image sensor 150 may support MIPI CSI ii (MIPI camera signaling interface ii) and MIPI CSI iii (MIPI camera signaling interface protocol iii). At this time, the MIPI CSI ii and MIPI CSI iii may transmit high-resolution (FHD-level or UHD-level) image data or additional image data.

The pin (pin) specification of the MIPI CSI ii will first be described with reference to fig. 9.

For the MIPI CSI ii, the image sensor 100 and the CPU520 may include 4 fiber optic modules (2 first fiber optic modules 200 and 2 second fiber optic modules 300) corresponding to a data line (data line) and 1 clock fiber optic module 610 corresponding to a clock line (clock line) as shown in fig. 9. The clock line may transmit image data or transmit a clock signal used in processing.

In this case, the first and second

optical fiber modules

200 and 300 can operate in the differential mode or the single-ended mode, and the differential mode and the single-ended mode are explained in detail and thus the explanation thereof will be omitted.

In this way, when 4 data lines and one clock line are operated in the differential mode, the first optical fiber module 200, the second optical fiber module 300, and the clock optical fiber module 610 are connected to 2 ports of the image sensor 100, respectively.

When both the 4 data lines and the clock line operate in the single-ended mode, the P ports of the light emitting portions LT of the first optical fiber module 200, the second optical fiber module 300, and the clock optical fiber module 610 may be connected to one port of the image sensor 100, and the N port may be grounded.

The transmission direction of the video data transmitted by the first fiber optic module 200 and the second fiber optic module 300 may be the same as the transmission direction of the clock signal transmitted by the clock fiber optic module 610. That is, as shown in fig. 9, image data and a clock signal can be transmitted from the image sensor 100 to the CPU 520.

The additional image sensor 150 is also connected to the first additional fiber module 250, the second additional fiber module 350, and the additional fiber module for clock 615 in accordance with the MIPI CSI ii pin (pin) specification. The first additional fiber optic module 250, the second additional fiber optic module 350, and the additional fiber optic module for clock 615 also operate in a differential mode (see fig. 9) or a single-ended mode (not shown).

That is, when the endoscope system of the embodiment of the present invention includes the additional image sensor 150, the additional image sensor further includes the first additional clock port ACT 1. The image data transmission apparatus 10 further includes a clock additional fiber module 615 connected to the first additional clock port ACT 1. At this time, the clock additional fiber optic module 615 transmits the clock signal in a differential mode or a single-ended mode.

For example, the endoscope system of the embodiment of the present invention includes 2 first additional fiber optic modules 250, 2 second additional fiber optic modules 350, and one clock additional fiber optic module 615 that transmit additional image data.

As shown in fig. 9, the light emitting part LT of the additional clock fiber module 615 is connected to the first additional clock port ACT1 and the second additional clock port ACT2 in the differential mode. Although one port of the light emitting part LT of the additional optical fiber module for clock 615 is not shown in the drawings to be connected to the first additional clock port ACT1 in the single-ended mode, the other port of the light emitting part LT may be grounded.

The first fiber optic module 200, the second fiber optic module 300, and the clock fiber optic module 610 have already been described, and therefore, the description thereof will be omitted.

The transmission directions of the additional image data and the clock signal of the first additional fiber module 250, the second additional fiber module 350, and the additional fiber module for clock 615 may be the same. This is similar to the description of the first fiber optic module 200, the second fiber optic module 300, and the clock fiber optic module 610, and therefore, the description thereof will be omitted.

Next, specification of the MIPI CSI iii pins different from the specification of the MIPI CSI ii pins will be described with reference to fig. 10.

For the MIPI CSI iii, the image sensor 100 and the CPU520 may include 4 fiber optic modules (2 first fiber optic modules 200 and 2 second fiber optic modules 300) corresponding to data lines (datalines) and 1 synchronization confirmation fiber optic module 620 corresponding to a synchronization confirmation line as shown in fig. 10.

The synchronization confirmation line is used to transmit a synchronization confirmation signal for confirming synchronization in the transmission and processing of image data or to transmit a command (command) of the CPU520 to the image sensor 100. Since the MIPI CSI iii uses an embedded clock (embedded clock), the optical fiber module 610 for a clock, which is additionally used in the MIPI CSI ii, is not required. At this time, the sync confirmation line transmits the sync confirmation signal also in the differential mode or the single-ended mode.

In this way, since both 4 data lines and 1 synchronization check line can operate in the differential mode, the first optical fiber module 200 and the second optical fiber module 300 are connected to 2 ports of the image sensor 100, respectively, and the light-receiving portion LR of the synchronization check optical fiber module 620 is connected to the synchronization check port ST of the image sensor 100.

Although not shown in fig. 10, when both of the 4 data lines and the 1 synchronization confirmation line operate in the single-ended mode, one ports of the light emitting portions LT of the first optical fiber module 200 and the second optical fiber module 300 may be connected to 1 port of the image sensor 100, and the other port may be grounded. One of the two ports of the light-emitting portion LT of the synchronization confirmation optical fiber module 620 is grounded, and the light-receiving portion LR of the synchronization confirmation optical fiber module 620 is connected to the synchronization confirmation port ST of the image sensor 100.

As described above, the image data transmission device 10 further includes the synchronization confirmation optical fiber module 620. The synchronization confirmation fiber optic module 620 may transmit the synchronization confirmation signal in a differential mode or a single-ended mode. For example, the image data transmission apparatus 10 may include 2 first fiber optic modules 200, 2 second fiber optic modules 300, and one synchronization confirmation fiber optic module 620.

At this time, a synchronization confirmation signal is input to the image sensor 100, and image data is output by the image sensor 100. Therefore, the transmission direction of the image data of the first fiber optic module 200 and the second fiber optic module 300 can be opposite to the transmission direction of the synchronization confirmation signal of the synchronization confirmation fiber optic module 620.

In addition, when the endoscope system of the embodiment of the present invention includes the additional image sensor 150, the image data transmission apparatus 10 further includes an additional optical fiber module 625 for synchronization confirmation that transmits a synchronization confirmation signal in the differential mode or the single-ended mode.

For example, the system includes 2 first additional fiber modules 250 for transmitting additional image data, 2 second additional fiber modules 350, and one additional fiber module 625 for synchronization confirmation. In this case, the synchronization confirmation additional fiber module 625 may be connected to the additional synchronization confirmation port AST of the additional image sensor 150.

The relationship among the additional image sensor 150, the first additional fiber module 250, the second additional fiber module 350, and the synchronization confirmation additional fiber module 625 is similar to the relationship among the image sensor 100, the first fiber module 200, the second fiber module 300, and the synchronization confirmation fiber module 620, and thus the description thereof will be omitted.

The transmission direction of the additional image data of the first additional fiber module 250 and the second additional fiber module 350 may be opposite to the transmission direction of the synchronization confirmation signal of the synchronization confirmation additional fiber module 625. Since the relationship between the video data and the transmission direction of the synchronization confirmation signal of the synchronization confirmation optical fiber module 620 is similar, the description thereof will be omitted.

In addition, the endoscope system of the embodiment of the present invention includes the image data transmission device 10 that can simultaneously realize the MIPI CSI ii and the MIPI CSI iii.

To this end, the video data transmission apparatus 10 includes a first optical fiber module 200, a second optical fiber module 300, a first transmission direction optical fiber module OF _ D1, and a second transmission direction optical fiber module OF _ D2.

In this case, the signal transmission direction OF the first transmission direction optical fiber module OF _ D1 and the signal transmission direction OF the second transmission direction optical fiber module OF _ D2 may be opposite, and the video data transmission directions OF the first optical fiber module 200 and the second optical fiber module 300 may be the same.

For example, as shown in fig. 11 and 12, the video data transmission apparatus 10 includes 2 first optical fiber modules 200, 2 second optical fiber modules 300, 1 first transmission direction optical fiber module OF _ D1, and 1 second transmission direction optical fiber module OF _ D2.

At this time, as shown in fig. 11, if the image data transmission apparatus satisfies the MIPI CSI ii, the image data transmission apparatus 10 further includes an emulation fiber module 630, and the emulation fiber module 630 may transmit signals in a direction opposite to a transmission direction of the image data and the clock signal.

That is, the first transmission-direction optical fiber module OF _ D1 may be the clock optical fiber module 610, and the second transmission-direction optical fiber module OF _ D2 may be the dummy optical fiber module 630. Such an emulation fiber module 630 may be used as a backup fiber module for transmitting various signals or data transmitted from the CPU520 to the image sensor 100.

And, when the image data transmission apparatus 10 further includes the additional image sensor 150, further includes an additional simulation fiber module 635, and the additional simulation fiber module 635 may transmit a signal in a direction opposite to a transmission direction of the additional image data and the clock signal.

In addition, as shown in fig. 12, if the image data transmission device 10 satisfies the MIPI CSI iii, the image data transmission device 10 includes the first optical fiber module 200, the second optical fiber module 300, the synchronization confirmation optical fiber module 620, and further includes a simulation optical fiber module 630.

At this time, the simulation fiber module 630 transmits a signal in the same direction as the transmission direction of the image data. That is, the first transmission-direction optical fiber module OF _ D1 may be the dummy optical fiber module 630, and the second transmission-direction optical fiber module OF _ D2 may be the synchronization confirmation optical fiber module 620.

When at least one OF the first optical fiber module 200 and the second optical fiber module 300 is an abnormal optical fiber module that cannot transmit image data, the dummy optical fiber module 630 as the first transmission direction optical fiber module OF _ D1 transmits the image data instead OF the abnormal optical fiber module. This can improve the operational stability of the endoscope system.

The image data transmission apparatus 10 includes an additional image sensor 150, and when the additional image sensor 150 satisfies the MIPI CSI iii, an additional simulation fiber module 635, and the additional simulation fiber module 635 may transmit a signal in the same direction as the transmission direction of the additional image data.

Similar to the above, when one of the first additional fiber module 250 and the second additional fiber module 350 is an abnormal additional fiber module that cannot transmit image data, the additional simulation fiber module 635 is used to transmit image data instead of the abnormal additional fiber module.

The above specification of the MIPI CSI ii and the specification of the MIPI CSI iii are merely examples, and the embodiments of the present invention are not limited to these specifications.

In addition, as shown in fig. 8, the endoscope system of the embodiment of the present invention further includes a control fiber module 640 and an input fiber module 650. The control fiber optic module 640 will first be described.

The control fiber module 640 may be used for communication among the CPU520, the focus part 530, the image sensor 100, and the additional image sensor 150, and thus, the focus part, the image sensor 100, and the additional image sensor 150 may be controlled by the CPU 520.

The focus unit 530 drives the focus lens under the control of the CPU520 to realize auto focusing (auto focusing) on the image sensor 100 or the additional image sensor 150. The image sensor 100 and the additional image sensor 150 are initialized according to a control signal of the CPU 520. Such auto-focusing and initialization are only an example of the control of the CPU520, and the CPU520 can realize various controls of the image sensor 100, the additional image sensor 150, and the focus part 530.

To this end, the endoscope system of the embodiment of the present invention includes a communication chip 540 for performing communication between the CPU520 and the focus part 530, communication between the CPU520 and the image sensor 100, and communication between the CPU520 and the additional image sensor 150. The communication chip 540 may support, for example, I²C, but not limited to I²And C, communication specification.

In this case, the communication chip 540 may incorporate the focus part 530, the image sensor 100, and the additional image sensor 150. The communication chips 540 used in the communication with the CPU520 are connected to the control fiber module 640, respectively.

Although each communication chip 540 is illustrated in fig. 8 as being connected to a control fiber module 640, this is for convenience of description and is not intended to be limiting.

For example, as shown in fig. 13, a plurality of communication chips 540 may communicate with the CPU520 through a communication bus (bus). Each of which is connected to a control fiber optic module 640. Two communication buses are used for transceiving with the CPU 520. That is, one communication bus is used to receive the control signal output from the CPU520, and the other communication bus is used to output the action information to the CPU 520.

The operation information may be information that the CPU520 receives reports for controlling the focus 530, the image sensor 100, and the additional image sensor 150. For example, the motion information may be information on the current state of the focus unit 530, the image sensor 100, and the additional image sensor 150, but is not limited thereto.

Although not shown in fig. 13, a clock bus for transmitting a clock signal from the CPU520 to the focus unit 530, the image sensor 100, and the additional image sensor 150 may be added, the clock bus is also connected to the control fiber module.

When the bus communication is performed in this manner, the number of control fiber optic modules 640 can be reduced. That is, as shown in fig. 13, when a communication bus is used, two control fiber modules 640 are required for the plurality of communication chips 540. Conversely, when a communication bus is not used, each communication chip 540 is connected to the control fiber optic module 640, and therefore, the number of the control fiber optic modules 640 needs to be increased.

That is, the image sensor 100 and the CPU520 communicate via a communication bus including a transmission bus and a reception bus. At this time, the transmission bus and the reception bus are connected to the control fiber module 640, respectively.

The additional image sensor 150 and the focus unit 530 also communicate with the CPU520 via the communication bus.

The input fiber optic module 650 is described next.

As shown in fig. 8, the endoscope system of the embodiment of the present invention includes an input portion 550. The input unit 550 may generate an input signal for moving the image generating unit 20 up and down and left and right, white balance (white balance) of the image data or the additional image data, and selection of the directory according to a user operation. In this manner, the CPU520 can control the endoscope system by the input signal.

For convenience of explanation, fig. 8 does not show a driving unit for moving the image generating unit 20 up, down, left, and right.

The input signal is transmitted to the CPU520 through the input fiber module 650 connected to the input unit 550, and includes 6 input fiber modules 650, and the 6 input fiber modules 650 are respectively used for the vertical and horizontal movements of the image generating unit 20, the white balance of the image data or the additional image data, and the selection of the directory, but the number of the input fiber modules 650 may be increased or decreased. The Input unit 550 may include GPIO (General Purpose Input/Output) but is not limited thereto.

In the case of the endoscope system shown in fig. 8, the optical fiber module connected to the input unit 550 and the communication chip 540 and the control optical fiber module 640 are connected to the image data input unit 500, so that the number of optical fiber modules can be increased.

For example, as described above, the input unit 550 is connected to the 6 input fiber optic modules 650, and when the communication buses for the plurality of communication chips 540 are connected to the 2 control fiber optic modules 640, 8 additional fiber optic modules are required in addition to the fiber optic modules connected to the image sensor 100 or the additional image sensor 150.

For this reason, the number of optical fibers surrounded by the protection portion OFP also needs to be increased, and the thickness of the image data transmission apparatus 10 may be excessively increased.

As shown in fig. 14, the endoscope system of the embodiment of the present invention further includes an mcu (micro control unit)560, so that the number of fiber optic modules can be reduced.

The endoscope system of the embodiment of the present invention further includes an input unit 550 that can be operated by a user, an MCU560 that encodes an input signal of the input unit 550, and a third optical fiber module 660 that is connected to the MCU560 and transmits the input signal encoded by the MCU 560. At this time, the number of the third fiber optic modules 660 transmitting the encoded input signal may be less than the number of input pins of the MCU560 receiving the input signal from the input part 550.

For example, as shown in fig. 15, the input unit 550 generates input signals for vertical and horizontal movement, white balance, and directory selection, and therefore the MCU560 may have 6 input pins for these input signals.

The MCU560 receives the input signals in parallel, encodes the input signals, and outputs the encoded input signals to the output port, and the third fiber module 660 is connected to the output port. In this way, the third fiber optic module 660 communicates with the CPU520 through the image data input unit 500 or may be directly connected to the CPU 520.

Unlike the embodiment of the present invention, when the MCU560 is not provided, the input part 550 needs to be connected to 6 input fiber modules 650 as described above, but the number of the third fiber modules 660 for transmitting the input signal encoded by the MCU560 may be less than the 6 input fiber modules 650 for the embodiment of the present invention.

As shown in fig. 14 and 15, the endoscope system according to the embodiment of the present invention further includes an additional image sensor 150, an MCU560, and a third fiber module 660.

The additional image sensor 150 senses light having a different wavelength from that of the light sensed by the image sensor 100 and generates additional image data.

The MCU560 transmits and receives control signals and operation information to and from the image sensor 100 and the additional image sensor 150. That is, the MCU560 outputs control signals to the image sensor 100 and the additional image sensor 150, and receives operation information from the image sensor 100 and the additional image sensor 150.

The third fiber module 660 is connected to the MCU560 for transceiving control signals and operation information with the CPU 520. That is, the MCU560 receives a control signal from the CPU520 through one fiber module 660 and outputs operation information to the CPU520 through another fiber module.

At this time, the number of the third fiber optic module 660 may be the same as or less than the number of pins of the MCU560 that transmit and receive the control signals and the motion information.

The control signal and the operation information have already been described, and thus detailed description thereof is omitted.

The MCU560 is connected to a third fiber module 660 for decoding and transmitting the control signal of the CPU520 via the communication bus. The MCU560 receives and encodes operation information of at least one of the image sensor 100, the additional image sensor 150, and the focus part 530 through the communication bus, and outputs the encoded operation information to the CPU520 through the other third optical fiber module 660.

The encoding and decoding of the MCU560 are merely an example of a communication process between the MCU560 and the CPU520, and the operation of the MCU560 is not limited thereto.

As described above, when the image sensor 100 and the additional image sensor 150 communicate with the CPU520 through the communication bus, the MCU560 has 2 ports for transmitting and receiving control signals and operation information, and the 2 ports are connected to the communication bus.

The MCU560 controls the transmission and reception of signals and operation information through the 2 third optical fiber modules 660. Thus, the number of the third optical fiber modules 660 is the same as the number of the pins of the MCU560 for transmitting and receiving the control signals and operation information of the image sensor 100 and the additional image sensor 150.

Since the MCU560 needs to have 2 ports for transmitting and receiving signals to and from each of the communication chips 540 if communication with the plurality of communication chips 540 is not performed through the communication bus, the number of the third optical fiber module 660 may be smaller than the number of pins of the MCU560 for outputting control signals of the image sensor 100 and the additional image sensor 150.

As shown in fig. 8 and 14, the protection portion OFP of the image data transmission apparatus 10 is made of a material that can withstand the high-pressure steam treatment (auto close) performed for the sterilization of the medical instrument. The endoscope system of the present invention is also a medical instrument, and therefore, high-pressure steam treatment can be performed. The high pressure steam treatment is carried out in a steam sprayer of 20 pressures and 120 degrees for 20 minutes, and the optical fiber is dissolved at a temperature lower than 120 degrees.

Since the protection portion OFP covers the optical fiber, the optical fiber can be protected during the high-pressure steam treatment. The sterilization using steam at the time of high-pressure steam treatment has a small heat capacity although the temperature of steam is high, and since the protection portion OFP of the embodiment of the present invention includes rubber that shields heat, the optical fiber can be protected.

As described above, the protection unit OFP can protect the optical fibers of the plurality of types of optical fiber modules, such as the first to third optical fiber modules 660, the first and second additional optical fiber modules 350, the control optical fiber module 640, and the input optical fiber module 650.

As shown in fig. 8 and 14, the endoscope system according to the embodiment of the present invention further includes a monitor portion 570. The monitoring unit 570 monitors at least one of the image data input unit 500, the CPU520, and the image processing unit 510 in real time, and resets (reset) at least one of the image data input unit, the CPU520, and the image processing unit according to at least one of the status values.

Since the endoscope system is used for medical purposes, the processing of the image data and the additional image data needs to be performed stably. If the doctor can not watch the image inside the human body in the operation process, the operation process can not be smoothly carried out.

Thus, the monitoring unit 570 can perform real-time monitoring of at least one of the image data input unit 500, the image processing unit 510, and the CPU520, and the image data input unit 500, the image processing unit 510, and the CPU520 are used for processing of image data, additional image data, and a user interface.

For example, the monitoring unit 570 may receive the state value of at least one of the video data input unit 500, the video processing unit 510, and the CPU520 every 1ms, and the cycle of receiving the state value may be larger or smaller than 1 ms.

The monitoring unit 570 resets the components of the status value in which the abnormal or error (error) occurs, and shortens or minimizes the processing time of the abnormal image processing or the user interface.

Such a monitoring Unit 570 can be embodied in the Micro Control Unit form or the firmware form because it executes a simple function with respect to the CPU520, but is not limited thereto.

As described above, the image data transmission apparatus 10 and the endoscope system of the embodiment of the present invention include the optical fiber module instead of the coaxial line, and thus the image data transmission apparatus 10 having a smaller diameter than the coaxial line can be provided.

Thus, the image data transmission apparatus 10 and the endoscope system of the embodiment of the present invention can overcome the limitation of the bandwidth of the coaxial line and can transmit the image data of high resolution or ultra-high resolution or the additional image data.

Furthermore, encoding, serializing, deserializing, and decoding by the optical fiber module are not required, and thus the image data and the additional image data can be transmitted more quickly.

As described above, while the preferred embodiments of the present invention have been described, it will be apparent to those skilled in the art to which the present invention pertains that the present invention can be embodied in other specific forms than the embodiments described above without departing from the spirit or scope of the invention. Accordingly, the above-described embodiments should not be construed as limiting, but rather as illustrative, and the invention is not to be limited by the foregoing description, but may be modified within the scope and equivalents of the appended claims.

Claims

1. An image data transmission apparatus, comprising:

an image sensor generating image data and including a first image port and a second image port for transmitting at least a part of the image data; and

the first optical fiber module and the second optical fiber module comprise a light emitting part, an optical fiber and a light receiving part, and the first optical fiber module and the second optical fiber module are respectively connected to the first image port and the second image port;

the first optical fiber module is connected to the first image port and a third image port, the second optical fiber module is connected to the second image port and a fourth image port, and the first optical fiber module and the second optical fiber module transmit the image data through a voltage difference between the first image port and the third image port and a voltage difference between the second image port and the fourth image port.

2. The apparatus of claim 1, wherein at least a portion of the image data is transmitted through the first fiber optic module and the second fiber optic module without being serialized.

3. The apparatus according to claim 1, wherein the first fiber optic module and the second fiber optic module are connected to the first image port and the second image port directly or through a connector.

4. The image data transmission apparatus according to claim 1, comprising:

an additional image sensor sensing light having a different wavelength from the light sensed by the image sensor and generating additional image data, and including a first additional image port and a second additional image port for transmitting at least a portion of the additional image data; and

the optical fiber module comprises a first additional optical fiber module and a second additional optical fiber module, wherein the first additional optical fiber module and the second additional optical fiber module are respectively connected to the first additional image port and the second additional image port.

5. The apparatus according to claim 4, wherein the first additional fiber module is connected to a third additional image port while being connected to the first additional image port, the second additional fiber module is connected to a fourth additional image port while being connected to the second additional image port, and the first additional fiber module and the second additional fiber module transmit the additional image data in a differential mode.

6. The apparatus according to claim 4, wherein the first additional fiber optic module and the second additional fiber optic module transmit the additional image data in single-ended mode.

7. The apparatus of claim 4, wherein at least a portion of the additional image data is transmitted via the first additional fiber module and the second additional fiber module without performing a serialization process on the additional image data.

8. An endoscopic system, comprising:

image data transmission apparatus comprising: the image sensor generates image data and comprises a first image port and a second image port, the first image port and the second image port are used for transmitting at least one part of image data, the first optical fiber module and the second optical fiber module comprise a light emitting part, an optical fiber and a light receiving part, the first optical fiber module and the second optical fiber module are respectively connected with the first image port and the second image port, the first optical fiber module is connected with the first image port and is also connected with a third image port, the second optical fiber module is connected with the second image port and is also connected with a fourth image port, and the first optical fiber module and the second optical fiber module transmit the image data through the voltage difference between the first image port and the third image port and the voltage difference between the second image port and the fourth image port The image data;

an image data input part which is connected with the image data transmission equipment and transmits the image data output by the image data transmission equipment according to a set path; and

and an image processing unit for performing image processing on the image data transmitted by the image data input unit under the control of a CPU.

9. The endoscope system according to claim 8, wherein the CPU performs user interface processing on the image data, and the image processing unit superimposes the user interface and the image data.

10. The endoscopic system of claim 8 wherein at least a portion of the image data is transmitted through the first fiber optic module and the second fiber optic module without being serialized.

11. The endoscopic system of claim 8 wherein the first and second fiber optic modules are connected to the first and second image ports directly or through connectors.

12. The endoscopic system of claim 8, further comprising: the image processing device comprises an additional image sensor, a first additional optical fiber module and a second additional optical fiber module, wherein the additional image sensor senses light with different wavelengths from the light sensed by the image sensor and generates additional image data and comprises a first additional image port and a second additional image port, and the first additional image port and the second additional image port are used for transmitting at least part of the additional image data;

the first additional optical fiber module and the second additional optical fiber module are respectively connected to the first additional image port and the second additional image port, and transmit the additional image data in a differential mode or a single-ended mode.

13. The endoscope system according to claim 12, wherein the image data input section receives additional image data together with the image data, transmits the additional image data to the CPU, and transmits the image data to the image processing section;

the image processing unit receives additional image data transmitted from the CPU and superimposes the additional image data on the image data.

14. The endoscopic system of claim 8 wherein the image sensor further comprises a port for a first clock; the image data transmission device also comprises a clock optical fiber module connected to the first clock port; the fiber optic clock module transmits a clock signal in a differential mode or in a single-ended mode.

15. The endoscope system according to claim 14, wherein a transmission direction of the image data transmitted by the first fiber optic module and the second fiber optic module is the same as a transmission direction of the clock signal transmitted by the clock fiber optic module.

16. The endoscopic system of claim 15 wherein said image data transmission device further comprises a simulation fiber optic module; the simulation optical fiber module can transmit signals in a direction opposite to the transmission direction of the image data and the clock signal.

17. The endoscopic system of claim 12 wherein said additional image sensor further comprises a first additional clock port; the image data transmission equipment also comprises an additional optical fiber module for a clock; the additional optical fiber module for the clock is connected to the first additional port for the clock; the clock uses an additional fiber optic module to transmit a clock signal in either differential mode or single-ended mode.

18. The endoscope system according to claim 17, wherein transmission directions of the additional image data and the clock signal of the first additional fiber optic module, the second additional fiber optic module, and the additional fiber optic module for clock are identical to each other.

19. The endoscopic system of claim 18 further comprising an additional emulation fiber optic module; the additional simulation fiber optic module is capable of transmitting signals in a direction opposite to a transmission direction of the additional image data and the clock signal.

20. The endoscope system according to claim 8, wherein the image data transmission apparatus further comprises a synchronization confirmation-use optical fiber module; the synchronization confirmation fiber optic module transmits a synchronization confirmation signal in a differential mode or in a single-ended mode.

21. The endoscope system according to claim 20, wherein a transmission direction of the image data of the first optical fiber module and the second optical fiber module is opposite to a transmission direction of the synchronization confirmation signal of the synchronization confirmation optical fiber module.

22. The endoscopic system of claim 21 further comprising a simulated fiber optic module; and the simulation optical fiber module transmits signals to the direction same as the transmission direction of the image data.

23. The endoscopic system of claim 22 wherein the simulated fiber optic module transmits the image data in place of an abnormal fiber optic module when one of the first and second fiber optic modules is the abnormal fiber optic module that is unable to transmit the image data.

24. The endoscope system of claim 12, wherein the image data transmission apparatus further comprises an additional optical fiber module for synchronization confirmation; the additional fiber optic module for synchronization confirmation transmits a synchronization confirmation signal in a differential mode or in a single-ended mode.

25. The endoscope system according to claim 24, wherein a transmission direction of the additional image data of the first additional optical fiber module and the second additional optical fiber module and a transmission direction of the synchronization confirmation signal of the synchronization confirmation additional optical fiber module are opposite to each other.

26. The endoscopic system of claim 25 further comprising an additional emulation fiber optic module; the additional simulation optical fiber module transmits signals to the same direction as the transmission direction of the additional image data.

27. The endoscopic system of claim 26 wherein said additional simulation fiber optic module transmits said image data in place of said abnormal additional fiber optic module when one of said first additional fiber optic module and said second additional fiber optic module is an abnormal additional fiber optic module that cannot transmit said image data.

28. The endoscopic system of claim 8, further comprising an input, an MCU, and a third fiber optic module; the input part can be operated by a user; the MCU encodes the data signal of the input part; the third optical fiber module is connected to the MCU and transmits an input signal coded by the MCU; the number of third fibre-optic modules transmitting the encoded input signal is less than the number of input pins of the MCU receiving the input signal from the input section.

29. The endoscopic system of claim 8, further comprising an additional image sensor, an MCU, and a third fiber optic module; the additional image sensor senses light with different wavelengths of light from the light sensed by the image sensor and generates additional image data; the MCU outputs and inputs control signals and action information to the image sensor and the additional image sensor; the third optical fiber module is connected with the MCU and receives and transmits the control signal and the action information to the CPU; the number of the third optical fiber modules is equal to or less than the number of pins of the MCU for inputting and outputting the control signal and the motion information.

30. The endoscope system of claim 8, wherein the image data transmission apparatus further comprises a protection portion; the protection unit protects optical fibers of the first optical fiber module and the second optical fiber module; the protection part is made of a material capable of withstanding high-pressure steam treatment for sterilizing medical instruments.

31. An endoscope system according to any of claims 8-30 and also comprising a monitoring portion; the monitoring part monitors at least one of the image data input part, the CPU and the image processing part in real time, and resets the at least one according to the state value of the at least one.

32. The endoscopic system of claim 8 wherein the image sensor and the CPU communicate via a communication bus comprising an output bus and an input bus, the output bus and the input bus each connected to a control fiber optic module.