KR20170093422A - System of providing augmented reality image for ultrasonic image diagnosis - Google Patents

Abstract

The present invention relates to an ultrasound image diagnostic system for supporting an augmented reality image, in which an ultrasound image is displayed on an augmented reality system on a glass of a headset worn by a diagnostic person, so that when the ultrasound is performed on the subject, The present invention provides an ultrasound image-viewing headset and an ultrasound imaging system using the same, which can increase the concentration and efficiency of the ultrasound examination while simultaneously viewing real-time ultrasound images.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an ultrasound imaging system,

The present invention relates to an ultrasound image diagnostic system for supporting an augmented reality image. More particularly, the present invention relates to an ultrasound echocardiographic system for augmenting reality images, To an ultrasound imaging system capable of increasing the concentration and efficiency of an ultrasound examination while simultaneously viewing real-time ultrasound images while observing the test site of the subject.

A vibrating body that generates sound is called an acoustic source, and sound energy generated from a sound source is transmitted in the form of a wave having a constant frequency. The frequency (audible frequency) of sound that a person can hear is 20-20,000 Hz. A sound wave having a high frequency higher than the audible frequency range is defined as an ultrasound.

Ultrasonography is a technique in which a pulse wave is transmitted through the tissue in a tissue having a difference in acoustic impedance, and a reflected wave that is differently reflected according to the density difference between tissues is received and amplified and converted into a computer image It is also called sonography or sonogram. Through such analysis of ultrasound images, it is possible to diagnose patients based on the size, position and shape of various organs.

The frequency range of the ultrasonic waves used in the human body is 1-30 mHz, and the type of ultrasonic wave used is divided into a pulse wave and a continuous wave depending on the vibration type. Ultrasound is a non-destructive and non-invasive technique that has been developed to a great extent due to advances in digital computer technology. In particular, it has less risk of radiation exposure than other imaging devices, It is possible to acquire images of various angles by freeing of scan and scanning direction selection, and it is excellent in depiction of moving organs such as blood vessels and heart valves, and the result is immediately known with ultrasound examination, And it is widely used as a human body inspection equipment.

In the case of such an ultrasound imaging apparatus, a doctor or the like locates an ultrasonic diagnostic probe on a region to be examined of the subject, and reads the ultrasound image of the subject while moving the probe. At this time, And the display on which the ultrasound image is displayed are alternately moved, so that the divergence of the diver's eyes is dispersed. As a result, the degree of focusing on the ultrasound is reduced, and ultrasound images of the neighboring sites are obtained there is a problem.

Disclosure of the Invention The present invention has been made to solve the problems of the prior art as described above, and it is an object of the present invention to provide an ultrasound image display method capable of confirming an ultrasound image while the eye of a subject is maintained at a target site of the examinee during ultrasound examination using the ultrasound diagnostic apparatus I suggest.

In particular, when the ultrasonic examination through the ultrasound imaging apparatus is performed, the examiner moves his / her line of sight alternately between the target portion of the subject and the display on which the ultrasound image is displayed, so that the diver's eyes are dispersed, In order to solve the problem of falling.

Furthermore, the problem of acquiring an ultrasound image for a neighboring site rather than an accurate site to be examined is solved.

According to an aspect of the present invention, there is provided an ultrasound diagnostic system for supporting an augmented reality image, the ultrasound diagnostic system comprising: a probe attached to a head of a diagnostic ultrasound examiner for performing an ultrasound examination on the examinee; An ultrasound image processing unit for generating an image; An augmented reality image generation unit for generating an augmented reality image based on the ultrasound image; A glass for providing a visual field to the diagnostic person; And an augmented reality image display unit installed in the glass or corresponding to at least one of the binocular eyes of the diagnoser or displaying the augmented reality image on the glass. And a diagnostic probe for performing ultrasound on the region to be examined of the subject and providing an inspection signal to the ultrasound image vision headset.

Or an ultrasound image diagnostic system for supporting an augmented reality image according to the present invention includes a glass that is worn on a head of a diagnostic ultrasound examiner to provide a visual field to the diagnostic person; And an augmented reality image display unit installed in the glass or corresponding to at least one of the binocular eyes of the diagnoser or displaying the augmented reality image on the glass. An ultrasound image processing unit for transmitting an ultrasound signal to an inspection site of the examinee and generating an ultrasound image based on the reflected ultrasound echo signal; And an augmented reality image generation unit that generates an augmented reality image to be provided to the ultrasound image vision headset based on the ultrasound image.

Preferably, the augmented reality image display unit may include an OLED display installed on the glass.

Alternatively, the augmented reality image display unit may include a display module for outputting the augmented reality image; And a reflector for reflecting the augmented reality image output from the display module onto the glass, so that the augmented reality image can be displayed on the glass by a head up display (HUD) method.

Further, the augmented reality image display unit may include a first augmented reality image appearance unit corresponding to the left eye of the diagnosis person and a second augmented reality image appearance unit corresponding to the right eye of the diagnosis person.

Preferably, the augmented reality image further includes patient information on the subject, the first augmented reality image display unit displays an ultrasound image included in the augmented reality image, and the second augmented reality image display unit displays , The patient information included in the augmented reality image can be displayed.

The first augmented reality image display unit may display a stereophagous ultrasound image corresponding to the left eye of the diagnoser, and may display the second augmented reality image The presenting unit may display a stereoscopic image corresponding to the right eye of the above-described examiner.

Further, the augmented reality image may include an acoustic signal according to an ultrasound examination, and the ultrasound image vision headset may further include an acoustic output unit that outputs an acoustic signal included in the augmented reality image.

Further, the ultrasound image presenting headset may further include a motion recognition unit for recognizing the motion of the diagnoser and generating motion information.

The ultrasound image presenting headset may further include a voice recognition unit for recognizing the voice of the diagnosis person and generating voice information.

Preferably, the ultrasound image presenting headset further includes a patient information processor for providing patient information on the subject in cooperation with a patient information database having patient information, wherein the augmented reality image generator generates the augmented reality image And generates an augmented reality image including the augmented reality image.

The diagnostic probe may further include a patient information processing unit for providing patient information on the subject in cooperation with a patient information database having patient information, and the augmented reality image generating unit may include an augmented reality It is possible to generate an image.

Furthermore, the diagnostic probe may further include an additional information providing unit for receiving motion information from the ultrasound image presenting headset, determining the motion information, and performing a predetermined function corresponding to the motion information.

Alternatively, the diagnostic probe may further include an additional information providing unit for receiving voice information from the ultrasound image presenting headset, determining the voice information, and performing a predetermined function corresponding to the voice information.

According to the present invention, a doctor or the like wears a headset that displays an ultrasound image on a head so that a diagnosis person's eye line can be maintained on the subject to be examined, and at the same time, the ultrasound image can be confirmed as an augmented reality. It is possible to acquire an ultrasound image for an accurate inspection site.

In addition, two display configurations are provided on the ultrasound image-presenting headset, and the ultrasound image of the subject and the patient information on the subject are simultaneously displayed, so that the diagnosis can confirm the patient information while checking the ultrasound image, .

The ultrasound image can be provided as a three-dimensional augmented reality image by simultaneously displaying two stereo ultrasound images corresponding to both sides of the diagnostic person.

1 is a block diagram of an embodiment of an ultrasound imaging system for supporting an augmented reality image according to the present invention,
2 is a block diagram of a first embodiment of an ultrasound imaging system supporting augmented reality image according to the present invention,
3 is a block diagram of a second embodiment of an ultrasound imaging system supporting an augmented reality image according to the present invention,
FIG. 4 is a block diagram of an embodiment of an ultrasound image processing unit in an ultrasound imaging system supporting an augmented reality image according to the present invention,
FIG. 5 illustrates an embodiment of an ultrasound imaging vision headset according to the present invention,
FIG. 6 illustrates a first embodiment of performing ultrasound diagnosis through the ultrasound imaging system according to the present invention,
FIG. 7 shows a second embodiment of performing ultrasound diagnosis through the ultrasound imaging system according to the present invention,
FIG. 8 shows a third embodiment of performing ultrasound diagnosis through the ultrasound imaging system according to the present invention,
FIG. 9 shows a fourth embodiment of performing ultrasound diagnosis through the ultrasound diagnostic system according to the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.

First, the terminology used in the present application is used only to describe a specific embodiment, and is not intended to limit the present invention, and the singular expressions may include plural expressions unless the context clearly indicates otherwise. Also, in this application, the terms "comprise", "having", and the like are intended to specify that there are stated features, integers, steps, operations, elements, parts or combinations thereof, But do not preclude the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In the present invention, an ultrasound image is displayed on a glass of a headset worn by a diagnostic person in an augmented reality manner. Thus, when performing an ultrasound examination on an examinee, an examiner's gaze can check a real- And to increase the efficiency and concentration of the ultrasound image.

FIG. 1 shows a configuration of an embodiment of an ultrasound imaging system for supporting an augmented reality image according to the present invention.

The ultrasound imaging system according to the present invention can be roughly configured to include an ultrasound image vision headset 100 and a diagnostic probe 200.

In the ultrasound diagnostic imaging system according to the present invention, the ultrasound image-presenting headset 100 can be implemented in a form in which a diagnostic person performing ultrasound testing on the subject can be worn on the head, The ultrasound examination is performed on the subject while wearing the head, and the result can be provided to the augmented reality through the ultrasound image vision headset 100.

In FIG. 1, the ultrasound image-presenting headset 100 is shown as a goggles. However, in one embodiment, the ultrasound image-presenting headset 100 may be modified into various forms. For example, An apparatus having a display means corresponding to an eye, or the like.

The diagnostic probe 200 functions to transmit an ultrasonic signal to a region to be examined of a subject and receive a reflected ultrasonic echo signal. Various probes known as the diagnostic probe 300 can be applied. Its shape and size can be variously modified. Since the function of transmitting the ultrasonic signals in the diagnostic probe 300 and receiving the reflected ultrasonic echo signals is not a main feature of the present invention, a detailed description thereof will be omitted.

The ultrasound image-presenting headset 100 and the diagnostic probe 200 may be connected to each other through wired / wireless communication. Preferably, the ultrasound image-presenting headset 100 and the diagnostic probe 200 are interconnected by a short-range wireless communication such as Bluetooth or ZigBee . Although not shown in FIG. 1, patient information may be provided in association with an external patient information database as needed.

The ultrasound diagnostic system according to the present invention can provide a stereoscopic image in addition to a two-dimensional ultrasound image. Furthermore, various patient information (PI) for a subject under ultrasound diagnosis interlocked with an EMR system, a PACS system, and an OCS system can be provided. Patient Information.

The ultrasound imaging system of the present invention will be described in more detail with reference to specific embodiments.

FIG. 2 is a block diagram of a first embodiment of an ultrasound image diagnostic system for supporting an augmented reality image according to the present invention.

In the first embodiment of FIG. 2, the ultrasound image presenting headset 100 processes ultrasound images through the diagnostic probe 200, and generates and provides augmented reality images based on the ultrasound images.

To this end, the ultrasound image presenting headset 100 basically includes an ultrasound image processing unit 110, an augmented reality image generating unit 130, an augmented reality image view unit 150, and a communication unit 190, And may further include an information processing unit 170.

The ultrasound image processing unit 110 transmits an ultrasound signal to the diagnostic probe 200. The diagnostic probe 200 transmits the ultrasound echo signal to the human body and receives the ultrasound echo signal reflected from the inside of the human body. The ultrasound image may be generated, and the processed ultrasound image may include an acoustic signal. The ultrasound image processing unit 110 will be described later in more detail with reference to FIG.

The communication unit 190 supports communication between the ultrasound image presenting headset 100 and the diagnostic probe 200, and wired communication or wireless communication can be selectively applied depending on the situation.

The augmented reality image generation unit 130 generates an augmented reality image for an ultrasound image so that the ultrasound image generated by the ultrasound image processing unit 110 can be displayed as an augmented reality image in the ultrasound image presentation headset 100. [ For example, the diagnostician provides the augmented reality image so that the ultrasound image can be simultaneously viewed while observing the examinee while wearing the ultrasound image presenting headset 100. The ultrasound image presenting headset 100 displays the augmented reality image using the HUD (Head Up Display) It is also possible to generate an augmented reality image so that an image can be displayed on the glass of the diagnostic person, and furthermore, an augmented reality image can be generated so that a three-dimensional augmented reality image can be displayed as a three- .

Furthermore, the augmented reality image generation unit 130 may generate an augmented reality image including additional information such as patient information in addition to the ultrasound image.

For this, the ultrasound image-presenting headset 100 may further include an additional information processor 170.

The additional information processing unit 170 can receive various patient information about the subject from the external patient information database 300. [ For example, the medical record may be provided to the subject in cooperation with an electronic medical record (EMR) system 310, and a past medical image of the subject may be provided in cooperation with a picture archiving communication system (PACS) 330 , And an order communication system (OCS) 350 to receive a past prescription record for the subject.

The augmented reality image generation unit 130 generates the augmented reality image using the augmented reality image generated by the augmented reality image generation unit 130 and the augmented reality image generated by the augmented reality image generation unit 130. The augmented reality image generation unit 130 extracts various patient information about the subject, And generates and provides the augmented reality image.

2, the additional information processing unit 170 may include a motion processing unit, an audio output unit, a voice recognition unit, and the like, if necessary.

The motion processing unit includes sensing means mounted on the ultrasound image presenting headset 100 to generate and process motion information such as a motion image or sensed information about a diagnostic person. For example, a specific function is set for each specific motion information in the dictionary , The motion processor analyzes the motion information for the diagnoser and performs a corresponding function corresponding to the specific motion when it is determined to be a specific motion.

The voice recognition unit may include a microphone or the like mounted on the ultrasound image presenting headset 100 and may perform a corresponding function corresponding to the voice signal of the diagnostic person.

Further, the ultrasound image generated by the ultrasound image processing unit 110 may include an acoustic signal according to the ultrasound examination, and the augmented reality image based on the ultrasound image may include an acoustic signal. For example, May be provided in the ultrasound image presenting headset 100.

FIG. 3 is a block diagram of a second embodiment of an ultrasound imaging system supporting an augmented reality image according to the present invention.

The second embodiment of FIG. 3 is similar to the first embodiment shown in FIG. 2. In the second embodiment of FIG. 3, the diagnostic probe 200 itself processes the ultrasound image, And provides the generated augmented reality image to the ultrasound image presenting headset 100. [

The diagnostic probe 200 basically includes an ultrasound image processing unit 210, an augmented reality image generating unit 230, and a communication unit 270. The diagnostic probe 200 may further include an additional information providing unit 250 have.

The ultrasound image processing unit 210 generates an ultrasound signal using the diagnostic probe 200, transmits the ultrasound signal to the human body, receives the ultrasound echo signal reflected from the inside of the human body, and generates an ultrasound image through the image processing.

The augmented reality image generation unit 230 generates an augmented reality image for the ultrasound image so that the ultrasound image generated by the ultrasound image processing unit 110 can be displayed as an augmented reality image in the ultrasound image presenting headset 100, The augmented reality image generated by the image generation unit 230 is provided to the ultrasound image vision headset 100 through the communication unit 270.

Here, the communication unit 270 supports communication between the ultrasound image-presenting headset 100 and the diagnostic probe 200, as in the embodiment of FIG. 2, and wired communication or wireless communication may be selectively applied depending on the situation.

In addition, the augmented reality image generating unit 230 may generate an augmented reality image including additional information such as patient information in addition to the ultrasound image. For this purpose, the diagnostic probe 200 further includes an additional information providing unit 250 can do.

The additional information providing unit 250 can receive various patient information from the external patient information database 300 and extracts various patient information about the subject and outputs the extracted patient information to the augmented reality image generating unit 250 And the patient information provided by the augmented reality image generation unit 230 may be generated and provided as an augmented reality image.

Furthermore, the additional information providing unit 250 may receive motion information from the ultrasound image presenting headset 100, determine the motion information to perform a predetermined function corresponding to the motion information, 100, and may determine the voice information to perform a predetermined function corresponding to the voice information.

In the ultrasound imaging system according to the embodiments of FIGS. 2 and 3, the ultrasound image processing unit for supporting the augmented reality image according to the present invention shown in FIG. A more detailed description will be given with reference to the drawings.

The ultrasound image processing unit 400 shown in FIG. 4 may be provided in the ultrasound image presenting headset 100 in the embodiment of FIG. 2, or may be provided in the diagnostic probe 200 in the case of FIG. And can be variously modified according to the situation so as to provide a stereoscopic image as well as a simple two-dimensional image.

 The ultrasound image processing unit 400 includes an ultrasound transmitting and receiving unit 410 for transmitting and receiving ultrasound signals to and from the diagnostic probe 200, a data processing unit 420 for processing signals transmitted from the diagnostic probe 200, And an image generating unit 430 for generating an ultrasound image based on the information.

The diagnostic probe 200 transmits an ultrasound signal to the subject according to a driving signal applied from the ultrasound transceiver 410 and receives an echo signal reflected from the subject. The diagnostic probe 200 includes a plurality of transducers, and the plurality of transducers generate ultrasonic waves that are vibrated according to an electrical signal to be transmitted and are acoustical energy. A plurality of various diagnostic probes 200 may be connected to the ultrasound transmitting / receiving unit 410 as needed.

The ultrasonic transmission / reception unit 410 generates a pulse for forming a transmission ultrasonic wave according to a predetermined pulse repetition frequency (PRF) to transmit a driving signal to the diagnostic probe 200, the delay time to determine the transmission directionality is applied to the pulse. Each of the pulses to which the delay time is applied may correspond to a plurality of piezoelectric vibrators included in the diagnostic probe 200, respectively. Then, a drive signal is applied to the diagnostic probe 200 at a timing corresponding to each pulse to which the delay time is applied.

The ultrasonic transmission / reception unit 410 processes the echo signal received from the diagnostic probe 200 to generate ultrasound data, amplifies the echo signal for each channel, and converts the amplified echo signal from analog to digital . The delay time for determining the reception directionality is applied to the digitally converted echo signal, and the processed echo signals are summed to generate the ultrasonic data.

The data processing unit 420 generates an ultrasound image through a scan conversion process on the ultrasound data generated by the ultrasound transceiver unit 410. The ultrasound image may include an A mode, And a Doppler image representing a subject moving using a Doppler effect as well as an image of a gray scale obtained by scanning an object in an M mode. The Doppler image may include a blood flow Doppler image indicative of blood flow, a tissue Doppler image indicative of tissue movement, and a spectral Doppler image indicative of the movement velocity of the object as a waveform.

The B-mode processing unit 421 extracts and processes the B-mode component from the ultrasound data, and the image generation unit 430 generates the B-mode component based on the B-mode component extracted by the B-mode processing unit 421, The ultrasound image can be generated.

In addition, the Doppler processing unit 425 extracts Doppler components from the ultrasound data, and the image generating unit 430 can generate a Doppler image that expresses the motion of the target object in color or waveform based on the extracted Doppler component.

Furthermore, the image generating unit 430 may generate a 3-dimensional ultrasound image through a volume rendering process for volume data, and may generate an ultrasound image including a sound signal if necessary.

Hereinafter, each configuration of the ultrasound diagnostic system will be described with reference to an embodiment of the present invention.

FIG. 5 illustrates an embodiment of an ultrasound imaging vision headset according to the present invention.

5 (a) shows a goggle-type ultrasound image-presenting headset 500, and FIG. 5 (b) shows an ultrasound image-presenting headset 500 at a time of a diagnostician wearing the ultrasound image- Fig.

The ultrasound imaging presenting headset 500 includes a wear portion 530 to be worn on the head of the diagnoser and a glass 510 corresponding to the frontal view of the diagnoser. The wearer 530 may be constituted by a belt or the like which can be adjusted in size around the perimeter of the diagnoser or may be constructed so as to be hooked to the ear of the diagnoser. The size can be varied.

A display configuration is provided on the glass 510 of the ultrasound image-presenting headset 500 as an augmented reality image display unit 550 capable of displaying an image. Here, the augmented reality image display unit 550 may display any one of the binocular The first augmented reality image display unit 550a and the second augmented reality image display unit 550b may be installed corresponding to both sides of the diagnoser as shown in FIG. 5 It is possible. 5B, the first augmented reality image appearance part 550a is provided on the glass 510a corresponding to the left eye of the diagnosis person, and the first augmented reality image appearance part 550b is provided on the glass 510b corresponding to the right eye of the diagnosis person. 2 augmented reality image appearance unit 550b.

Here, the display configuration may be an OLED display on the glass 510 or a display module installed on the outside of the glass 510 as the HUD system and a reflector (not shown) for reflecting the image displayed on the display module on the glass 510. [ .

The augmented reality image display unit 550 is installed on the glass 510 of the ultrasound image presenting headset 500 so that the diagnostician operates the diagnostic probe 200 while observing the region to be inspected of the examinee, 550 can be provided as an augmented reality.

Furthermore, the ultrasound image presenting headset 500 may be provided with an acoustic output unit 560 and may output the acoustic signals included in the augmented reality image through the acoustic output unit 560. In the embodiment of FIG. 5, the sound output unit 560 is depicted as a speaker installed in correspondence with the ear of the diagnoser wearing the ultrasound image vision headset 500. In one embodiment, Can be modified into various configurations capable of outputting acoustic signals.

That is, in the case of ultrasound imaging for pregnant women, the sound output unit enables the diagnosis of the heart sound of the fetus at the same time to perform ultrasound imaging.

The motion recognition unit 570 may be mounted on the ultrasound image presenting headset 500. The motion recognition unit 570 generates motion information by sensing the motion of the diagnoser wearing the ultrasound image presenting headset 500, Can be performed. In the embodiment of FIG. 5, the motion recognition unit 570 photographs the gesture of the diagnoser including the camera corresponding to the time of the diagnoser wearing the ultrasound image vision headset 500, and generates motion information based on the photographed image And may be modified into various configurations such as an optical sensor capable of recognizing the gesture of a diagnostic person.

The voice recognizing unit 580 may be mounted on the ultrasound image presenting headset 500. The voice recognizing unit 580 may include a microphone or the like for recognizing the voice of a diagnostic person wearing the ultrasound image presenting headset 500 And analyzes the voice signal of the diagnoser input through the microphone to perform a specific function corresponding to the voice signal.

In this case, when the voice signal generated by the voice recognition unit coincides with the predetermined voice information, a preprogrammed function corresponding to each voice information, for example, a function of outputting a depth of ultrasound generated through a probe or augmented reality image display unit (I.e., images for the ultrasound image and the patient information) are output to the first augmented reality image display unit 550a and the second augmented reality image display unit 550b, respectively, or only one of them And outputting the combined signals to the first augmented reality image appearance part 550a and the second augmented reality image appearance part 550b) and the like can be made only by the voice command of the diagnosis person.

FIG. 6 shows a first embodiment of performing ultrasound diagnosis through the ultrasound imaging system according to the present invention.

In the first embodiment of FIG. 6, only one augmented reality image appearance unit 550 is installed in the ultrasound image vision headset 500. The diagnostic ultrasound image is displayed on the headset 500 while the ultrasound image vision headset 500 is worn on the head. The ultrasound image of the region to be inspected is enhanced through the augmented reality image display portion 550 installed on the glass 510 while the inspection portion of the subject 10 is observed through the diagnostic probe 200, It becomes possible to confirm it with a real image.

As described above, according to the present invention, since the examiner's eye line is maintained on the target site of the examinee and simultaneously the ultrasound image can be confirmed by the augmented reality, the ultrasound image can be obtained for the accurate region while increasing the concentration of the ultrasound.

FIG. 7 shows a second embodiment for performing ultrasound diagnosis through the ultrasound imaging system according to the present invention.

7, the first and second augmented reality image viewers 650a and 650b are installed as two augmented reality image viewers of the ultrasound image presenting headset 600 , A first augmented reality image appearance part 650a is installed on a glass 610a corresponding to the left eye of the diagnosis person and a second augmented reality image appearance part 650b is installed on a glass 610b corresponding to the right eye of the diagnosis person do.

In the first augmented reality image display unit 650a, the ultrasound image of the subject being examined is displayed, and at the same time, the patient information of the subject is displayed in the second augmented reality image display unit 650b.

Thus, the ultrasound image of the subject and the patient information about the subject are displayed, so that the diagnosis can confirm the patient information while confirming the ultrasound image, and more accurate ultrasound diagnosis becomes possible.

FIG. 8 shows a third embodiment of performing ultrasound diagnosis through the ultrasound diagnostic system according to the present invention.

In the third embodiment of FIG. 8, two augmented reality image appearance units 650a and 650b are installed in the augmented reality image appearance unit of the ultrasound image vision headset 600 as in the second embodiment of FIG. 7, In addition, the ultrasound image presenting headset 600 is provided with the motion recognition unit 670.

8, the motion recognition unit 670 recognizes the finger gesture of the diagnostic person. For example, when the motion recognition unit 670 includes a camera, the motion recognition unit 670 generates a real time photographed image in the motion mode, When a gesture corresponding to a specific pattern of a diagnostic person occurs, the corresponding function can be performed. Or if the motion recognition unit 670 includes an optical sensor, if the diagnoser takes repetitive hand movements in the vicinity of the optical sensor, the optical sensor is repeatedly sensed, thereby performing a function corresponding to the sensing information .

In the third embodiment of FIG. 8, when the diagnostic person takes a right-to-left motion, the motion recognition unit 670 recognizes the motion, and the motion recognition unit 670 recognizes the motion to the second augmented reality image display unit 650b on the glass 610b corresponding to the right eye And changes the patient information screen displayed.

In addition, various functions may be performed according to the motion information. In brief, on / off of the display configuration of the augmented reality image display unit may be performed, or enlargement, reduction, rotation and the like of the ultrasound image may be performed.

Furthermore, in addition to the configuration for recognizing and transmitting the gesture of the diagnosis person through the motion recognition unit 670 of the ultrasound image presenting headset 600, the voice recognition unit is mounted on the ultrasound image presenting headset 600 to recognize the voice of the diagnosis person May perform certain functions.

FIG. 9 shows a fourth embodiment of performing ultrasound diagnosis through the ultrasound imaging system according to the present invention.

In the fourth embodiment shown in FIG. 9, two augmented reality image viewers 750a and 750b are installed in the ultrasound image presenting headset 700, which can be provided as a three-dimensional augmented reality image.

In order to provide a three-dimensional image, the first and second augmented reality image display units 750a and 750b may display a ratio of a binocular interval and a focal length of a diagnostic person wearing the ultrasound image vision headset 700 And a partition wall 790 is formed at an end of the ultrasound image-presenting headset 700 so that the left and right eyes of the diagnoser can independently view the images.

As described above, the ultrasound images can be provided as three-dimensional augmented reality images by simultaneously displaying the stereoscopic ultrasound images in the two augmented reality image display units corresponding to the two sides of the diagnoser.

6 to 9, the ultrasound image presenting headset may include an acoustic output unit to output an acoustic signal according to the ultrasound image examination of the subject. For example, when the subject is a mother, The heart sound of the fetus may be included in the augmented reality image transmitted from the ultrasound imaging apparatus and the sound output unit of the ultrasound image presenting headset may output the sound signal as an acoustic signal so that the diagnosis can be made to determine the state of the fetus by a heart sound or the like.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments of the present invention are not intended to limit the scope of the present invention but to limit the scope of the present invention. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents thereof should be construed as being included in the scope of the present invention.

100: Ultrasound image vision headset,
200: diagnostic probe,
110, 210: an ultrasound image processing unit,
130, 230: augmented reality image generation unit,
150: augmented reality image display part,
170: additional information processor,
190:
250: Additional information Offering,
270:
300: Patient information database.

Claims (14)

And is worn on the head of a diagnostic person performing an ultrasound examination on the subject,
An ultrasound image processing unit for generating an ultrasound image through a probe for performing an ultrasound examination on the subject;
An augmented reality image generation unit for generating an augmented reality image based on the ultrasound image;
A glass for providing a visual field to the diagnostic person;
And an augmented reality image display unit installed in the glass or corresponding to at least one of the binocular eyes of the diagnoser or displaying the augmented reality image on the glass. And
And a diagnostic probe for performing an ultrasound examination on the region to be inspected of the subject and providing an inspection signal for the ultrasound image to the ultrasound image vision headset.
And is worn on the head of a diagnostic person performing an ultrasound examination on the subject,
A glass for providing a visual field to the diagnostic person;
And an augmented reality image display unit installed in the glass or corresponding to at least one of the binocular eyes of the diagnoser or displaying the augmented reality image on the glass. And
An ultrasound image processing unit for transmitting an ultrasound signal to an inspection site of the examinee and generating an ultrasound image based on the reflected ultrasound echo signal;
And an augmented reality image generation unit for generating an augmented reality image to be provided to the ultrasound image vision headset based on the ultrasound image.
3. The method according to claim 1 or 2,
The augmented reality image display unit includes:
And an OLED display installed on the glass.
3. The method according to claim 1 or 2,
The augmented reality image display unit includes:
A display module for outputting the augmented reality image; And
And a reflector for reflecting the augmented reality image output from the display module onto the glass,
Wherein the augmented reality image is displayed on the glass by a head up display (HUD) method.
3. The method according to claim 1 or 2,
The augmented reality image display unit includes:
A first augmented reality image display unit corresponding to the left eye of the diagnostic person and a second augmented reality image display unit corresponding to a right eye of the diagnostic person.
6. The method of claim 5,
Wherein the augmented reality image further includes patient information for the subject,
Wherein the first augmented reality image display unit comprises:
And displaying the ultrasound image included in the augmented reality image,
Wherein the second augmented reality image display unit comprises:
And displaying the patient information included in the augmented reality image.
6. The method of claim 5,
Further comprising a partition wall separating the visual field of the left eye and the right eye of the diagnostic person,
Wherein the first augmented reality image display unit comprises:
A stereoscopic image corresponding to the left eye of the diagnosis person is displayed,
Wherein the second augmented reality image display unit comprises:
And a stereoscopic image corresponding to the right eye of the diagnoser is displayed.
3. The method according to claim 1 or 2,
Wherein the augmented reality image includes an acoustic signal according to an ultrasonic inspection,
Wherein the ultrasound image vision headset comprises:
And an acoustic output unit for outputting the acoustic signals included in the augmented reality image.
3. The method according to claim 1 or 2,
Wherein the ultrasound image vision headset comprises:
And a motion recognition unit for recognizing the motion of the diagnostic person and generating motion information.
3. The method according to claim 1 or 2,
Wherein the ultrasound image vision headset comprises:
Further comprising: a voice recognition unit for recognizing a voice of the diagnostic person and generating voice information; and an ultrasound diagnostic system for supporting the augmented reality image.
The method according to claim 1,
Wherein the ultrasound image vision headset comprises:
And a patient information processing unit for providing patient information on the subject in cooperation with a patient information database having patient information,
Wherein the augmented reality image generation unit comprises:
Wherein the augmented reality image further includes the patient information.
3. The method of claim 2,
Wherein the diagnostic probe comprises:
And a patient information processing unit for providing patient information on the subject in cooperation with a patient information database having patient information,
Wherein the augmented reality image generation unit comprises:
Wherein the augmented reality image further includes the patient information.
10. The method of claim 9,
Wherein the diagnostic probe comprises:
And an additional information providing unit for receiving the motion information from the ultrasound image presenting headset and determining the motion information to perform a predetermined function corresponding to the motion information. system.
11. The method of claim 10,
Wherein the diagnostic probe comprises:
Further comprising an additional information providing unit for receiving the voice information from the ultrasound image presenting headset and determining the voice information to perform a preset function corresponding to the voice information. system.

Images