KR101629134B1 - Device and method for measuring using augmented reality - Google Patents

Abstract

The present invention relates to a measurement device using an augmented reality and a measurement method using the augmented reality. The measuring device using the augmented reality according to the present invention is characterized in that a probe is provided with a marker portion for setting a reference marker as a certain point in the measured object is pointed to the first marker and a marker portion for setting a reference distance between the first marker and the reference marker And an imaginary ruler unit for measuring the virtual ruler unit.

Description

Technical Field [0001] The present invention relates to a measurement device using an augmented reality and a measurement method using an augmented reality.

The present invention relates to a measurement apparatus using an augmented reality and a measurement method using the augmented reality.

In recent years, new technologies using IT devices have been actively researched as personal mobile devices such as smart phones and tablet PCs and various applications have been developed. The representative new technology is 'augmented reality'. Augmented reality is a technology that superimposes a 3D virtual image on a realistic image or background and displays it as a single image. An example of using an augmented reality is to display a virtual direction instruction on an image of a distance taken in navigation.

Such augmented reality technique can be usefully used in the medical field, for example, an operation for removing a bone tumor. Bone Tumor Removal Surgery is a surgery that cuts the tumor in the middle of the bone. An important point in the surgery is to accurately measure the location of the tumor and to measure and display the portion to be cut at regular intervals from the tumor.

In conventional bone tumor removal surgery, a physician (user) directly measured the tumor site using a medical instrument (for example, C-ARM) and tape measure. In other words, in conventional surgery to remove a tumor, the part of the tumor is opened, the tape is placed on the tumor, the distance between the end of the bone and the tumor is measured by C-ARM and X- As a marker.

These prior art techniques may have some disadvantages. First, in the prior art, marking the marker directly on the body may not be hygienic. Also, in the prior art, it takes a considerable amount of time to measure the surgical site after lapping the body, thereby increasing the time of infection possibility.

Therefore, it is necessary to develop an apparatus and a method that can measure a surgical site hygienically and simply using an augmented reality.

SUMMARY OF THE INVENTION The present invention has been conceived in order to solve the problems as described above, and it is an object of the present invention to provide an apparatus and a method for measuring a length of a measured object by generating an imaginary ruler between two points designated by a probe, .

Another object of the present invention is to display hygienically a display for eliminating a lesion by displaying the lesion length and the lesion removal length together with the virtual ruler on the measurement object.

The measuring device using the augmented reality for achieving the above object is characterized by comprising a marker for setting a fiducial marker as a certain point in the measured object is pointed to the first marker by the probe, And an imaginary ruler section for measuring a reference distance.

As a technical method for achieving the above object, a measurement method using an augmented reality may include a step of setting a fiducial marker according to a point of an arbitrary point in the measured object being pointed to the first marker by a probe, And measuring a reference distance between the reference markers.

According to one embodiment of the present invention, by creating an imaginary ruler between two points specified by the probe, the length of the measured object can be measured and a numerical value for the measured length can be displayed together with the measured object.

In addition, according to an embodiment of the present invention, the mark for lesion removal can be displayed hygienically by displaying the lesion length and the lesion removal length together with the virtual ruler in the measurement object.

1 is a diagram illustrating a measurement system using a measurement device using an augmented reality according to an embodiment of the present invention.
2 is a diagram illustrating a specific configuration of a measurement device using an augmented reality according to an embodiment of the present invention.
3 is a diagram illustrating a process of measuring a measurement distance using a measurement device using an augmented reality according to an embodiment of the present invention.
4 is a view for explaining a process of displaying a lesion removal length on a virtual ruler according to an embodiment of the present invention.
5 is a flowchart illustrating a method of measuring augmented reality according to an exemplary embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. Like reference symbols in the drawings denote like elements.

The measuring device using the augmented reality and the measuring method using the augmented reality described in the present specification can display the values of the virtual ruler and the measured length on the image including the measured object from the camera.

1 is a diagram illustrating a measurement system using a measurement device using an augmented reality according to an embodiment of the present invention.

The measurement system 100 using a measurement device using an augmented reality may include a measurement object 110, a camera 120, and a measurement device 130 using an augmented reality.

The measurement object 110 may be a human body or an object. For example, the measurement object 110 may be a bone in the human body. In the present specification, the measurement object 110 is an example of a body, but is not limited thereto.

The camera 120 may be a digital video camera capable of video shooting. The camera 120 captures an image including the measurement object 110 and transmits the captured image to the measurement device 130 using an augmented reality in real time, wirelessly or by wire.

The measurement device 130 using the augmented reality may generate a virtual ruler for the image including the measurement object 110 acquired from the camera 120 and measure the length of the measurement object 110. [ A detailed description of the measurement device 130 using the augmented reality will be described with reference to FIG.

2 is a diagram illustrating a specific configuration of a measurement device using an augmented reality according to an embodiment of the present invention.

The measuring device 200 using the augmented reality according to an exemplary embodiment of the present invention may include a marker unit 210 and an imaginary ruler unit 220. Also, according to the embodiment, the measurement apparatus 200 using the augmented reality may be configured by adding a display unit 230 and an input unit 240. [

First, the marker unit 210 sets a fiducial marker by the probe, as any point in the measured object is pointed to the first marker. That is, the marker unit 210 can set a fiducial marker when any point on the measurement object is pointed to the first marker by the probe. The setting of the fiducial markers may be a process of determining a reference coordinate, and the fiducial markers may be predetermined coordinates, for example, in a coordinate recognition plate produced by the inventor of the present invention.

Next, the virtual ruler unit 220 measures a reference distance between the first marker and the reference marker. That is, the virtual ruler unit 220 can measure the distance between the first marker pointed to the measured object and the reference marker, and the distance between the first marker and the reference marker can be a reference distance. At this time, the virtual ruler unit 220 can calculate the reference distance using the trigonometric function. A detailed description of the process of measuring the reference distance will be made with reference to FIG. 3 to be described later.

Further, the virtual ruler unit 220 generates, by the probe, an imaginary ruler whose scaling interval is determined based on the reference distance when any other point in the measured object is pointed to the second marker, The measurement distance between the marker and the second marker can be measured. That is, the virtual ruler unit 220 may generate a virtual ruler that measures between the first marker and the second marker, and the second marker may be any point other than the point designated by the first marker. At this time, the virtual ruler unit 220 can calculate the measured distance using the trigonometric function. A detailed description of the virtual ruler will be given with reference to FIG. 3 to be described later.

In addition, when the viewing angle or the zoom in-zoom-out with respect to the measured object in the image is changed, the virtual ruler unit 220 determines the scale interval of the virtual ruler in consideration of the changed viewing angle or the zoom in- Can be re-determined. In other words, the size and position of the measured object in the image may be different depending on the time of camera shooting, and the virtual ruler unit 220 can measure the actual distance that is not distorted by recalculating the scale interval of the virtual ruler.

For example, when the right side of the measured object is zoomed in on the image and the size of the measured object is different by the perspective method when zooming out, the virtual ruler unit 220 enlarges the scale of the virtual ruler Can be recrystallized. Further, when the virtual ruler unit 220 zooms out, the scale interval of the virtual ruler can be re-determined to be small. Accordingly, the virtual ruler unit 220 can display the virtual ruler in an image proportional to the measured object, and can measure the actual distance without distortion.

Next, the display unit 230 can visualize the reference distance or the measured distance as a numerical value in an image including the measured object. That is, the display unit 230 can display an image including the measured object, and the reference distance measured by the virtual ruler unit 220 or the numerical value of the measured distance can be displayed together.

3 is a diagram illustrating a process of measuring a measurement distance using a measurement device using an augmented reality according to an embodiment of the present invention.

3 (a) is a view showing a process of measuring a reference distance between the first marker and the reference marker.

The marker 310 may recognize the point as the first marker 330 as the arbitrary point in the measurement object 320 is pointed by the probe 310. [ The marker unit 210 can set the reference marker 340 when the first marker 330 is pointed. The virtual ruler unit 220 may generate a virtual dotted line connecting the first marker 330 and the reference marker 340 to measure the reference distance 350.

At this time, the display unit 230 may display the dimensions measured by the reference distance 350 together. For example, as shown in FIG. 3A, the virtual ruler unit 220 can measure '265 mm' as the reference distance 350 between the first marker 330 and the reference marker 340 , The display unit 230 may display '265 mm' together with the dotted line connecting the first marker 330 and the reference marker 340 in the image.

3 (b) is a diagram showing a process of generating a virtual ruler and measuring a measurement distance.

The virtual ruler unit 220 may measure the reference distance 350 and then generate an imaginary ruler 370 between the first marker 330 and the second marker 360 when the second marker 360 is pointed have. At this time, the virtual ruler unit 220 may determine the scale interval of the virtual ruler 370 based on the reference distance 350 and display it. The virtual ruler unit 220 may generate the virtual ruler 370 to measure the measurement distance between the first marker 330 and the second marker 360. [ For example, the virtual ruler unit 220 may measure '103 mm' for a distance measured between the first marker 330 and the second marker 360. At this time, the display unit 230 can display '103 mm' together with the virtual ruler 370 as shown in FIG. 3 (b).

Also, the virtual ruler unit 220 can reset the scale interval of the virtual ruler by considering the viewing angle or the zoom in-zoom-out with respect to the image including the reference marker 340. [

The measuring device 200 using the augmented reality according to the present invention can generate a virtual ruler between two points designated by the probe, thereby measuring the length of the measured object and displaying the numerical value of the measured length together with the measured object .

Referring again to FIG. 2, the input unit 240 can receive the length of the lesion from the measurement object. That is, the input unit 240 can receive the length of the lesion of the measured object input by the user. At this time, the input unit 240 can receive not only the length of the lesion but also the lengths of all the lesions associated with the lesion. The length of the lesion input to the user is measured from the image captured by the medical device according to the medical digital image and communication (DICOM) standards such as X-ray, X-ray CT and MRI Lt; / RTI > That is, the input unit 240 can receive the measured values of at least one of the images captured by the medical device.

In addition, the display unit 230 may display the lesion removal length including the length of the input lesion and a region spaced apart from the lesion by a predetermined interval on the virtual ruler. In other words, when displaying the virtual ruler, the display unit 230 displays the length of the lesion received from the input unit 240, and may display the area spaced apart at a predetermined interval with respect to the lesion. An example of displaying the lesion removal length on the virtual ruler using the length of the lesion of the inputted measurement object will be described with reference to FIG.

The measurement device 200 using the augmented reality according to the present invention can display a mark for eliminating a lesion in a hygienic manner by displaying the lesion length and the lesion removal length together with the virtual ruler on the measurement object.

4 is a view for explaining a process of displaying a lesion removal length on a virtual ruler according to an embodiment of the present invention.

4 (a) can be an image photographed in a medical device. The user can measure the length of each measurement object (bone) based on the image captured by the medical device. Next, the user can input the length of each measured object to the measuring device 200 using the augmented reality. That is, the input unit 240 of the measurement device 200 using the augmented reality can receive the lesion length 410 of the measurement object and the length of the measurement object related to the lesion.

4B, the measurement apparatus 200 using the augmented reality includes lesion removal lengths 420 and 421 including regions spaced apart from the lesion length 410 by a predetermined distance in the hypothetical ruler 400, Can be displayed separately. That is, the display unit 230 may display the lesion length 410 and the lesion removal lengths 420 and 421 in different colors.

The measurement device 200 using the augmented reality can display and match the virtual ruler 400 on the actual measurement object of the image photographed by the camera. That is, the measurement device 200 using the augmented reality can display the lesion length 410 and the lesion removal lengths 420 and 421 on the image including the measurement object.

5 is a flowchart illustrating a method of measuring augmented reality according to an exemplary embodiment of the present invention.

The measurement method using the augmented reality according to the present embodiment can be performed by the measurement device 200 using the augmented reality.

First, the measuring device 200 using the augmented reality sets a reference marker by a probe as an arbitrary point in the measured object is pointed to the first marker (510). That is, step 510 may be a process of setting a fiducial marker if any point on the measurement object is pointed to by the probe by the first marker. At this time, the measurement apparatus 200 using the augmented reality can calculate the reference distance using the trigonometric function.

Next, the measurement apparatus 200 using the augmented reality measures a reference distance between the first marker and the reference marker (520). That is, step 520 may be a process of measuring the distance between the first marker pointed to the measurement object and the reference marker, and the distance between the first marker and the reference marker may be a reference distance.

In addition, according to the embodiment, the measuring device 200 using the augmented reality may be configured such that, when the arbitrary point in the measured object is pointed to the second marker by the probe, And the measurement distance between the first marker and the second marker can be measured. That is, the augmented reality measuring apparatus 200 may generate a virtual ruler that measures between the first marker and the second marker, and the second marker may be any arbitrary point other than the point designated by the first marker. At this time, the virtual ruler unit 220 can calculate the measured distance using the trigonometric function.

In addition, according to the embodiment, the measurement apparatus 200 using the augmented reality can visualize the reference distance or the measurement distance as numerical values in an image including the measured object. That is, the measuring device 200 using the augmented reality can display an image including the measured object, and the measured reference distance or the measured distance can be displayed together.

In addition, according to the embodiment, when the viewing angle or the zoom in-zoom-out with respect to the measured object in the image is changed, the measuring device 200 using the augmented reality considers the changed viewing angle or the zoom in- So that the scale interval of the virtual ruler can be re-determined. That is, the size and position of the measured object in the image may be different depending on the time point when the camera is photographed. The measuring device 200 using the augmented reality may measure the actual distance that is not distorted by recalculating the scale interval of the virtual ruler .

For example, when the right side of the measured object in the image is zoomed in and the magnitude of the measured object is different due to the perspective view when zooming out, the measuring device 200 using the augmented reality, when zooming in, The interval can be recrystallized widely. In addition, the measurement apparatus 200 using the augmented reality can re-determine the scale interval of the virtual ruler when zooming out. Thus, the measuring device 200 using the augmented reality can display the virtual ruler in an image proportional to the measured object, and can measure the actual distance without distortion.

In the measuring method using the augmented reality according to the present invention, a virtual ruler is generated between two points designated by the probe, so that the length of the measured object can be measured and the numerical value of the measured length can be displayed together with the measured object.

Also, according to the embodiment, the measurement device 200 using the augmented reality can receive the length of the lesion from the measurement object. That is, the measurement device 200 using the augmented reality can receive the length of the lesion of the measured object input by the user. At this time, the measurement device 200 using the augmented reality can receive not only the length of the lesion but also the lengths of all the objects related to the lesion. The length of the lesion input to the user is measured from the image captured by the medical device according to the medical digital image and communication (DICOM) standards such as X-ray, X-ray CT and MRI Lt; / RTI > That is, the measurement device 200 using the augmented reality can receive the measured values of at least one of the images taken by the medical device.

In addition, according to the embodiment, the measurement device 200 using the augmented reality classifies the lesion removal length including the length of the input lesion and the area spaced apart from the lesion by a predetermined interval on the virtual ruler can do. That is, when the virtual ruler is displayed, the measurement device 200 using the augmented reality can display the length of the inputted lesion, and display the areas spaced apart from the lesion at regular intervals.

The measurement method using the augmented reality of the present invention can display hygienic marks for eliminating lesions by displaying the lesion length and the lesion removal length together with the virtual ruler on the measurement object.

The method according to an embodiment of the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

200: Measuring device using Augmented Reality
210:
220: virtual ruler part
230:
240: input unit

Claims (10)

A marker unit for setting a reference marker and setting a reference marker in a coordinate recognition plate located outside the measurement object as an arbitrary point in the measurement object is pointed by the probe with the first marker; And
A virtual dotted line connecting the first marker and the reference marker is generated to measure a reference distance between the first marker and the reference marker, and another arbitrary point in the measured object is pointed to the second marker by the probe An imaginary ruler for determining a scale distance based on the reference distance and measuring a measurement distance between the first marker and the second marker,
Wherein the augmented reality measuring device comprises: delete The method according to claim 1,
The measuring device includes:
A display unit for visualizing the reference distance or the measured distance as a numerical value in an image including the measured object,
Wherein the augmented reality device further includes an augmented reality device. The method of claim 3,
When the viewing angle or the zoom in-zoom-out with respect to the measured object in the image is changed,
The virtual ruler unit,
The scale interval of the virtual ruler is re-determined in consideration of the changed viewing angle or the zoom-in-zoom-out
Measurement system using augmented reality. The method according to claim 1,
The measuring device includes:
An input unit for receiving a length of a lesion from the measurement object; And
A display unit for displaying on the virtual ruler the lesion removal length including the length of the input lesion and a region spaced apart at a predetermined interval with respect to the lesion;
Wherein the augmented reality device further includes an augmented reality device. Setting a reference marker by setting a reference coordinate in a coordinate recognition plate located on the outside of the measurement object as an arbitrary point in the measurement object is pointed to the first marker by the probe;
Generating a virtual dotted line connecting the first marker and the reference marker to measure a reference distance between the first marker and the reference marker; And
Generating an imaginary ruler in which, with the probe, a scale interval is determined based on the reference distance when any other point in the measurement point is pointed to the second marker, and a measurement is made between the first marker and the second marker Steps to measure distance
The method comprising the steps of: delete The method according to claim 6,
Visualizing the reference distance or the measured distance as a numerical value in an image including the measured object,
The method comprising the steps of: 9. The method of claim 8,
When the viewing angle or the zoom in-zoom-out with respect to the measured object in the image is changed,
Re-determining the scale interval of the virtual ruler in consideration of the changed viewing angle or the zoom-in-zoom-out step
The method comprising the steps of: The method according to claim 6,
Receiving a lesion length from the measurement object; And
Dividing and displaying a length of the input lesion on the virtual ruler and a lesion removal length including a region spaced apart at a predetermined interval with respect to the lesion
The method comprising the steps of:

Images