KR20180101871A - System and Method for Combination of Image data for Producing of Surgical Guide - Google Patents

Abstract

The present invention relates to an image data registration system and method for manufacturing a surge guide, and more particularly, to a system and method for image data registration for producing a surge guide, which comprises a CT acquisition image and an CT acquisition image for acquiring an CT scan image and an oral scan image of an inside of an oral cavity of a subject having a plurality of reference markers, An electronic device that generates a matching image with respect to the interior of the oral cavity by matching the CT scan image and the oral scan image based on the reference marker included in the oral scan image may be included and may be applied to other embodiments.

Description

Technical Field [0001] The present invention relates to an image data matching system and method for producing a surge guide,

The present invention relates to an image data registration system and method for manufacturing a surge guide, and more particularly, it relates to a system and method for image data registration for producing a surge guide, which generates a matching image using a CT scan image and an oral scan image of an inside of an oral cavity of a patient with a reference mark, And more particularly, to a system and method for matching image data for manufacturing a surge guide.

In general, implants refer to replacements that can replace human tissue when the original human tissue is lost, and in particular, dental implants include fixtures, abutments, and crown Implies implanting the artificial tooth with the prosthesis to the actual tooth position.

The implant procedure is performed by forming a perforation in the alveolar bone, placing the fixture in the perforation, and attaching the abutment and the crown to the fixture when the fixture is fused to the alveolar bone. In dentistry, a surge guide is used for more accurate operation of the implant.

Generally, the surge guide combines the information obtained from the CT image and the information obtained from the 3D oral scan image. However, since the oral scan image is acquired from the scanned information by moving the oral scanner along the inside of the mouth of the subject, the curvature of the teeth and the like may be distorted differently from the inside of the oral cavity. Therefore, there arises a problem that the accuracy of the surge guide generated using the CT image and the scan scan image is deteriorated.

In order to solve such conventional problems, various embodiments of the present invention include a method of attaching a plurality of reference markers to an inside of a wearer's mouth, a CT scan image of an inside of a mouth with a reference marker attached thereto, And to provide a video data matching system and method for manufacturing the same.

In addition, various embodiments of the present invention provide a system and method for image data registration for the manufacture of a surge guide that generates a matched image based on a CT scan image and a reference marker image included in an oral scan image.

In addition, various embodiments of the present invention provide a method for producing a surge guide that produces a design image that includes a guide hole corresponding to a placement location where an artificial tooth is placed within the oral cavity based on a registration image, And to provide a video data matching system and method.

The image data matching system for manufacturing a surge guide according to an exemplary embodiment of the present invention includes an image acquisition device for acquiring a CT image and an oral scan image of an inside of an oral cavity of a subject having a plurality of reference markers, And an electronic device for matching the CT scan image and the oral scan image based on the image and the reference marker included in the oral scan image to generate a matching image for the inside of the oral cavity.

The apparatus further includes a light irradiating device for irradiating light for curing the reference marker attached to the inside of the mouth.

Further, the electronic device controls the at least one image according to a control signal for at least one of the CT shot image or the ORAL scan image inputted from the outside,

The control signal is a signal for adjusting at least one of a three-dimensional angle, a ratio, and a direction of the orthoscopic image so that the CT scan image and the reference marker included in the ORAL scan image are matched.

Further, the electronic device controls the ORAL scan image to coincide with the CT shot image in accordance with the control signal.

The electronic device generates a design image including a guide hole corresponding to a placement position at which the artificial tooth is to be placed in the oral cavity based on the matched image.

The apparatus further includes a 3D printer, and outputs the design image through the 3D printer to produce a surge guide.

According to another aspect of the present invention, there is provided an image data registration method for manufacturing a surge guiding method, the method comprising: acquiring a CT scan image and an oral scan image of an inside of an oral cavity of a subject having a plurality of reference markers; And generating an aligned image by matching the CT scan image and the ORAL scan image based on the image and the reference marker included in the ORAL scan image.

The method further includes the step of irradiating light to cure the reference marker attached to the interior of the mouth through a light irradiating device prior to the act of acquiring an oral scan image.

The operation of generating a matching image may further include controlling the at least one image in accordance with a control signal for at least one of the CT shot image or the ORAL scan image.

Also, the operation of controlling at least one image controls at least one of a three-dimensional angle, a ratio, and a direction of the ORAL scan image so that the CT shot image and the reference marker included in the ORAL scan image are matched.

In addition, the operation of controlling at least one image controls the or each scan image so that the or each scan image matches the CT scan image.

The method further includes the step of fabricating a surge guide based on the generated registration image.

The operation of manufacturing the surge guide may include generating a design image corresponding to the profile of the oral cavity based on the matched image and outputting the design image through the 3D printer when the control of the design image is completed Further comprising the act of manufacturing the surge guide.

The method further includes the step of controlling the generated design image to create a guide hole corresponding to a position where the artificial tooth is to be placed in the oral cavity.

As described above, the image data matching system and method for manufacturing a surge guide according to the present invention is characterized in that a plurality of reference markers are attached to the inside of a mouth of a client, a CT scan image and an oral scan image of the inside of the mouth are obtained, By generating a matching image on the basis of the reference markers, it is possible to achieve precise and accurate image registration.

According to the present invention, there is provided an image data matching system and method for producing a surge guide, the method comprising: generating a merged image including a guide hole corresponding to a placement position where an artificial tooth is placed in the oral cavity based on a matching image, Thereby, a more accurate surge guide can be produced.

1 is a diagram illustrating a system according to an embodiment of the present invention.
2 is a diagram showing a main configuration of an electronic device according to an embodiment of the present invention.
3 is a flowchart illustrating a method of matching image data according to an embodiment of the present invention.
4 is a detailed flowchart illustrating a method of manufacturing a surge guide according to an embodiment of the present invention.
5 is a view illustrating an example in which a reference marker is attached to the interior of the oral cavity according to an embodiment of the present invention.
6 is a view showing a CT image of the inside of the oral cavity with reference markers according to an embodiment of the present invention.
FIG. 7 is a diagram illustrating an oral scan image of an inside of a mouth with a reference marker according to an embodiment of the present invention. FIG.
8 is a view showing an image in which an CT scan image and an oral scan image are overlaid and displayed according to an embodiment of the present invention.
9 is a view showing a matching image in which a CT scan image and an oral scan image are matched according to an embodiment of the present invention.
10 is a view illustrating a surge guide according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that, in the drawings, the same components are denoted by the same reference symbols as possible. Further, the detailed description of known functions and configurations that may obscure the gist of the present invention will be omitted.

1 is a diagram illustrating a system according to an embodiment of the present invention.

Referring to FIG. 1, a system 10 according to the present invention includes a light irradiation apparatus 100, an image acquisition apparatus 150, an electronic apparatus 200, and a 3D printer 250.

The light irradiation apparatus 100 is an apparatus for irradiating light of a predetermined wavelength inside the oral cavity, and hardens a plurality of reference markers attached to the inside of the oral cavity. The light irradiation apparatus 100 can irradiate light of a different wavelength depending on the type of the reference marker formed of the resin adhesive. For example, when the resin adhesive is a visible light curing series, the light irradiation apparatus 100 irradiates light having a wavelength of visible light. When the resin adhesive is an ultraviolet ray (UV) curing series, the light irradiation apparatus 100 irradiates light of a UV wavelength. When the resin adhesive is an IR (infrared ray) curing series, the light irradiation apparatus 100 irradiates light of an IR wavelength. At this time, the resin adhesive is provided so as to have a high viscosity and can be adhered to the teeth inside the oral cavity, the surface of the gum, and the palate. The resin adhesive is formed of a material that does not transmit radiation, and can be clearly displayed in a computed tomography (CT) image and an oral scan image. The light irradiating apparatus 100 may be connected to the electronic apparatus 200 to irradiate light according to a control signal received from the electronic apparatus 200 and may be formed separately from the electronic apparatus 200. [

The image acquisition device 150 acquires an image of the inside of the mouth of the subject who has a plurality of reference markers attached thereto. To this end, the image acquisition device 150 includes a CT imaging device (not shown) and an oral scanner (not shown). The CT imaging device acquires a CT imaging image of the inside of the mouth through CT imaging using radiation. The CT photographing apparatus is located on the head of the client and scans the head of the client in the vertical direction. The CT imaging apparatus generates a CT imaging image by three-dimensionally combining a plurality of obtained cross-sectional images by scanning the head of the subject in the vertical direction. The practitioner can determine the distribution of the internal tissues of the recipient such as the internal dental crown (the upper part of the tooth appearing outside the gums), the root (the part under the tooth hidden inside the gum as a part of the alveolar bone), the alveolar bone and the bone mineral density .

The Oral Scanner is an oral scanner that captures a continuous image of the interior of the mouth while moving along the inside of the mouth of a client and combines the captured continuous images three-dimensionally to create an oral scan image. The practitioner confirms the image of gum appearance which is soft tissue and hard to obtain by CT scan through the oral scan image. In addition, since the oral scan image is acquired by the combination of the images continuously captured by the oral scanner moved along the inside of the oral cavity, the curvature of the dental arch identified in the oral scan image is distorted .

The electronic device 200 generates a matching image for the inside of the mouth by matching the CT shot image and the oral scan image on the basis of the CT shot image obtained in the image acquiring device 150 and the reference marker image included in the oral scan image . The electronic device 200 generates a design image for manufacturing a surge guide, based on the generated registration image. The electronic device 200 produces a surge guide by outputting a design image generated using the 3D printer 250. [

The 3D printer 250 is a printer capable of three-dimensional output, and is connected to the electronic device 200 to output a design image received from the electronic device 200 as a surge guide.

2 is a diagram showing a main configuration of an electronic device according to an embodiment of the present invention.

2, an electronic device 200 according to the present invention includes a communication unit 201, an input unit 203, a display unit 205, a memory 207, and a control unit 209.

The communication unit 201 communicates with the light irradiation apparatus 100, the image acquisition apparatus 150, and the 3D printer 250. The communication unit 201 can perform wired communication and wireless communication with the light irradiation apparatus 100, the image acquisition apparatus 150, and the 3D printer 250. The wired communication may be a communication using a cable such as a USB. Wireless communication is a communication using LTE-A (Long Term Evolution-Advanced), LTE (Long Term Evolution), WCDMA (Wideband Code Division Multiple Access), Bluetooth, Bluetooth low energy (BLE) .

The input unit 203 generates input data corresponding to the manager input of the electronic device 200. [ The input unit 203 includes at least one input means. The input unit 203 may include a key pad, a dome switch, a touch panel, a jog & shuttle, a sensor, a touch key, button and the like.

The display unit 205 displays display data according to the operation of the electronic device 200. [ The display unit 205 may be a liquid crystal display (LCD), a light emitting diode (LED) display, an organic LED (OLED) display, a micro electro mechanical systems (MEMS) And an electronic paper display. The display unit 205 may be implemented as a touch screen by being combined with the input unit 203. [

The memory 207 stores operation programs of the electronic device 200. The memory 207 maps and stores a CT shot image, an oral scan image, a matching image, and a design image of the oral cavity of at least one subject.

The control unit 209 generates a matching image for the interior of the oral cavity by matching the CT image and the oral scan image obtained from the CT photographing apparatus and the oral scanner included in the image acquiring apparatus 150, respectively. The control unit 209 generates a matching image based on the CT photographed image and the reference marker included in the oral scan image. The control unit 209 generates a design image for manufacturing a surge guide based on the generated registration image. The control unit 209 transmits the generated design image to the 3D printer 250 and outputs the generated design image to the 3D printer 250 to produce a surge guide.

More specifically, the control unit 209 activates the light irradiation apparatus 100 by the light irradiation signal received from the input unit 203. [ The control unit 209 irradiates light for curing the reference marker attached to the inside of the mouth. When the reference marker is cured, the operator provides an image acquisition signal to the control unit 209 via the input unit 203. [ The control unit 209 activates the image capturing apparatus 150 by the image acquiring signal to acquire an image of the inside of the mouth.

The control unit 209 overlays the CT scan image obtained from the CT imaging apparatus and the ORL scan image obtained from the ORL scanner to display on the display unit 205. The control unit 209 may receive a control signal for controlling the image from the input unit 203 when the CT shot image and the oral scan image do not match. The control unit 209 can control an image according to a control signal. The oral scan image is created by combining consecutively photographed images by an oral scanner which is moved along the oral cavity. Accordingly, since the dental check identified in the oral scan image may be more distorted than the actual dentition in the oral cavity from the anterior to posterior teeth side, the control unit 209 may correct the dentition identified in the oral scan image do.

To this end, the control unit 209 confirms the CT image and the reference marker image included in the oral scan image. The control unit 209 can emphasize and display the reference marker image identified in the CT image and emphasize and display the reference marker image identified in the oral scan image. When the control unit 209 receives the control signal for the reference marker image identified in the original scan image through the input unit 203, the control unit 209 can correct the score of the original scan image based on the reference marker image. In particular, the control unit 209 can correct the dental scan image by correcting the ratio and direction of the original scan image according to the control signal received from the input unit 203. [

When the correction of the original scan image is completed, the controller 209 adjusts the three-dimensional angle of the original scan image so that the CT scan image and the oral scan image match. The control unit 209 generates a matching image by matching the CT scan image and the oral scan image that are matched. The practitioner can accurately confirm information on the actual teeth such as the width and volume of each tooth through the oral scan image and obtain information on the root and alveolar bone connected to the crown through the matching image and information .

When the generation of the matching image is completed, the control unit 209 generates a design image based on the matching image. The design image is the image on which the surgeon guide is fabricated and is an image that is matched to the profile of the intraoral cavity identified in the registration image. The surge guide is an auxiliary device that is formed in the inside of the mouth of the recipient to provide the operator with the perforation position, diameter, direction, depth, and the like. In the surgeon guide, a guide hole is formed at a position where the artificial tooth needs to be implanted in the oral cavity of the patient. Accordingly, the control unit 209 controls the design image by generating a guide hole in the design image according to the input of the input unit 203. [ The control unit 209 transmits the design image in which the guide holes are generated to the 3D printer 250. The controller 209 outputs the design image in three dimensions in the 3D printer 250, and transmits the control signal to the 3D printer 250 in order to manufacture it as a surge guide.

3 is a flowchart illustrating a method of matching image data according to an embodiment of the present invention.

Referring to FIG. 3, in operation 301, the control unit 209 performs operation 303 when the light irradiation signal is received through the input unit 203. In operation 303, the control unit 209 controls the light irradiation apparatus 100 to irradiate the inside of the mouth of the client. At this time, a plurality of reference markers are attached to the inside of the oral cavity, and light emitted from the light irradiation apparatus 100 is light for curing the reference markers. For example, the reference marker includes a resin adhesive body that is harmless to the human body, has a viscosity of a certain level or higher in a cured state, and can be stably cured in a humidity range inside the oral cavity. The light emitted from the light irradiation apparatus 100 may differ depending on the type of the reference marker. For example, when the reference marker is a visible light curing series, the light may be a visible light wavelength, and when the reference marker is a UV curing series, the light may be a UV wavelength, and when the reference marker is an IR curing series, Lt; / RTI > The reference markers may be adhered to the teeth inside the oral cavity, the surface of the gums, and the palate, and may be displayed on the CT shot image and the oral scan image.

In operation 305, the control unit 209 performs an operation 307 when a signal for acquiring an image of the inside of the mouth is received from the input unit 203. In operation 307, the control unit 209 controls the image acquisition device 150 to display an image of the acquired oral cavity. At this time, the control unit 209 can overlay and display the CT image and the oral scan image. More specifically, the control unit 209 confirms the CT photograph image and the reference marker image included in the oral scan image. The control unit 209 can emphasize and display the reference marker image identified in the CT image and emphasize and display the reference marker image identified in the oral scan image. The image acquisition device 150 includes a CT imaging device and an oral scanner. The CT photographing apparatus refers to a device for scanning the head of a subject using radiation. The CT image shows the distribution of internal tissues such as alveolar bone (the upper part of the teeth appearing outside the gums), the root (the part under the teeth hidden inside the gums) and the alveolar bone based on the transmittance of radiation and bone density information . The Oral Scanner captures a continuous image while moving along the interior of the mouth of the subject and combines the captured continuous images in three dimensions to obtain a three-dimensional oral scan image. Oral scan image is an image of gum appearance that is difficult to obtain by CT.

In operation 309, the control unit 209 confirms whether or not a control signal for the image is received from the input unit 203. When the control signal is received in operation 309, the controller 209 performs an operation 311. If the control signal is not received, the controller 209 determines that the CT scan image and the oral scan image can be matched and performs operation 313. In operation 311, the control unit 209 controls the oral scan image by the input of the input unit 203. The control unit 209 can correct the dentition of the oral scan image based on the reference marker image. In particular, the control unit 209 can correct the dental scan image by correcting the ratio and direction of the original scan image according to the control signal received from the input unit 203. [ The controller 209 adjusts the three-dimensional angle of the original scan image so that the CT scan image and the original scan image match each other.

In operation 313, the control unit 209 performs the operation 315 when the image matching signal for matching the CT image and the oral scan image is received from the input unit 203, and returns to the operation 309 if the image matching signal is not received. In operation 315, the control unit 209 generates a three-dimensional registered image by matching the CT shot image and the oral scan image. In operation 317, the control unit 209 manufactures a surge guide using the generated registration image. A method of manufacturing a surge guide will be described with reference to Fig. 4 is a detailed flowchart illustrating a method of manufacturing a surge guide according to an embodiment of the present invention.

Referring to FIG. 4, in operation 401, the control unit 209 generates a design image based on the registration image. The design image is the basis for manufacturing the surge guide. The design image may be an image that matches the profile of the interior of the mouth identified in the matched image. In operation 403, the control unit 209 controls the design image by the input of the input unit 203. The surgeon guide is an auxiliary device for forming the perforation position, the diameter, the direction and the depth, etc., in the inside of the mouth of the patient. Therefore, a guide hole should be formed in the surgeon guide at the position where the artificial tooth needs to be implanted in the inside of the patient's mouth. To this end, the control unit 209 controls the generated design image by generating a guide hole according to the input of the input unit 203.

In operation 405, the control unit 209 performs an operation 407 when an output signal of the surge arrester is received from the input unit 203. In operation 407, the control unit 209 transmits the design image to the 3D printer 250, and outputs the design image in which the guide hole is generated in three dimensions, thereby manufacturing the surge guide.

5 is a view illustrating an example in which a reference marker is attached to the interior of the oral cavity according to an embodiment of the present invention. 6 is a view showing a CT image of the inside of the oral cavity with reference markers according to an embodiment of the present invention. FIG. 7 is a diagram illustrating an oral scan image of an inside of a mouth with a reference marker according to an embodiment of the present invention. FIG. 8 is a view showing an image in which an CT scan image and an oral scan image are overlaid and displayed according to an embodiment of the present invention. 9 is a view showing a matching image in which a CT scan image and an oral scan image are matched according to an embodiment of the present invention. 10 is a view illustrating a surge guide according to an embodiment of the present invention.

5 to 10, one placing position 501 may exist in the oral cavity 500 of the subject. At this time, the placement position 501 is a position where the artificial tooth is to be placed. The practitioner can confirm the dentist's dentition 510 from the mouth cavity 500 of the dentist. The operator attaches a plurality of reference markers 521, 522, 523 and 524 to the inside of the wearer's mouth 500 and applies reference markers 521, 522 and 523 And 524 are cured.

The control unit 209 activates the image capturing apparatus 150 connected to the electronic device 200 in accordance with the input of the input unit 203 and displays the CT image 600 and the CT image 600, And receives the ORAL scan image 700 shown in FIG. The control unit 209 overlays the received CT scan image 600 and the oral scan image 700 to display the overlay image 800 as shown in FIG. More specifically, in the CT image 600, images 611, 612, 613, and 614 for the reference markers 521, 522, 523, and 524 attached to the oral cavity 500 can be identified. In the oral scan image 700, the images 711, 721, 713, and 714 for the reference markers 521, 522, 523, and 524 attached to the oral cavity 500 can be identified.

The control unit 209 overlays the CT shot image 600 and the oral scan image 700 to display the overlay image 800 and the practitioner can view the CT scan image 600 and the oral scan image 700) are not coincident with each other. The control unit 209 can control the oral scan image 700 by the input of the input unit 203. [ The operator uses the input unit 203 to match the images 611, 612, 613, and 614 identified in the CT image 600 and the images 711, 721, 713, and 714 identified in the oral scan image 700 And adjusts the ratio and direction of the original scan image 700 by moving the reference image 713 identified in the original scan image 700 in the direction of the arrow. This allows correction of the curvature distortion on the teeth 710 visible in the oral scan image 700.

The control unit 209 controls the CT scan image 600 and the oral scan image 700 as shown in FIG. 9 if the CT scan image 600 and the oral scan image 700 are coincident with each other by the control of the oral scan image 700 And the matching image 900 is generated and displayed. In the matching image 900, images 611, 612, 613, and 614 identified in the CT scan image 600 by the operator and images 711, 721, 713, and 714 identified in the oral scan image 700 are matched 911, 912, 913, and 914 can be confirmed. In addition, the practitioner can confirm the dentist's teeth 910 in the matching image 900.

The control unit 209 identifies the profile 920 of the subject's oral cavity based on the registration image 900 and generates a design image 1010 based on the identified profile 920. [ At this point, the design image 1010 may be generated in a form that can be matched to the identified profile 920. The control unit 209 controls the design image 1010 to generate the guide hole 1020 at a position corresponding to the placement position 501 inside the oral cavity based on the design image 1010. [ The controller 209 transmits the controlled design image to the 3D printer 250 and proceeds to three-dimensional output. Such a three-dimensionally outputted design image may be a surge guide.

It should be noted that the embodiments of the present invention disclosed in the present specification and drawings are only illustrative of the present invention in order to facilitate the understanding of the present invention and are not intended to limit the scope of the present invention. That is, it will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible.

Claims (15)

An image acquiring device for acquiring a CT shot image and an oral scan image of the inside of the mouth of a subject having a plurality of reference markers; And
An electronic device for matching the CT scan image and the oral scan image based on the CT scan image and the reference markers included in the oral scan image to generate a matched image for the inside of the mouth;
/ RTI > The method according to claim 1,
A light irradiating device for irradiating light to harden the reference marker attached to the inside of the mouth;
≪ / RTI > 3. The method of claim 2,
The electronic device includes:
And controls the at least one image according to a control signal for at least one of the CT shot image or the ORAL scan image inputted from the outside. The method of claim 3,
Wherein the control signal comprises:
And a signal for adjusting at least one of a three-dimensional angle, a ratio, and a direction of the ORAL scan image so that the CT shot image and the reference marker included in the ORAL scan image coincide with each other. 5. The method of claim 4,
The electronic device includes:
And controls the oral scan image to match the CT shot image in accordance with the control signal. The method according to claim 1,
The electronic device includes:
And a guide hole corresponding to a position where the artificial teeth are to be placed in the oral cavity based on the matching image. The method according to claim 6,
3D printer;
Further comprising:
And outputting the design image through the 3D printer to produce a surge guide. Acquiring a CT shot image and an oral scan image of an inside of the mouth of a subject having a plurality of reference markers; And
Generating a matching image by matching the CT shot image and the ORAL scan image based on the CT shot image and the reference marker included in the ORAL scan image;
≪ / RTI > 9. The method of claim 8,
Prior to the act of acquiring the ocular scan image,
Irradiating light to cure the reference marker attached to the interior of the mouth through a light irradiating device;
≪ / RTI > 10. The method of claim 9,
The operation of generating the matched image comprises:
Controlling the at least one image according to a control signal for at least one of the CT shot image or the ORAL scan image;
≪ / RTI > 11. The method of claim 10,
Wherein the controlling at least one image comprises:
And controlling at least one of a three-dimensional angle, a ratio, and a direction of the ORAL scan image so that the CT shot image and the reference markers included in the ORAL scan image coincide with each other. 12. The method of claim 11,
Wherein the controlling at least one image comprises:
And controlling the orial scan image so that the or each scan image matches the CT scan image. 9. The method of claim 8,
Generating a surge guide based on the generated matched image;
≪ / RTI > 14. The method of claim 13,
The operation of manufacturing the surge guide includes:
Generating a design image corresponding to a profile of the interior of the mouth based on the matched image; And
Outputting the design image through a 3D printer when control of the design image is completed to produce the surge guide;
≪ / RTI > 15. The method of claim 14,
Controlling the generated design image to generate a guide hole corresponding to a position where the artificial tooth is to be placed in the oral cavity;
≪ / RTI >

Images