KR102696585B1 - Method for providing image of tmj using virtual camera, and apparatus implementing the same method - Google Patents

Abstract

A method for providing a temporomandibular joint (TMJ) image using a virtual camera capable of providing an image capable of observing the external shape and internal structure of the TMJ from various viewpoints through virtual camera settings is provided. The method performed by a computing device according to an embodiment of the present invention includes the steps of setting a position of a virtual camera in a TMJ (temporomandibular joint) region connecting the mandible and the skull in a 3D image obtained by matching oral CT data and oral scan data, obtaining an image captured at the position of the virtual camera set in the TMJ region when the occlusion state of the maxillary teeth and the mandibular teeth is converted from a static occlusion state to a dynamic movement state, and displaying the captured image on a screen.

Description

METHOD FOR PROVIDING IMAGE OF TMJ USING VIRTUAL CAMERA, AND APPARATUS IMPLEMENTING THE SAME METHOD

The present invention relates to a method for providing a TMJ image, and a device for implementing the same, and more specifically, to a method for providing a TMJ image for providing an image near the TMJ (temporomandibular joint) through a virtual camera setting using dental image software, and a device for implementing the same.

Observing CT or panoramic images of the patient's oral cavity using dental imaging software is very important in establishing an accurate treatment plan for the patient's oral structures, such as teeth and temporomandibular joints.

In particular, in the case of temporomandibular joint (TMJ) disorders, symptoms such as jaw pain, difficulty opening the mouth, and facial asymmetry may occur, so it is necessary to closely observe the condition of the temporomandibular joint through dental imaging. In addition, in the case of orthodontic treatment, it is necessary to diagnose through imaging how the temporomandibular joint moves when the maxilla and mandible occlude.

Previously, to obtain images of the area around the temporomandibular joint (TMJ), it was possible to use intraoral CT or panoramic images provided by dental imaging software, or to obtain images of the inside of the temporomandibular joint using a real endoscope camera.

However, when using dental imaging software, there is a problem that although it provides a screen that allows observation of the external appearance of the temporomandibular joint (TMJ), the internal structure of the temporomandibular joint (TMJ) is structurally obscured, making it difficult to observe. In addition, when using a real endoscope camera separately from dental imaging software, the structure of the temporomandibular joint (TMJ) can be observed accurately, but both the patient and the medical staff may feel uncomfortable during the process of filming with the endoscope camera.

Therefore, a method is required to observe the internal structure of the temporomandibular joint on dental imaging software without using an actual endoscopic camera.

Publication of Patent Publication No. 10-2011-0027467 (Published on March 16, 2011)

The technical problem to be solved by the present invention is to provide a method for providing a TMJ image capable of observing the external shape and internal structure of the TMJ from various viewpoints through a virtual camera setting in dental imaging software, and a device for implementing the same.

Another technical problem to be solved by the present invention is to provide a method for providing a TMJ image capable of diagnosing a disorder of the temporomandibular joint (TMJ) by visually observing the relationship between the TMJ and surrounding structures when the TMJ changes from a static occlusion state to a dynamic movement state in dental imaging software, and a device for implementing the same.

Another technical problem to be solved by the present invention is to provide a method for providing a TMJ image capable of analyzing the movement path of the temporomandibular joint (TMJ) and controlling the settings of a virtual camera according to the movement path in dental image software, and a device for implementing the same.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below.

In order to solve the above technical problem, a method performed by a computing device according to one embodiment of the present invention includes the steps of setting a position of a virtual camera in a TMJ (temporomandibular joint) region connecting the mandible and the skull in a 3D image in which oral CT data and oral scan data are aligned, obtaining an image captured at the position of the virtual camera set in the TMJ region when the occlusion state of the maxillary teeth and the mandibular teeth is converted from a static occlusion state to a dynamic movement state, and displaying the captured image on a screen.

As an example, the step of setting the position of the virtual camera may include, when the mode of the virtual camera is selected as a variable viewpoint mode, setting a first point corresponding to the medial pole of the mandible in the TMJ region, a second point corresponding to the lateral pole of the mandible, and a third point corresponding to the uppermost point of the mandible as the position of the virtual camera.

As one embodiment, the step of setting the position of the virtual camera may include, when the mode of the virtual camera is selected as a position variable mode, a step of setting the position and direction of the virtual camera by selecting the fourth point and the fifth point among the TMJ regions.

As one embodiment, the step of setting the position of the virtual camera and the direction of the virtual camera may include the step of receiving a user input for setting the fourth point, and the step of additionally receiving a user input for setting the fifth point while the fourth point is set.

As one embodiment, the step of acquiring an image captured at a position of a virtual camera set in the TMJ region may include a step of acquiring an image by utilizing a viewpoint mismatch between the virtual cameras positioned at the fourth point of the left and right TMJ regions.

As an example, the dynamic movement state may include a forward movement state based on whether the upper teeth and the lower teeth are in occlusion, and a lateral movement state based on whether the two molars are in occlusion.

As one embodiment, the method may further include a step of providing a UI capable of rotating the position of the virtual camera about each of the X-axis, Y-axis, and Z-axis which are mutually orthogonal to each other, and a step of setting the position of the virtual camera by rotating it according to a user input to the UI.

As an embodiment, the method may further include a step of providing a UI capable of moving the position of the virtual camera up and down or left and right while fixing the Z-axis among the X-axis, Y-axis, and Z-axis that are orthogonal to each other, and a step of moving and setting the position of the virtual camera according to a user input to the UI.

As one embodiment, the method may further include a step of providing a UI capable of moving the position of the virtual camera in a positive or negative direction on the Z axis among the X-axis, Y-axis, and Z-axis that are orthogonal to each other, and a step of moving and setting the position of the virtual camera according to a user input to the UI.

As one embodiment, the method may further include a step of providing a UI capable of setting a magnification for adjusting a perspective projection value of the virtual camera while fixing an X-axis, a Y-axis, and a Z-axis that are orthogonal to the position of the virtual camera, and a step of setting the magnification of the virtual camera according to a user input to the UI.

As an embodiment, the method may further include a step of providing a UI capable of rotating the captured image by modifying the position of the fifth point so that the direction of the virtual camera is changed, and a step of rotating and displaying the captured image according to a user input to the UI.

In order to solve the above technical problem, according to one embodiment of the present invention, a dental image providing device comprises: one or more processors, a communication interface for communicating with an external device, a memory for loading a computer program executed by the processor, and a storage for storing the computer program, wherein the computer program includes instructions for performing an operation of setting a position of a virtual camera in a TMJ (temporomandibular joint) area connecting the mandible and the skull in a 3D image obtained by matching oral CT data and oral scan data, an operation of acquiring an image captured at a position of a virtual camera set in the TMJ area when the occlusion state of the maxillary and mandibular teeth is converted from a static occlusion state to a dynamic movement state, and an operation of displaying the captured image on a screen.

Figure 1 is a system configuration diagram according to one embodiment of the present invention.
FIG. 2 is a block diagram illustrating the configuration of a dental image providing device according to one embodiment of the present invention.
FIG. 3 is a flowchart for explaining a method for providing a TMJ image using a virtual camera according to one embodiment of the present invention.
FIG. 4 is an example of generating a 3D image by aligning oral CT data and oral scan data according to some embodiments of the present invention.
FIG. 5 is an example of obtaining static occlusion data and dynamic occlusion data according to some embodiments of the present invention.
FIG. 6 is an example illustrating a process of matching forward motion data according to some embodiments of the present invention.
FIG. 7 is an example of an image showing aligned left-side and right-side motion data according to some embodiments of the present invention.
FIG. 8 is an example of setting the position of a camera in a variable viewpoint mode according to some embodiments of the present invention.
FIG. 9 is an example of finding the center of the condyle as a reference point for determining the movement path of the temporomandibular joint according to some embodiments of the present invention.
FIGS. 10 and 11 are examples of finding the angles at which the condyle can move during forward and lateral movements according to some embodiments of the present invention.
FIG. 12 is an example of setting the position and direction of a camera in a position variable mode according to some embodiments of the present invention.
FIG. 13 is an example of providing a rotation function of a virtual camera according to some embodiments of the present invention.
FIG. 14 is an example of providing a movement function of a virtual camera according to some embodiments of the present invention.
FIG. 15 is an example of providing a zoom in/zoom out function of a virtual camera according to some embodiments of the present invention.
Figure 16 is a hardware configuration diagram of the dental image providing device described with reference to Figure 2.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. The advantages and features of the present disclosure and the methods for achieving them will become apparent with reference to the embodiments described in detail below together with the accompanying drawings. However, the technical idea of the present disclosure is not limited to the following embodiments but may be implemented in various different forms, and the following embodiments are provided only to make the technical idea of the present disclosure complete and to fully inform a person having ordinary skill in the art to which the present disclosure belongs of the scope of the present disclosure, and the technical idea of the present disclosure is defined only by the scope of the claims.

In describing the present disclosure, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present disclosure, the detailed description will be omitted.

Hereinafter, some embodiments of the present disclosure will be described in detail with reference to the attached drawings.

Fig. 1 is a system configuration diagram according to an embodiment of the present invention. Referring to Fig. 1, a dental image providing device (1) according to an embodiment of the present invention generates an image of an oral structure using CT data and oral scan data that photograph the oral structure of a patient received from an external device (10), and displays the image on a screen. The external device (10) is a device that stores and manages CT data and oral scan data that photograph the oral structure of a patient, and may be, for example, a computing device such as a server or a PC.

The dental image providing device (1) is a terminal of a user or medical staff who wants to analyze images of teeth and temporomandibular joints using software, and can be implemented as, for example, a PC, laptop, tablet, smart phone, etc.

A dental image providing device (1) can generate a 3D image by aligning oral CT data and oral scan data, and can set the position of a virtual camera in the temporomandibular joint (TMJ) region connecting the mandible and the skull within the aligned 3D image. The position of the virtual camera can be set differently depending on whether the mode of the camera selected according to user input is the viewpoint variable mode (or stationary mode) or the position variable mode (or moving mode). When the mode of the camera is selected as the viewpoint variable mode (or stationary mode), the position of the virtual camera is fixed to a specific point in the temporomandibular joint (TMJ) region, and at this time, the direction of the camera can be varied according to the user input. In addition, when the mode of the camera is selected as the position variable mode (or moving mode), the position of the virtual camera moves along a predetermined path, and the direction of the camera during the movement can be identical to the moving direction of the camera.

A dental image providing device (1) can obtain an image captured at the position of a virtual camera set in the temporomandibular joint (TMJ) region when the occlusion state of the maxillary and mandibular teeth changes from a static occlusion state to a dynamic movement state. Here, the dynamic movement state can include a forward movement state based on whether the anterior teeth between the maxillary and mandibular teeth are occluded, and a lateral movement state based on whether the two molars are occluded.

According to the system configuration of the present invention as described above, it is possible to provide an image that can observe the external appearance and internal structure of the temporomandibular joint (TMJ) from various viewpoints through a virtual camera setting in the dental imaging software. In addition, when the temporomandibular joint (TMJ) changes from a static occlusion state to a dynamic movement state, the relationship between the TMJ and the surrounding structures can be visually observed to diagnose whether the TMJ has a disorder. For example, when the TMJ changes from a static occlusion state to a dynamic movement state, the visual state change between the TMJ and the mandibular fossa/mandibular head, and the visual state change between the TMJ and the articular eminence can be observed, and through this, whether the TMJ has a disorder can be diagnosed and a treatment plan can be established. FIG. 2 is a block diagram illustrating the configuration of a dental image providing device according to an embodiment of the present invention.

A dental image providing device (1) according to an embodiment of the present invention includes a communication unit (13), a storage unit (14), and a processor (11), and can be connected to an external device (10) through the communication unit (13).

The external device (10) is a device that stores and manages CT data and oral scan data that capture the patient's oral structure, and can be implemented as a computing device such as a server or a PC.

A dental image providing device (1) is a device that provides an interface that can perform a series of operations to obtain a temporomandibular joint image through a virtual camera setting according to a user's input, and can be implemented as a computing device such as a PC, laptop, tablet, or smart phone.

The communication unit (13) communicates with the external device (10) using a wired or wireless communication method. The communication unit (13) may communicate with the external device (10) using a wired communication method such as Ethernet, or may communicate using a wireless communication method such as Wi-Fi or Bluetooth. The method by which the communication unit (13) communicates is not limited to this, and may communicate using other communication methods.

The storage unit (14) stores data related to the settings of a virtual camera performed according to a user's input, and can store temporomandibular joint (TMJ) images captured by the virtual camera.

The processor (11) includes an image acquisition module (11a) for acquiring a temporomandibular joint (TMJ) image through a virtual camera setting, and may further include an additional module for providing a user interface for the virtual camera setting.

The processor (11) receives a request for provision of a temporomandibular joint (TMJ) image through a virtual camera setting according to a user's input, and performs an operation for obtaining a temporomandibular joint (TMJ) image captured by the virtual camera according to the request.

The processor (11) receives CT data and oral scan data that photograph the oral structure from an external device (10), and creates a 3D image by aligning the received CT data and oral scan data and displays it on the screen.

The processor (11) sets the position of the virtual camera in the temporomandibular joint (TMJ) area connecting the mandible and the skull in a 3D image that aligns CT data and oral scan data.

As an example, when the camera mode is selected as a variable view mode (or a stationary mode), the processor (11) may set a point corresponding to the medial pole of the mandible in the temporomandibular joint (TMJ) region, a point corresponding to the lateral pole of the mandible, and a point corresponding to the uppermost point of the mandible as the positions of the virtual camera according to user input.

In addition, when the camera mode is a position variable mode (or a movement mode), the processor (11) can select two points in the temporomandibular joint (TMJ) area according to user input to set the position and direction of the virtual camera.

The image acquisition module (11a) can acquire a temporomandibular joint (TMJ) image captured at a location of a virtual camera set by an external device (10). At this time, the temporomandibular joint (TMJ) image can be provided as an endoscopic 3D image captured to observe not only the exterior of the temporomandibular joint (TMJ) region but also the interior.

In addition, the image acquisition module (11a) can adjust the position and direction of the virtual camera according to user input. For example, a new jaw joint image can be obtained at a position adjusted by rotating, moving, or zooming in/out the position of the virtual camera.

FIG. 3 is a flowchart for explaining a method for providing a TMJ image using a virtual camera according to another embodiment of the present invention.

A method for providing a TMJ image using a virtual camera according to an embodiment of the present invention can be executed by a dental image providing device (1). The description of a subject performing some operations included in the method according to an embodiment of the present invention may be omitted, and in such a case, it may be understood that the subject is the dental image providing device (1).

Referring to FIG. 3, first, in operation S31, the dental image providing device (1) sets the position of the virtual camera in the temporomandibular joint (TMJ) region connecting the mandible and the skull in a 3D image in which oral CT data and oral scan data are aligned.

As an example, as in the example of FIG. 4, when generating a 3D aligned image (43) by aligning oral CT data (41) and oral scan data (42), the dental image providing device (1) can perform an alignment operation by setting three points corresponding to the anterior teeth and left and right molars among the tooth areas of the oral CT data (41) and oral scan data (42) as reference points.

Here, the oral scan data (42) may include static occlusion data (50) that records when the patient closes his/her mouth and the upper and lower teeth come into contact, and dynamic occlusion data (51, 52, 53) that records the moments when the upper and lower teeth come into contact and do not come into contact when the patient moves forward, left, and right. At this time, the dynamic occlusion data includes forward movement data (51), left-side movement data (52), and right-side movement data (53), and may be acquired by a photographic method or a video recording method.

For example, as shown in FIG. 6, a 3D aligned image (62) can be generated by matching oral CT data (60) and forward motion data (61). In addition, as shown in FIG. 7, a 3D aligned image (71) can be generated by matching oral CT data (60) and left-side motion data, or a 3D aligned image (72) can be generated by matching oral CT data (60) and right-side motion data.

As an example, operation S31 may include an operation of setting a first point corresponding to the medial pole of the mandibular head in the TMJ region, a second point corresponding to the lateral pole of the mandibular head, and a third point corresponding to the uppermost point of the mandibular head as the positions of the virtual camera when the camera mode is selected as the variable view mode (or fixed-in-place mode) according to a user input. At this time, the dental image providing device (1) may also set the direction and angle of view (or FOV) of the camera for image acquisition.

For example, as illustrated in FIG. 8, the dental image providing device (1) can select the camera mode as a variable view mode (or a fixed mode) according to user input, and at this time, three points (81, 82, 83) among the temporomandibular joint (TMJ) region (80) connecting the mandible and the skull in the 3D aligned image in which oral CT data and oral scan data are aligned can be set as the positions of three virtual cameras, respectively.

At this time, each of the three points (81, 82, 83) set as the positions of the three virtual cameras can be determined as the first point (91), which is the medial pole of the mandible within the temporomandibular joint (TMJ) region (90), the second point (92), which is the lateral pole of the mandible, and the third point (93), which is the uppermost point of the mandible, in the example of Fig. 9.

Meanwhile, in the example of Fig. 9, the dental image providing device (1) sets the center (94) of the condyle that comes into contact with the temporomandibular joint disc in the temporomandibular joint (TMJ) region (90), so that the movement path of the condyle can be identified when the temporomandibular joint (TMJ) changes from a static occlusion state to a dynamic movement state. At this time, the center (94) of the condyle can be determined as the point where the line connecting the first point (91), which is the medial pole of the mandible, the second point (92), which is the lateral pole of the mandible, and the third point (93), which is the uppermost point of the mandible, meet vertically.

As an example, in the example of FIG. 10, the dental image providing device (1) can set the condylar angle, which is the angle at which the condyle can move when the temporomandibular joint (TMJ) moves forward. Specifically, the superior edge of the external auditory canal (1011) and the inferior edge of the orbit (1012) can be selected through the UI in the coronal view of CT data, and a first reference plane (FH plane) connecting the superior edge of the external auditory canal (1011) and the inferior edge of the orbit (1012) can be set. In addition, the uppermost part of the mandibular condyle (1013) and the inferiormost part of the condyle (1014) can be automatically extracted using the inflection point in the coronal view of CT data, and a second reference plane connecting the uppermost part of the mandibular condyle (1013) and the inferiormost part of the condyle (1014) can be set. At this time, the uppermost part of the mandibular condyle (1013) and the lowermost part of the condyle (1014) can also be selected through the UI.

The dental image providing device (1) can set the angle formed by the first reference plane (FH plane) and the second reference plane set in the above manner as the condylar angle (1015). Accordingly, the dental image providing device (1) can provide the movement path of the condyle during forward movement by using the condylar angle.

As an example, in the example of FIG. 11, the dental image providing device (1) can set the lateral condyle inclination angle (Bennett angle), which is the angle at which the condyle can move when the temporomandibular joint (TMJ) moves lateral. Specifically, the dental image providing device (1) can set the angle at which the condyle moves on the opposite side (non-working side) (111) to the direction of movement (working side) (110) in a third reference plane (axial plane) (113) cut parallel to the first reference plane (FH plane) (112) connecting the superior border of the external auditory meatus (1011) and the inferior border of the orbit (1012) when the temporomandibular joint (TMJ) moves left lateral or right lateral, as the lateral condyle inclination angle (Bennett angle). At this time, the dental image providing device (1) can measure the limit movement distance centered on the condyle on the opposite side (non-working side) (111) to the movement direction (working side) (110) along with the lateral condyle inclination angle (Bennett angle). Based on this, the dental image providing device (1) can provide the movement path of the condyle during lateral movement by using the lateral condyle inclination angle.

As an example, operation S31 may include an operation of setting the position and direction of the virtual camera by selecting the fourth point and the fifth point in the temporomandibular joint (TMJ) region when the mode of the virtual camera is selected as the position variable mode (or movement mode) according to user input.

For example, as illustrated in FIG. 12, the mode of the virtual camera can be selected as the position variable mode (or movement mode) according to the user input, and at this time, the position and direction of the virtual camera can be set by selecting the first point (121) and the second point (122) among the temporomandibular joint (TMJ) region (120) connecting the mandible and the skull in the 3D registration image that aligns the oral CT data and the oral scan data. At this time, the second point (122) can be additionally set while the first point (121) is first set according to the user input. Accordingly, an image captured from the position of the first point (121) toward the direction in which the second point (122) is located can be acquired, and at this time, the virtual camera can be rotated (R) along the outer edge of the temporomandibular joint (TMJ) region (120) to obtain images captured from various angles.

Next, in operation S32, the dental image providing device (1) obtains an image captured at the position of a virtual camera set in the temporomandibular joint (TMJ) area when the occlusion state of the upper and lower teeth changes from a static occlusion state to a dynamic movement state.

As an example, referring to FIG. 12, operation S32 may acquire an image by utilizing the viewpoint mismatch between virtual cameras located at a first point (121) in each of the left temporomandibular joint (TMJ) region and the right temporomandibular joint (TMJ) region.

Finally, in operation S33, the dental image providing device (1) displays the image captured in operation S32 on the screen.

As an example, the dental image providing device (1) may provide a user interface that can adjust the position of a virtual camera, a view-plane normal (VPN) vector, and a view angle.

For example, as illustrated in FIG. 13, the dental image providing device (1) provides a UI capable of changing the properties of a virtual camera so that the virtual camera can be rotated about each of the X-axis, Y-axis, and Z-axis which are orthogonal to each other, and can rotate the virtual camera in a selected direction according to a user input to the UI. At this time, the rotation methods for the X-axis, Y-axis, and Z-axis can be implemented as Pitch, Roll, and Yaw, respectively, and each rotation method can be set by dragging in the right-click state of the mouse. At this time, Pitch is a method of rotating about the X-axis (horizontal axis) so that the line of sight of the camera moves up and down, Roll is a method of rotating about the Y-axis (vertical axis) so that the line of sight of the camera changes from the front to a diagonal direction. Yaw is a method of rotating about the Z-axis (vertical axis) so that the line of sight of the camera moves left and right.

As another example, as shown in Fig. 14, the dental image providing device (1) provides a UI that can change the properties of a virtual camera so that the virtual camera can be moved up and down or left and right while fixing the Z-axis among the X-axis, Y-axis, and Z-axis that are orthogonal to each other, and the position of the virtual camera can be moved according to a user input to the UI. At this time, the X-axis and Y-axis can be moved according to the up, down, left, and right commands while fixing the Z-axis, respectively. u, It can be moved by the value v.

As another example, as shown in Fig. 15, the dental image providing device (1) provides a UI that can change the properties of the virtual camera so that the virtual camera can be moved in the positive or negative direction on the Z axis among the X-axis, Y-axis, and Z-axis that are orthogonal to each other, and the virtual camera can be moved according to the user input to the UI. At this time, the mouse scroll is used to move the virtual camera in the positive direction of the Z axis. Move n units, in the negative direction of the Z-axis. It can be moved by n amount.

As an example, the dental image providing device (1) provides a UI that can set a magnification for adjusting a perspective projection value of a virtual camera while fixing the position of the virtual camera and the X-axis, Y-axis, and Z-axis, and can set the magnification of the virtual camera to 0.5 times, 1.0 times, 1.5 times, 2.0 times, etc. according to a user input to the UI.

In addition, the dental image providing device (1) provides a UI that can rotate the captured image by modifying the second point (122) in FIG. 12, and can display the captured image by rotating it according to user input to the UI.

According to the above-described embodiment of the present invention, in dental imaging software, it is possible to provide an effect of observing the external appearance and internal structure of the temporomandibular joint (TMJ) as if captured by an endoscopic camera using a virtual camera. In addition, when the temporomandibular joint (TMJ) changes from a static occlusion state to a dynamic movement state, it is possible to visually observe the relationship between the temporomandibular joint (TMJ) and surrounding structures using an image captured by the virtual camera, thereby diagnosing whether there is a disorder of the temporomandibular joint (TMJ).

Fig. 16 is a hardware configuration diagram of a dental image providing device (1). As shown in Fig. 16, the dental image providing device (1) may include one or more processors (101), a bus (107), a network interface (102), a memory (103) that loads a computer program (105) executed by the processor (101), and a storage (104) that stores the computer program (105).

The processor (101) controls the overall operation of each component of the dental image providing device (1). The processor (101) can perform operations for at least one application or program for executing methods/operations according to various embodiments of the present invention. The memory (103) stores various data, commands, and/or information. The memory (103) can load one or more computer programs (105) from the storage (104) to execute methods/operations according to various embodiments of the present invention. The bus (107) provides a communication function between components of the dental image providing device (1). The network interface (102) supports wired and wireless Internet communication of the dental image providing device (1). The storage (104) can non-temporarily store one or more computer programs (105). The computer program (105) can include one or more instructions in which methods/operations according to various embodiments of the present invention are implemented. When a computer program (105) is loaded into the memory (103), the processor (101) can perform methods/operations according to various embodiments of the present invention by executing one or more of the instructions.

The computer program (105) may include one or more instructions implementing methods/operations according to various embodiments of the present invention. When the computer program (105) is loaded into the memory (103), the processor (101) may execute the one or more instructions to perform the methods/operations according to various embodiments of the present invention. As an example, the computer program (105) may include instructions for performing an operation of setting a position of a virtual camera in a TMJ (temporomandibular joint) area connecting the mandible and the skull in a 3D image that aligns oral CT data and oral scan data, an operation of acquiring an image captured at a position of a virtual camera set in the TMJ area when the occlusion state of the maxillary teeth and the mandibular teeth is converted from a static occlusion state to a dynamic movement state, and an operation of displaying the captured image on a screen.

Various embodiments of the present invention and effects according to the embodiments have been described with reference to FIGS. 1 to 16 so far. The effects according to the technical idea of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

The technical idea of the present invention described so far can be implemented as a computer-readable code on a computer-readable medium. The computer program recorded on the computer-readable recording medium can be transmitted to another computing device through a network such as the Internet and installed on the other computing device, thereby allowing it to be used on the other computing device.

Although the operations are depicted in the drawings in a particular order, it should not be understood that the operations must be performed in the particular order depicted or in any sequential order, or that all depicted operations must be performed to achieve a desired result. In certain situations, multitasking and parallel processing may be advantageous. Furthermore, the separation of the various components in the embodiments described above should not be understood to imply that such separation is necessary, and that the program components and systems described may generally be integrated together in a single software product or packaged into multiple software products.

Although the embodiments of the present invention have been described with reference to the attached drawings, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without changing the technical idea or essential features thereof. Therefore, it should be understood that the embodiments described above are exemplary and not restrictive in all respects. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the technical ideas defined by the present invention.

Claims (12)

In a method performed by a computing device,
A step of setting the position of a virtual camera in the temporomandibular joint (TMJ) area connecting the mandible and the skull in a 3D image that is aligned with oral CT data and oral scan data;
A step of acquiring an image captured at the position of a virtual camera set in the TMJ region when the occlusion state of the maxillary and mandibular teeth is converted from a static occlusion state to a dynamic movement state; and
including a step of displaying the above-described captured image on a screen;
The step of setting the position of the above virtual camera is:
Including a step of setting at least one of a first point corresponding to the medial pole of the mandibular head in the TMJ region, a second point corresponding to the lateral pole of the mandibular head, or a third point corresponding to the uppermost point of the mandibular head as the position of the virtual camera when the mode of the virtual camera is selected as a variable viewpoint mode;
How to provide TMJ images. delete In the first paragraph,
The step of setting the position of the above virtual camera is:
Including a step of setting the position and direction of the virtual camera by selecting the fourth point and the fifth point among the TMJ areas when the mode of the virtual camera is selected as the position variable mode;
How to provide TMJ images. In the third paragraph,
The step of setting the position of the virtual camera and the direction of the virtual camera is:
A step of receiving a user input for setting the fourth point; and
A step of additionally receiving a user input for setting the fifth point while the fourth point is set; comprising;
How to provide TMJ images. In the third paragraph,
The step of acquiring an image captured at the position of the virtual camera set in the above TMJ area is as follows.
A step of acquiring an image by utilizing the viewpoint mismatch between the virtual cameras positioned at the fourth point of the left and right TMJ region; comprising;
How to provide TMJ images. In the first paragraph,
The above dynamic motion state is,
Including a forward movement state based on the occlusion of the upper and lower teeth and anterior teeth, and a lateral movement state based on the occlusion of the left and right molars.
How to provide TMJ images. In the first paragraph,
A step of providing a UI capable of rotating the position of the virtual camera around each of the X-axis, Y-axis, and Z-axis which are mutually orthogonal; and
A step of setting the position of the virtual camera by rotating it according to a user input to the UI is further included;
How to provide TMJ images. In the first paragraph,
A step for providing a UI that can move the position of the virtual camera up and down or left and right while fixing the Z-axis among the X-axis, Y-axis, and Z-axis that are mutually orthogonal; and
Further comprising a step of moving and setting the position of the virtual camera according to user input to the UI;
How to provide TMJ images. In the first paragraph,
A step of providing a UI that can move the position of the virtual camera in a positive or negative direction along the Z axis among the X-axis, Y-axis, and Z-axis that are mutually orthogonal to each other; and
Further comprising a step of moving and setting the position of the virtual camera according to user input to the UI;
How to provide TMJ images. In the first paragraph,
A step for providing a UI capable of setting a scale for adjusting the perspective projection value of the virtual camera while fixing the X-axis, Y-axis, and Z-axis that are mutually orthogonal to the position of the virtual camera; and
further comprising a step of setting the magnification of the virtual camera according to a user input to the UI;
How to provide TMJ images. In the third paragraph,
A step for providing a UI that can rotate the captured image by modifying the position of the fifth point so that the direction of the virtual camera is changed; and
A step of rotating and displaying the captured image according to a user input for the UI is further included.
How to provide TMJ images. One or more processors;
Communication interface for communicating with external devices;
A memory that loads a computer program to be executed by the processor; and
Including storage for storing the above computer program,
The above computer program,
An action to set the position of the virtual camera in the temporomandibular joint (TMJ) area connecting the mandible and skull in a 3D image that aligns oral CT data and oral scan data.
An operation of acquiring an image captured at the position of a virtual camera set in the TMJ area when the occlusion state of the maxillary and mandibular teeth is converted from a static occlusion state to a dynamic movement state, and
Including instructions for performing an action of displaying the above-described captured image on a screen,
The action of setting the position of the above virtual camera is:
When the mode of the virtual camera is selected as a variable viewpoint mode, an operation of setting at least one of a first point corresponding to the medial pole of the mandibular head in the TMJ region, a second point corresponding to the lateral pole of the mandibular head, or a third point corresponding to the uppermost point of the mandibular head as the position of the virtual camera is included.
Dental imaging device.

Images