Disclosure of Invention
The invention provides a method, a device and equipment for generating virtual gingiva, which solve the problem that in the prior art, virtual gingiva generation only depends on the geometrical information of a gum line and ignores the dynamic deformation characteristic of real gingiva, and realize that the generated virtual gingiva can dynamically adapt to tooth movement and maintain biomechanical rationality.
The invention provides a method for generating virtual gingiva, which comprises the following steps:
Acquiring a scanning model of teeth, and dividing a tooth model and a gum model based on the scanning model, wherein the gum model covers gaps of adjacent teeth and forms corresponding holes for each tooth model;
The method comprises the steps of obtaining the layer number of points affected by each tooth, wherein the points affected by the teeth are grid points affected by tooth movement on a gum model, and the layer number of the points affected by the teeth represents the maximum topological layer depth affected by outward radiation from the edge of a corresponding hole of the tooth model;
And carrying out layered movement calculation on points on the gum model according to the layer number of the points affected by each tooth, and generating a virtual gum model.
The method for generating the virtual gingiva comprises the steps of marking a tooth part and a gingiva part in a scanning model, determining a marking result, extracting the tooth model according to the marking result, shrinking the marked tooth part by a preset distance, and extracting the gingiva model according to the marking result.
The method for generating the virtual gingiva comprises the steps of carrying out layered movement calculation on points on a gingiva model according to the number of layers of the points affected by each tooth, and generating a virtual gingiva model, wherein the method specifically comprises the steps of determining each point movement vector of points of each tooth in the range of the number of layers of all the affected points on the gingiva model according to the current number of layers; and moving the points of each layer to the new positions to generate a virtual gum model.
According to one method of generating virtual gingiva provided by the present invention, if the points affected by the current tooth on the gingival model include points on the remaining tooth holes, the motion vector of the points on the remaining tooth holes relative to the current tooth is zero.
The method for generating the virtual gingiva comprises the steps of obtaining a space transformation matrix of a tooth model, determining a movement coefficient according to the current layer number and the total layer number of points affected by teeth, and determining the movement vector of each point of the current layer according to the movement coefficient and the space transformation matrix.
The method for generating the virtual gingiva comprises the steps of determining a motion vector of each point of a current layer according to the motion coefficient and the space transformation matrix, and determining an initial vector according to the space transformation matrix and the original position of each point of the current layer, and determining the motion vector of each point of the current layer according to the initial vector and the motion coefficient.
The method for generating the virtual gingiva comprises the steps of obtaining the original position of a point affected by teeth, obtaining the modular length of a plurality of movement vectors generated by the influence of different teeth on the same point, summing to obtain the total modular length of the movement vectors, correcting each movement vector of the point affected by the teeth according to the total modular length of the movement vectors, adding all corrected movement vectors to obtain a final movement vector, and determining the new position of the point according to the original position and the final movement vector.
The invention also provides a device for generating the virtual gingiva, which comprises the following modules:
the device comprises a segmentation module, a tooth model, a gum model and a tooth model, wherein the segmentation module is used for acquiring a scanning model of teeth and segmenting the tooth model and the gum model based on the scanning model;
The virtual gum generating module is used for acquiring the layer number of points affected by each tooth, wherein the points affected by the teeth are grid points affected by tooth movement on a gum model, the layer number of the points affected by the teeth represents the maximum topological layer depth affected by outward radiation from the edge of a corresponding hole of the tooth model, and the points on the gum model are subjected to layered movement calculation according to the layer number of the points affected by each tooth to generate a virtual gum model.
The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing a method of generating virtual gums as any one of the above when executing the computer program.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method of generating virtual gums as any of the above.
The invention also provides a computer program product comprising a computer program which when executed by a processor implements a method of generating virtual gums as defined in any of the above.
The method, the device and the equipment for generating the virtual gingiva have the advantages that an anatomical structure foundation comprising a tooth model and a gingiva model with holes is obtained through accurate segmentation, and more importantly, a hierarchical deformation system radiating outwards from the edge of the holes of the teeth is established through the technical feature of defining the layer number of points affected by the teeth. The hierarchical movement calculation method enables the gingival deformation to have gradient attenuation characteristics, namely the displacement of grid points close to teeth is larger, the influence is gradually weakened along with the outer movement of a topological layer, and the gingival deformation is in high agreement with the physical rule of stress conduction when the real gingival tissue is pulled by the teeth. The virtual gum model generated by the method not only automatically covers the tooth gap, but also can dynamically reflect progressive influence of tooth movement on peripheral gum tissues, and solves the technical defects that gum deformation machinery is single and is inconsistent with clinical practice in the prior art.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The following is a description of terms involved in the present invention.
The model, i.e., the three-dimensional model, is a polygonal-sided representation of the object, typically displayed by a computer or other video device. The displayed object may be a real world entity or an imaginary object. Anything that exists in physical nature can be represented by a three-dimensional model. The model in the method refers to a three-dimensional model consisting of a plurality of triangular faces, and the model consisting of other polygonal faces can be converted into the form of the triangular faces and then the method is applied.
Triangular patches-a single triangular face that makes up the model.
The mesh is defined by a polygon set, the topology and the space structure used for representing the surface outline of the three-dimensional model are called as a mesh, and English is called as a poly mesh or a mesh. The mesh in the present method is made up of a collection of triangles.
Virtual gingiva a virtual gingival model is generated for a maxillary or mandibular tooth model, which should change as some of the tooth models move or rotate.
Gingival sulcus, the shallow groove formed between the gingival margin and the neck of a tooth.
Gum line, the edge line where the teeth meet the gums. The tooth model is generally divided from the tooth scan model, and the division is performed along the edge line of the intersection of the tooth and the gum, so that the edge line of the bottom fracture of the tooth model is the gum line.
In orthodontic treatment, a patient changes a set of braces each time the patient's teeth reach the current target location of the braces for subsequent correction. Along with the continuous correction of teeth, the gum shape is changed, so the change of the gum is considered when the tooth socket is generated, the tooth socket does not press the gum as much as possible, and the pain of patients during wearing is reduced. However, the hospital design dental braces are designed according to the virtual gums, and the virtual gums can be generated only according to the planned target tooth positions, so that it is very important how to generate the virtual gums more in line with the actual situation.
In the prior art, when generating virtual gingiva, according to the gum line of each tooth, several control points are respectively generated at the lingual side, the buccal side and the crevices of adjacent teeth, the control points are sequentially connected to generate the gum line which surrounds the whole maxillary or mandibular model, and triangular patches of the top, the side wall and the base are respectively generated according to a plurality of formulas based on the gum line, and are combined into the whole virtual gingiva model.
The prior art only refers to the gum line of teeth, but does not refer to the initial forms of gums and gingival sulcus, the virtual gums finally generated are far away from the real gums, and the tooth socket designed based on the virtual gums is likely to press the gums, so that the patient is uncomfortable to wear.
In view of the above drawbacks, the present invention provides a method for generating a virtual gum, which is capable of generating a virtual gum more conforming to a real gum morphology.
Embodiments of the present invention are described in detail below in conjunction with fig. 1-5.
Fig. 1 is a flowchart of a method for generating virtual gingiva according to the present invention, as shown in fig. 1, the method includes the following steps:
s110, acquiring a scanning model of the teeth, and dividing the tooth model and the gum model based on the scanning model. Wherein, gum model covers the gap of adjacent tooth to form corresponding hole for each tooth model.
The method for generating the virtual gingiva comprises the steps of marking a tooth part and a gingiva part in a scanning model, determining a marking result, extracting the tooth model according to the marking result, shrinking the marked tooth part by a preset distance, and extracting the gingiva model according to the marking result.
In particular, any algorithm or artificial intelligence technique may be employed to identify and mark tooth portions and gum portions from the maxillary or mandibular scan model. For example, fig. 2 is a schematic view of a three-dimensional model of teeth and gums, and fig. 3 is a schematic view of a three-dimensional model of gums divided.
Firstly, extracting independent tooth models based on marking results, then, shrinking marked tooth parts inwards by a preset distance along the normal direction, reducing the tooth area boundary through the geometric transformation operation, simultaneously expanding the gum area range correspondingly, and finally, re-extracting gum models based on the adjusted boundary. The processing mode has the technical advantages that the generated gum model can completely cover the physiological gaps between adjacent teeth by accurately controlling the inward contraction amount, and form an independent hole structure matched with the shape for each tooth, so that an accurate topology basis is provided for gum deformation simulation in the subsequent tooth moving process. Thus, not only the anatomical fit of the teeth and gums is maintained, but also a reliable initial geometry is established for dynamically simulating the elastic deformation of the gum tissue.
S120, obtaining the number of layers of the points affected by each tooth, and performing layered movement calculation on the points on the gum model according to the number of layers of the points affected by each tooth to generate a virtual gum model.
Wherein the points affected by teeth are grid points affected by tooth movement on the gingival model, and the number of layers of the points affected by teeth represents the maximum topological level depth affected by outward radiation from the edge of the corresponding hole of the tooth model.
Carrying out layered movement calculation on points on a gum model according to the number of layers of the points affected by each tooth to generate a virtual gum model, wherein the method specifically comprises the steps of determining a movement vector of each point of each tooth in the range of the number of layers of all the affected points on the gum model according to the current number of layers of each tooth; and moving the points of each layer to the new positions to generate a virtual gum model.
The method comprises the steps of carrying out hierarchical movement calculation on points on a gum model according to the number of layers of the points, and generating a virtual gum model, wherein all the points on the gum model are initially marked as 0, holes closest to the original center point of the points are found on each tooth model and serve as corresponding holes, the points on the holes are marked as 1, traversing each tooth model, taking the points on the gum on the holes corresponding to the tooth model as the points of the current layer, determining the movement vector of each point on the current layer according to the current layer, traversing the points on each layer according to the number of layers of the points, determining the movement vector of each point on the gum model, determining the new position of the points according to the movement vector of the points on each layer, and carrying out smoothing processing after the points on each layer are moved to the new position, so as to generate the virtual gum model.
According to one method of generating virtual gingiva provided by the present invention, if the points affected by the current tooth on the gingival model include points on the remaining tooth holes, the motion vector of the points on the remaining tooth holes relative to the current tooth is zero. Thus, holes are avoided around the teeth on the three-dimensional model.
Specifically, after the tooth space position is changed, a new virtual gum model matched with the tooth space position is generated. The specific implementation steps are as follows:
1) Initializing a gingival model topology marker.
All grid points on the gum model are initially marked 0, for each tooth model, the hole closest to the original center point of the tooth is located on the gum model, and the grid point on the hole is marked 1. The marking mechanism ensures that each aperture grid point only follows the corresponding tooth movement, unaffected by other tooth transformations. By establishing an accurate tooth-gum corresponding relation, a foundation is laid for subsequent layered deformation calculation.
2) And performing hierarchical displacement calculation.
The method for generating the virtual gingiva comprises the steps of obtaining a space transformation matrix of a tooth model, determining a movement coefficient according to the current layer number and the total layer number of points affected by teeth, and determining the movement vector of each point of the current layer according to the movement coefficient and the space transformation matrix.
The method for generating the virtual gingiva comprises the steps of determining an initial vector according to the space transformation matrix and the original position of each point of the current layer, and determining the motion vector of each point of the current layer according to the initial vector and the motion coefficient.
Specifically, for each tooth, starting from its corresponding aperture grid point (layer 0), the layer-by-layer calculation is performed according to the following rule:
a) Traversing each tooth model, taking the point on the gum of the corresponding hole of each tooth model as a current layer grid point set, and calculating a movement coefficient f= (L-Lv)/L according to the current layer number Lv, namely, the larger the current layer number is, the smaller the coefficient is, wherein L is the total layer number of points affected by teeth (one layer is calculated by one circle of connected holes, the empirical value is 20), lv is the current layer number, and f is the movement coefficient;
b) Calculating a motion vector v= (T-Pt) f for each grid point Pt of the current layer according to a tooth space transformation matrix T, wherein Pt is the original coordinates of the grid point, T is the tooth space transformation matrix, f is a motion coefficient, and v is the motion vector;
c) The mesh points adjacent to the current layer mesh points are acquired on the gum model, the mesh points which are not traversed by the current teeth and marked with 0 are used as the next layer mesh points, and the current layer number Lv is increased.
And repeating the process to calculate and record the motion vector of each point of the current layer. This process is repeated until the current number of layers reaches L-1, i.e., each tooth traverses L layers in total.
The elastic deformation characteristics of gum tissues are simulated through a hierarchical attenuation mechanism, so that the deformation of the area close to teeth is remarkable, the deformation of the area far away from the teeth is gradually weakened, and the biomechanical law is met.
3) The synergistic effect of multiple teeth is treated.
The method for generating the virtual gingiva comprises the steps of obtaining the original position of a point affected by teeth, obtaining the modular length of a plurality of movement vectors generated by the influence of different teeth on the same point, summing to obtain the total modular length of the movement vectors, correcting each movement vector of the point affected by the teeth according to the total modular length of the movement vectors, adding all corrected movement vectors to obtain a final movement vector, and determining the new position of the point according to the original position and the final movement vector.
Specifically, since the point between two teeth on the gum may be affected by multiple teeth, the direct superposition of multiple motion vectors with similar motion directions may cause the amplification of the motion amount, which does not conform to the actual effect, so an algorithm approximating the mean value should be used to calculate the final motion vector, and this algorithm is also applicable to the calculation of motion vectors with approximately opposite motion directions.
After calculating the grid point affected by each tooth, a weighted fusion algorithm is adopted for the grid points affected by a plurality of teeth simultaneously:
a) Calculating the module length D and the total module length totalD of each motion vector;
b) Correcting each motion vector of the grid point, v=v×d/totalD;
c) All corrected motion vectors for that grid point are added to get the final motion vector totalV and the new grid point position newPt =pt+ totalV is calculated.
The algorithm has the advantages that deformation distortion caused by excessive superposition of displacement can be avoided, the offset effect of displacement in the opposite direction can be correctly processed, and the physical rationality of gum deformation is ensured.
4) And (5) performing model fairing treatment.
After all affected points are moved to new positions, a fairing algorithm is performed on all shifted grid points to eliminate grid distortion caused by grid point movement. The method remarkably improves the surface quality of the generated gum model, so that the gum model not only meets the anatomical accuracy, but also has good geometric smoothness, and a reliable biomechanical reference model is provided for the subsequent dental mouthpiece design.
The virtual gum model generated by the invention is more close to clinical practice in geometric form and biomechanical characteristics through accurate space matrix transformation and layered deformation calculation from the real gum model. The method not only inherits the morphological characteristics of the real gingiva, but also realizes the dynamic deformation prediction through physical simulation, so that the generated virtual gingiva model can keep the geometrical shape and mechanical characteristics which are highly consistent with those of the real gingiva at each stage before and after tooth movement, and provides reliable soft tissue change prediction for accurate orthodontic treatment.
The apparatus for generating virtual gingiva according to the present invention will be described below, and the apparatus for generating virtual gingiva described below and the method for generating virtual gingiva described above may be referred to correspondingly to each other.
Fig. 4 shows an apparatus for generating a virtual gum according to the present invention, including:
The segmentation module 410 is used for obtaining a scanning model of teeth, and segmenting a tooth model and a gum model based on the scanning model, wherein the gum model covers gaps of adjacent teeth and forms corresponding holes for each tooth model;
The virtual gum generating module 420 is configured to obtain the number of layers of each of the points affected by the teeth, where the points affected by the teeth are grid points affected by the movement of the teeth on the gum model, the number of layers of the points affected by the teeth represents the maximum topology level depth affected by the external radiation from the edge of the hole corresponding to the tooth model, and perform hierarchical movement calculation on the points on the gum model according to the number of layers of the points affected by each of the teeth, so as to generate a virtual gum model.
Fig. 5 illustrates a physical schematic diagram of an electronic device, which may include a processor (processor) 510, a communication interface (Communications Interface) 520, a memory (memory) 530, and a communication bus 540, where the processor 510, the communication interface 520, and the memory 530 perform communication with each other through the communication bus 540, as shown in fig. 5. The processor 510 may invoke logic instructions in the memory 530 to perform a method of generating virtual gums, the method comprising obtaining a scan model of teeth, segmenting a tooth model and a gum model based on the scan model, wherein the gum model covers gaps of adjacent teeth and forms corresponding holes for each tooth model, obtaining a number of layers of points affected by each tooth, wherein the points affected by teeth are grid points affected by tooth movement on the gum model, the number of layers of points affected by teeth represents a maximum topological level depth of outward radiation influence from edges of the corresponding holes of the tooth model, and performing hierarchical movement calculation on the points on the gum model according to the number of layers of points affected by each tooth to generate the virtual gum model.
Further, the logic instructions in the memory 530 described above may be implemented in the form of software functional units and may be stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method of the embodiments of the present invention. The storage medium includes a U disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, an optical disk, or other various media capable of storing program codes.
In another aspect, the invention also provides a computer program product, which comprises a computer program, wherein the computer program can be stored on a non-transitory computer readable storage medium, and when the computer program is executed by a processor, the computer can execute the method for generating virtual gingiva provided by the methods, and the method comprises the steps of acquiring a scanning model of teeth, dividing a tooth model and a gingiva model based on the scanning model, wherein the gingiva model covers gaps of adjacent teeth, and forms corresponding holes for each tooth model, acquiring the layer number of points affected by each tooth, wherein the points affected by teeth are grid points affected by tooth movement on the gingiva model, the layer number of the points affected by teeth represents the maximum topological layer depth of outward radiation influence from the edges of the corresponding holes of the tooth model, and performing layered movement calculation on the points on the gingiva model according to the layer number of the points affected by each tooth, so as to generate the virtual gingiva model.
In yet another aspect, the present invention further provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of generating virtual gums provided by the above methods, the method comprising obtaining a scan model of teeth, dividing a tooth model and a gum model based on the scan model, wherein the gum model covers gaps of adjacent teeth and forms corresponding holes for each tooth model, obtaining a number of layers of points affected by each tooth, wherein the points affected by tooth movement are grid points on the gum model, the number of layers of points affected by tooth represents a maximum topological level depth of outward radiation effects from edges of corresponding holes of the tooth model, and performing hierarchical movement calculation on the points on the gum model according to the number of layers of points affected by each tooth, thereby generating a virtual gum model.
The apparatus embodiments described above are merely illustrative, wherein elements illustrated as separate elements may or may not be physically separate, and elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on such understanding, the foregoing technical solutions may be embodied essentially or in part in the form of a software product, which may be stored in a computer-readable storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the various embodiments or methods of some parts of the embodiments.
It should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present invention, and not for limiting the same, and although the present invention has been described in detail with reference to the above-mentioned embodiments, it should be understood by those skilled in the art that the technical solution described in the above-mentioned embodiments may be modified or some technical features may be equivalently replaced, and these modifications or substitutions do not make the essence of the corresponding technical solution deviate from the spirit and scope of the technical solution of the embodiments of the present invention.