CN111938655B - Orbit soft tissue form evaluation method, system and equipment based on key point information - Google Patents
Orbit soft tissue form evaluation method, system and equipment based on key point information Download PDFInfo
- Publication number
- CN111938655B CN111938655B CN202010655993.1A CN202010655993A CN111938655B CN 111938655 B CN111938655 B CN 111938655B CN 202010655993 A CN202010655993 A CN 202010655993A CN 111938655 B CN111938655 B CN 111938655B
- Authority
- CN
- China
- Prior art keywords
- feature points
- soft tissue
- model
- dimensional face
- face data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 210000004872 soft tissue Anatomy 0.000 title claims abstract description 44
- 238000011156 evaluation Methods 0.000 title claims abstract description 27
- 238000006073 displacement reaction Methods 0.000 claims abstract description 21
- 239000011159 matrix material Substances 0.000 claims abstract description 21
- 238000011084 recovery Methods 0.000 claims abstract description 15
- 238000012417 linear regression Methods 0.000 claims abstract description 12
- 230000001419 dependent effect Effects 0.000 claims abstract description 9
- 238000010606 normalization Methods 0.000 claims abstract description 5
- 210000001508 eye Anatomy 0.000 claims description 48
- 210000004279 orbit Anatomy 0.000 claims description 38
- 230000015654 memory Effects 0.000 claims description 24
- 230000002980 postoperative effect Effects 0.000 claims description 13
- 238000012549 training Methods 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 3
- 238000007781 pre-processing Methods 0.000 claims description 3
- 238000001356 surgical procedure Methods 0.000 abstract description 3
- 238000000034 method Methods 0.000 description 25
- 238000004590 computer program Methods 0.000 description 9
- 238000003745 diagnosis Methods 0.000 description 8
- 201000010099 disease Diseases 0.000 description 8
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 8
- 230000008961 swelling Effects 0.000 description 6
- 208000007825 Orbital Fractures Diseases 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 206010016042 Facial bones fracture Diseases 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000001815 facial effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 208000018087 Orbital disease Diseases 0.000 description 2
- 210000005252 bulbus oculi Anatomy 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000011158 quantitative evaluation Methods 0.000 description 2
- 230000008733 trauma Effects 0.000 description 2
- 201000004569 Blindness Diseases 0.000 description 1
- 206010011039 Corneal perforation Diseases 0.000 description 1
- 208000003164 Diplopia Diseases 0.000 description 1
- 208000012661 Dyskinesia Diseases 0.000 description 1
- 206010061218 Inflammation Diseases 0.000 description 1
- 206010028980 Neoplasm Diseases 0.000 description 1
- 208000030768 Optic nerve injury Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 208000029444 double vision Diseases 0.000 description 1
- 208000001936 exophthalmos Diseases 0.000 description 1
- 208000030533 eye disease Diseases 0.000 description 1
- 210000000744 eyelid Anatomy 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000004054 inflammatory process Effects 0.000 description 1
- 230000002427 irreversible effect Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000000877 morphologic effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 210000001685 thyroid gland Anatomy 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 208000019553 vascular disease Diseases 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000009978 visual deterioration Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 230000004382 visual function Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
- A61B5/1077—Measuring of profiles
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
- A61B5/1075—Measuring physical dimensions, e.g. size of the entire body or parts thereof for measuring dimensions by non-invasive methods, e.g. for determining thickness of tissue layer
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4848—Monitoring or testing the effects of treatment, e.g. of medication
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Public Health (AREA)
- Physics & Mathematics (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Eye Examination Apparatus (AREA)
Abstract
本发明提供了一种基于关键点信息的眼眶软组织形态评价方法、系统及设备，使用LSFM模型对三维人脸数据进行注册，并以标准可动模型所处的坐标空间为基础对三维人脸数据做校准和归一化；记录左右眼区域特征点索引和特征点数量，并提取左右眼区域特征点；采用线性回归模型判断从三维人脸数据手术前后对应的左、右眼特征点区域，得到平均位移矩阵和对应区域是否进行手术，再得到线性回归的自变量和因变量，计算出方向对结果影响的权值；计算手术眼区域与标准可动模型的平均位移矩阵和非手术眼区域与标准可动模型的平均位移矩阵，设定阈值判断术后眼眶软组织恢复情况。本发明准确率达到90％。
The present invention provides an orbital soft tissue morphology evaluation method, system and equipment based on key point information. The LSFM model is used to register the three-dimensional face data, and the three-dimensional face data is based on the coordinate space where the standard movable model is located. Do calibration and normalization; record the feature point index and number of feature points in the left and right eye regions, and extract the feature points in the left and right eye regions; use a linear regression model to determine the corresponding left and right eye feature point regions from the three-dimensional face data before and after surgery, and obtain The average displacement matrix and whether the corresponding area is operated, then the independent and dependent variables of the linear regression are obtained, and the weight of the influence of the direction on the result is calculated; the average displacement matrix of the surgical eye area and the standard movable model and the non-surgical eye area are calculated. The average displacement matrix of the standard movable model, and the threshold is set to judge the recovery of orbital soft tissue after surgery. The accuracy rate of the present invention reaches 90%.
Description
Technical Field
The invention relates to the field of three-dimensional image processing, in particular to an orbit soft tissue morphology evaluation method, system and device based on key point three-dimensional information.
Background
Diagnosis of orbit diseases, decision of treatment schemes, evaluation of curative effect and the like mainly depend on CT and MRI data of patients at present. In recent years, with the increasing aesthetic needs, medical decision making and patient-ported output based on subjective feelings of patients are more and more emphasized. Therefore, on the basis of the pre-determination of imaging science, the determination based on the facial measurement is gradually becoming a new factor for the diagnosis and treatment decision of the orbital disease of the image. Orbital diseases comprise vascular diseases, tumor diseases, trauma, inflammation and the like, and many diseases such as thyroid associated eye disease (TAO), orbital fracture and the like can have multiple, rapid and transient clinical manifestation changes in different periods of the disease process, particularly the changes in soft tissue morphology. Although the changes can be captured by means of imaging examination, the cost of CT examination is the radiation of rays, and the limiting factors of MRI are cost and examination time, so that the two types of examination are only used in diagnosis decision and important follow-up nodes, are not items which can be repeatedly detected for many times, at any time and repeatedly, cannot provide reliable data for rapidly changing physical signs of patients, and limit the promotion space of an orbit doctor in the aspects of cognition and intervention in the aspects of early prompt of high-risk changes of the patients, rapid response, rehabilitation guidance and the like.
Orbital fracture is a kind of orbit disease with large specific gravity, and is mostly caused by trauma, resulting in deformity of the middle of face, dyskinesia of eyeball, double vision, visual deterioration and even blindness. TAO causes clinical symptoms such as exophthalmos, eyelid recession, and dysoculomosia, and irreversible damage such as corneal perforation and optic nerve injury occurs in severe patients, and the quality of life is seriously reduced. In addition to considerations of bony structure and visual function, changes in appearance are also increasingly important factors in surgical decision making, whether orbital fractures or TAOs. The perceivable orbital facial morphology change, the orbital swelling degree, the regression of the orbital soft tissue swelling, etc. are all patient-related outchomes or complaints which are of considerable importance in the aspects of patient treatment purpose and self-evaluation of the treatment effect, etc. However, as previously mentioned, we have no better index than subjective "presence or absence of judgment" other than CT and MRI and indices such as the degree of eyeball protrusion based on or not based on these imaging examinations. In the case of orbital fracture patients, patients who are eligible for surgical indications often have or do not have all or some of the following characteristics over the course of the disease: the change of the orbital facial morphology can be detected before the affected side operation, the soft tissue of the orbit is swollen immediately after the operation, and the short-term or long-term swelling is subsided after the operation. The evaluation of the content in the past only depends on the subjective feelings of the doctor and the patient, and the quantitative evaluation with repeatability cannot be carried out, so that the evaluation cannot be used as a reliable observation index, and the participation degree of the visual angle of the patient in the disease diagnosis and treatment process is also seriously reduced.
At present, no explanation or report of the similar technology of the invention is found, and similar data at home and abroad are not collected.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides an orbit soft tissue form evaluation method, system and equipment based on key point three-dimensional information.
The invention is realized by the following technical scheme.
According to one aspect of the invention, a method for evaluating the morphology of soft tissues in an orbit based on key point information is provided, which comprises the following steps:
registering the three-dimensional face data by using an LSFM model, and calibrating and normalizing the registered three-dimensional face data on the basis of a coordinate space where a standard movable model is located;
recording indexes of feature points of left and right eye regions and the number n of the feature points, and extracting the feature points of the left and right eye regions from the three-dimensional face data as key points;
judging whether the operation area is positioned on the left eye or the right eye by adopting a linear regression model, wherein the operation area comprises a left eye characteristic point area P and a right eye characteristic point area P which correspond to the ith three-dimensional face data before and after the operationi_before,Pi_afterTo obtain the ith average displacement matrix PiAnd whether the corresponding area is operated YiThen obtaining independent variable P and dependent variable Y of linear regression, and calculating weight W of the influence of x, Y and z directions on the result;
calculating the average displacement matrix P of the operation eye area and the standard movable modeloperationAnd the average displacement matrix P of the non-operative ocular region and the standard mobile modelnaturalAnd setting a threshold value thread to judge the postoperative recovery condition of the soft tissues of the eye socket.
Preferably, the registration adopts a non-rigid iterative closest point algorithm to correspond the points in the three-dimensional face data to the LSFM standard movable model.
Preferably, the calibration and normalization refers to unifying the spatial position and the data size of the three-dimensional face data.
Preferably, the feature point index is to select feature points in accordance with the left and right eye surgery areas from texture data of the standard movable model and record numbers of the feature points.
Preferably, the number n of feature points includes 2572 feature points of the left-eye region and/or 2591 feature points of the right-eye region.
Preferably, the average displacement matrix Pi＝∑(Pi_after-Pi_before)/n。
Preferably, the surgical condition of said corresponding region
Preferably, the independent variable
Wherein m is the number of training set samples.
Preferably, said dependent variable
Wherein m is the number of training set samples.
Preferably, the weight W ═ P (P)T·P)-1·PT·Y。
Preferably, the threshold thread is 0.006.
Preferably, the judging of the postoperative soft tissue recovery condition of the orbit is as follows:
when P is presentoperation-thread<Pnatural<PoperationWhen the current value is + thread, the recovery is judged to be good, otherwise, the recovery is judged not to be recovered.
According to another aspect of the present invention, there is provided an orbit soft tissue morphology evaluation system based on three-dimensional information of key points, comprising:
a preprocessing module: registering the three-dimensional face data by using an LSFM model, and calibrating and normalizing the registered three-dimensional face data on the basis of a coordinate space where a standard movable model is located;
a feature extraction module: recording indexes of feature points of left and right eye regions and the number n of the feature points, and extracting the feature points of the left and right eye regions from the three-dimensional face data;
an operation area judgment module: judging whether the operation area is positioned on the left eye or the right eye by adopting a linear regression model, wherein the operation area comprises a left eye characteristic point area P and a right eye characteristic point area P which correspond to the ith three-dimensional face data before and after the operationi_before,Pi_afterObtaining the ith average displacement matrix PiAnd whether the corresponding area is operated YiThen obtaining independent variable P and dependent variable Y of linear regression, and calculating weight W of the influence of x, Y and z directions on the result;
postoperative resumes judging module: calculating the average displacement matrix P of the operation eye area and the standard movable modeloperationAnd the average displacement matrix P of the non-operative ocular region and the standard mobile modelnaturalAnd setting a threshold value thread to judge the postoperative recovery condition of the soft tissues of the eye socket.
According to a third aspect of the present invention, there is provided an apparatus comprising a memory, a processor and a computer program stored on the memory and operable on the processor, the processor being operable when executing the computer program to perform any of the methods described above.
According to a fourth aspect of the present invention, there is provided another apparatus comprising a memory, a processor, and the system provided above stored on the memory and executable by the processor.
Compared with the prior art, the invention has at least one of the following beneficial effects:
according to the orbit soft tissue morphology evaluation method and system based on the key point three-dimensional information, provided by the invention, because the method and the system are based on image discrimination with the traditional image, direct intervention is not involved, and the risk is not increased. Besides meeting the basic principle requirement of replacing the endpoint in the aspect of clinical test, the method and the system have the advantages of convenience in index acquisition, repeatability in the measurement process and quantification in the evaluation mode.
According to the method and the system for evaluating the form of the soft tissues of the eye socket based on the three-dimensional information of the key points, provided by the invention, the medical diagnosis part is automated and repeatable, and the accuracy rate reaches 90%, according to the characteristic that the shape of the model is not changed and only the topological structure is changed in the registration process of the three-dimensional model of the face.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
fig. 1 is a schematic diagram illustrating results of registering, calibrating and normalizing three-dimensional face data in the method for evaluating the form of soft tissues of an orbit based on three-dimensional information of key points according to the embodiment of the present invention; wherein: (a) the model is an original model, (b) is a registered model, and (c) is a calibrated and normalized model;
fig. 2 is a schematic diagram of left and right eye regions extracted in the orbit soft tissue morphology evaluation method based on the three-dimensional information of the key points according to the embodiment of the invention; wherein: fig. a is a left eye region model, and fig. b is a right eye region model;
fig. 3 is a flowchart of an orbit soft tissue morphology evaluation method based on three-dimensional key point information according to an embodiment of the present invention.
Detailed Description
The following examples illustrate the invention in detail: the embodiment is implemented on the premise of the technical scheme of the invention, and a detailed implementation mode and a specific operation process are given. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.
An embodiment of the invention provides an orbit soft tissue morphology evaluation method based on key point information, the method can be used for automatically judging the orbit soft tissue swelling condition of a postoperative patient, and the method and the system can be used for automatically judging the orbit soft tissue swelling condition of the postoperative patient. As shown in fig. 3, the method includes:
the method comprises the steps of firstly, registering three-dimensional face data by using an LSFM model, and calibrating and normalizing the registered three-dimensional face data on the basis of a coordinate space where a standard movable model is located.
As a preferred embodiment, the registration adopts a non-rigid iterative closest point algorithm to correspond the points in the three-dimensional face data to the LSFM standard movable model.
As a preferred embodiment, the calibration and normalization refers to unifying the spatial position and the data size of the three-dimensional face data.
The specific registration, calibration and normalization results in the first step are shown in fig. 1.
And secondly, recording indexes of the feature points of the left eye region and the right eye region and the number n of the feature points, and extracting the feature points (namely key points) of the left eye region and the right eye region from the three-dimensional face data.
As a preferred embodiment, the feature point index is to select feature points in the texture data of the standard movable model, which are in accordance with the surgical area of the left and right eyes, and record the numbers of the feature points.
As a preferred embodiment, the number of feature points includes 2572 feature points for the left eye region and 2591 feature points for the right eye region.
Thirdly, judging whether the operation area is positioned on the left eye or the right eye by adopting a linear regression model, wherein the operation area comprises a left eye characteristic point area P and a right eye characteristic point area P which correspond to the ith three-dimensional face data before and after the operationi_before,Pi_afterTo obtain the ith average displacement matrix PiAnd whether the corresponding area is operated YiAnd then obtaining an independent variable P and a dependent variable Y of the linear regression, and calculating a weight W of the influence of the directions x, Y and z on the result.
As a preferred embodiment, the average displacement matrix Pi＝∑(Pi_after-Pi_before)/n。
As a preferred embodiment, the surgical condition of the corresponding region
As a preferred embodiment, the independent variable
Wherein m is the number of training set samples.
As a preferred embodiment, dependent variables
Wherein m is the number of training set samples.
As a preferred embodiment, the weight W ═ P (P)T·P)-1·PT·Y。
In the third step, W ═ 47.85693945, 2.64343121, 79.23895416, -0.37536196, four values correspond to the weight of the model x coordinate on the result, the weight of the y coordinate on the result, the weight of the z coordinate on the result, and the error term, respectively.
Fourthly, calculating an average displacement matrix P of the operation eye area and the standard movable modeloperationAnd the average displacement matrix P of the non-operative ocular region and the standard mobile modelnaturalAnd setting a threshold value thread to judge the postoperative recovery condition of the soft tissues of the eye socket.
As a preferred embodiment, the threshold thread is 0.006;
as a preferred embodiment, the postoperative soft tissue recovery condition of the orbit is judged as follows:
when P is presentoperation-thread<Pnatural<PoperationWhen the current value is + thread, the recovery is judged to be good, otherwise, the recovery is judged not to be recovered.
In the fourth step Poperation＝0.01588，PnaturalWhen the determination result is not restored at 0.00865, the result is consistent with the actual situation, as shown in fig. 1 and 2.
Effects of the implementation
According to the above steps, three-dimensional face models of 65 patients were diagnosed, of which 59 achieved correct diagnosis.
Another embodiment of the present invention provides an orbit soft tissue morphology evaluation system based on keypoint information, including:
a preprocessing module: registering the three-dimensional face data by using an LSFM model, and calibrating and normalizing the registered three-dimensional face data on the basis of a coordinate space where a standard movable model is located;
a feature extraction module: recording indexes of feature points of left and right eye regions and the number n of the feature points, and extracting the feature points of the left and right eye regions from the three-dimensional face data;
an operation area judgment module: judging whether the operation area is positioned on the left eye or the right eye by adopting a linear regression model, wherein the operation area comprises a left eye characteristic point area P and a right eye characteristic point area P which correspond to the ith three-dimensional face data before and after the operationi_before,Pi_afterObtaining the ith average displacement matrix PiAnd whether the corresponding area is operated YiThen obtaining independent variable P and dependent variable Y of linear regression, and calculating weight W of the influence of x, Y and z directions on the result;
postoperative resumes judging module: calculating the average displacement matrix P of the operation eye area and the standard movable modeloperationAnd the average displacement matrix P of the non-operative ocular region and the standard mobile modelnaturalAnd setting a threshold value thread to judge the postoperative recovery condition of the soft tissues of the eye socket.
A third embodiment of the present invention provides an apparatus, which includes a memory, a processor, and a computer program stored in the memory and capable of being executed on the processor, wherein the processor, when executing the computer program, can be configured to perform a method for morphological evaluation of soft tissues of an orbit based on keypoint information.
Optionally, a memory for storing a program; a Memory, which may include a volatile Memory (RAM), such as a Random Access Memory (SRAM), a Double Data Rate Synchronous Dynamic Random Access Memory (DDR SDRAM), and the like; the memory may also comprise a non-volatile memory, such as a flash memory. The memory 62 is used to store computer programs (e.g., applications, functional modules, etc. that implement the above-described methods), computer instructions, etc., which may be stored in one or more memories in a partitioned manner. And the computer programs, computer instructions, data, etc. described above may be invoked by a processor.
The computer programs, computer instructions, etc. described above may be stored in one or more memories in a partitioned manner. And the computer programs, computer instructions, data, etc. described above may be invoked by a processor.
A processor for executing the computer program stored in the memory to implement the steps of the method according to the above embodiments. Reference may be made in particular to the description relating to the preceding method embodiment.
The processor and the memory may be separate structures or may be an integrated structure integrated together. When the processor and the memory are separate structures, the memory, the processor may be coupled by a bus.
A fourth embodiment of the invention provides another apparatus comprising a memory, a processor, and a keypoint information-based orbital soft tissue morphology evaluation system stored on the memory and executable by the processor.
The same or similar memory and processor as described above may be used in this embodiment and will not be described here.
The orbit soft tissue morphology evaluation method, system and device based on the key point information (three-dimensional information) provided by the embodiment of the invention are a new orbit soft tissue morphology evaluation technology which is rapid, quantitative and good in repeatability, and the orbit soft tissue quantitative evaluation based on the SKO provides rapid, quantitative and repeatable evaluation for the eye soft tissue morphology description. Extracting a plurality of mesh vertexes of an orbit region 2500 from three-dimensional information of a Face of a patient with an orbit disease acquired by a Bellus3D structured light scanner to establish an orbit soft tissue evaluation key point set (SKO, soft-tissue key-points-set of the orbit), and registering key points by using an LSFM (Large Scale Face model); an SKO regression equation is established by using 65 orbital fracture patient data, and the form of orbital soft tissues is judged, so that objective evaluation of subjective judgments such as the change of the form of the perceivable orbital face, the swelling and regression of the orbital is realized, effective verification is obtained, and a new thought is provided for diagnosis and treatment and decision research of orbital face diseases. Compared with the prior art, the method reduces the requirement on manpower, basically realizes the automation of medical diagnosis, has the accuracy rate of 90 percent, and basically meets the clinical requirement.
It should be noted that, the steps in the method provided by the present invention can be implemented by using corresponding modules, devices, units, and the like in the system, and those skilled in the art can implement the step flow of the method by referring to the technical scheme of the system, that is, the embodiment in the system can be understood as a preferred example of the implementation method, and details are not described herein.
Those skilled in the art will appreciate that, in addition to implementing the system and its various devices provided by the present invention in purely computer readable program code means, the method steps can be fully programmed to implement the same functions by implementing the system and its various devices in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Therefore, the system and various devices thereof provided by the present invention can be regarded as a hardware component, and the devices included in the system and various devices thereof for realizing various functions can also be regarded as structures in the hardware component; means for performing the functions may also be regarded as structures within both software modules and hardware components for performing the methods.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes and modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention.
Claims (7)
1. A system for evaluating the morphology of soft tissues in an orbit based on keypoint information is characterized by comprising:
a preprocessing module: registering the three-dimensional face data by using an LSFM model, and calibrating and normalizing the registered three-dimensional face data on the basis of a coordinate space where a standard movable model is located;
a feature extraction module: recording indexes of feature points of left and right eye regions and the number n of the feature points, and extracting the feature points of the left and right eye regions from the three-dimensional face data;
an operation area judgment module: judging whether the operation area is positioned on the left eye or the right eye by adopting a linear regression model, wherein the operation area comprises a left eye characteristic point area P and a right eye characteristic point area P which correspond to the ith three-dimensional face data before and after the operationi_before,Pi_afterObtaining the ith average displacement matrix PiAnd whether the corresponding area is operated YiThen obtaining independent variable P and dependent variable Y of linear regression, and calculating weight W of the influence of x, Y and z directions on the result;
the average displacement matrix Pi＝∑(Pi_after-Pi_before)/n；
Surgical condition of the corresponding area
The independent variable
Wherein m is the number of training set samples;
dependent variable of the
Wherein m is the number of training set samples;
the weight W ═ PT·P)-1·PT·Y；
Postoperative resumes judging module: calculating the average displacement matrix P of the operation eye area and the standard movable modeloperationAnd the average displacement matrix P of the non-operative ocular region and the standard mobile modelnaturalAnd setting a threshold value thread to judge the postoperative recovery condition of the soft tissues of the eye socket.
2. The system for orbital soft tissue morphology evaluation based on keypoint information according to claim 1, wherein the registration uses a non-rigid iterative closest point algorithm to map points in the three-dimensional face data to a standard mobile model.
3. The system for evaluating the morphology of soft tissues of the orbit based on the keypoint information according to claim 1, wherein the calibration and normalization are to unify the spatial position and the data size of the three-dimensional face data.
4. The system for evaluating morphology of soft tissues of an orbit based on keypoint information according to claim 1, wherein the index of the feature points refers to the selection of feature points in the texture data of the standard mobile model, which are in accordance with the surgical area of the left and right eyes, and the recording of the serial numbers of the feature points.
5. The keypoint information-based orbital soft tissue morphology evaluation system of claim 1, wherein the number of feature points n comprises 2572 feature points for a left eye region and/or 2591 feature points for a right eye region.
6. The keypoint information based orbit soft tissue morphology evaluation system of claim 1, wherein the threshold thread is 0.006;
the judgment of the postoperative soft tissue recovery condition of the eye socket is as follows:
when P is presentoperation-thread<Pnatural<PoperationWhen the current value is + thread, the recovery is judged to be good, otherwise, the recovery is judged not to be recovered.
7. An apparatus comprising a memory, a processor, and the keypoint information-based orbital soft tissue morphology evaluation system provided in any one of claims 1-6 stored on the memory and executable by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010655993.1A CN111938655B (en) | 2020-07-09 | 2020-07-09 | Orbit soft tissue form evaluation method, system and equipment based on key point information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010655993.1A CN111938655B (en) | 2020-07-09 | 2020-07-09 | Orbit soft tissue form evaluation method, system and equipment based on key point information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111938655A CN111938655A (en) | 2020-11-17 |
| CN111938655B true CN111938655B (en) | 2021-09-03 |
Family
ID=73340115
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010655993.1A Active CN111938655B (en) | 2020-07-09 | 2020-07-09 | Orbit soft tissue form evaluation method, system and equipment based on key point information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111938655B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112568992A (en) * | 2020-12-04 | 2021-03-30 | 上海交通大学医学院附属第九人民医院 | Eyelid parameter measuring method, device, equipment and medium based on 3D scanning |
| CN113610875A (en) * | 2021-09-03 | 2021-11-05 | 成都天地罔极科技有限公司 | Simulation method and system for soft tissue filling effect |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004094399A (en) * | 2002-08-29 | 2004-03-25 | Mitsubishi Heavy Ind Ltd | Control process for multi-joint manipulator and its control program as well as its control system |
| CA2654759A1 (en) * | 2006-06-13 | 2007-12-21 | Rhythmia Medical, Inc. | Non-contact cardiac mapping, including moving catheter and multi-beat integration |
| WO2007041463A3 (en) * | 2005-10-03 | 2009-04-23 | Combinatorx Inc | Electrical devices and anti-scarring drug combinations |
| CN104462723A (en) * | 2014-12-25 | 2015-03-25 | 北京航空航天大学 | Personalized interbody fusion cage design method based on topological optimization and bony reconstitution simulation |
| CN105147341A (en) * | 2015-09-29 | 2015-12-16 | 合肥工业大学 | Three-dimensional model reconstructing method for keeping fracture line of jaw bone |
| CN109410133A (en) * | 2018-09-30 | 2019-03-01 | 北京航空航天大学青岛研究院 | A kind of face texture repairing method based on 3DMM |
| CN109671505A (en) * | 2018-10-25 | 2019-04-23 | 杭州体光医学科技有限公司 | A kind of head three-dimensional data processing method for medical consultations auxiliary |
| CN110072433A (en) * | 2016-09-19 | 2019-07-30 | 莱雅公司 | The systems, devices and methods of three dimensional analysis for eye pouch |
| CN110246158A (en) * | 2019-07-19 | 2019-09-17 | 上海交通大学医学院附属第九人民医院 | Eye illness detection device, method, electric terminal and storage medium |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6683968B1 (en) * | 1999-09-16 | 2004-01-27 | Hewlett-Packard Development Company, L.P. | Method for visual tracking using switching linear dynamic system models |
| US7130835B2 (en) * | 2002-03-28 | 2006-10-31 | Bausch & Lomb Incorporated | System and method for predictive ophthalmic correction |
| NZ548255A (en) * | 2004-02-02 | 2010-10-29 | Ambrx Inc | Modified human interferon polypeptides and their uses |
| US11298209B2 (en) * | 2004-02-27 | 2022-04-12 | Align Technology, Inc. | Method and system for providing dynamic orthodontic assessment and treatment profiles |
| CN101694716A (en) * | 2009-10-10 | 2010-04-14 | 北京理工大学 | Stereoscopic vision optical tracking system aiming at multipoint targets |
| CN105259904B (en) * | 2015-10-15 | 2018-01-30 | 山东科技大学 | More control surface unmanned plane longitudinal direction decoupling control methods based on Model Predictive Control |
| CN107194980A (en) * | 2017-05-18 | 2017-09-22 | 成都通甲优博科技有限责任公司 | Faceform's construction method, device and electronic equipment |
| US11413808B2 (en) * | 2018-12-12 | 2022-08-16 | University Of Florida Research Foundation, Incorporated | Cross-linkable microgel composite matrix bath for embedded bioprinting of perfusable tissue constructs |
| CN110570430B (en) * | 2019-09-16 | 2023-01-03 | 中南大学 | Orbital bone tissue segmentation method based on volume registration |
-
2020
- 2020-07-09 CN CN202010655993.1A patent/CN111938655B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004094399A (en) * | 2002-08-29 | 2004-03-25 | Mitsubishi Heavy Ind Ltd | Control process for multi-joint manipulator and its control program as well as its control system |
| WO2007041463A3 (en) * | 2005-10-03 | 2009-04-23 | Combinatorx Inc | Electrical devices and anti-scarring drug combinations |
| CA2654759A1 (en) * | 2006-06-13 | 2007-12-21 | Rhythmia Medical, Inc. | Non-contact cardiac mapping, including moving catheter and multi-beat integration |
| CN104462723A (en) * | 2014-12-25 | 2015-03-25 | 北京航空航天大学 | Personalized interbody fusion cage design method based on topological optimization and bony reconstitution simulation |
| CN105147341A (en) * | 2015-09-29 | 2015-12-16 | 合肥工业大学 | Three-dimensional model reconstructing method for keeping fracture line of jaw bone |
| CN110072433A (en) * | 2016-09-19 | 2019-07-30 | 莱雅公司 | The systems, devices and methods of three dimensional analysis for eye pouch |
| CN109410133A (en) * | 2018-09-30 | 2019-03-01 | 北京航空航天大学青岛研究院 | A kind of face texture repairing method based on 3DMM |
| CN109671505A (en) * | 2018-10-25 | 2019-04-23 | 杭州体光医学科技有限公司 | A kind of head three-dimensional data processing method for medical consultations auxiliary |
| CN110246158A (en) * | 2019-07-19 | 2019-09-17 | 上海交通大学医学院附属第九人民医院 | Eye illness detection device, method, electric terminal and storage medium |
Non-Patent Citations (4)
| Title |
|---|
| 3D visualization and simulation of frontoorbital advancement in metopic synostosis;Rodt, T;《CHILDS NERVOUS SYSTEM》;20071130;第23卷(第11期);1313–1317 * |
| Facial Feature Points Extraction;Shaojun Zhu，等;《2009 Fifth International Conference on Image and Graphics》;20100325;195-199 * |
| Method for determining weight matrix for resolving three-dimensional surface deformation using Multi-LOS D-InSAR technology;ZhiweiWang,等;《International Journal of Applied Earth Observation and Geoinformation》;20200630;1-14 * |
| Symmetric Shape Morphing for 3D Face and Head Modelling;Hang Dai，等;《 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition 》;20180607;91-97 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111938655A (en) | 2020-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113962311B (en) | Knowledge data and artificial intelligence driven multi-disease identification system for ophthalmology | |
| CN110188767B (en) | Corneal disease image serialization feature extraction and classification method and device based on deep neural network | |
| CN111951219B (en) | Thyroid eye disease screening method, system and equipment based on orbital CT images | |
| CN108209924A (en) | The analysis method of gait feature after a kind of Anterior Cruciate Ligament Ruptures | |
| CN111938655B (en) | Orbit soft tissue form evaluation method, system and equipment based on key point information | |
| CN109919254B (en) | Breast density classification method, system, readable storage medium and computer device | |
| CN111402243B (en) | Macula fovea identification method and terminal | |
| CN114266729B (en) | A method and system for predicting radiation pneumonitis after thoracic tumor radiotherapy based on machine learning | |
| CN113096137A (en) | Adaptive segmentation method and system for OCT (optical coherence tomography) retinal image field | |
| CN115762787B (en) | A method and system for evaluating the curative effect of eyelid disease surgery | |
| WO2021037790A1 (en) | Image processing for stroke characterization | |
| Agustin et al. | Implementation of data augmentation to improve performance CNN method for detecting diabetic retinopathy | |
| CN113313667A (en) | Benign tumor development trend evaluation system, computer device and storage medium | |
| CN113243914A (en) | Brain image-based assessment method and neuropsychiatric disease assessment system | |
| CN111340794B (en) | Quantification method and device for coronary artery stenosis | |
| CN119963599A (en) | Anterior segment image processing method, system, device and medium based on tracking | |
| CN118762843B (en) | A numerical simulation method for orbital pressure in patients with thyroid-related eye disease | |
| CN114176616A (en) | Venous thrombosis detection method, electronic device and storage medium | |
| CN115909470B (en) | Fully automatic eyelid disease postoperative appearance prediction system and method based on deep learning | |
| Purwanithami et al. | Hemorrhage diabetic retinopathy detection based on fundus image using neural network and FCM segmentation | |
| CN116843612A (en) | Image processing method for diabetic retinopathy diagnosis | |
| Sheet et al. | Convolution neural network model for fundus photograph quality assessment | |
| Chaskar et al. | Learning to predict diabetes from iris image analysis | |
| Elseid et al. | DEVELOPING A REAL TIME ALGORITHM FOR DIAGNOSING GLAUCOMA. | |
| CN112508919A (en) | Image processing method and device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |