CN107993293A - A kind of three-dimensional interactive anatomic teaching method for including Chinese population difference - Google Patents

Abstract

The invention discloses a three-dimensional interactive anatomy teaching method that includes differences among Chinese populations. The method can realize the interactive operation of the three-dimensional visualized anatomical deformation model through the local computer software and the web browser, realize the difference learning of anatomical shape changes between people, and achieve the purpose of assisting anatomy education. The technical scheme adopted by the present invention is divided into two parts, one is to use the deformable model technology to obtain a deformable human anatomy model according to a large number of medical images, and to reflect the anatomical differences of different people through the deformation of the digital model; the other is to use the computer local software Build an interactive teaching system for human body deformation models with web browsers, and realize interactive operations such as deformation of anatomical deformation models, model zooming, and angle rotation. The web-side version of the teaching software system does not depend on the platform or operating system, and only completes the display of the model through the browser, realizing cross-platform, cross-operating system use and flexible interactive operation.

Description

A 3D interactive anatomy teaching method that incorporates differences among Chinese populations

technical field

The present invention relates to a three-dimensional interactive anatomy teaching method that includes differences among Chinese populations. The anatomical differences between people are displayed through a deformable three-dimensional anatomical model, and the model that includes differences in human anatomical forms is displayed through Computer local software or online web pages are used in anatomy teaching and clinical application.

Background technique

The anatomical knowledge of human organs plays an important role in human anatomy courses and clinical diagnosis and treatment of diseases. Medical diagnosis and treatment of human organ diseases require clear and accurate assessment of complex human anatomy and the spatial relationships between structures. As a pillar of basic medicine and a highly intuitive subject, human anatomy is an important and very necessary subject that combines theory and practice, and requires a large number of anatomical resources to support teaching and medical students' practice. Traditional anatomical models only rely on rare and hard-to-preserve donated human specimens, two-dimensional wall charts that are difficult to understand intuitively, or rough human models, all of which are difficult to achieve good teaching effects due to factors such as lack of precise spatial positioning. Therefore, anatomy education urgently needs a three-dimensional anatomical model with a true and accurate structure.

Digital anatomy is a technology that can computerize anatomy to observe, measure and manipulate it in different ways. With the continuous development of various medical imaging equipment and three-dimensional (3D) visualization technology, the digitized 3D anatomical structure is gradually perfected. The 3D digital human anatomy model displays complex anatomical structures layer by layer or partially according to requirements, so that medical students can observe repeatedly from multiple directions, layers, and spaces, and can micro-display organ structures, Dynamic display loop or conduction and so on. At present, some local virtual 3D models with teaching or clinical significance have been constructed, such as female pelvis models, eyeball anatomy models, high-precision bone models, and mixed deformation models of brain anatomy guides, etc., as well as full-body models such as Human Anatomy Atlas, Anatomy&Physiology and Complete Anatomy, etc.

In recent years, the 3D visualized human anatomy model based on the web end of the web browser has been gradually used in anatomy teaching. The 3D visualization technology on the web side inherits the important advantages of the Internet. The use of the model does not depend on the operating system or platform-related plug-ins, and can directly realize cross-platform or even mobile device access without transplantation costs. The established web-side model can provide model services to all medical teaching and students who need it. The model establishment can achieve good network real-time application and multi-terminal sharing, which greatly reduces the teaching cost of anatomy courses in all medical schools across the country.

Although the 3D digital anatomical model and its web application have achieved good teaching results, most of the existing digital models are aimed at a standard human body and fail to cover the anatomical differences between different human individuals. Because there are considerable individual differences in the crowd, teaching only through standard human body models is not conducive to students' understanding of the differences in organ morphology between different people. If the deformation of the three-dimensional model can be used to display the changes in the anatomical structure of different individuals, it will be of better help to anatomy teaching and students' future medical practice.

Contents of the invention

Based on the above considerations, the present invention proposes a teaching software system based on the anatomical deformation model of Chinese healthy population. The deformable anatomical model used in the present invention is based on a large number of Chinese medical images as training samples, and the real anatomical deformation modes between different people are extracted from a large number of samples by the method of statistical shape model modeling, and the real anatomical deformation mode between different people is extracted through the local computer software or the Web The browser enables users to adjust the deformation of the model interactively, so as to observe the changes in the anatomical shape of organs between different people, which is closer to the anatomical shape of different individuals faced in real clinical diagnosis and treatment, and provides novel knowledge of individual differences for anatomy teaching, which is convenient for students Use your PC or mobile device to study online.

The present invention provides an anatomical difference between people in human medical images obtained by statistical shape model technology, and presents the difference as a three-dimensional model deformation process that can be adjusted interactively, and applies it to anatomy teaching, so that Students learn about individual anatomical differences among individuals, including the following steps:

Technical scheme of the present invention:

A three-dimensional interactive anatomy teaching method that includes the differences of the Chinese population, the steps are as follows:

The first step is the construction of a deformable model of human anatomy

The image data of the human anatomical deformable model used in the construction of the human anatomical deformable model comes from individuals diagnosed as without clinical symptoms, and the image data is screened to ensure uniform distribution of age, height, and weight; Deformable models of human anatomy, including living anatomy information and Chinese population sample information; said Chinese population sample information includes human-to-human differences in all organs or tissues of the human body, and health and disease differences in all organs or tissues ;

The construction of the deformable human anatomy model adopts the statistical shape training algorithm, and the deformation components of the three-dimensional anatomical differences in the crowd are obtained from a large number of medical images; the changes in the anatomical structure of the Chinese population are reflected by the deformable human anatomy model, and It is used in anatomy teaching system;

Construction method of deformable human anatomy model:

Training from a large number of medical images to obtain the deformation components of the three-dimensional anatomical differences in the crowd is divided into three steps: image segmentation, template registration, and statistical models;

Image segmentation: Segment the organs in the screened image data to obtain the three-dimensional area division of all organs and tissues, and the segmentation results are presented as three-dimensional curved surfaces;

Template registration: Then use the point cloud registration algorithm to register the standard three-dimensional human body model and the three-dimensional area obtained by image segmentation, and sequentially obtain the corresponding relationship between the anatomical positions of the point clouds on the surface of the organs between individuals;

Statistical model: Based on the registration results of all individuals, the deformation model and deformation components are obtained through the statistical shape model algorithm; the human anatomical deformation model is expressed as

in: Represents the anatomical average model, which is composed of the vertex coordinates of the model surface; [φ ₁ ,φ ₂ ,...,φ _c ] is the deformation component, which is learned from the training data set through the statistical shape model algorithm; b=[b ₁ ,b ₂ ,...,b _c ] are shape coefficients, which can be adjusted by the user on the web interface; X is the personalized shape of the human anatomical deformation model, and when the deformation components are known, the The shape is controlled by adjusting the shape coefficient; in order to control the deformation of the model within a reasonable range, the value of each deformation component b _m is λ _m is the principal component analysis eigenvalue;

The second step is to realize the interactive observation of the deformable human anatomy model based on the local computer software or the web browser

The function display mode of the deformable human anatomy model on the interactive interface is described as follows:

First, set the webpage tags and elements to form the basic structure of the webpage;

Second, set up the rendering scene module: the scene includes an adjustable light source, a deformable human anatomy model, an interactive control bar for the user to interact with the model, and background objects other than the model; realizing the deformation control of the deformable human anatomy model lies in , relating the control variables of the interactive control bar to the shape coefficients of the deformation components of the model:

First, load the initial state average model and deformation component model of the human anatomical deformation model, corresponding to the and φ ₁ , φ ₂ ,...,φ _n , where n is the number of deformation components. Since the first five deformation differences basically include the anatomical differences between people, the deformation components and The shape coefficients are the top five deformations of each organ; secondly, set the interactive control bar, and add the shape coefficients b ₁ , b ₂ ,...,b _n corresponding to the deformation components of each organ in the interactive control bar as variables in the control bar , the number of shape coefficients is consistent with the number of deformation components, and five are selected in this method; finally, the display model X is set in the constantly called webpage render() function, and the human anatomy displayed on the interface is displayed according to the formula (1) The anatomical deformation model is associated with the shape coefficient variable of the control bar, so as to adjust the variable of the control bar on the web page, and the human anatomical deformation model displayed on the page has the effect of corresponding anatomical deformation;

Third, set the display content of the webpage: by adjusting the webpage to display different scene positions, fields of view and angles, the effect of observing the human anatomical deformation model from different angles and far and near can be achieved;

The interactive observation of the human anatomy deformation model system on the web includes: visual selection function, deformation adjustment model function, zoom function, rotation angle function and translation function;

Visual selection function: each organ or tissue model has a visualization option function, by checking the visualization option of an organ or tissue model in the interactive status bar, the effect of controlling whether the model is visible or not is achieved;

Deformation adjustment model function: through the adjustment of the deformation component of each organ or tissue model in the control bar, each organ or tissue model makes corresponding anatomical changes;

Zoom function: on the computer side, use the mouse wheel to zoom in forward and backward to zoom out, and on the touch side of the tablet and mobile phone, use two fingers to control the zoom;

Rotation angle function: directly drag the model with the left mouse button on the computer side to control the rotation of the model angle, and control the zoom with a single finger on the touch side of the tablet and mobile phone;

Panning function: Drag and drop the mouse on the right side of the computer to realize the panning function of the model;

The control bar of the human anatomy deformation model is designed as the "organ" column, including the label of the human organ and the optional "organ visualization" whether it is visible; for each organ or tissue, there are visualization settings and multiple deformation components that can be adjusted to In this way, the visualization setting and anatomical deformation direction and size of each organ or tissue can be adjusted on the display interface; the visualization setting in the control bar has two states, the controlled organ or tissue is visible or invisible, and for the convenience of users to observe the anatomical model, all The initial state of the visualization settings is visible by default; multiple deformation components are arranged according to the principal component analysis weights that decrease in order, and the initial state of each component is 0 as the average model state.

Beneficial effects of the present invention: the Web version of the present invention does not depend on the platform or operating system, and only completes the display of the model through the browser, realizing cross-platform, cross-operating system use and flexible interactive operation.

Description of drawings

Figure 1 is a display of human anatomy deformation model; (a) male model; (b) female model; (c) interactive control bar.

Figure 2 is the display of the deformation adjustment of the human anatomical deformed liver model; the arrows in the figure point to the local significant deformation, (a)-(c) are the adjustment results of the first to third deformation components, and the second column is the average model of the liver In the initial state, the first column is the result of the reduced deformation component model, and the third column is the result of the increased deformation component model;

Figure 3 is a display of the deformation adjustment of the human anatomical deformation model; (a) skin; (b) bone; (c) muscle; (d) heart; (e) lung; (f) spleen; (g) kidney.

Detailed ways

The human anatomy deformation model displayed by the software teaching system constructed in this study is divided into male and female, which are displayed on two separate pages. Figure 1(a) and (b) show the deformation models of male and female human anatomy on the web respectively, and Figure 1(c) shows the interactive control bar on the web. In order to illustrate the complete model, the lower right corner of the figure shows the main organs of the male or female anatomical model occluded. The main organs and tissues of the anatomical deformation model are covered with simulated color textures, visually having a real human anatomical effect. The deformation model exists independently in the visual interface, and the anatomical deformation of each part of the organ or tissue is independently controlled according to its own control bar, and changes in real time according to the control bar.

The software system of this model provides two versions of computer local software and web browser interface. Among them, the web browser interface is cross-platform, and the interactive operation and anatomical structure learning of the deformation model can be realized on personal computers, mobile devices, virtual reality devices and other devices that support web browsers.

In order to demonstrate the interactive model deformation effect of adjusting different deformation components of the human anatomical deformation model on the web, we take the liver model of the female anatomical model as an example, and select the first three components with the largest deformation components of the liver model. The adjustment schematic diagram is shown in Figure 2 . (a-c) in the figure are the results of sequentially adjusting the first to third deformation components, and the three pictures in each row are the deformation effect of the liver model when the deformation component is reduced, the liver average model and the deformation effect of the liver model when the deformation component is increased . In the figure, the significant deformation parts in the deformation of the liver model are marked by red arrows. Observe Figure 2(a) to adjust the deformation component 1. The deformation of the liver model is represented by the enlargement and reduction of the model as a whole, which reflects that the biggest difference between people is the change in the size of the liver. This change is not a simple linear scaling. Instead, it is accompanied by non-linear deformation of the left and right lobes. Observing Figure 3(b-c) and adjusting the deformation components 2 and 3, it can be found that the ratio of the transverse length of the left lobe of the liver to that of the right lobe of the liver has changed significantly. The specific analysis shows that when the deformation component 2 is adjusted, the lateral length ratio of the right lobe of the liver changes greatly, and the left lobe of the liver fluctuates slightly; when the deformation component 3 is adjusted, the lateral length ratio of the left liver lobe changes greatly, accompanied by the The tip of the left lobe of the liver becomes more and more sharp as the growth increases, while the right lobe of the liver hardly changes in shape during the adjustment process of the third deformation component. From this, we can obtain the changes in the anatomical liver differences between people in the Chinese population. The biggest difference is the liver size, followed by the ratio of the lateral length of the left lobe of the liver to the right lobe of the liver. Through the adjustment of each deformation component of the liver model, it is possible to learn the anatomical changes of the liver in the real population and provide assistance for liver learning.

In addition, the skin, bones, muscles, heart, left and right lungs, spleen, and left and right kidneys except the liver have their own top five anatomical deformation components for adjustment. Due to space limitations, we only show the skin, bones and heart of women , left and right lungs, spleen, left and right kidneys and a representative deformation component adjustment of male muscles as a schematic illustration. As shown in Figure 3, (a-g) are female skin, male muscles, female bones, female hearts, female left and right lungs, female spleens, and female left and right kidneys in sequence. The red arrows mark the parts with large deformation of organs or tissues. Figure 3(a) is the deformation result of the female skin model. It can be seen that when the first deformation component is adjusted, the model has a significant change in body shape and fat accumulation difference; the skeleton in Figure 3(b), when adjusted In the second deformation component, the curvature of the spine in the skeleton is greatly deformed, indicating that the degree of curvature of the spine varies from person to person; because the muscle difference between women is not significant enough compared with that of men, Figure 3(c) chooses to show the muscles of men The difference in deformation change, adjusting the deformation component, can clearly observe the significant change in the size of the muscle in the large muscle model; Figure 3(d) reflects the differences in the shape characteristics of the heart between different people; Figure 3(e) is the female lung deformation model , with the adjustment of the first deformation component, the topological deformation of the front edge of the lower end of the left lung occurred, and the longitudinal length and shape of the three lobes of the right lung also changed significantly. At the same time, the relative longitudinal height of the left and right lung apices changed significantly Part of these changes in the lungs come from differences in the breath-hold amplitude of PET-CT image acquisition between people, and the other part comes from differences in the anatomical shape of the lungs between people; as the most important lymphatic organ in the human body, the body's immune system The degree directly affects the size of the spleen, as shown in Figure 3(f) for the deformation of the spleen model, the difference in the adjustment of the first deformation component partly comes from the difference in spleen size between different people, and the other part comes from the anatomical shape of the spleen difference, such as the difference in the protruding degree of the front and rear ends; a significant anatomical difference between the left and right kidneys is the change in the relative longitudinal position of the left and right kidneys, as shown in Figure 3(g), with the adjustment of the deformation component, the relative relationship between the two kidneys The position changes and is accompanied by a certain degree of difference in the shape and size of the left and right kidneys.

The present invention is not limited to the human anatomical organs and tissues shown as examples, and the present invention can be extended to any human anatomical parts.

Claims (1)

1. A kind of 1. three-dimensional interactive anatomic teaching method for including Chinese population difference, it is characterised in that step is as follows：

   The first step, the structure of human anatomy deformable model

   The human anatomy that uses of human anatomy deformable model structure can the image data of deformation model come from and be diagnosed For the individual of no clinical symptoms, image data ensures to be uniformly distributed in age, height, weight through screening；According to the shadow collected As data structure human anatomy deformable model, including vivisection information and Chinese population sample information；In described State's crowd's sample information includes the interpersonal the change of divergence of all organ or tissues of human body, the health of all organ or tissues With ill the change of divergence；

   The structure of human anatomy deformable model uses Statistical Shape training algorithm, trained from big size medical image to obtain people The deformation component of Three-dimensional anatomical evaluation difference in group；The Chinese population reflected by human anatomy deformable model dissects knot Structure changes, and uses it for anatomic teaching system；

   The construction method of human anatomy deformable model：

   The deformation component of the Three-dimensional anatomical evaluation difference obtained in crowd is trained to be divided into image segmentation, masterplate from big size medical image Three registration, statistical model steps；

   Image is split：Organ segmentation in the image data that screening is obtained obtains all organs and the 3D region of tissue is drawn Point, segmentation result is presented with three-dimension curved surface；

   Masterplate registration：Then point cloud registration algorithm is used, three areas that the human 3d model of standard and image are split Domain carries out registration, obtains the anatomical position correspondence of organ surface point cloud between individual successively；

   Statistical model：Based on all individual registration results, deformation model and deformation component are obtained by statistical shape model algorithm；People Body anatomy deformation model is expressed as

   <mrow> <mi>X</mi> <mo>=</mo> <mover> <mi>X</mi> <mo>&amp;OverBar;</mo> </mover> <mo>+</mo> <munderover> <mo>&amp;Sigma;</mo> <mrow> <mi>m</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>c</mi> </munderover> <msub> <mi>b</mi> <mi>m</mi> </msub> <msub> <mi>&amp;phi;</mi> <mi>m</mi> </msub> <mo>-</mo> <mo>-</mo> <mo>-</mo> <mrow> <mo>(</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow>

   Wherein：Represent anatomy averaging model, be made of the apex coordinate of model curved surface；[φ₁,φ₂,...,φ_c] it is deformation Component, is to be obtained by statistical shape model algorithm by training data focusing study；B=[b₁,b₂,...,b_c] it is form factor, Its value size is adjusted on web interface by user；X is the personalized shape of human anatomy deformation model, in deformation component In the case of known, the shape of X controls it to produce change by adjustable shape coefficient；It is maintained at for the deformation of Controlling model Within rational amplitude, each deformation component b_mValue isλ_mFor principal component analysis characteristic value；

   Second step, realizes that the interactive of human anatomy deformable model is seen based on computer local software or Web ends browser Examine

   Human anatomy deformable model function exhibition method on interactive interface is described as follows：

   First, set web page tag to form webpage foundation structure with element；

   Second, render scenes module is set：Scene includes adjustable light source, human anatomy deformation model, is handed over for user Background object beyond the Interactive control column and model of Model for Interoperability；Realize the deformation of human anatomy deformable model Regulation and control are, the control variable on Interactive control column is associated with the form factor of model deformation component：

   First, the original state averaging model and deformation component Model of human anatomy deformation model are loaded, corresponds to formula respectively (1) inAnd φ₁,φ₂,...,φ_n, wherein n is the number of deformation component, since first five large deformation difference essentially comprising Interpersonal anatomical discrepancies, therefore first five big shape that the deformation component and form factor chosen in this method are each organ Become；Secondly, Interactive control column is set, the corresponding form factor of each organ deformation component is added in Interactive control column b₁,b₂,...,b_nAs control group variable, form factor number is consistent with deformation component number, chooses five in the method； Finally, display model X is set in constantly called webpage call back function, according to formula (1) by the human body solution of interface display Cut open and learn deformation model together with the form factor variable association of control group, reach in page end adjustment control column variable, the page The effect of corresponding anatomy deformation occurs for the human anatomy deformation model of display；

   3rd, web page display contents are set：By adjusting the different scene location of web displaying, the visual field and angle, reach never The effect of same angle, far and near observation human anatomy deformation model；

   The interactive observation of Web ends human anatomy deformation model system includes：Visualize selection function, deformation adjusts model work( Energy, zoom function, rotation angle function and translation functions；

   Visualize selection function：Each organ or tissue model has visualization option, by choosing interactive status column In certain organ or tissue's model visualization option, reach regulation and control the whether visible effect of the model；

   Deformation adjusts model function：By in control group each organ or tissue model deformation component regulate and control, each organ or Tissue model makes corresponding anatomical variations；

   Zoom function：Computer end is that amplification is that diminution, tablet and Mobile phone touch control end refer to by two backward forward by mouse roller Control scaling；

   Rotation angle function：Computer end left mouse button directly pulls the rotation of model cootrol model angle, tablet and Mobile phone touch control End is by singly referring to control scaling；

   Translation functions：The translation functions of implementation model are pulled on the right side of computer end mouse；

   The control group of human anatomy deformation model is designed as " organ " column, including human organ label and whether visible " device Official visualizes " option；For each organ or tissue, there are visual setting and multiple deformation components adjustable, with this Adjust visual setting and anatomy deformation direction and size of each organ or tissue in display interface；Visualization is set in control group Two states are equipped with, the organ or tissue of control is visible or invisible, observes anatomical model for the convenience of the user, and all visualizations are set Put original state be defaulted as it is visible；Multiple deformation components are arranged according to the principal component analysis weight being sequentially reduced, and each point Amount original state 0 is averaging model state.