CN114388056B - AR-based protein section generation method - Google Patents

Abstract

The invention discloses an AR-based protein section generation method, an AR-based protein section generation device, an AR-based protein section generation equipment and a computer-readable storage medium, wherein the AR-based protein section generation method comprises the following steps: displaying a three-dimensional image of a protein to be observed in a real scene through the AR headset; acquiring a user instruction through the AR headset; establishing a reference plane in the real scene, and adjusting the reference plane according to the user instruction; and after receiving the confirmation instruction, generating a cross-sectional view of the protein to be observed by taking the datum plane as a reference. The method has the advantages of convenience in operation and high operation freedom.

Description

AR-based protein cross-section generation method

technical field

The present invention relates to the technical field of protein section generation, and in particular to an AR-based protein section generation method, device, equipment and computer-readable storage medium.

Background technique

Protein is a spatial structure formed by disordered stacking of polypeptide chains in space. In order to understand its microstructure, computer three-dimensional imaging technology of protein has been widely used.

However, people only pay attention to the arrangement of basic amino acid functional units, and lack of in-depth understanding of the dense distribution and porosity inside proteins.

In order to visually display the dense distribution and porosity inside the protein, the conventional method is to use a virtual plane on the computer to perform Boolean subtraction operations on the protein to obtain the corresponding cross-sectional view. This kind of section operation needs to select multiple references and set multiple parameters, which is not only complicated to operate, but also has high requirements on the user's professional ability.

Contents of the invention

The embodiment of the present application aims to simplify the method of generating protein cross sections by providing an AR-based method for generating protein cross sections.

In order to achieve the above purpose, the embodiment of the present application provides an AR-based protein section generation method, including:

Display the three-dimensional image of the protein to be observed in the real scene through the AR head-mounted device;

Obtain user instructions through AR headsets;

establishing a reference plane in the real scene, and adjusting the reference plane according to the user instruction;

After receiving the confirmation instruction, generate a cross-sectional view of the protein to be observed with reference to the reference plane.

In one embodiment, establishing a reference plane in the real scene includes:

Determine the type of datum to be established from user instructions;

A datum matching the type is established in the real world.

In one embodiment, if the type of datum defined by the user instruction is a spherical datum, then establishing a datum matching the type in the real scene includes:

Acquiring the geometric center of the three-dimensional image;

Obtain the distance from the geometric center of the three-dimensional image to the outermost edge of the three-dimensional image;

The spherical datum plane is established with the geometric center as the center of the sphere and the distance as the radius of the sphere.

In an embodiment, if the type of the reference plane defined by the user instruction is a plane reference plane, then establishing a reference plane matching the type in the real scene includes:

Acquiring the geometric center of the three-dimensional image;

Establishing a preset reference axis in the real scene;

The plane reference plane is established with the geometric center as the plane center and the preset reference axis as the plane normal.

In an embodiment, adjusting the reference plane according to the user instruction includes:

At least one of the size, position and angle of the reference plane is adjusted according to the user instruction.

In an embodiment, the user instruction is a voice instruction.

In one embodiment, generating a cross-sectional view of the protein to be observed with reference to the reference plane includes:

Taking the intersecting surface of the reference plane and the three-dimensional image as the section position, performing a Boolean subtraction operation on the three-dimensional image of the protein to be observed to generate a cross-sectional view of the protein to be observed;

The cross-sectional view is displayed in the real scene.

In order to achieve the above purpose, the embodiment of this application also proposes an AR-based protein section generation device, including:

The AR display module is used to display the three-dimensional image of the protein to be observed in the real scene;

The acquisition module is used to acquire user instructions;

A control module, configured to establish a reference plane in the real scene according to the user instruction, and adjust the reference plane according to the user instruction;

The control module is further configured to generate a cross-sectional view of the protein to be observed with reference to the reference plane after receiving the confirmation instruction.

In order to achieve the above purpose, the embodiment of the present application also proposes an AR-based protein section generation device, including a memory, a processor, and an AR-based protein section generation program stored on the memory and operable on the processor. When the device executes the AR-based protein cross-section generation program, the AR-based protein cross-section generation method described in any one of the above is realized.

In order to achieve the above purpose, the embodiment of the present application also proposes a computer-readable storage medium, the computer-readable storage medium stores an AR-based protein cross-section generation program, and the AR-based protein cross-section generation program is executed by a processor At the same time, the AR-based protein section generation method as described in any one of the above is realized.

The AR-based protein section generation method of this application uses the AR head-mounted device to display the three-dimensional image of the protein to be observed in the real scene, and then obtains user instructions through the AR head-mounted device to adjust the reference plane established in the real scene. The reference plane is used as a reference to generate a cross-sectional view of the protein to be observed. In this way, any required protein cross-sectional view can be generated without inputting complex parameters, which reduces the technical difficulty of obtaining the protein cross-sectional view; and, the AR head-mounted device displays the cross-sectional view of the protein to be observed. The three-dimensional images of proteins can also break through the limitations of traditional displays, and users can observe the three-dimensional images of proteins more freely and adjust the position of the reference plane, so that it is easier to obtain protein cross-sectional views that better meet their needs. It can be seen that, compared with the traditional method of generating protein cross-sections by setting complex parameters, the method of the present application has the advantages of convenient operation and high degree of freedom of operation.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to the structures shown in these drawings without creative effort.

Fig. 1 is a module structure diagram of an embodiment of an AR-based protein cross section generating device of the present invention;

Fig. 2 is a schematic flow chart of an embodiment of the AR-based protein section generation method of the present invention;

Fig. 3 is a schematic flow chart of an embodiment of the AR-based protein section generation method of the present invention;

Fig. 4 is a schematic flowchart of an embodiment of the AR-based protein section generation method of the present invention;

Fig. 5 is a module structure diagram of an embodiment of an AR-based protein section generating device of the present invention.

The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Detailed ways

It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

In order to better understand the above-mentioned technical solutions, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

It should be noted that, in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" used herein does not exclude the presence of elements or steps not listed in a claim. The numeral "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. While the use of "first," "second," and "third," etc. does not imply any order, these words may be construed as designations.

As shown in FIG. 1 , FIG. 1 is a schematic structural diagram of a server 1 (also called an AR-based protein section generation device) in a hardware operating environment involved in the solution of the embodiment of the present invention.

The server of the embodiment of the present invention, such as "Internet of Things device", AR/VR device with networking function, PC, smart phone, tablet computer, portable computer and other devices with display function.

As shown in FIG. 1 , the server 1 includes: a memory 11 , a processor 12 and a network interface 13 .

Wherein, the memory 11 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (eg, SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, etc. The storage 11 may be an internal storage unit of the server 1 in some embodiments, such as a hard disk of the server 1 . Storage 11 also can be the external storage device of server 1 in some other embodiments, for example the plug-in type hard disk equipped on this server 1, smart memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card , Flash Card (Flash Card) and so on.

Further, the storage 11 may also include an internal storage unit of the server 1 or an external storage device. The memory 11 can not only be used to store application software and various data installed on the server 1, such as codes of the AR-based protein section generation program 10, etc., but also can be used to temporarily store data that has been output or will be output.

In some embodiments, the processor 12 may be a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, a microprocessor, or other data processing chips for running program codes stored in the memory 11 or processing Data, such as executing the AR-based protein section generation program 10 and so on.

The network interface 13 may optionally include standard wired interfaces and wireless interfaces (such as WI-FI interfaces), which are generally used to establish communication connections between the server 1 and other electronic devices.

The network may be the Internet, a cloud network, a wireless fidelity (Wi-Fi) network, a personal network (PAN), a local area network (LAN) and/or a metropolitan area network (MAN). Various devices in a network environment can be configured to connect to the communication network according to various wired and wireless communication protocols. Examples of such wired and wireless communication protocols may include, but are not limited to, at least one of the following: Transmission Control Protocol and Internet Protocol (TCP/IP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), file transfer Protocol (FTP), ZigBee, EDGE, IEEE 802.11, Optical Fidelity (Li-Fi), 802.16, IEEE 802.11s, IEEE 802.11g, multi-hop communication, wireless access point (AP), device-to-device communication, cellular communication protocol and/or Bluetooth (Blue Tooth) communication protocol or a combination thereof.

Optionally, the server may further include a user interface. The user interface may include a display (Display) and an input unit such as a keyboard (Keyboard). Optional user interfaces may also include standard wired interfaces and wireless interfaces. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode, Organic Light-Emitting Diode) touch device, and the like. Wherein, the display may also be referred to as a display screen or a display unit, and is used for displaying information processed in the server 1 and for displaying a visualized user interface.

Fig. 1 only shows a server 1 with components 11-13 and an AR-based protein cross-section generation program 10, those skilled in the art can understand that the structure shown in Fig. 1 does not constitute a limitation to the server 1, and may include Fewer or more components than shown, or combinations of certain components, or different arrangements of components.

In this embodiment, the processor 12 can be used to call the AR-based protein section generation program stored in the memory 11, and perform the following operations:

Display the three-dimensional image of the protein to be observed in the real scene through the AR head-mounted device;

Obtain user instructions through AR headsets;

establishing a reference plane in the real scene, and adjusting the reference plane according to the user instruction;

After receiving the confirmation instruction, generate a cross-sectional view of the protein to be observed with reference to the reference plane.

In one embodiment, the processor 12 can be used to call the AR-based protein section generation program stored in the memory 11, and perform the following operations:

Determine the type of datum to be established from user instructions;

A datum matching the type is established in the real world.

In one embodiment, the processor 12 can be used to call the AR-based protein section generation program stored in the memory 11, and perform the following operations:

Acquiring the geometric center of the three-dimensional image;

Obtain the distance from the geometric center of the three-dimensional image to the outermost edge of the three-dimensional image;

The spherical datum plane is established with the geometric center as the center of the sphere and the distance as the radius of the sphere.

In one embodiment, the processor 12 can be used to call the AR-based protein section generation program stored in the memory 11, and perform the following operations:

Acquiring the geometric center of the three-dimensional image;

Establishing a preset reference axis in the real scene;

The plane reference plane is established with the geometric center as the plane center and the preset reference axis as the plane normal.

In one embodiment, the processor 12 can be used to call the AR-based protein section generation program stored in the memory 11, and perform the following operations:

At least one of the size, position and angle of the reference plane is adjusted according to the user instruction.

In one embodiment, the processor 12 can be used to call the AR-based protein section generation program stored in the memory 11, and perform the following operations:

The user instruction is a voice instruction.

In one embodiment, the processor 12 can be used to call the AR-based protein section generation program stored in the memory 11, and perform the following operations:

Taking the intersecting surface of the reference plane and the three-dimensional image as the section position, performing a Boolean subtraction operation on the three-dimensional image of the protein to be observed to generate a cross-sectional view of the protein to be observed;

The cross-sectional view is displayed in the real scene.

Based on the hardware framework of the above-mentioned AR-based protein cross-section generation device, an embodiment of the AR-based protein cross-section generation method of the present invention is proposed. The AR-based protein cross-section generation method of the present invention aims to simplify the protein cross-section generation method.

Referring to Fig. 2, Fig. 2 is an embodiment of the AR-based protein section generation method of the present invention, and the AR-based protein section generation method includes the following steps:

S10. Displaying a three-dimensional image of the protein to be observed in a real scene through an AR head-mounted device.

Among them, AR refers to Augmented Reality, that is, augmented reality, which is a technology that integrates virtual information with the real world. into the real world. AR devices are devices that apply AR technology. Common AR headsets include AR headsets and AR glasses. Generally, an AR head-mounted device has a display lens capable of displaying an AR object such as a three-dimensional model. Since the display lens has light transmission, when the AR object is displayed on the display lens, the user can see the real scene and the AR object at the same time, so that the AR object can be displayed in the real scene. It is worth noting that AR headsets usually also have an image acquisition module and a calculation module. The image acquisition module can collect the depth information of the real scene, and the calculation module can model the real scene based on the depth information collected by the image acquisition module. , so that the newly loaded 3D image and other AR objects can be fixed in the real scene by selecting the coordinates of the real scene as anchor points. In other words, after the three-dimensional image of the protein to be observed is displayed, its coordinates in the real scene are fixed.

Specifically, after importing the three-dimensional image data of the protein to be observed into the AR head-mounted device, if the user selects the protein to be observed through the menu option of the AR head-mounted device, the three-dimensional image of the protein to be observed can be displayed in the display module. , and then, the user can display the protein to be observed in the real scene.

S20. Obtain a user instruction through the AR headset.

Specifically, the AR headset is usually provided with an image collection module and a sound collection module, the image collection module may be a camera, and the sound collection module may be a microphone. The image collection module can collect the user's gestures, and then collect the user's gesture instructions; and the voice collection module can collect the user's voice, and then collect the user's voice instructions. The user instruction referred to in this application may be at least one of the user's gesture instruction or voice instruction.

S30. Establish a reference plane in the real scene, and adjust the reference plane according to the user instruction.

Specifically, after the three-dimensional image of the protein to be observed is loaded in the real scene, a reference plane can be established in the real scene. The reference plane refers to the reference plane used to generate the three-dimensional image of the protein to be observed. The adjustment command issued, the datum can be moved, rotated and scaled in the real scene.

After the reference plane is established, the reference plane can be adjusted according to the acquired user instruction, so as to change the position of the reference plane relative to the three-dimensional image of the protein to be observed.

S40. After receiving the confirmation instruction, generate a cross-sectional view of the protein to be observed with reference to the reference plane.

Specifically, when adjusting the reference plane in three-dimensional space, if the reference plane moves to any cross-sectional position required by the user, a confirmation command can be sent to the calculation module of the AR headset, and the calculation module of the AR headset receives After the corresponding confirmation instructions, the interface between the reference plane and the three-dimensional image can be used as a section to generate a cross-sectional view of the protein to be observed.

It can be understood that the AR-based protein section generation method of this application uses the AR head-mounted device to display the three-dimensional image of the protein to be observed in the real scene, and then obtains user instructions through the AR head-mounted device to adjust the reference plane established in the real scene , and finally generate the cross-sectional view of the protein to be observed with reference to the reference plane, so that any required protein cross-sectional view can be generated without inputting complicated parameters, which reduces the technical difficulty of obtaining the protein cross-sectional view; and, through the AR head-mounted device Displaying the three-dimensional image of the protein to be observed can also break through the limitations of traditional displays. Users can observe the three-dimensional image of the protein more freely and adjust the position of the reference plane, so that it is easier to obtain a cross-sectional view of the protein that better meets their needs. It can be seen that, compared with the traditional method of generating protein cross-sections by setting complex parameters, the method of the present application has the advantages of convenient operation and high degree of freedom of operation.

In one embodiment, establishing a reference plane in the real scene includes:

S110. Determine the type of the reference plane to be established from the user instruction.

S120. Establish a reference plane matching the type in the real scene.

Exemplarily, the types of datums include but are not limited to plane datums, curved datums and spherical datums, where the plane datum refers to a planar datum, which has any of the three dimensions of X, Y, and Z. Dimensions in two dimensions. The curved datum plane is a curved datum plane, which is similar to the plane datum plane, but has dimensions in any three dimensions of X, Y, and Z; for example, the curved datum plane can be an arc datum plane, wavy datum etc. The spherical datum plane refers to a three-dimensional datum plane, which has three dimensions of X, Y, and Z.

Specifically, according to different user instructions, corresponding types of datums are established. In this way, users can choose different types of datums according to their own needs, thereby meeting different needs of users and expanding the applicability of the technical solution. Of course, the design of the present application is not limited thereto, and in other embodiments, only one type of reference plane may be provided.

As shown in Figure 3, in one embodiment, if the type of datum defined by the user instruction is a spherical datum, then a datum matching the type is established in the real scene, including:

S210. Acquire the geometric center of the 3D image.

Among them, the geometric center of the three-dimensional image is the geometric center of the protein to be observed.

Specifically, when calculating the geometric center of the protein to be observed, the three-dimensional image can be equivalent to a regular polyhedron, such as a regular tetrahedron, a regular pentahedron, a regular hexahedron, etc., and then based on the equivalent regular polyhedron, to obtain the The geometric center of the protein.

S220. Obtain the distance from the geometric center of the 3D image to the outermost edge of the 3D image.

Specifically, the distance from the geometric center to the outermost edge of the three-dimensional image can be obtained by acquiring the three-dimensional coordinates of the geometric center and the three-dimensional coordinates of the outermost point of the three-dimensional image.

S230. Establish the spherical datum plane with the geometric center as the center of the sphere and the distance as the radius of the sphere.

Specifically, after the center and radius of the spherical datum are determined, the required spherical datum can be established in the corresponding real scene, because the spherical radius of the spherical datum and the geometric center of the three-dimensional image to the outermost The edges are uniformly spaced, so this spherical datum can be thought of as the circumscribed sphere of the three-dimensional image of the protein.

It can be understood that such a setting can completely accommodate the three-dimensional image of the protein in the spherical reference plane, and then it is convenient for the user to observe the relative position between the spherical reference plane and the three-dimensional image of the protein, so that the user can obtain the desired protein section. In addition, by establishing a spherical datum in the real scene, the cross-sectional structure of the protein can be observed from all directions, increasing the viewing angle of the user.

As shown in FIG. 4, in one embodiment, if the type of reference plane defined by the user instruction is a plane reference plane, a reference plane matching the type is established in the real scene, including:

S410. Acquire the geometric center of the 3D image.

Among them, the geometric center of the three-dimensional image is the geometric center of the protein to be observed.

Specifically, when calculating the geometric center of the protein to be observed, the three-dimensional image can be equivalent to a regular polyhedron, such as a regular tetrahedron, a regular pentahedron, a regular hexahedron, etc., and then based on the equivalent regular polyhedron, to obtain the The geometric center of the protein.

S420. Establish a preset reference axis in the real scene.

Specifically, the preset reference axis may be any axis in the real scene, and for ease of calculation, any coordinate axis in the reference coordinate system (ie, XYZ coordinate system) in the real scene may be taken as the preset reference axis. For example, the X axis is used as the preset reference axis.

S430. Establish the plane reference plane with the geometric center as the plane center and the preset reference axis as the plane normal.

Specifically, after the center and normal of the plane reference plane are established, the required plane reference plane can be established accordingly.

It can be understood that establishing a plane reference plane passing through the geometric center of the protein to be observed can facilitate the user to cut a plane section of the protein to be observed.

In an embodiment, adjusting the reference plane according to the user instruction includes:

At least one of the size, position and angle of the reference plane is adjusted according to the user instruction.

Specifically, when the established datum is a spherical datum, the user can take the center of the spherical datum as the center to zoom in and out the spherical datum; and when the established datum is a plane datum, the user can adjust The angle and position of the plane datum.

In one embodiment, the method also includes:

The confirmation instruction is obtained from a user instruction.

That is to say, after the reference plane is adjusted to the desired position, the user can issue a voice or gesture corresponding to the confirmation command, and when the AR headset collects the relevant voice or gesture, it can be considered that the confirmation command has been received. It can be understood that the user can complete the adjustment of the reference plane and the confirmation of the protein cross-section only by voice or gesture, so that the user's operation method can be more uniform and convenient for the user to operate. Of course, the design of the present application is not limited thereto. In other embodiments, the confirmation instruction may also come from an independent switch module, such as an independent hand switch, foot switch, and the like.

In one embodiment, generating a cross-sectional view of the protein to be observed with reference to the reference plane includes:

S510. Using the intersection of the reference plane and the 3D image as a section position, perform a Boolean subtraction operation on the 3D image of the protein to be observed, so as to generate a sectional view of the protein to be observed.

Among them, the Boolean subtraction operation is the bool subtraction operation. Specifically, when generating a protein cross-section, the intersection of the current reference plane and the three-dimensional image of the protein to be observed is taken as the cross-section position, and the Boolean subtraction operation is performed on the three-dimensional image of the protein to be observed to obtain the cross-sectional view of the protein to be observed at the current position .

S520. Display the cross-sectional view in the real scene.

Specifically, after the cross-sectional view of the protein to be observed is generated, the cross-sectional view can be displayed through the display module, so that the user can observe the intercepted protein cross-sectional view in real time. Afterwards, the user can determine whether to acquire a new protein cross-sectional view based on the current protein cross-sectional view.

Exemplarily, the adjustment instruction is based on the acquired user's voice instruction. When the user selects a spherical datum plane, when adjusting the datum plane, the user only needs to say voice commands containing the two key words "increase" and "decrease" to make the datum ball zoom in or out in real time. When the user selects a flat reference plane, when adjusting the reference plane, the user only needs to say keywords including direction + action + quantity (such as moving left 0.5, translation 0.2, turning left 30 degrees, rotating left 20 degrees forward, etc.) That is, the position and angle of the datum plane can be adjusted in real time. When reaching a satisfactory position, the user needs to say a sentence containing keywords such as "OK" or "OK" to confirm. After the AR headset receives the voice confirmation signal, it will perform a bool subtraction operation on the 3D image to generate The desired cross-sectional graphics, complete the generation and display of cross-sectional graphics.

In addition, referring to FIG. 5 , the embodiment of the present invention also proposes an AR-based protein section generation device, and the AR-based protein section generation device includes:

A display module 110, configured to display a three-dimensional image of the protein to be observed in a real scene;

An acquisition module 120, configured to acquire user instructions;

A control module 130, configured to establish a reference plane in the real scene according to the user instruction, and adjust the reference plane according to the user instruction;

The control module is further configured to generate a cross-sectional view of the protein to be observed with reference to the reference plane after receiving the confirmation instruction.

The steps implemented by each functional module of the AR-based protein cross-section generation device can refer to the various embodiments of the AR-based protein cross-section generation method of the present invention, and will not be repeated here.

In addition, the embodiment of the present invention also proposes a computer-readable storage medium. The computer-readable storage medium can be a hard disk, a multimedia card, an SD card, a flash memory card, an SMC, a read-only memory (ROM), an erasable programmable read-only Any one or any combination of memory (EPROM), portable compact disk read-only memory (CD-ROM), USB memory, etc. The computer-readable storage medium includes an AR-based protein cross-section generation program 10. The specific implementation of the computer-readable storage medium of the present invention is substantially the same as the above-mentioned AR-based protein cross-section generation method and the specific implementation of the server 1. Let me repeat.

Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, systems, or computer program products. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams.

While preferred embodiments of the invention have been described, additional changes and modifications to these embodiments can be made by those skilled in the art once the basic inventive concept is appreciated. Therefore, it is intended that the appended claims be construed to cover the preferred embodiment as well as all changes and modifications which fall within the scope of the invention.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims (7)

1. A method for generating protein cross-sections based on AR, characterized in that, comprising: Display the three-dimensional image of the protein to be observed in the real scene through the AR head-mounted device; Obtain user instructions through AR headsets; establishing a reference plane in the real scene, and adjusting the reference plane according to the user instruction; After receiving the confirmation instruction, generate a cross-sectional view of the protein to be observed with reference to the reference plane; wherein, Establish datums in the described real-world scenario, including: Determine the type of datum to be established from user instructions; establishing a datum matching the type in the real scene; If the type of datum defined by the user instruction is a plane datum, a datum matching the type is established in the real scene, including: Acquiring the geometric center of the three-dimensional image; Establishing a preset reference axis in the real scene; The plane reference plane is established with the geometric center as the plane center and the preset reference axis as the plane normal. 2. The AR-based protein section generation method according to claim 1, wherein adjusting the reference plane according to the user instruction comprises: At least one of the size, position and angle of the reference plane is adjusted according to the user instruction. 3. The method for generating protein cross-sections based on AR according to claim 1, wherein the user instruction is a voice instruction. 4. The AR-based protein cross-section generation method according to claim 1, wherein generating a cross-sectional view of the protein to be observed with reference to the reference plane comprises: Taking the intersecting surface of the reference plane and the three-dimensional image as the section position, performing a Boolean subtraction operation on the three-dimensional image of the protein to be observed to generate a cross-sectional view of the protein to be observed; The cross-sectional view is displayed in the real scene. 5. An AR-based protein section generation device, characterized in that it comprises: The AR display module is used to display the three-dimensional image of the protein to be observed in the real scene; The acquisition module is used to acquire user instructions; A control module, configured to establish a reference plane in the real scene according to the user instruction, and adjust the reference plane according to the user instruction; The control module is also used to generate a cross-sectional view of the protein to be observed with reference to the reference plane after receiving the confirmation instruction; wherein, The establishment of the reference plane in the real scene by the control module includes: Determine the type of datum to be established from user instructions; establishing a datum matching the type in the real scene; If the type of reference surface defined by the user instruction is a plane reference surface, then the control module establishing a reference surface matching the type in the real scene includes: Acquiring the geometric center of the three-dimensional image; Establishing a preset reference axis in the real scene; The plane reference plane is established with the geometric center as the plane center and the preset reference axis as the plane normal. 6. An AR-based protein section generation device, characterized in that it includes a memory, a processor, and an AR-based protein section generation program that is stored on the memory and can run on the processor, and the processor executes the The AR-based protein cross-section generation method as described in any one of claims 1-4 is realized when the protein cross-section generation program of AR is used. 7. A computer-readable storage medium, characterized in that, the computer-readable storage medium is stored with an AR-based protein section generation program, and the AR-based protein section generation program is executed by a processor to achieve The method for generating protein cross-sections based on AR described in any one of 1-4.

Images