CN111625093B - Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses - Google Patents
Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses Download PDFInfo
- Publication number
- CN111625093B CN111625093B CN202010422755.6A CN202010422755A CN111625093B CN 111625093 B CN111625093 B CN 111625093B CN 202010422755 A CN202010422755 A CN 202010422755A CN 111625093 B CN111625093 B CN 111625093B
- Authority
- CN
- China
- Prior art keywords
- data
- current
- point cloud
- glasses
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/005—Tree description, e.g. octree, quadtree
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/28—Indexing scheme for image data processing or generation, in general involving image processing hardware
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Multimedia (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a dynamic scheduling display method of massive digital point cloud data in MR glasses, which comprises a point cloud and a lens, and is characterized by comprising the steps of firstly, importing current view angle frame data into incremental octree data, traversing the incremental octree data, and calculating the central point P of the point cloud projected on a screen through the coordinates of a certain level node Bn Bn Coordinates and pass through P Bn Calculating boundary point P En Coordinates; step two, dynamically scheduling by dynamically cutting the octree algorithm, and calculating and loading the P of the current view child node Bn in each frame Bn P En Unloading child nodes which are not in the current field of view, and obtaining a loading list An and An unloading list Rn; step three, traversing the element Ai in the loading list An, judging whether the element Ai is loaded or not, and rendering data; step four, traversing the elements Ri in the unloading list Rn, and judging whether the current Ri is loaded or not; step five, continuously traversing the next level of child nodes, and automatically supplementing the child nodes into Rn; sixth, return to the first step.
Description
Technical Field
The invention relates to the field of dynamic scheduling display in MR (magnetic resonance) glasses, in particular to a dynamic scheduling display method for massive digital point cloud data in MR glasses.
Background
Mixed reality technology (MR) is a further development of virtual reality technology that enhances the realism of the user experience by presenting virtual scene information in a real scene, and by placing an interactive feedback information loop between the real world, the virtual world and the user. Mixed reality is a set of technical combinations that not only provide new viewing methods but also new input methods, and all methods are combined with each other, thereby promoting innovation.
Mixed Reality (MR), which includes both augmented reality and augmented virtual, refers to a new visual environment created by merging the real and virtual worlds. Physical and digital objects coexist in the new visualization environment and interact in real time. Systems typically have three features: 1. virtual and real 2. In virtual three-dimensional (3D registration) 3. Real-time operation; the implementation of Mixed Reality (MR) is required in an environment that can interact with real world things. The key point of MR is to interact with the real world and acquire information in time.
The existing MR glasses cannot load all point cloud data into the memory for rendering at one time because the CPU/GPU calculation power and the memory space of the existing MR glasses are very limited, namely, the dynamic scheduling display of massive digital point cloud data in the MR glasses cannot be realized.
Disclosure of Invention
The technical problem solved by the invention is to provide a dynamic scheduling display method of massive digital point cloud data in MR glasses, which can adopt a dynamic scheduling method under the CPU/GPU computing power and memory space of the MR glasses, namely, each frame calculates and loads child node data visible in the current field of view, and unloads child nodes which are not in the current field of view; therefore, CPU/GPU computing power and memory space of the MR glasses are fully utilized, and dynamic scheduling display of point cloud data is realized.
In order to achieve the above purpose, the present invention provides the following technical solutions:
the invention discloses a dynamic scheduling display method of massive digital point cloud data in MR glasses, which is characterized by comprising the following steps:
the first step: importing the current view frame data into incremental octree data, traversing the incremental octree data, and calculating the central point P projected on the screen by the coordinates of a certain level node Bn of the point cloud Bn Coordinates and pass through P Bn Calculating coordinates to obtain boundary point P En Coordinates;
and a second step of: calculating and loading the central point P of the current view child node Bn in each frame through dynamic scheduling of a dynamic cut octree algorithm Bn Boundary point P En Unloading child nodes which are not in the current field of view, and obtaining a loading list An and An unloading list Rn;
and a third step of: after the loading list An is obtained, traversing the elements Ai in the loading list An, judging whether the elements Ai are loaded or not, and rendering corresponding point cloud data;
fourth step: after obtaining an unloading list Rn, traversing elements Ri in the unloading list Rn, judging whether the current Ri is loaded or not, and unloading data in the Ri;
fifth step: continuing traversing the next level of child nodes and automatically supplementing the child nodes into Rn;
sixth step: returning to the first step, the rendering of the next frame is continued.
Preferably, in the first step, among the plurality of nodes Bn, a center point P projected on the screen is calculated according to coordinates of a certain level of nodes Bn Bn The coordinate P ', the transformation formula of each point P to the screen coordinate P' is:
wherein: p is the coordinates of Bn; the posture matrix data M0 of the position of the person is obtained in real time through an inertial navigation positioning system; obtaining an internal reference matrix Mi and a perspective projection matrix Mp of the micro projector by using a calibration flow provided by the MR glasses; and calculating according to the current MR glasses display resolution to obtain a window transformation matrix Mw.
Preferably, in the first step, the step is performed by P Bn Calculating coordinates to obtain boundary point P En The coordinates and the calculation formula are as follows:
P En =P Bn +V 0 *R n
wherein: by means of a posture matrix M of the position of the person 0 Calculating to obtain the head top direction V of the person wearing the MR glasses 0 Then taking the radius R of the outside surrounding sphere of Bn n Calculating boundary point P En 。
Preferably, in the second step, the dynamic scheduling method by dynamically cutting the octree algorithm includes: firstly, judging the display size of a certain level of node Bn projected to a lens; then the central point P of a certain level node Bn is obtained Bn One boundary point P En And converts them into screen coordinate data; if P Bn And P En The coordinates are all outside the screen range, or P Bn And P En The distance value of the coordinates is smaller than a specified threshold L, and the current node and all child nodes are removed from the rendering queue; otherwise, displaying the point cloud content of the current node, continuously traversing the next level of child nodes, judging whether the current node can be displayed, putting the current node into a loading list An which can be displayed, and putting the current node into An unloading list Rn which cannot be displayed; the element in An is Ai and the element in Rn is Ri.
Preferably, after the third step, the element Ai in the loading list An is traversed after the loading list An is obtained, and if the current Ai is already loaded, the current element Ai is skipped; if the current Ai is not loaded, loading the data request in the Ai, and rendering corresponding point cloud data.
Preferably, after the unloading list Rn is obtained in the fourth step and the fifth step, traversing the elements Ri in the unloading list Rn, if the current Ri is not loaded, skipping the current elements Ri, unloading the data in the Ri, and continuing traversing the next level child node without rendering the corresponding point cloud data, and automatically supplementing the data to the Rn.
Preferably, the calculation node Bn has high calculation speed of the display size after being projected to the lens and the dynamic cut octree algorithm, and is suitable for being used in a low-calculation-force environment such as MR glasses; the dynamic scheduling process of the dynamic cutting octree algorithm has no influence on the real-time rendering efficiency, and the residual renderable data amount of each frame after cutting is controllable; the density distribution of the point cloud scene accords with the natural law observed by human eyes, and can be directly used for the exhibition application of massive digital achievements.
Preferably, the plurality of center points PBn and boundary points PEn which are dynamically scheduled and processed by the dynamic cut octree algorithm are copied into the MR glasses through cloud data, and the position and the gesture of the MR glasses in space can be accurately calculated through inertial navigation positioning in the copying process, so that real-time rendering of the digital point cloud scene can be accurately realized; the rendered physical scene is accurately overlapped with the physical scene seen in eyes, and scene navigation or data analysis and calculation work combining virtual and real are realized on the basis.
Preferably, an overall loading threshold value is required to be set in the dynamic scheduling process of the dynamic cut octree algorithm, if the point data which is loaded currently exceeds the threshold value, all other child node data are automatically shielded, new data are not loaded any more, and the dynamic scheduling display of massive digital point cloud data in the MR glasses can be realized through the setting of the parameters.
Compared with the prior art, the invention has the beneficial effects that:
1. the invention uses the structure of the increment octree, can adopt the method of dynamic scheduling under CPU/GPU computing power and memory space of MR glasses, namely, calculate and load the visible child node data of the current field of view every frame, and unload the child node not already in the current field of view; therefore, CPU/GPU computing power and memory space of the MR glasses are fully utilized, and dynamic scheduling display of point cloud data is realized.
2. The dynamic cutting octree process used by the invention does not affect the real-time rendering efficiency, and the residual renderable data quantity of each frame after cutting is controllable; the density distribution of the point cloud scene accords with the natural law observed by human eyes, and can be directly used for the exhibition application of massive digital achievements.
Drawings
FIG. 1 is a flow chart of a method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to the invention
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Fig. 1 is a flow chart of a dynamic scheduling display method of massive digital point cloud data in MR glasses, and discloses a dynamic scheduling display method of massive digital point cloud data in MR glasses, which comprises the following steps: firstly, importing current view frame data into incremental octree data, traversing the incremental octree data, and calculating a central point P projected on a screen by coordinates of a certain level node Bn of a point cloud Bn Coordinates and pass through P Bn Calculating coordinates to obtain boundary point P En Coordinates; step two, dynamically scheduling by a dynamic cut octree algorithm, and calculating and loading a central point P of a current view child node Bn in each frame Bn Boundary point P En Unloading child nodes which are not in the current field of view, and obtaining a loading list An and An unloading list Rn; thirdly, after the loading list An is obtained, traversing the elements Ai in the loading list An, judging whether the elements Ai are loaded or not, and rendering corresponding point cloud data; step four, after obtaining an unloading list Rn, traversing elements Ri in the unloading list Rn, judging whether the current Ri is loaded or not, and unloading data in the Ri; step five, continuously traversing the next level of child nodes, and automatically supplementing the child nodes into Rn; and sixthly, returning to the first step, and continuing to execute the rendering of the next frame.
First, in a plurality of nodes Bn, according to the coordinates of a certain level of nodes Bn, calculating the center point P projected on the screen Bn The coordinate P ', the transformation formula of each point P to the screen coordinate P' is:
wherein: p is the coordinates of Bn; the posture matrix data M0 of the position of the person is obtained in real time through an inertial navigation positioning system; obtaining an internal reference matrix Mi and a perspective projection matrix Mp of the micro projector by using a calibration flow provided by the MR glasses; and calculating according to the current MR glasses display resolution to obtain a window transformation matrix Mw.
First step, through P Bn Calculating coordinates to obtain boundary point P En The coordinates and the calculation formula are as follows:
P En =P Bn +V 0 *R n
wherein: by means of a posture matrix M of the position of the person 0 Calculating to obtain the head top direction V of the person wearing the MR glasses 0 Then taking the radius R of the outside surrounding sphere of Bn n Calculating boundary point P En 。
The second step is that the dynamic scheduling method by the dynamic cutting octree algorithm comprises the following steps: firstly, judging the display size of a certain level of node Bn projected to a lens; then the central point P of a certain level node Bn is obtained Bn One boundary point P En And converts them into screen coordinate data; if P Bn And P En The coordinates are all outside the screen range, or P Bn And P En The distance value of the coordinates is smaller than a specified threshold L, and the current node and all child nodes are removed from the rendering queue; otherwise, displaying the point cloud content of the current node, continuously traversing the next level of child nodes, judging whether the current node can be displayed, putting the current node into a loading list An which can be displayed, and putting the current node into An unloading list Rn which cannot be displayed; the element in An is Ai and the element in Rn is Ri.
Thirdly, after the loading list An is obtained, traversing the elements Ai in the loading list An, and if the current Ai is already loaded, skipping the current elements Ai; if the current Ai is not loaded, loading the data request in the Ai, and rendering corresponding point cloud data.
And step four and step five, after obtaining an unloading list Rn, traversing the elements Ri in the unloading list Rn, if the current Ri is not loaded, skipping the current elements Ri, unloading the data in the Ri, continuing traversing the next level of child nodes without rendering the corresponding point cloud data, and automatically supplementing the child nodes into the Rn.
And sixthly, returning to the first step, and continuing to execute the rendering of the next frame.
The display size of the projected computing node Bn to the lens and the computing speed of the dynamic cut octree algorithm are high, and the method is suitable for being used in an environment with low computation power such as MR glasses; the dynamic scheduling process of the dynamic cutting octree algorithm has no influence on the real-time rendering efficiency, and the residual renderable data amount of each frame after cutting is controllable; the density distribution of the point cloud scene accords with the natural law observed by human eyes, and can be directly used for the exhibition application of massive digital achievements.
The central points PBn and the boundary points PEn which are dynamically scheduled by the dynamic cutting octree algorithm are copied into the MR glasses through cloud data, and the positions and the postures of the MR glasses in space can be accurately calculated through inertial navigation positioning, so that real-time rendering of the digital point cloud scene can be accurately realized; the rendered physical scene is accurately overlapped with the physical scene seen in eyes, and scene navigation or data analysis and calculation work combining virtual and real are realized on the basis.
And setting an overall loading threshold value in the dynamic scheduling process of the dynamic cutting octree algorithm, automatically shielding all other child node data if the currently loaded point data exceeds the threshold value, and not loading new data, thereby realizing the dynamic scheduling display of massive digital point cloud data in the MR glasses through the setting of the parameters.
Working principle:
1. starting rendering of the current frame;
2. judging the values of BPn and BEn according to the current view traversing increment octree data to obtain a loading list An and An unloading list Rn
3. IF (BPn and BEn are both out of view) {
The current child node Bn is added to Rn
}
4. ELSE IF (BPn and BEn are less than threshold L) { apart
The current child node Bn is added to Rn
}
5、ELSE{
The current child node Bn is added to An
Continuing traversing the child nodes of Bn
}
6. Element Ai { in FOR EACH An
7. IF (Ai has been loaded) { skip current element }
Loading the data request in Ai, and rendering corresponding point cloud data
}
8. The element Ri { in the FOR EACH Rn
9. IF Ri is not loaded { skip current element }
10. Unloading the data in Ri, and not rendering the corresponding point cloud data any more
12. Continuing traversing the next level of child nodes and automatically supplementing the child nodes into Rn
}
Returning to the step 1, continuing to execute the rendering of the next frame.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (6)
1. A dynamic scheduling display method of massive digital point cloud data in MR glasses is characterized by comprising the following steps:
the first step: importing the current view frame data into incremental octree data, traversing the incremental octree data, calculating the central point PBn coordinate of a certain level node Bn of the point cloud projected on a screen, and calculating the boundary point PEn coordinate through the PBn coordinate;
and a second step of: calculating and loading data of visible points of a central point PBn and a boundary point PEn of a current view child node Bn in each frame through dynamic scheduling of a dynamic cut octree algorithm, and unloading child nodes which are not in the current view to obtain a loading list An and An unloading list Rn;
and a third step of: after the loading list An is obtained, traversing the elements Ai in the loading list An, judging whether the elements Ai are loaded or not, and rendering corresponding point cloud data;
fourth step: after obtaining the unloading list Rn, traversing the elements Ri in the unloading list Rn, judging whether the current Ri is loaded or not, and unloading the data in the Ri;
fifth step: continuing traversing the next level of child nodes and automatically supplementing the child nodes into Rn;
sixth step: returning to the first step, and continuing to execute the rendering of the next frame;
the first step, in a plurality of nodes Bn, according to the coordinates of a certain level node Bn, calculates the center point P of the projection of the node Bn on the screen Bn The coordinate P ', the transformation formula of each point P to the screen coordinate P' is:wherein: p is the coordinates of Bn; the posture matrix data M0 of the position of the person is obtained in real time through an inertial navigation positioning system; obtaining an internal reference matrix M of the micro projector by using a calibration process provided by the MR glasses i And a perspective projection matrix M p The method comprises the steps of carrying out a first treatment on the surface of the Calculating to obtain a window transformation matrix M according to the current MR glasses display resolution w ,
The first step is performed by P Bn Calculating coordinates to obtain boundary point P En The coordinates and the calculation formula are as follows:
P En =P Bn +V 0 *R n
wherein: the head top direction V of the person wearing the MR glasses is calculated through the posture matrix M0 of the position of the person 0 Then taking the radius R of the outside surrounding sphere of Bn n Calculating boundary point P En 。
2. The method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to claim 1, wherein the dynamic scheduling method by dynamically cutting octree algorithm in the second step comprises: firstly, judging the display size of a certain level of node Bn projected to a lens; then, a central point PBn and a boundary point PEn of a certain level of node Bn are obtained, and are converted into screen coordinate data; if the PBn and PEn coordinates are both located outside the screen range, or the distance value of the PBn and PEn coordinates is smaller than a specified threshold L, the current node and all child nodes are removed from the rendering queue; otherwise, displaying the point cloud content of the current node, continuously traversing the next level of child nodes, judging whether the current node can be displayed, putting the current node into a loading list An which can be displayed, and putting the current node into An unloading list Rn which cannot be displayed; the element in An is Ai and the element in Rn is Ri.
3. The method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to claim 1, wherein the third step is to traverse the elements Ai in the loading list An after obtaining the loading list An, and skip the current elements Ai if the current Ai is already loaded; if the current Ai is not loaded, loading the data request in the Ai, and rendering corresponding point cloud data.
4. The method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to claim 1, wherein after obtaining an unloading list Rn, traversing elements Ri in the unloading list Rn, if current Ri is not loaded, skipping the current elements Ri, unloading data in Ri, continuing traversing the next level child node without rendering the corresponding point cloud data, and automatically supplementing to Rn.
5. The dynamic scheduling display method of massive digital point cloud data in MR glasses according to claim 1, wherein a plurality of center points PBn and boundary points PEn subjected to dynamic scheduling processing by a dynamic cutting octree algorithm are copied into the MR glasses through cloud data, and the position and the gesture of the MR glasses in space can be accurately calculated by inertial navigation positioning in the copying process.
6. The method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to claim 1, wherein an overall loading threshold is set in the dynamic scheduling process of the dynamic cut octree algorithm, and if the point data which is currently loaded exceeds the threshold, all other child node data are automatically shielded and new data are not loaded.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010422755.6A CN111625093B (en) | 2020-05-19 | 2020-05-19 | Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010422755.6A CN111625093B (en) | 2020-05-19 | 2020-05-19 | Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111625093A CN111625093A (en) | 2020-09-04 |
CN111625093B true CN111625093B (en) | 2023-08-01 |
Family
ID=72259796
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010422755.6A Active CN111625093B (en) | 2020-05-19 | 2020-05-19 | Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111625093B (en) |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019242262A1 (en) * | 2018-06-19 | 2019-12-26 | 亮风台(上海)信息科技有限公司 | Augmented reality-based remote guidance method and device, terminal, and storage medium |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160267720A1 (en) * | 2004-01-30 | 2016-09-15 | Electronic Scripting Products, Inc. | Pleasant and Realistic Virtual/Augmented/Mixed Reality Experience |
US9508186B2 (en) * | 2013-11-07 | 2016-11-29 | Autodesk, Inc. | Pre-segment point cloud data to run real-time shape extraction faster |
US10740971B2 (en) * | 2015-01-20 | 2020-08-11 | Microsoft Technology Licensing, Llc | Augmented reality field of view object follower |
WO2017168038A1 (en) * | 2016-03-31 | 2017-10-05 | Umbra Software Oy | Virtual reality streaming |
US10803988B2 (en) * | 2017-03-20 | 2020-10-13 | SK Commercial Construction, Inc. | Color analysis and control using a transparent display screen on a mobile device with non-transparent, bendable display screen or multiple display screen with 3D sensor for telemedicine diagnosis and treatment |
US10803561B2 (en) * | 2017-06-02 | 2020-10-13 | Wisconsin Alumni Research Foundation | Systems, methods, and media for hierarchical progressive point cloud rendering |
US10776111B2 (en) * | 2017-07-12 | 2020-09-15 | Topcon Positioning Systems, Inc. | Point cloud data method and apparatus |
WO2019016820A1 (en) * | 2017-07-20 | 2019-01-24 | Alon Melchner | A METHOD FOR PLACING, TRACKING AND PRESENTING IMMERSIVE REALITY-VIRTUALITY CONTINUUM-BASED ENVIRONMENT WITH IoT AND/OR OTHER SENSORS INSTEAD OF CAMERA OR VISUAL PROCCESING AND METHODS THEREOF |
US10685446B2 (en) * | 2018-01-12 | 2020-06-16 | Intel Corporation | Method and system of recurrent semantic segmentation for image processing |
US10854003B2 (en) * | 2018-01-15 | 2020-12-01 | Worcester Polytechnic Institute | Visualization of network data as a three-dimensional hierarchical data structure in a mixed reality environment |
US10943115B2 (en) * | 2018-07-24 | 2021-03-09 | Apical Ltd. | Processing image data to perform object detection |
CN109582134B (en) * | 2018-11-09 | 2021-07-23 | 北京小米移动软件有限公司 | Information display method and device and display equipment |
-
2020
- 2020-05-19 CN CN202010422755.6A patent/CN111625093B/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019242262A1 (en) * | 2018-06-19 | 2019-12-26 | 亮风台(上海)信息科技有限公司 | Augmented reality-based remote guidance method and device, terminal, and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN111625093A (en) | 2020-09-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4643271B2 (en) | Visible surface determination system and method for computer graphics using interval analysis | |
CN108351864B (en) | Concave geometric dense paving | |
Loop et al. | Real-time high-resolution sparse voxelization with application to image-based modeling | |
TWI578266B (en) | Varying effective resolution by screen location in graphics processing by approximating projection of vertices onto curved viewport | |
CN106780709B (en) | A kind of method and device of determining global illumination information | |
US10586375B2 (en) | Hybrid raytracing approach for modeling light reflection | |
US9684997B2 (en) | Efficient rendering of volumetric elements | |
US20060256112A1 (en) | Statistical rendering acceleration | |
JP2012190428A (en) | Stereoscopic image visual effect processing method | |
KR20160130433A (en) | Method for efficient re-rendering objects to vary viewports and under varying rendering and rasterization parameters | |
US9508191B2 (en) | Optimal point density using camera proximity for point-based global illumination | |
US20080309668A1 (en) | Image processing method and apparatus | |
RU2680355C1 (en) | Method and system of removing invisible surfaces of a three-dimensional scene | |
WO2024027237A1 (en) | Rendering optimization method, and electronic device and computer-readable storage medium | |
CN116051713B (en) | Rendering method, electronic device and computer-readable storage medium | |
US9401044B1 (en) | Method for conformal visualization | |
CN111161398A (en) | Image generation method, device, equipment and storage medium | |
CN102693065A (en) | Stereoscopic image visual effect processing method | |
CN103679818B (en) | A kind of real-time scene method for drafting based on virtual surface light source | |
CN106204418A (en) | Image warping method based on matrix inversion operation in a kind of virtual reality mobile terminal | |
CN111625093B (en) | Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses | |
JP2020532022A (en) | Sphere light field rendering method in all viewing angles | |
US8952968B1 (en) | Wave modeling for computer-generated imagery using intersection prevention on water surfaces | |
Hall et al. | Networked and multimodal 3d modeling of cities for collaborative virtual environments | |
US8659600B2 (en) | Generating vector displacement maps using parameterized sculpted meshes |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |