[go: up one dir, main page]

CN111625093B - Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses - Google Patents

Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses Download PDF

Info

Publication number
CN111625093B
CN111625093B CN202010422755.6A CN202010422755A CN111625093B CN 111625093 B CN111625093 B CN 111625093B CN 202010422755 A CN202010422755 A CN 202010422755A CN 111625093 B CN111625093 B CN 111625093B
Authority
CN
China
Prior art keywords
data
current
point cloud
glasses
node
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010422755.6A
Other languages
Chinese (zh)
Other versions
CN111625093A (en
Inventor
杨杰
储园
李丰
王轶
何涛
钟其波
陈玺舟
李镜晓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kunming Escher Technology Co ltd
Original Assignee
Kunming Escher Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kunming Escher Technology Co ltd filed Critical Kunming Escher Technology Co ltd
Priority to CN202010422755.6A priority Critical patent/CN111625093B/en
Publication of CN111625093A publication Critical patent/CN111625093A/en
Application granted granted Critical
Publication of CN111625093B publication Critical patent/CN111625093B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • G06F9/5016Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/20Processor architectures; Processor configuration, e.g. pipelining
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/005Tree description, e.g. octree, quadtree
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/28Indexing scheme for image data processing or generation, in general involving image processing hardware
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Multimedia (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a dynamic scheduling display method of massive digital point cloud data in MR glasses, which comprises a point cloud and a lens, and is characterized by comprising the steps of firstly, importing current view angle frame data into incremental octree data, traversing the incremental octree data, and calculating the central point P of the point cloud projected on a screen through the coordinates of a certain level node Bn Bn Coordinates and pass through P Bn Calculating boundary point P En Coordinates; step two, dynamically scheduling by dynamically cutting the octree algorithm, and calculating and loading the P of the current view child node Bn in each frame Bn P En Unloading child nodes which are not in the current field of view, and obtaining a loading list An and An unloading list Rn; step three, traversing the element Ai in the loading list An, judging whether the element Ai is loaded or not, and rendering data; step four, traversing the elements Ri in the unloading list Rn, and judging whether the current Ri is loaded or not; step five, continuously traversing the next level of child nodes, and automatically supplementing the child nodes into Rn; sixth, return to the first step.

Description

Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses
Technical Field
The invention relates to the field of dynamic scheduling display in MR (magnetic resonance) glasses, in particular to a dynamic scheduling display method for massive digital point cloud data in MR glasses.
Background
Mixed reality technology (MR) is a further development of virtual reality technology that enhances the realism of the user experience by presenting virtual scene information in a real scene, and by placing an interactive feedback information loop between the real world, the virtual world and the user. Mixed reality is a set of technical combinations that not only provide new viewing methods but also new input methods, and all methods are combined with each other, thereby promoting innovation.
Mixed Reality (MR), which includes both augmented reality and augmented virtual, refers to a new visual environment created by merging the real and virtual worlds. Physical and digital objects coexist in the new visualization environment and interact in real time. Systems typically have three features: 1. virtual and real 2. In virtual three-dimensional (3D registration) 3. Real-time operation; the implementation of Mixed Reality (MR) is required in an environment that can interact with real world things. The key point of MR is to interact with the real world and acquire information in time.
The existing MR glasses cannot load all point cloud data into the memory for rendering at one time because the CPU/GPU calculation power and the memory space of the existing MR glasses are very limited, namely, the dynamic scheduling display of massive digital point cloud data in the MR glasses cannot be realized.
Disclosure of Invention
The technical problem solved by the invention is to provide a dynamic scheduling display method of massive digital point cloud data in MR glasses, which can adopt a dynamic scheduling method under the CPU/GPU computing power and memory space of the MR glasses, namely, each frame calculates and loads child node data visible in the current field of view, and unloads child nodes which are not in the current field of view; therefore, CPU/GPU computing power and memory space of the MR glasses are fully utilized, and dynamic scheduling display of point cloud data is realized.
In order to achieve the above purpose, the present invention provides the following technical solutions:
the invention discloses a dynamic scheduling display method of massive digital point cloud data in MR glasses, which is characterized by comprising the following steps:
the first step: importing the current view frame data into incremental octree data, traversing the incremental octree data, and calculating the central point P projected on the screen by the coordinates of a certain level node Bn of the point cloud Bn Coordinates and pass through P Bn Calculating coordinates to obtain boundary point P En Coordinates;
and a second step of: calculating and loading the central point P of the current view child node Bn in each frame through dynamic scheduling of a dynamic cut octree algorithm Bn Boundary point P En Unloading child nodes which are not in the current field of view, and obtaining a loading list An and An unloading list Rn;
and a third step of: after the loading list An is obtained, traversing the elements Ai in the loading list An, judging whether the elements Ai are loaded or not, and rendering corresponding point cloud data;
fourth step: after obtaining an unloading list Rn, traversing elements Ri in the unloading list Rn, judging whether the current Ri is loaded or not, and unloading data in the Ri;
fifth step: continuing traversing the next level of child nodes and automatically supplementing the child nodes into Rn;
sixth step: returning to the first step, the rendering of the next frame is continued.
Preferably, in the first step, among the plurality of nodes Bn, a center point P projected on the screen is calculated according to coordinates of a certain level of nodes Bn Bn The coordinate P ', the transformation formula of each point P to the screen coordinate P' is:
wherein: p is the coordinates of Bn; the posture matrix data M0 of the position of the person is obtained in real time through an inertial navigation positioning system; obtaining an internal reference matrix Mi and a perspective projection matrix Mp of the micro projector by using a calibration flow provided by the MR glasses; and calculating according to the current MR glasses display resolution to obtain a window transformation matrix Mw.
Preferably, in the first step, the step is performed by P Bn Calculating coordinates to obtain boundary point P En The coordinates and the calculation formula are as follows:
P En =P Bn +V 0 *R n
wherein: by means of a posture matrix M of the position of the person 0 Calculating to obtain the head top direction V of the person wearing the MR glasses 0 Then taking the radius R of the outside surrounding sphere of Bn n Calculating boundary point P En
Preferably, in the second step, the dynamic scheduling method by dynamically cutting the octree algorithm includes: firstly, judging the display size of a certain level of node Bn projected to a lens; then the central point P of a certain level node Bn is obtained Bn One boundary point P En And converts them into screen coordinate data; if P Bn And P En The coordinates are all outside the screen range, or P Bn And P En The distance value of the coordinates is smaller than a specified threshold L, and the current node and all child nodes are removed from the rendering queue; otherwise, displaying the point cloud content of the current node, continuously traversing the next level of child nodes, judging whether the current node can be displayed, putting the current node into a loading list An which can be displayed, and putting the current node into An unloading list Rn which cannot be displayed; the element in An is Ai and the element in Rn is Ri.
Preferably, after the third step, the element Ai in the loading list An is traversed after the loading list An is obtained, and if the current Ai is already loaded, the current element Ai is skipped; if the current Ai is not loaded, loading the data request in the Ai, and rendering corresponding point cloud data.
Preferably, after the unloading list Rn is obtained in the fourth step and the fifth step, traversing the elements Ri in the unloading list Rn, if the current Ri is not loaded, skipping the current elements Ri, unloading the data in the Ri, and continuing traversing the next level child node without rendering the corresponding point cloud data, and automatically supplementing the data to the Rn.
Preferably, the calculation node Bn has high calculation speed of the display size after being projected to the lens and the dynamic cut octree algorithm, and is suitable for being used in a low-calculation-force environment such as MR glasses; the dynamic scheduling process of the dynamic cutting octree algorithm has no influence on the real-time rendering efficiency, and the residual renderable data amount of each frame after cutting is controllable; the density distribution of the point cloud scene accords with the natural law observed by human eyes, and can be directly used for the exhibition application of massive digital achievements.
Preferably, the plurality of center points PBn and boundary points PEn which are dynamically scheduled and processed by the dynamic cut octree algorithm are copied into the MR glasses through cloud data, and the position and the gesture of the MR glasses in space can be accurately calculated through inertial navigation positioning in the copying process, so that real-time rendering of the digital point cloud scene can be accurately realized; the rendered physical scene is accurately overlapped with the physical scene seen in eyes, and scene navigation or data analysis and calculation work combining virtual and real are realized on the basis.
Preferably, an overall loading threshold value is required to be set in the dynamic scheduling process of the dynamic cut octree algorithm, if the point data which is loaded currently exceeds the threshold value, all other child node data are automatically shielded, new data are not loaded any more, and the dynamic scheduling display of massive digital point cloud data in the MR glasses can be realized through the setting of the parameters.
Compared with the prior art, the invention has the beneficial effects that:
1. the invention uses the structure of the increment octree, can adopt the method of dynamic scheduling under CPU/GPU computing power and memory space of MR glasses, namely, calculate and load the visible child node data of the current field of view every frame, and unload the child node not already in the current field of view; therefore, CPU/GPU computing power and memory space of the MR glasses are fully utilized, and dynamic scheduling display of point cloud data is realized.
2. The dynamic cutting octree process used by the invention does not affect the real-time rendering efficiency, and the residual renderable data quantity of each frame after cutting is controllable; the density distribution of the point cloud scene accords with the natural law observed by human eyes, and can be directly used for the exhibition application of massive digital achievements.
Drawings
FIG. 1 is a flow chart of a method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to the invention
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Fig. 1 is a flow chart of a dynamic scheduling display method of massive digital point cloud data in MR glasses, and discloses a dynamic scheduling display method of massive digital point cloud data in MR glasses, which comprises the following steps: firstly, importing current view frame data into incremental octree data, traversing the incremental octree data, and calculating a central point P projected on a screen by coordinates of a certain level node Bn of a point cloud Bn Coordinates and pass through P Bn Calculating coordinates to obtain boundary point P En Coordinates; step two, dynamically scheduling by a dynamic cut octree algorithm, and calculating and loading a central point P of a current view child node Bn in each frame Bn Boundary point P En Unloading child nodes which are not in the current field of view, and obtaining a loading list An and An unloading list Rn; thirdly, after the loading list An is obtained, traversing the elements Ai in the loading list An, judging whether the elements Ai are loaded or not, and rendering corresponding point cloud data; step four, after obtaining an unloading list Rn, traversing elements Ri in the unloading list Rn, judging whether the current Ri is loaded or not, and unloading data in the Ri; step five, continuously traversing the next level of child nodes, and automatically supplementing the child nodes into Rn; and sixthly, returning to the first step, and continuing to execute the rendering of the next frame.
First, in a plurality of nodes Bn, according to the coordinates of a certain level of nodes Bn, calculating the center point P projected on the screen Bn The coordinate P ', the transformation formula of each point P to the screen coordinate P' is:
wherein: p is the coordinates of Bn; the posture matrix data M0 of the position of the person is obtained in real time through an inertial navigation positioning system; obtaining an internal reference matrix Mi and a perspective projection matrix Mp of the micro projector by using a calibration flow provided by the MR glasses; and calculating according to the current MR glasses display resolution to obtain a window transformation matrix Mw.
First step, through P Bn Calculating coordinates to obtain boundary point P En The coordinates and the calculation formula are as follows:
P En =P Bn +V 0 *R n
wherein: by means of a posture matrix M of the position of the person 0 Calculating to obtain the head top direction V of the person wearing the MR glasses 0 Then taking the radius R of the outside surrounding sphere of Bn n Calculating boundary point P En
The second step is that the dynamic scheduling method by the dynamic cutting octree algorithm comprises the following steps: firstly, judging the display size of a certain level of node Bn projected to a lens; then the central point P of a certain level node Bn is obtained Bn One boundary point P En And converts them into screen coordinate data; if P Bn And P En The coordinates are all outside the screen range, or P Bn And P En The distance value of the coordinates is smaller than a specified threshold L, and the current node and all child nodes are removed from the rendering queue; otherwise, displaying the point cloud content of the current node, continuously traversing the next level of child nodes, judging whether the current node can be displayed, putting the current node into a loading list An which can be displayed, and putting the current node into An unloading list Rn which cannot be displayed; the element in An is Ai and the element in Rn is Ri.
Thirdly, after the loading list An is obtained, traversing the elements Ai in the loading list An, and if the current Ai is already loaded, skipping the current elements Ai; if the current Ai is not loaded, loading the data request in the Ai, and rendering corresponding point cloud data.
And step four and step five, after obtaining an unloading list Rn, traversing the elements Ri in the unloading list Rn, if the current Ri is not loaded, skipping the current elements Ri, unloading the data in the Ri, continuing traversing the next level of child nodes without rendering the corresponding point cloud data, and automatically supplementing the child nodes into the Rn.
And sixthly, returning to the first step, and continuing to execute the rendering of the next frame.
The display size of the projected computing node Bn to the lens and the computing speed of the dynamic cut octree algorithm are high, and the method is suitable for being used in an environment with low computation power such as MR glasses; the dynamic scheduling process of the dynamic cutting octree algorithm has no influence on the real-time rendering efficiency, and the residual renderable data amount of each frame after cutting is controllable; the density distribution of the point cloud scene accords with the natural law observed by human eyes, and can be directly used for the exhibition application of massive digital achievements.
The central points PBn and the boundary points PEn which are dynamically scheduled by the dynamic cutting octree algorithm are copied into the MR glasses through cloud data, and the positions and the postures of the MR glasses in space can be accurately calculated through inertial navigation positioning, so that real-time rendering of the digital point cloud scene can be accurately realized; the rendered physical scene is accurately overlapped with the physical scene seen in eyes, and scene navigation or data analysis and calculation work combining virtual and real are realized on the basis.
And setting an overall loading threshold value in the dynamic scheduling process of the dynamic cutting octree algorithm, automatically shielding all other child node data if the currently loaded point data exceeds the threshold value, and not loading new data, thereby realizing the dynamic scheduling display of massive digital point cloud data in the MR glasses through the setting of the parameters.
Working principle:
1. starting rendering of the current frame;
2. judging the values of BPn and BEn according to the current view traversing increment octree data to obtain a loading list An and An unloading list Rn
3. IF (BPn and BEn are both out of view) {
The current child node Bn is added to Rn
}
4. ELSE IF (BPn and BEn are less than threshold L) { apart
The current child node Bn is added to Rn
}
5、ELSE{
The current child node Bn is added to An
Continuing traversing the child nodes of Bn
}
6. Element Ai { in FOR EACH An
7. IF (Ai has been loaded) { skip current element }
Loading the data request in Ai, and rendering corresponding point cloud data
}
8. The element Ri { in the FOR EACH Rn
9. IF Ri is not loaded { skip current element }
10. Unloading the data in Ri, and not rendering the corresponding point cloud data any more
12. Continuing traversing the next level of child nodes and automatically supplementing the child nodes into Rn
}
Returning to the step 1, continuing to execute the rendering of the next frame.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims (6)

1. A dynamic scheduling display method of massive digital point cloud data in MR glasses is characterized by comprising the following steps:
the first step: importing the current view frame data into incremental octree data, traversing the incremental octree data, calculating the central point PBn coordinate of a certain level node Bn of the point cloud projected on a screen, and calculating the boundary point PEn coordinate through the PBn coordinate;
and a second step of: calculating and loading data of visible points of a central point PBn and a boundary point PEn of a current view child node Bn in each frame through dynamic scheduling of a dynamic cut octree algorithm, and unloading child nodes which are not in the current view to obtain a loading list An and An unloading list Rn;
and a third step of: after the loading list An is obtained, traversing the elements Ai in the loading list An, judging whether the elements Ai are loaded or not, and rendering corresponding point cloud data;
fourth step: after obtaining the unloading list Rn, traversing the elements Ri in the unloading list Rn, judging whether the current Ri is loaded or not, and unloading the data in the Ri;
fifth step: continuing traversing the next level of child nodes and automatically supplementing the child nodes into Rn;
sixth step: returning to the first step, and continuing to execute the rendering of the next frame;
the first step, in a plurality of nodes Bn, according to the coordinates of a certain level node Bn, calculates the center point P of the projection of the node Bn on the screen Bn The coordinate P ', the transformation formula of each point P to the screen coordinate P' is:wherein: p is the coordinates of Bn; the posture matrix data M0 of the position of the person is obtained in real time through an inertial navigation positioning system; obtaining an internal reference matrix M of the micro projector by using a calibration process provided by the MR glasses i And a perspective projection matrix M p The method comprises the steps of carrying out a first treatment on the surface of the Calculating to obtain a window transformation matrix M according to the current MR glasses display resolution w
The first step is performed by P Bn Calculating coordinates to obtain boundary point P En The coordinates and the calculation formula are as follows:
P En =P Bn +V 0 *R n
wherein: the head top direction V of the person wearing the MR glasses is calculated through the posture matrix M0 of the position of the person 0 Then taking the radius R of the outside surrounding sphere of Bn n Calculating boundary point P En
2. The method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to claim 1, wherein the dynamic scheduling method by dynamically cutting octree algorithm in the second step comprises: firstly, judging the display size of a certain level of node Bn projected to a lens; then, a central point PBn and a boundary point PEn of a certain level of node Bn are obtained, and are converted into screen coordinate data; if the PBn and PEn coordinates are both located outside the screen range, or the distance value of the PBn and PEn coordinates is smaller than a specified threshold L, the current node and all child nodes are removed from the rendering queue; otherwise, displaying the point cloud content of the current node, continuously traversing the next level of child nodes, judging whether the current node can be displayed, putting the current node into a loading list An which can be displayed, and putting the current node into An unloading list Rn which cannot be displayed; the element in An is Ai and the element in Rn is Ri.
3. The method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to claim 1, wherein the third step is to traverse the elements Ai in the loading list An after obtaining the loading list An, and skip the current elements Ai if the current Ai is already loaded; if the current Ai is not loaded, loading the data request in the Ai, and rendering corresponding point cloud data.
4. The method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to claim 1, wherein after obtaining an unloading list Rn, traversing elements Ri in the unloading list Rn, if current Ri is not loaded, skipping the current elements Ri, unloading data in Ri, continuing traversing the next level child node without rendering the corresponding point cloud data, and automatically supplementing to Rn.
5. The dynamic scheduling display method of massive digital point cloud data in MR glasses according to claim 1, wherein a plurality of center points PBn and boundary points PEn subjected to dynamic scheduling processing by a dynamic cutting octree algorithm are copied into the MR glasses through cloud data, and the position and the gesture of the MR glasses in space can be accurately calculated by inertial navigation positioning in the copying process.
6. The method for dynamically scheduling and displaying massive digital point cloud data in MR glasses according to claim 1, wherein an overall loading threshold is set in the dynamic scheduling process of the dynamic cut octree algorithm, and if the point data which is currently loaded exceeds the threshold, all other child node data are automatically shielded and new data are not loaded.
CN202010422755.6A 2020-05-19 2020-05-19 Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses Active CN111625093B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010422755.6A CN111625093B (en) 2020-05-19 2020-05-19 Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010422755.6A CN111625093B (en) 2020-05-19 2020-05-19 Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses

Publications (2)

Publication Number Publication Date
CN111625093A CN111625093A (en) 2020-09-04
CN111625093B true CN111625093B (en) 2023-08-01

Family

ID=72259796

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010422755.6A Active CN111625093B (en) 2020-05-19 2020-05-19 Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses

Country Status (1)

Country Link
CN (1) CN111625093B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019242262A1 (en) * 2018-06-19 2019-12-26 亮风台(上海)信息科技有限公司 Augmented reality-based remote guidance method and device, terminal, and storage medium

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160267720A1 (en) * 2004-01-30 2016-09-15 Electronic Scripting Products, Inc. Pleasant and Realistic Virtual/Augmented/Mixed Reality Experience
US9508186B2 (en) * 2013-11-07 2016-11-29 Autodesk, Inc. Pre-segment point cloud data to run real-time shape extraction faster
US10740971B2 (en) * 2015-01-20 2020-08-11 Microsoft Technology Licensing, Llc Augmented reality field of view object follower
WO2017168038A1 (en) * 2016-03-31 2017-10-05 Umbra Software Oy Virtual reality streaming
US10803988B2 (en) * 2017-03-20 2020-10-13 SK Commercial Construction, Inc. Color analysis and control using a transparent display screen on a mobile device with non-transparent, bendable display screen or multiple display screen with 3D sensor for telemedicine diagnosis and treatment
US10803561B2 (en) * 2017-06-02 2020-10-13 Wisconsin Alumni Research Foundation Systems, methods, and media for hierarchical progressive point cloud rendering
US10776111B2 (en) * 2017-07-12 2020-09-15 Topcon Positioning Systems, Inc. Point cloud data method and apparatus
WO2019016820A1 (en) * 2017-07-20 2019-01-24 Alon Melchner A METHOD FOR PLACING, TRACKING AND PRESENTING IMMERSIVE REALITY-VIRTUALITY CONTINUUM-BASED ENVIRONMENT WITH IoT AND/OR OTHER SENSORS INSTEAD OF CAMERA OR VISUAL PROCCESING AND METHODS THEREOF
US10685446B2 (en) * 2018-01-12 2020-06-16 Intel Corporation Method and system of recurrent semantic segmentation for image processing
US10854003B2 (en) * 2018-01-15 2020-12-01 Worcester Polytechnic Institute Visualization of network data as a three-dimensional hierarchical data structure in a mixed reality environment
US10943115B2 (en) * 2018-07-24 2021-03-09 Apical Ltd. Processing image data to perform object detection
CN109582134B (en) * 2018-11-09 2021-07-23 北京小米移动软件有限公司 Information display method and device and display equipment

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019242262A1 (en) * 2018-06-19 2019-12-26 亮风台(上海)信息科技有限公司 Augmented reality-based remote guidance method and device, terminal, and storage medium

Also Published As

Publication number Publication date
CN111625093A (en) 2020-09-04

Similar Documents

Publication Publication Date Title
JP4643271B2 (en) Visible surface determination system and method for computer graphics using interval analysis
CN108351864B (en) Concave geometric dense paving
Loop et al. Real-time high-resolution sparse voxelization with application to image-based modeling
TWI578266B (en) Varying effective resolution by screen location in graphics processing by approximating projection of vertices onto curved viewport
CN106780709B (en) A kind of method and device of determining global illumination information
US10586375B2 (en) Hybrid raytracing approach for modeling light reflection
US9684997B2 (en) Efficient rendering of volumetric elements
US20060256112A1 (en) Statistical rendering acceleration
JP2012190428A (en) Stereoscopic image visual effect processing method
KR20160130433A (en) Method for efficient re-rendering objects to vary viewports and under varying rendering and rasterization parameters
US9508191B2 (en) Optimal point density using camera proximity for point-based global illumination
US20080309668A1 (en) Image processing method and apparatus
RU2680355C1 (en) Method and system of removing invisible surfaces of a three-dimensional scene
WO2024027237A1 (en) Rendering optimization method, and electronic device and computer-readable storage medium
CN116051713B (en) Rendering method, electronic device and computer-readable storage medium
US9401044B1 (en) Method for conformal visualization
CN111161398A (en) Image generation method, device, equipment and storage medium
CN102693065A (en) Stereoscopic image visual effect processing method
CN103679818B (en) A kind of real-time scene method for drafting based on virtual surface light source
CN106204418A (en) Image warping method based on matrix inversion operation in a kind of virtual reality mobile terminal
CN111625093B (en) Dynamic scheduling display method of massive digital point cloud data in MR (magnetic resonance) glasses
JP2020532022A (en) Sphere light field rendering method in all viewing angles
US8952968B1 (en) Wave modeling for computer-generated imagery using intersection prevention on water surfaces
Hall et al. Networked and multimodal 3d modeling of cities for collaborative virtual environments
US8659600B2 (en) Generating vector displacement maps using parameterized sculpted meshes

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant