CN109741463B - Rendering method, device and equipment of virtual reality scene - Google Patents
Rendering method, device and equipment of virtual reality scene Download PDFInfo
- Publication number
- CN109741463B CN109741463B CN201910001295.7A CN201910001295A CN109741463B CN 109741463 B CN109741463 B CN 109741463B CN 201910001295 A CN201910001295 A CN 201910001295A CN 109741463 B CN109741463 B CN 109741463B
- Authority
- CN
- China
- Prior art keywords
- rendering
- area
- virtual reality
- reality scene
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2215/00—Indexing scheme for image rendering
- G06T2215/16—Using real world measurements to influence rendering
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Human Computer Interaction (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computing Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a rendering method, a rendering device and rendering equipment of a virtual reality scene, wherein the method comprises the following steps: acquiring a virtual reality scene, and judging whether the virtual reality scene is in a rendering idle state; if so, performing image rendering on the virtual reality scene, generating a display image and storing the corresponding relation between the display image and the display area; and acquiring a target area to be displayed of the virtual reality scene, calling a target display image corresponding to the target area according to the corresponding relation, and displaying the target display image. Therefore, the problem that the display refresh rate is limited due to the fact that the GPU is low in rendering refresh rate is solved by means of image rendering in the rendering idle state and calling during display, the display refresh rate is improved, time delay is reduced, and vertigo of a user when the user uses the virtual reality device is reduced.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to a rendering method, a rendering device and rendering equipment of a virtual reality scene.
Background
Virtual reality technology has become one of the research hotspots in the direction of human-computer interaction as a simulation technology that can create and experience a virtual world. With the development of virtual reality technology, users have higher and higher requirements on the reality degree and the substitution sense of virtual reality.
Currently, the main reason affecting the development of virtual reality is "vertigo feeling", and the most fundamental reason for the "vertigo feeling" is that the virtual reality equipment has a relatively large time delay, so that a method capable of reducing the time delay and reducing the "vertigo feeling" is urgently needed.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art.
Therefore, a first object of the present invention is to provide a rendering method for a virtual reality scene, which solves the problem of limiting a display refresh rate due to a low GPU rendering refresh rate by performing image rendering in a rendering idle state and calling during display, thereby improving the display refresh rate, further reducing a time delay, and reducing a vertigo feeling when a user uses a virtual reality device.
The second purpose of the invention is to provide a rendering device of a virtual reality scene.
The third purpose of the invention is to provide a virtual reality device.
A fourth object of the invention is to propose a computer-readable storage medium.
An embodiment of a first aspect of the present invention provides a method for rendering a virtual reality scene, including:
acquiring a virtual reality scene, and judging whether the virtual reality scene is in a rendering idle state;
if so, performing image rendering on the virtual reality scene, generating a display image and storing the corresponding relation between the display image and a display area;
and acquiring a target area to be displayed of the virtual reality scene, and calling and displaying a target display image corresponding to the target area according to the corresponding relation.
According to the rendering method of the virtual reality scene, the virtual reality scene is obtained, and whether the virtual reality scene is in a rendering idle state or not is judged; and if so, performing image rendering on the virtual reality scene, generating a display image and storing the corresponding relation between the display image and the display area. And further acquiring a target area to be displayed of the virtual reality scene, and calling and displaying a target display image corresponding to the target area according to the corresponding relation. Therefore, the problem that the display refresh rate is limited due to the fact that the GPU rendering refresh rate is low in real-time rendering is solved by means of image rendering in the rendering idle state and calling in the display process, the display refresh rate is improved, time delay is reduced, and vertigo of a user when the user uses virtual reality equipment is reduced. Moreover, the display refresh rate is improved, meanwhile, the authenticity of the picture is guaranteed, the rendered display image is called, the power consumption of the equipment is reduced, and the cruising ability of the equipment is improved.
Optionally, the determining whether the rendering idle state is reached includes: judging whether the scene is in a scene initialization state, if so, determining that the scene is in a rendering idle state; the rendering the virtual reality scene comprises: acquiring a gazing area in the virtual reality scene; and performing image rendering on the gazing area.
Optionally, the method further comprises: acquiring a non-gazing area in the virtual reality scene; and rendering the images of the non-gazing area according to a preset sequence.
Optionally, the determining whether the rendering idle state is reached includes: judging whether the scene is in a scene display state and the watching area finishes image rendering, if so, determining that the scene is in a rendering idle state; the rendering the virtual reality scene comprises: acquiring a non-gazing area in the virtual reality scene; and rendering the images of the non-gazing area according to a preset sequence.
Optionally, the method further comprises: when the position of the gazing area is changed, interrupting image rendering operation and acquiring the changed gazing area; and performing image rendering on the changed watching area.
Optionally, the rendering the virtual reality scene includes: acquiring a region to be rendered, and judging whether the region to be rendered has finished image rendering; and if so, determining a next region to be rendered according to the region to be rendered, and rendering the image of the next region to be rendered.
Optionally, the image rendering of the virtual reality scene, the generating of the display image and the storing of the correspondence between the display image and the display area include: establishing a coordinate system according to the virtual reality scene, and dividing the virtual reality scene into a plurality of display areas according to the coordinate system; performing image rendering on the display area to generate a display image; and storing the display image and the corresponding relation between the display image and the display area.
An embodiment of a second aspect of the present invention provides a rendering apparatus for a virtual reality scene, including:
the judging module is used for acquiring the virtual reality scene and judging whether the virtual reality scene is in a rendering idle state;
the processing module is used for rendering the images of the virtual reality scene to generate display images and storing the corresponding relation between the display images and the display areas if the display images are in the rendering idle state;
and the display module is used for acquiring a target area to be displayed of the virtual reality scene, calling a target display image corresponding to the target area according to the corresponding relation and displaying the target display image.
The virtual reality scene rendering device of the embodiment of the invention acquires the virtual reality scene and judges whether the virtual reality scene is in a rendering idle state; and if so, performing image rendering on the virtual reality scene, generating a display image and storing the corresponding relation between the display image and the display area. And further acquiring a target area to be displayed of the virtual reality scene, and calling and displaying a target display image corresponding to the target area according to the corresponding relation. Therefore, the problem that the display refresh rate is limited due to the fact that the GPU rendering refresh rate is low in real-time rendering is solved by means of image rendering in the rendering idle state and calling in the display process, the display refresh rate is improved, time delay is reduced, and vertigo of a user when the user uses virtual reality equipment is reduced. Moreover, the display refresh rate is improved, meanwhile, the authenticity of the picture is guaranteed, the rendered display image is called, the power consumption of the equipment is reduced, and the cruising ability of the equipment is improved.
Optionally, the determining module is specifically configured to: judging whether the scene is in a scene initialization state, if so, determining that the scene is in a rendering idle state; the processing module is specifically configured to: acquiring a gazing area in the virtual reality scene; and performing image rendering on the watching area.
Optionally, the processing module is specifically configured to: acquiring a non-gazing area in the virtual reality scene; and rendering the images of the non-gazing area according to a preset sequence.
Optionally, the determining module is specifically configured to: judging whether the scene is in a scene display state and the watching area finishes image rendering, if so, determining that the scene is in a rendering idle state; the processing module is specifically configured to: acquiring a non-gazing area in the virtual reality scene; and rendering the images of the non-gazing area according to a preset sequence.
Optionally, the apparatus further comprises: the interruption module is used for interrupting image rendering operation when the position of the gazing area is changed and acquiring the changed gazing area; and performing image rendering on the changed watching area.
Optionally, the processing module is further configured to: acquiring a region to be rendered, and judging whether the region to be rendered has finished image rendering; and if so, determining a next region to be rendered according to the region to be rendered, and rendering the image of the next region to be rendered.
An embodiment of a third aspect of the present invention provides a virtual reality device, including the rendering apparatus for a virtual reality scene according to the embodiment of the second aspect.
A fourth aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the method for rendering a virtual reality scene as described in the first aspect.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a schematic flowchart of a rendering method for a virtual reality scene according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of another rendering method for a virtual reality scene according to an embodiment of the present invention;
FIG. 3 is a schematic view of a virtual reality scene;
FIG. 4 is a schematic view of rendering a virtual reality scene;
fig. 5 is a schematic flowchart of another rendering method for a virtual reality scene according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of another virtual reality scene rendering;
fig. 7 is a schematic flow chart of an application scenario provided in the embodiment of the present invention;
fig. 8 is a schematic structural diagram of a rendering apparatus for a virtual reality scene according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of another virtual reality scene rendering apparatus according to an embodiment of the present disclosure;
FIG. 10 illustrates a block diagram of an exemplary electronic device suitable for use in implementing embodiments of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The following describes a rendering method, a rendering device and rendering equipment of a virtual reality scene according to an embodiment of the invention with reference to the accompanying drawings.
Fig. 1 is a schematic flowchart of a rendering method for a virtual reality scene according to an embodiment of the present invention, and as shown in fig. 1, the method includes:
In this embodiment, when displaying the virtual reality scene, the virtual reality scene may be obtained first. For example, when medical diagnosis is performed through a virtual reality scene, a selection instruction of a user for the medical scene may be received, and the medical virtual reality scene may be acquired according to the selection instruction. For another example, when teaching is performed through the virtual reality scene, a selection instruction of the user for the education scene can be received, and the education virtual reality scene can be obtained according to the instruction.
And judging whether the rendering idle state is existed or not. For example, it is determined whether the virtual reality device is in a render idle state.
As an example, it may be determined whether the device is in a scene initialization state, and if it is known that the device is in the scene initialization state, it is determined that the device is in a rendering idle state.
As another example, if it is known that the device is in a scene display state, for example, when it is known that the virtual reality device performs virtual reality scene display, it is determined that the device is in the scene display state, and the watching region has completed image rendering, it is determined that the device is in a rendering idle state.
And 102, if so, performing image rendering on the virtual reality scene, generating a display image and storing the corresponding relation between the display image and the display area.
As a possible implementation manner, corresponding rendering information may be acquired according to an acquired virtual reality scene to perform image rendering. For example, three-dimensional model information, three-dimensional animation definition information, material information, and the like corresponding to the virtual reality scene may be acquired, and the virtual reality scene may be rendered to generate a display image.
In an embodiment of the present invention, the virtual reality scene may be image-rendered according to different strategies to generate a display image, and the correspondence between the display image and the display area is stored.
As an example, a partial region in the virtual reality scene may be obtained and image rendering may be performed on the partial region to generate a display image corresponding to the partial region.
As another example, an entire region of a virtual reality scene may be image rendered and a display image generated.
There are various ways to implement the corresponding relationship between the display image and the display area. For example, a coordinate system may be established based on the virtual reality scene, and the virtual reality scene may be divided into a plurality of display regions according to the coordinate system. Further, after the display image 2 is generated by rendering the display area 1, the display image 2 is stored, and the mapping table is generated and stored according to the correspondence relationship between the display image 2 and the display area 1.
And 103, acquiring a target area to be displayed of the virtual reality scene, calling a target display image corresponding to the target area according to the corresponding relation, and displaying the target display image.
As an example, taking a virtual reality head-mounted display device as an example, the position and posture information of the head of the user may be detected according to sensors such as a gyroscope and an accelerometer, the position of a gaze point of the user in a virtual reality scene may be obtained, a gaze area may be determined according to the position of the gaze point, and then a target area to be displayed may be determined according to the gaze area. Further, by inquiring the corresponding relation between the pre-stored display image and the display area, the corresponding target display image is obtained according to the target area, and the target display image is displayed. For example, the virtual reality scene includes a display area A, B corresponding to the display images a and b, respectively, and the target area is known to match the display area a according to the position and orientation information detected by the sensor, so as to obtain the corresponding display image a for display.
It is understood that the main reason for generating the vertigo feeling is that the time delay is large, the time delay needs to be reduced in order to reduce the vertigo feeling, and increasing the frame rate is the main method for reducing the time delay. In the related art, when a virtual reality scene is displayed, image rendering is performed in real time by a GPU (Graphics Processing Unit), and since the rendering capability of the GPU is limited, the display refresh rate is limited by the lower rendering refresh rate of the GPU during the real-time rendering of the GPU, which results in a lower display refresh rate and a lower frame rate.
In the embodiment, the image rendering is performed in advance in the rendering idle state and the image is called during display, so that the problem that the display refresh rate is limited due to the fact that the GPU rendering refresh rate is low during real-time rendering of the GPU is solved, the display refresh rate is improved, the time delay is further reduced, and the vertigo of a user when the user uses VR equipment is reduced.
Furthermore, in the related art, there is a method of inserting a dummy frame or calling a previous frame image and adding an offset to perform display to increase the frame rate, for example, a GPU rendering refresh rate of 30 to 40Hz is much smaller than a display refresh rate of 60 to 120Hz, and the frame rate is increased by inserting the dummy frame or calling the previous frame image and adding the offset to perform display, but the reality of the picture is low, and the generated picture is not an accurate picture to be displayed at that time. Compared with the mode of inserting a false frame or calling the previous frame image and adding the offset for displaying, the rendering method of the virtual reality scene in the embodiment of the invention ensures the reality of the picture while improving the display refresh rate, and reduces the power consumption of equipment by calling the rendered display image.
The rendering method of the virtual reality scene comprises the steps of obtaining the virtual reality scene and judging whether the virtual reality scene is in a rendering idle state or not; and if so, performing image rendering on the virtual reality scene, generating a display image and storing the corresponding relation between the display image and the display area. And further acquiring a target area to be displayed of the virtual reality scene, and calling and displaying a target display image corresponding to the target area according to the corresponding relation. Therefore, the problem that the display refresh rate is limited due to the fact that the GPU rendering refresh rate is low in real-time rendering is solved by means of image rendering in the rendering idle state and calling in the display process, the display refresh rate is improved, time delay is reduced, and vertigo of a user when the user uses virtual reality equipment is reduced. Moreover, the display refresh rate is improved, meanwhile, the authenticity of the picture is guaranteed, the calling of the rendered display image is realized, the power consumption of the equipment is reduced, and the cruising ability of the equipment is improved.
Based on the above embodiments, further, the following describes a rendering method of a virtual reality scene according to an embodiment of the present invention with reference to scene initialization.
Fig. 2 is a schematic flowchart of another rendering method for a virtual reality scene according to an embodiment of the present invention, and as shown in fig. 2, the method includes:
As an example, a scene initialization instruction may be obtained, and it may be determined that the scene initialization state is present within a preset time after the initialization instruction is received. The preset time can be determined according to a large amount of experimental data, and can also be set according to needs, which is not limited here.
As another example, the display state of the virtual reality device may be obtained, and if it is known that the current virtual reality device does not display the virtual reality scene, it is determined that the virtual reality device is in the scene initialization state.
As a possible implementation manner, the position and posture information of the head of the user can be detected by sensors such as a gyroscope, an accelerometer, and the like, the gaze point position of the user in the virtual reality scene is acquired, and the gaze area is determined according to the detected gaze point position and parameters such as the gaze range of human eyes, the field angle, the screen center, and the like.
In this embodiment, a gazing region in a virtual reality scene may be obtained, and image rendering may be performed on the gazing region to generate a corresponding display image. For example, when the scene is initialized, the gazing area is rendered to generate a display image, and then when the scene is initialized and displayed, the display image corresponding to the gazing area is called to display.
And step 204, acquiring a non-gazing area in the virtual reality scene.
And 205, rendering the images of the non-gazing area according to a preset sequence.
In this embodiment, a non-gazing region in the virtual reality scene may also be rendered, and a corresponding display image may be generated. That is to say, in the scene initialization state, the image rendering of the entire virtual reality scene can be realized to generate and store a corresponding display image, so that when the user uses the virtual reality scene, the display image is called and displayed to improve the frame rate and reduce the delay and the dizziness.
As an example, the distance between the non-gazing area and the center of the screen may be obtained, and then the non-gazing area is subjected to image rendering in order from the center of the screen to the outside, and a corresponding display image is generated.
It should be noted that the above sequence of image rendering for the non-gaze area is merely exemplary and not limited herein.
The following description is made in connection with an application scenario in which a gaze area and a non-gaze area are rendered.
Referring to fig. 3, in the figure, points a and b are fixation points, and point c is a middle point between the two fixation points, a coordinate system may be established based on a virtual reality scene region, and the virtual reality scene may be divided into a plurality of regions according to the coordinate system, for example, into a plurality of square regions in the figure. Through GPU rendering and anti-distortion processing on the virtual reality scene, the display image is displayed to human eyes through the lens or the display assembly on the virtual reality equipment.
Referring to fig. 4, fig. 4 is a schematic plan view of the virtual reality scene area in fig. 3. In the figures, a (x1, y1) and b (x2, y2) detect that the left eye gaze region is in a region enclosed by (x1 +/-d, y1 +/-d) and the right eye gaze region is in a region enclosed by (x2 +/-d, y2 +/-d), wherein d is the side length of the square region in the figure. When a scene is initialized, image rendering is performed on a watching area, and a display image is generated and stored. And sequentially rendering the non-gazing area and storing the display image according to the sequence of the area numbers in the figure from small to large, and calling when the image of a certain area needs to be displayed. The area numbers in the graph can be determined according to the preset data table corresponding relation, and only represent one sequence example for rendering the non-gazing areas.
It should be noted that, in the area division of the virtual reality scene, the shape, size and relative position of the region of interest are merely examples, which are used to explain the present invention and are not limited herein.
According to the rendering method of the virtual reality scene, disclosed by the embodiment of the invention, the image rendering is carried out on the watching area and the non-watching area in the scene initialization state, so that when a user uses the virtual reality scene, the display image is called and displayed, the frame rate is improved, and the delay and dizziness are reduced.
Based on the above embodiments, further, the following description is made in connection with rendering a virtual reality scene in a scene display state.
Fig. 5 is a schematic flowchart of another rendering method for a virtual reality scene according to an embodiment of the present invention, and as shown in fig. 5, the method includes:
As an example, the display state of the virtual reality device may be obtained, and if it is known that the current virtual reality device performs virtual reality scene display, it is further determined whether the current gazing area completes image rendering. And if the current watching area is known to finish image rendering, determining that the watching area is in a rendering idle state.
It can be understood that, in the related art, the virtual reality scene is rendered in real time by the GPU, in this embodiment, when rendering of the current watching area is completed in the display process, image rendering may be performed on other areas in advance, for example, the virtual reality scene includes areas 1, 2, and 3, the current watching area is area 1, and when rendering of area 1 is completed, image rendering is performed on areas 2 and 3 in advance, so as to call a display image that is rendered in advance when displaying other areas, thereby improving the display refresh rate and reducing the delay.
And 303, rendering the image of the non-gazing area according to a preset sequence.
It should be noted that the explanation of the image rendering on the non-gaze region in the foregoing embodiment is also applicable to this embodiment, and is not described herein again.
In some embodiments of the present invention, it may be further determined whether the position of the gazing area is changed, and if the change of the position of the gazing area is known, the current image rendering operation is interrupted, and the changed gazing area is obtained, so as to perform image rendering on the changed gazing area. For example, when the gaze area 1 is image-rendered in the scene initialization state, when the position of the gaze area 1 changes, the current image rendering operation on the gaze area 1 is interrupted, the changed gaze area 2 is acquired, and the gaze area 2 is image-rendered.
As a possible implementation manner, the position of the gazing point may be detected once every preset time, and if the change of the position of the gazing point is known, the change of the position of the gazing area is determined. And then, interrupting the current image rendering process, re-acquiring the watching area, and further performing corresponding image rendering operation according to the changed position of the watching area.
In some embodiments of the present invention, a current region to be rendered may also be obtained, and it is determined whether the region to be rendered has completed image rendering, if yes, the region to be rendered is skipped, and a next region is obtained according to a preset sequence for image rendering. The area to be rendered is an area to be subjected to image rendering in the virtual reality scene, for example, when the area to be rendered is changed from the watching area 1 to the watching area 2, the watching area 2 needs to be subjected to image rendering, and the watching area 2 is determined to be the area to be rendered. And then, judging whether the watching area 2 finishes image rendering, and when the watching area 2 finishes image rendering, skipping the watching area 2 and acquiring the next area according to a preset sequence for image rendering. For example, when the watching region is changed, there may be a case that the rendering of the region to be rendered currently is completed, and therefore, the region in which the rendering is completed may be determined by querying the correspondence between the display image and the display region, so that the repetitive processing is reduced, and the processing efficiency is improved.
The following description will be made in conjunction with the case where the region of interest is changed.
Referring to fig. 6, the original gazing area is an area determined according to the gazing points a and b, and in the process of rendering, when the current gazing area and the digital area in the figure are rendered, the gazing area is changed, interrupt setting is performed according to a program, new gazing points a1 and b1 are obtained, and the current gazing area is determined. And then, rendering the current gazing region, and after the rendering of the current gazing region is finished, sequentially performing image rendering outside the image according to the center points c1 of the new gazing points a1 and b1, wherein when a rendered scene area is encountered, skipping is performed, and the image rendering is continued according to the current algorithm.
The following description is made in conjunction with a practical application scenario.
Referring to fig. 7, a virtual reality scene is obtained at the beginning, for example, a selection instruction of a user is received to select a corresponding virtual reality scene, and when the virtual reality scene is a known virtual reality scene, for example, a virtual reality scene such as medical treatment, the next step is executed; otherwise, displaying the virtual reality scene. When a scene starts to enter, for example, when the scene is in an initialized state, the position and posture of a sensor such as a gyroscope, an accelerometer and the like are used for judging the fixation point coordinate after the scene enters. Determining a gazing area according to the gazing point coordinate, the gazing range, the viewing angle and the screen center, wherein the gazing range, the viewing angle and the screen center can be obtained according to related measurement; otherwise, displaying the virtual reality scene. And then, performing image rendering on the watching region of the virtual reality scene, performing image rendering on the non-watching region according to a preset data table corresponding relation sequence when the watching region rendering is completed and the watching region is not changed, and storing a display image generated by rendering. And further acquiring a new watching area and performing corresponding image rendering operation when the watching area is changed. And when the scene initialization is completed, entering virtual reality scene display, and starting to call the display image stored in the current coordinate system for display. Therefore, the problem that the display refresh rate is limited due to the fact that the GPU rendering refresh rate is low in real-time rendering is solved by means of image rendering in the rendering idle state and calling in the display process, the display refresh rate is improved, time delay is reduced, and vertigo of a user when the user uses virtual reality equipment is reduced. Moreover, the display refresh rate is improved, meanwhile, the authenticity of the picture is guaranteed, the calling of the rendered display image is realized, the power consumption of the equipment is reduced, and the cruising ability of the equipment is improved.
In order to implement the above embodiments, the present invention further provides a rendering apparatus for a virtual reality scene.
Fig. 8 is a schematic structural diagram of a rendering apparatus for a virtual reality scene provided in an embodiment of the present invention, and as shown in fig. 8, the apparatus includes: the device comprises a judging module 100, a processing module 200 and a display module 300.
The determining module 100 is configured to obtain a virtual reality scene, and determine whether the virtual reality scene is in a rendering idle state.
And the processing module 200 is configured to perform image rendering on the virtual reality scene if the virtual reality scene is in the rendering idle state, generate a display image, and store a corresponding relationship between the display image and the display area.
And the display module 300 is configured to acquire a target region to be displayed in the virtual reality scene, and call and display a target display image corresponding to the target region according to the corresponding relationship.
On the basis of fig. 8, the apparatus shown in fig. 9 further comprises: an interrupt module 400.
Wherein the interrupting module 400 is configured to determine whether a location of the gazing area changes; if so, interrupting the current image rendering and acquiring the changed watching area; and performing image rendering on the changed watching area.
Further, the determining module 100 is specifically configured to: judging whether the scene is in a scene initialization state, if so, determining that the scene is in a rendering idle state; the processing module 200 is specifically configured to: acquiring a gazing area in the virtual reality scene; and performing image rendering on the watching area.
Further, the processing module 200 is specifically configured to: acquiring a non-gazing area in a virtual reality scene; and rendering the images of the non-gazing area according to a preset sequence.
The determining module 100 is specifically configured to: judging whether the scene is in a scene display state and the watching area finishes image rendering, if so, determining that the scene is in a rendering idle state; the processing module 200 is specifically configured to: acquiring a non-gazing area in a virtual reality scene; and rendering the images of the non-gazing area according to a preset sequence.
Further, the processing module 200 is further configured to: acquiring a current region to be rendered, and judging whether the region to be rendered has finished image rendering; and if so, skipping the area to be rendered.
It should be noted that, the explanation of the rendering method for a virtual reality scene in the foregoing embodiment is also applicable to the rendering apparatus for a virtual reality scene in this embodiment, and details are not repeated here. The module in this embodiment may be a module having a data processing capability and/or a program execution capability, and includes but is not limited to one or more of a processor, a single chip, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), and the like. For example, it may be a Central Processing Unit (CPU), a Field Programmable Gate Array (FPGA), or a Tensor Processing Unit (TPU). Each module may include one or more chips of the above-described devices.
The virtual reality scene rendering device of the embodiment of the invention acquires the virtual reality scene and judges whether the virtual reality scene is in a rendering idle state; and if so, performing image rendering on the virtual reality scene, generating a display image and storing the corresponding relation between the display image and the display area. And further acquiring a target area to be displayed of the virtual reality scene, and calling and displaying a target display image corresponding to the target area according to the corresponding relation. Therefore, the problem that the display refresh rate is limited due to the fact that the GPU rendering refresh rate is low in real-time rendering is solved by means of image rendering in the rendering idle state and calling in the display process, the display refresh rate is improved, time delay is reduced, and vertigo of a user when the user uses virtual reality equipment is reduced. Moreover, the display refresh rate is improved, meanwhile, the authenticity of the picture is guaranteed, the calling of the rendered display image is realized, the power consumption of the equipment is reduced, and the cruising ability of the equipment is improved.
In order to implement the foregoing embodiments, the present invention further provides a virtual reality device, including the rendering apparatus for a virtual reality scene according to any of the foregoing embodiments.
In order to implement the above embodiments, the present invention further provides an electronic device, which includes a processor and a memory; the processor runs a program corresponding to the executable program code by reading the executable program code stored in the memory, so as to implement the rendering method of the virtual reality scene according to any one of the foregoing embodiments.
In order to implement the foregoing embodiments, the present invention further provides a computer program product, wherein when the instructions in the computer program product are executed by a processor, the method for rendering a virtual reality scene according to any one of the foregoing embodiments is implemented.
In order to implement the foregoing embodiments, the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the method for rendering a virtual reality scene according to any one of the foregoing embodiments.
FIG. 10 illustrates a block diagram of an exemplary electronic device suitable for use in implementing embodiments of the present invention. The electronic device 12 shown in fig. 10 is only an example and should not bring any limitation to the function and the scope of use of the embodiment of the present invention.
As shown in fig. 10, electronic device 12 is embodied in the form of a general purpose computing device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the embodiments described herein.
The processing unit 16 executes various functional applications and data processing, for example, implementing the methods mentioned in the foregoing embodiments, by running a program stored in the system memory 28.
In the description of the present invention, it is to be understood that the terms "first", "second" and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (13)
1. A rendering method of a virtual reality scene is characterized by comprising the following steps:
acquiring a virtual reality scene, and judging whether the virtual reality scene is in a rendering idle state or not;
if so, performing image rendering on the virtual reality scene, generating a display image and storing the corresponding relation between the display image and a display area;
acquiring a target area to be displayed of the virtual reality scene according to the watching area, and calling and displaying a target display image corresponding to the target area according to the corresponding relation;
the judging whether the rendering idle state is achieved comprises the following steps:
judging whether the scene display state is achieved and the watching areas are subjected to image rendering, if so, determining that the scene display state is in an idle rendering state, wherein the number of the watching areas is 2 and the watching areas are respectively marked as a first watching area and a second watching area;
the rendering the virtual reality scene comprises:
acquiring a non-gazing area in the virtual reality scene;
rendering images of the non-watching areas according to a preset sequence;
the image rendering is carried out on the non-gazing area according to a preset sequence, and the image rendering comprises the following steps:
the non-gazing area is divided into a plurality of sub-areas according to a coordinate system established based on the virtual reality scene, the number of the sub-areas is obtained according to the corresponding relation of a preset data table, the number is according to the relative position between the sub-areas and two gazing areas, the relative position between the intermediate points of the sub-areas and the two gazing areas is determined and is multiple, the sub-areas form at least three annular areas and are respectively recorded as a first annular area, a second annular area and a third annular area, the first annular area surrounds the first gazing area and is connected with the first gazing area, the second annular area surrounds the second gazing area and is connected with the second gazing area, and the third annular area surrounds the first annular area, the second annular area and is connected with the first annular area, The second annular region is connected with the inside of the first annular region, and the first annular region and the second annular region are connected with the outside of the second annular region;
and sequentially performing image rendering on corresponding sub-areas according to the preset sequence according to the serial numbers, so that the first annular area and the second annular area are rendered first, and then the third annular area is rendered.
2. The method for rendering the virtual reality scene of claim 1, wherein the determining whether the rendering is in an idle state comprises:
judging whether the scene is in a scene initialization state, if so, determining that the scene is in a rendering idle state;
the image rendering of the virtual reality scene comprises:
acquiring a gazing area in the virtual reality scene;
and performing image rendering on the watching area.
3. The method of rendering a virtual reality scene of claim 2, further comprising:
acquiring a non-gazing area in the virtual reality scene;
and rendering the images of the non-gazing area according to a preset sequence.
4. The method of rendering a virtual reality scene of claim 3, further comprising:
when the position of the watching area is changed, interrupting image rendering operation and acquiring the changed watching area;
and performing image rendering on the changed gazing area.
5. The method of rendering a virtual reality scene of claim 4, wherein the rendering the virtual reality scene comprises:
acquiring a region to be rendered, and judging whether the region to be rendered has finished image rendering;
if so, determining a next region to be rendered according to the region to be rendered, and rendering the image of the next region to be rendered.
6. The method for rendering the virtual reality scene as recited in claim 1, wherein the rendering the image of the virtual reality scene, generating the display image and storing the corresponding relationship between the display image and the display area comprises:
establishing a coordinate system according to the virtual reality scene, and dividing the virtual reality scene into a plurality of display areas according to the coordinate system;
rendering the display area to generate a display image;
and storing the display image and the corresponding relation between the display image and the display area.
7. An apparatus for rendering a virtual reality scene, comprising:
the judging module is used for acquiring the virtual reality scene and judging whether the virtual reality scene is in a rendering idle state;
the processing module is used for rendering the image of the virtual reality scene to generate a display image and storing the corresponding relation between the display image and the display area if the virtual reality scene is in the rendering idle state;
the display module is used for acquiring a target area to be displayed of the virtual reality scene according to the watching area, calling a target display image corresponding to the target area according to the corresponding relation and displaying the target display image;
the judgment module is specifically configured to:
judging whether the scene is in a scene display state and the watching areas finish image rendering, if so, determining that the scene is in a rendering idle state, wherein the number of the watching areas is 2 and the watching areas are respectively marked as a first watching area and a second watching area;
the processing module is specifically configured to:
acquiring a non-gazing area in the virtual reality scene;
rendering the images of the non-gazing area according to a preset sequence;
the image rendering is carried out on the non-gazing area according to a preset sequence, and the image rendering comprises the following steps:
the non-gazing area is divided into a plurality of sub-areas according to a coordinate system established based on the virtual reality scene, the number of the sub-areas is obtained according to the corresponding relation of a preset data table, the number is according to the relative position between the sub-areas and two gazing areas, the relative position between the intermediate points of the sub-areas and the two gazing areas is determined and is multiple, the sub-areas form at least three annular areas and are respectively recorded as a first annular area, a second annular area and a third annular area, the first annular area surrounds the first gazing area and is connected with the first gazing area, the second annular area surrounds the second gazing area and is connected with the second gazing area, and the third annular area surrounds the first annular area, the second annular area and is connected with the first annular area, The first annular area and the second annular area are connected outside the first annular area and the second annular area;
and sequentially rendering the images of the corresponding sub-areas according to the preset sequence according to the serial numbers to realize that the first annular area and the second annular area are rendered first, and then the third annular area is rendered.
8. The virtual reality scene rendering apparatus of claim 7, wherein the determining module is specifically configured to:
judging whether the scene is in a scene initialization state, if so, determining that the scene is in a rendering idle state;
the processing module is specifically configured to:
acquiring a gazing area in the virtual reality scene;
and performing image rendering on the watching area.
9. The virtual reality scene rendering apparatus of claim 8, wherein the processing module is specifically configured to:
acquiring a non-gazing area in the virtual reality scene;
and rendering the images of the non-gazing area according to a preset sequence.
10. The rendering apparatus of a virtual reality scene of claim 9, further comprising:
the interruption module is used for interrupting the image rendering operation when the position of the watching area is changed and acquiring the changed watching area;
and performing image rendering on the changed watching area.
11. The apparatus for rendering a virtual reality scene of claim 10, wherein the processing module is further configured to:
acquiring a region to be rendered, and judging whether the region to be rendered has finished image rendering;
if so, determining a next region to be rendered according to the region to be rendered, and rendering the image of the next region to be rendered.
12. A virtual reality device, characterized in that it comprises rendering means of a virtual reality scene according to any one of claims 7 to 11.
13. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of rendering a virtual reality scene according to any one of claims 1 to 6.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910001295.7A CN109741463B (en) | 2019-01-02 | 2019-01-02 | Rendering method, device and equipment of virtual reality scene |
| PCT/CN2019/124860 WO2020140720A1 (en) | 2019-01-02 | 2019-12-12 | Rendering method and apparatus for virtual reality scene, and device |
| US16/764,401 US11263803B2 (en) | 2019-01-02 | 2019-12-12 | Virtual reality scene rendering method, apparatus and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910001295.7A CN109741463B (en) | 2019-01-02 | 2019-01-02 | Rendering method, device and equipment of virtual reality scene |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109741463A CN109741463A (en) | 2019-05-10 |
| CN109741463B true CN109741463B (en) | 2022-07-19 |
Family
ID=66363116
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910001295.7A Active CN109741463B (en) | 2019-01-02 | 2019-01-02 | Rendering method, device and equipment of virtual reality scene |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US11263803B2 (en) |
| CN (1) | CN109741463B (en) |
| WO (1) | WO2020140720A1 (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109741463B (en) | 2019-01-02 | 2022-07-19 | 京东方科技集团股份有限公司 | Rendering method, device and equipment of virtual reality scene |
| CN110351480B (en) * | 2019-06-13 | 2021-01-15 | 歌尔光学科技有限公司 | Image processing method and device for electronic equipment and electronic equipment |
| CN110930307B (en) * | 2019-10-31 | 2022-07-08 | 江苏视博云信息技术有限公司 | Image processing method and device |
| CN111402263B (en) * | 2020-03-04 | 2023-08-29 | 南方电网科学研究院有限责任公司 | Visual optimization method for high-resolution large screen |
| CN111381967A (en) * | 2020-03-09 | 2020-07-07 | 中国联合网络通信集团有限公司 | Virtual object processing method and device |
| CN111367414B (en) * | 2020-03-10 | 2020-10-13 | 厦门络航信息技术有限公司 | Virtual reality object control method and device, virtual reality system and equipment |
| CN111429333A (en) * | 2020-03-25 | 2020-07-17 | 京东方科技集团股份有限公司 | GPU dynamic frequency modulation method, device and system |
| US11721052B2 (en) * | 2020-09-24 | 2023-08-08 | Nuvolo Technologies Corporation | Floorplan image tiles |
| US12014030B2 (en) | 2021-08-18 | 2024-06-18 | Bank Of America Corporation | System for predictive virtual scenario presentation |
| CN113888685A (en) * | 2021-09-29 | 2022-01-04 | 青岛歌尔声学科技有限公司 | A control method of a head-mounted device, and a screen rendering method |
| CN114125301B (en) * | 2021-11-29 | 2023-09-19 | 卡莱特云科技股份有限公司 | Shooting delay processing method and device for virtual reality technology |
| CN114140567A (en) * | 2021-12-03 | 2022-03-04 | 三星电子（中国）研发中心 | Rendering method and device |
| CN114845147B (en) * | 2022-04-29 | 2024-01-16 | 北京奇艺世纪科技有限公司 | Screen rendering method, display screen synthesizing method and device and intelligent terminal |
| US12106488B2 (en) * | 2022-05-09 | 2024-10-01 | Qualcomm Incorporated | Camera frame extrapolation for video pass-through |
| CN115082284B (en) * | 2022-06-13 | 2025-04-29 | 成都四方伟业软件股份有限公司 | A 3D resource cache dynamic balancing method |
| CN118537450B (en) * | 2024-04-28 | 2025-02-14 | 广州乐艺动漫文化有限公司 | Animation scene rendering method and system |
Family Cites Families (37)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003039698A1 (en) * | 2001-11-02 | 2003-05-15 | Atlantis Cyberspace, Inc. | Virtual reality game system with pseudo 3d display driver & mission control |
| US6791549B2 (en) * | 2001-12-21 | 2004-09-14 | Vrcontext S.A. | Systems and methods for simulating frames of complex virtual environments |
| US20110273466A1 (en) * | 2010-05-10 | 2011-11-10 | Canon Kabushiki Kaisha | View-dependent rendering system with intuitive mixed reality |
| CN103164541B (en) * | 2013-04-15 | 2017-04-12 | 北京世界星辉科技有限责任公司 | Image presentation method and equipment |
| EP3301585A3 (en) * | 2013-08-02 | 2018-07-25 | Huawei Technologies Co., Ltd. | Image display method and apparatus |
| EP3129958B1 (en) * | 2014-04-05 | 2021-06-02 | Sony Interactive Entertainment LLC | Method for efficient re-rendering objects to vary viewports and under varying rendering and rasterization parameters |
| US10162412B2 (en) * | 2015-03-27 | 2018-12-25 | Seiko Epson Corporation | Display, control method of display, and program |
| US10089790B2 (en) * | 2015-06-30 | 2018-10-02 | Ariadne's Thread (Usa), Inc. | Predictive virtual reality display system with post rendering correction |
| CN107850981B (en) * | 2015-08-04 | 2021-06-01 | 株式会社和冠 | User notification method, handwritten data access device, and storage medium |
| CN106652004A (en) * | 2015-10-30 | 2017-05-10 | 北京锤子数码科技有限公司 | Method and apparatus for rendering virtual reality on the basis of a head-mounted visual device |
| CN105472207A (en) * | 2015-11-19 | 2016-04-06 | 中央电视台 | Video and audio file rendering method and device |
| CN105976424A (en) * | 2015-12-04 | 2016-09-28 | 乐视致新电子科技（天津）有限公司 | Image rendering processing method and device |
| US10218968B2 (en) * | 2016-03-05 | 2019-02-26 | Maximilian Ralph Peter von und zu Liechtenstein | Gaze-contingent display technique |
| CN105892683A (en) | 2016-04-29 | 2016-08-24 | 上海乐相科技有限公司 | Display method and target equipment |
| CN106484116B (en) * | 2016-10-19 | 2019-01-08 | 腾讯科技（深圳）有限公司 | The treating method and apparatus of media file |
| US10255714B2 (en) * | 2016-08-24 | 2019-04-09 | Disney Enterprises, Inc. | System and method of gaze predictive rendering of a focal area of an animation |
| CN106331823B (en) * | 2016-08-31 | 2019-08-20 | 北京奇艺世纪科技有限公司 | A kind of video broadcasting method and device |
| GB2553353B (en) * | 2016-09-05 | 2021-11-24 | Advanced Risc Mach Ltd | Graphics processing systems and graphics processors |
| KR102719606B1 (en) * | 2016-09-09 | 2024-10-21 | 삼성전자주식회사 | Method, storage medium and electronic device for displaying images |
| CN106485790A (en) * | 2016-09-30 | 2017-03-08 | 珠海市魅族科技有限公司 | Method and device that a kind of picture shows |
| CN106600515A (en) * | 2016-11-07 | 2017-04-26 | 深圳市金立通信设备有限公司 | Virtual-reality low-delay processing method and terminal |
| US10735691B2 (en) * | 2016-11-08 | 2020-08-04 | Rockwell Automation Technologies, Inc. | Virtual reality and augmented reality for industrial automation |
| WO2018093923A1 (en) * | 2016-11-16 | 2018-05-24 | Magic Leap, Inc. | Mixed reality system with reduced power rendering |
| CN106502427B (en) * | 2016-12-15 | 2023-12-01 | 北京国承万通信息科技有限公司 | Virtual reality system and scene presenting method thereof |
| CN106919360B (en) * | 2017-04-18 | 2020-04-14 | 珠海全志科技股份有限公司 | Head posture compensation method and device |
| US10109039B1 (en) * | 2017-04-24 | 2018-10-23 | Intel Corporation | Display engine surface blending and adaptive texel to pixel ratio sample rate system, apparatus and method |
| CN107145235A (en) * | 2017-05-11 | 2017-09-08 | 杭州幻行科技有限公司 | A kind of virtual reality system |
| CN107274472A (en) * | 2017-06-16 | 2017-10-20 | 福州瑞芯微电子股份有限公司 | A kind of method and apparatus of raising VR play frame rate |
| CN107516335A (en) * | 2017-08-14 | 2017-12-26 | 歌尔股份有限公司 | Graphics rendering method and device for virtual reality |
| CN107317987B (en) * | 2017-08-14 | 2020-07-03 | 歌尔股份有限公司 | Display data compression method, device and system for virtual reality |
| CN107562212A (en) * | 2017-10-20 | 2018-01-09 | 网易（杭州）网络有限公司 | Virtual reality scenario anti-fluttering method, device, storage medium and wear display device |
| US10949947B2 (en) * | 2017-12-29 | 2021-03-16 | Intel Corporation | Foveated image rendering for head-mounted display devices |
| CN109032350B (en) * | 2018-07-10 | 2021-06-29 | 深圳市创凯智能股份有限公司 | Vertigo sensation alleviating method, virtual reality device, and computer-readable storage medium |
| CN109242943B (en) * | 2018-08-21 | 2023-03-21 | 腾讯科技（深圳）有限公司 | Image rendering method and device, image processing equipment and storage medium |
| US20200110271A1 (en) * | 2018-10-04 | 2020-04-09 | Board Of Trustees Of Michigan State University | Photosensor Oculography Eye Tracking For Virtual Reality Systems |
| US11199912B2 (en) * | 2018-11-30 | 2021-12-14 | Magic Leap, Inc. | Multi-modal hand location and orientation for avatar movement |
| CN109741463B (en) * | 2019-01-02 | 2022-07-19 | 京东方科技集团股份有限公司 | Rendering method, device and equipment of virtual reality scene |
-
2019
- 2019-01-02 CN CN201910001295.7A patent/CN109741463B/en active Active
- 2019-12-12 US US16/764,401 patent/US11263803B2/en active Active
- 2019-12-12 WO PCT/CN2019/124860 patent/WO2020140720A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| US11263803B2 (en) | 2022-03-01 |
| US20210225064A1 (en) | 2021-07-22 |
| WO2020140720A1 (en) | 2020-07-09 |
| CN109741463A (en) | 2019-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109741463B (en) | Rendering method, device and equipment of virtual reality scene | |
| CN110460831B (en) | Display method, device, equipment and computer readable storage medium | |
| WO2022110903A1 (en) | Method and system for rendering panoramic video | |
| WO2018188499A1 (en) | Image processing method and device, video processing method and device, virtual reality device and storage medium | |
| WO2017092332A1 (en) | Method and device for image rendering processing | |
| CN108921050B (en) | A virtual reality image processing system based on mobile terminal | |
| US11294535B2 (en) | Virtual reality VR interface generation method and apparatus | |
| US11954805B2 (en) | Occlusion of virtual objects in augmented reality by physical objects | |
| CN108259810A (en) | A kind of method of video calling, equipment and computer storage media | |
| US20220237818A1 (en) | Image Processing Method and Apparatus for Electronic Dvice, and Electronic Device | |
| CN109727305A (en) | Virtual reality system picture processing method, device and storage medium | |
| CN106774821B (en) | Display method and system based on virtual reality technology | |
| US20240233088A9 (en) | Video generation method and apparatus, device and medium | |
| US11778155B2 (en) | Image processing apparatus, image processing method, and storage medium | |
| JP2020173529A (en) | Information processing device, information processing method, and program | |
| CN113596569A (en) | Image processing method, apparatus and computer-readable storage medium | |
| CN113206993A (en) | Method for adjusting display screen and display device | |
| CN110728749B (en) | Virtual three-dimensional image display system and method | |
| US11966278B2 (en) | System and method for logging visible errors in a videogame | |
| CN109814703B (en) | Display method, device, equipment and medium | |
| US20230168510A1 (en) | Head-mounted display device, control method, and non-transitory computer readable storage medium | |
| CN111091848B (en) | Method and device for predicting head posture | |
| CN118732259A (en) | Control method, device and system of smart glasses, readable storage medium and terminal | |
| TW202427173A (en) | Immersive content display method, display device and computer readable storage medium | |
| JP2024042545A (en) | Work support system and work support method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |