CN117632063A - Display processing methods, devices, equipment and media based on virtual reality space - Google Patents

Abstract

The embodiment of the disclosure relates to a display processing method, a device, equipment and a medium based on a virtual reality space, wherein the method comprises the following steps: in response to a user's operation to enter a virtual reality space, presenting virtual reality video information within a virtual screen in the virtual reality space; and, a plurality of layers are respectively displayed in a plurality of space position areas in the virtual reality space; wherein, each spatial position area is different from the display distance of the current watching position of the user and is positioned in front of the virtual screen. In the embodiment of the disclosure, the structural display of the related layers of the video between the virtual screen and the current viewing position of the user is realized, the depth information in the virtual reality space is fully utilized through the hierarchical arrangement of the distances between the layers and the current viewing position of the user, the three-dimensional display effect is realized, and the viewing experience of the user is promoted.

Description

Display processing methods, devices, equipment and media based on virtual reality space

Technical field

The present disclosure relates to the field of virtual reality technology, and in particular, to a display processing method, device, equipment and medium based on virtual reality space.

Background technique

Virtual Reality (VR) technology, also known as virtual environment, spiritual environment or artificial environment, refers to the use of computers to generate a virtual environment that directly exerts visual, auditory and tactile sensations on participants and allows them to observe and operate interactively. world technology.

In related technologies, live video can be displayed based on virtual reality technology. In the process of displaying videos, how to make full use of the depth information in the virtual reality space to improve the user's interactive experience is a mainstream demand.

Contents of the invention

In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a display processing method, device, equipment and medium based on virtual reality space, which realizes video correlation between the virtual screen and the user's current viewing position. The structured display of layers makes full use of the depth information in the virtual reality space through the hierarchical setting of the distance between the layer and the user's current viewing position, achieving a three-dimensional display effect and helping to improve the user's viewing experience.

Embodiments of the present disclosure provide a display processing method based on a virtual reality space. The method includes the following steps: in response to a user's operation of entering the virtual reality space, presenting virtual reality video information in a virtual screen in the virtual reality space. ; And, multiple layers are respectively displayed in multiple spatial location areas in the virtual reality space; wherein each of the spatial location areas has a different display distance from the user's current viewing position and is located in front of the virtual screen. Embodiments of the present disclosure also provide a display processing device based on the virtual reality space. The device includes: a display processing module, configured to respond to the user's operation of entering the virtual reality space, within the virtual screen in the virtual reality space. Present virtual reality video information; and display multiple layers respectively in multiple spatial location areas in the virtual reality space; wherein each of the spatial location areas has a different display distance from the user's current viewing position, and is located in the In front of the virtual screen.

An embodiment of the present disclosure also provides an electronic device. The electronic device includes: a processor; a memory used to store instructions executable by the processor; and the processor is used to read the instruction from the memory. The instructions can be executed and executed to implement the display processing method based on the virtual reality space as provided by the embodiments of the present disclosure.

An embodiment of the present disclosure also provides a computer-readable storage medium, the storage medium stores a computer program, and the computer program is used to execute the display processing method based on the virtual reality space as provided by the embodiment of the present disclosure.

Compared with the existing technology, the technical solution provided by the embodiments of the present disclosure has the following advantages:

The display processing solution based on the virtual reality space provided by the embodiment of the present disclosure presents virtual reality video information on the virtual screen in the virtual reality space in response to the user's operation of entering the virtual reality space, and multiple The spatial location areas display multiple layers respectively, wherein each spatial location area is at a different display distance from the user's current viewing position and is located in front of the virtual screen. As a result, the structured display of video-related layers between the virtual screen and the user's current viewing position is realized. Through the hierarchical setting of the distance between the layer and the user's current viewing position, the depth information in the virtual reality space is fully utilized. A three-dimensional display effect is achieved, which helps improve the user's viewing experience.

Description of drawings

The above and other features, advantages, and aspects of various embodiments of the present disclosure will become more apparent with reference to the following detailed description taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It is to be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.

Figure 1 is a schematic diagram of an application scenario of a virtual reality device provided by an embodiment of the present disclosure;

Figure 2 is a schematic flowchart of a display processing method based on virtual reality space provided by an embodiment of the present disclosure;

Figure 3 is a schematic diagram of a display scene based on virtual reality space provided by an embodiment of the present disclosure;

Figure 4 is a schematic diagram of another display scene based on virtual reality space provided by an embodiment of the present disclosure;

Figure 5 is a schematic flowchart of another display processing method based on virtual reality space provided by an embodiment of the present disclosure;

Figure 6 is a schematic diagram of another display scene based on virtual reality space provided by an embodiment of the present disclosure;

Figure 7 is a schematic diagram of another display scene based on virtual reality space provided by an embodiment of the present disclosure;

Figure 8 is a schematic diagram of another display scene based on virtual reality space provided by an embodiment of the present disclosure;

Figure 9 is a schematic diagram of another display scene based on virtual reality space provided by an embodiment of the present disclosure;

Figure 10A is a schematic diagram of another display scene based on virtual reality space provided by an embodiment of the present disclosure;

Figure 10B is a schematic diagram of another display scene based on virtual reality space provided by an embodiment of the present disclosure;

Figure 11 is a schematic diagram of another display scene based on virtual reality space provided by an embodiment of the present disclosure;

Figure 12 is a schematic structural diagram of a display processing device based on virtual reality space provided by an embodiment of the present disclosure;

FIG. 13 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, which rather are provided for A more thorough and complete understanding of this disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that various steps described in the method implementations of the present disclosure may be executed in different orders and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performance of illustrated steps. The scope of the present disclosure is not limited in this regard.

As used herein, the term "include" and its variations are open-ended, ie, "including but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below.

It should be noted that concepts such as “first” and “second” mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units. Or interdependence.

It should be noted that the modifications of "one" and "plurality" mentioned in this disclosure are illustrative and not restrictive. Those skilled in the art will understand that unless the context clearly indicates otherwise, it should be understood as "one or Multiple”.

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not used to limit the scope of these messages or information.

Explain some technical concepts or noun concepts involved in this article:

Virtual reality equipment, a terminal that realizes virtual reality effects, can usually be provided in the form of glasses, helmet-mounted displays (HMD), and contact lenses to achieve visual perception and other forms of perception. Of course, virtual reality equipment realizes The form is not limited to this, and can be further miniaturized or enlarged as needed.

The virtual reality devices recorded in the embodiments of this disclosure may include but are not limited to the following types:

Computer-side virtual reality (PCVR) equipment uses the PC side to perform calculations and data output related to virtual reality functions. The external computer-side virtual reality equipment uses the data output from the PC side to achieve virtual reality effects.

Mobile virtual reality equipment supports setting up a mobile terminal (such as a smartphone) in various ways (such as a head-mounted display with a special card slot), and through a wired or wireless connection with the mobile terminal, the mobile terminal performs virtual reality Function-related calculations and output data to mobile virtual reality devices, such as viewing virtual reality video information through an APP on a mobile terminal.

The all-in-one virtual reality device has a processor for performing calculations related to virtual functions, so it has independent virtual reality input and output functions. It does not need to be connected to a PC or mobile terminal, and has a high degree of freedom in use.

Virtual reality objects, objects that interact in a virtual scene, are controlled by users or robot programs (for example, robot programs based on artificial intelligence), and can be still, move, and perform various behaviors in the virtual scene, such as in live broadcast scenarios. The virtual person corresponding to the user.

As shown in Figure 1, HMDs are relatively lightweight, ergonomically comfortable, and provide high-resolution content with low latency. The virtual reality device is equipped with a posture detection sensor (such as a nine-axis sensor), which is used to detect posture changes of the virtual reality device in real time. If the user wears a virtual reality device, when the user's head posture changes, the head posture will be changed. The real-time posture is passed to the processor to calculate the gaze point of the user's line of sight in the virtual environment. Based on the gaze point, the image in the three-dimensional model of the virtual environment within the user's gaze range (i.e., the virtual field of view) is calculated and displayed on the display screen. display, giving people an immersive experience as if they were watching in a real environment.

In this embodiment, when the user wears the HMD device and opens a predetermined application, such as a live video application, the HMD device will run a corresponding virtual scene. The virtual scene can be a simulation environment of the real world or a semi-real-world simulation environment. Simulate a semi-fictional virtual scene or a purely fictitious virtual scene. The virtual scene may be any one of a two-dimensional virtual scene, a 2.5-dimensional virtual scene, or a three-dimensional virtual scene. The embodiments of this application do not limit the dimensions of the virtual scene. For example, the virtual scene can include people, sky, land, ocean, etc. The land can include environmental elements such as deserts and cities. Users can control virtual objects to move in the virtual scene, and can also control devices through handle devices, bare hands, etc. Use gestures and other methods to interactively control controls, models, display content, characters, etc. in the virtual scene.

In order to make full use of the depth information in the virtual reality space and improve the user's interactive experience when watching videos, embodiments of the present disclosure provide a display processing method based on the virtual reality space. This method is introduced below with reference to specific embodiments.

Figure 2 is a schematic flowchart of a display processing method based on virtual reality space provided by an embodiment of the present disclosure. The method can be executed by a display processing device based on virtual reality space, where the device can be implemented using software and/or hardware. Generally, Can be integrated into electronic equipment. As shown in Figure 2, the method includes the following steps:

Step 201: In response to the user's operation of entering the virtual reality space, virtual reality video information is presented on the virtual screen in the virtual reality space; and, multiple layers are displayed in multiple spatial location areas in the virtual reality space;

Each spatial location area has a different display distance from the user's current viewing position and is located in front of the virtual screen.

In the real world, when a live video stream is played, various information is displayed on the video interface. For example, barrage information, gift information, etc. may be displayed. In one embodiment of the present disclosure, depth information in the virtual reality space is fully utilized, and different information is split and displayed in different layers according to scene requirements to achieve a hierarchical display effect.

In some possible embodiments, the user's operation of entering the virtual reality space is obtained, where the operation may be detecting the user's switch operation of turning on the virtual display device, etc., and further, in response to the user's operation of entering the virtual reality space, in the virtual reality Virtual reality video information is presented in a virtual screen in the space, where the virtual screen corresponds to a canvas pre-built in the virtual scene to display relevant videos, and virtual reality video information is presented in the virtual screen, for example, a live video is presented in the virtual screen Or online concert videos, etc.

In this embodiment, multiple layers are displayed in multiple spatial location areas in the virtual reality space. The spatial location areas corresponding to each layer are at different display distances from the user's current viewing position and are located in front of the virtual screen. That is, multiple layers are displayed staggered between the user's current viewing position and the virtual screen to display different layer information, visually presenting a three-dimensional sense of layer information display. Among them, using this hierarchical structure of layers can Display some layer information that requires high user attention in the scene in a spatial location area that is closer to the display distance, and display some other layer information that does not require high user attention in a space that is farther from the display distance. In the location area, the depth information in the virtual reality space is fully utilized to achieve "enhanced display" and "weakened display" of layer messages in the display dimension, improving the user's viewing experience.

It should be noted that the vertical coordinate values on the vertical axis between the various spatial location areas corresponding to the above-mentioned multiple layers are different to achieve the user's visual "far and near" staggered display. In addition, in order to avoid display occlusion between layers , the coordinate values corresponding to the horizontal coordinate values of each spatial location area may not be exactly the same (that is, the front and rear layers contain layer parts that do not overlap in the X-axis direction), that is, there are many "staggered" arrangements in the horizontal direction. layers, or the coordinate values corresponding to the vertical coordinate values of each spatial location area may not be exactly the same (that is, the front and rear layers contain layer parts that do not overlap in the Y-axis direction), that is, in the vertical Arrange multiple layers "staggered" in the direction, or you can also arrange multiple layers "staggered" in the horizontal and vertical directions at the same time, etc.

For example, as shown in Figure 3, when the application scenario is the playback scenario of a live video stream, in front of the currently played virtual video frame are the spatial position display areas of the corresponding layers, and the distance between different layers is The display distance of the current viewing position is different. When the user watches in the virtual reality space, the layer with a closer display distance is obviously closer to the user's eyes, and the user is more likely to notice. For example, using this hierarchical structure relationship to combine some operations The interface type layer is set closest to the user's eyes, which obviously makes the user's operations more convenient.

Continuing to refer to Figure 3, in order to avoid front and rear occlusion between layers, the horizontal coordinate values of the spatial location areas corresponding to multiple layers are not exactly the same, and the vertical coordinate values of the spatial location areas corresponding to multiple layers are not exactly the same. Not exactly the same, so, as shown in Figure 4, the viewing user can see layer messages on multiple layers in front of the virtual screen.

It should be emphasized that this hierarchical structure between layers only has different attention sensitivities to different layers for the viewing user. Continuing to refer to Figure 4, the viewing user cannot intuitively see the difference. The hierarchical structure relationship between the target display positions of the layers can only feel the distance of the content between different layers. Since users tend to focus on information closer to themselves, therefore, the layer closest to the user is improved. attention to information.

The following describes with reference to the embodiment, in some possible examples, how to display multiple layers in the virtual reality space. As shown in Figure 5, multiple layers are displayed in multiple spatial location areas in the virtual reality space, including :

Step 501: Obtain the layer types of multiple layers corresponding to the virtual reality video information.

Among them, virtual reality video information is a video stream displayed in a virtual scene in a virtual reality space, including but not limited to live video streams, concert video streams, etc.

In one embodiment of the present disclosure, layer types of multiple layers corresponding to virtual reality video information are obtained, where the layer types can be calibrated according to the scene, including but not limited to operation user interface layers, information flow display diagrams layer, gift display layer, expression display layer, etc., wherein each layer type can include at least one sub-layer, etc., for example, the operation user interface layer can include a control board layer, etc., I won’t list them all here.

Step 502: Determine multiple spatial location areas of multiple layers in the virtual reality space according to the layer type.

In one embodiment of the present disclosure, multiple spatial location areas of multiple layers in the virtual reality space are determined according to the layer type. Each spatial location area has a different display distance from the user's current viewing position. Therefore, visually, Different layer types are at different distances from the user. Usually, users notice the content on the layer that is closer to them first. Therefore, according to the needs of the scene, the hierarchical structure between the above layers can be used to display unnecessary information to enhance the user experience. viewing experience.

In some possible embodiments, the display vector of the layer can be adjusted according to the change information of the user's sight direction, so that the relevant information on the layer is always displayed to the user. Among them, the user's sight change information includes the change direction and change angle of the user's perspective, etc.

For example, as shown in Figure 6, when it is detected that the user's sight direction changes from S1 to S2, multiple layers A, B, and C are controlled to rotate from the direction of the front S1 to the direction of the front S2, thereby , realizing the line-of-sight following effect in the display space position area of the layer.

Step 503: Display the layer message in the corresponding layer according to the spatial location area.

In one embodiment of the present disclosure, after the spatial location area is determined, the layer messages in the corresponding layer are displayed according to the spatial location area. That is, during the actual display process, as shown in Figure 7, the layer messages in the corresponding layer are displayed according to the spatial location area. The area displays layer messages on different layers, that is, the layer messages are displayed on the spatial location area of the corresponding layer, and there is no need to render the corresponding layer (only two images are shown in the figure) display of layer messages), thereby reducing occlusion between layers and improving the viewing experience. Among them, as mentioned above, in order to further avoid front and rear occlusion between layers, the display positions of layer messages of different layers can be "staggered", or the spatial location areas of different layers can be "staggered" as much as possible. "Stagger" to reduce the overlap between the front and rear layers, etc.

It should be noted that when displaying layer messages in the corresponding layer according to the spatial location area, you only need to ensure that the corresponding layer message is displayed in the corresponding spatial location area. There are no restrictions on the display method and display content. , which can be calibrated according to scene needs.

In some possible embodiments, in response to obtaining the first layer message of the preset first type, the first layer message of the first type may be considered as a message that can be displayed in real time, such as a message sent to the user. "Gift message", etc., after obtaining the first layer message, determine the first layer corresponding to the first layer message.

For example, the first display level of the first layer message can be determined according to the evaluation index set by the scene, the second display level of each layer that can display the preset first type message can be obtained, and the first display level matching the first display level can be determined. The layer corresponding to the second level is the first layer, etc. Of course, in other optional methods, other methods can also be used to determine the first layer, which are not listed here.

Further, the first layer message is displayed in the spatial position area corresponding to the first layer, thereby fully utilizing the depth information in the virtual reality space to determine the display position of different layer messages.

Among them, the specific display position of the first layer message in the spatial location area corresponding to the first layer can be random, or can be set according to the needs of the relevant scene.

In some possible embodiments, in response to obtaining a preset second type of second layer message, the second type of second layer message may be a layer message that cannot be displayed in real time, for example, in a live broadcast scene Since multiple users may send gift messages at the same time, in order to enhance the atmosphere of the live broadcast room and allow users to intuitively see the second layer messages they send, gift messages are usually sent in the form of a message queue. It is shown that this kind of gift message can be regarded as a second type of second layer message.

In this embodiment, the second layer message is added to the layer message queue of the second layer corresponding to the second layer message, where the layer messages in the layer queue are in the first layer in the order in the message queue. The spatial location area of the second layer is displayed.

In this embodiment, the layer messages in the message queue can be further divided into layer message subtypes, and the display subregion corresponding to each layer message subtype is determined in the spatial location area of the second layer, thereby, When displaying the layer message in the layer message queue of the second layer, according to the layer message subtype of the layer message, the corresponding layer message is displayed in the corresponding display sub-area in the spatial location area of the second layer. . That is, layer messages under the same layer type can share a spatial location area to avoid a complex hierarchical structure that affects the user's viewing experience.

For example, when the second layer message is a gift message and the second layer is layer A, as shown in Figure 8, the gift message can be divided into a half-screen gift message subtype and a full-screen message subtype, where, The display sub-area corresponding to the half-screen gift message subtype is the left half of X, and the display sub-area corresponding to the full-screen gift message subtype is the entirety of When the gift message is a, the display position of a is determined on the left half of X. When it is obtained that the gift message to be displayed in the current message queue is a full-screen gift message b, the display position of b is determined on X.

In summary, the display processing method based on the virtual reality space according to the embodiment of the present disclosure presents virtual reality video information on the virtual screen in the virtual reality space in response to the user's operation of entering the virtual reality space, and multiple objects in the virtual reality space Each spatial location area displays multiple layers respectively, wherein each spatial location area has a different display distance from the user's current viewing position and is located in front of the virtual screen. As a result, the structured display of video-related layers between the virtual screen and the user's current viewing position is realized. Through the hierarchical setting of the distance between the layer and the user's current viewing position, the depth information in the virtual reality space is fully utilized. A three-dimensional display effect is achieved, which helps improve the user's viewing experience.

Based on the above embodiments, in order to make full use of the depth information in the virtual display space, the layer priority of each layer can also be determined based on the needs of the scene, and the spatial location areas of different layers can be determined based on the priority. Indicators such as the importance of the message will divide the layer messages into different layers for display based on the degree to which the user's attention is required, further improving the user's viewing experience.

In one embodiment of the present disclosure, determining multiple spatial location areas of multiple layers in the virtual reality space according to the layer type includes: determining priority information of multiple layers according to the multiple layer types, and further, Determine multiple spatial location areas of multiple layers in the virtual reality space based on priority information.

Among them, the higher the priority information, the more the layer messages displayed in the corresponding layer need to attract the user's attention. Therefore, the distance between the corresponding target space area and the user's viewing position is closer. The priority information corresponding to the layer type can be calibrated according to the needs of the scene. The same layer type may have different priority information in different scenes.

For example, when the application scene is a live broadcast scene in the virtual reality space, as shown in Figure 9, if there are multiple layers, the corresponding layer types include: operation user interface layer (including control board layer), information flow diagram Layers (including public screen layers (used to display comment information, etc.)), gift display layers (including tray layers (used to display tray gifts), host-guest gift layers (the picture shows half-screen gift layers and full-screen Gift layer, used to display full-screen gifts or half-screen gifts sent by any user watching the current live video, etc.), guest gift layer (used to display flying gifts sent by other viewing users, etc., including the main state emission map Layer (used to display related gifts emitted by the currently viewing user, etc.), expression display layer (including main state emitting layer (used to display related emoticons emitted by the currently viewing user, etc.)), guest emoticon layer type (used for To display expressions sent by other viewing users, etc.)), the priority information of multiple layer types in the picture is control layer = public screen layer > main emission layer > tray layer > full screen gift layer = half Screen gift layer > guest gift layer > guest expression layer, multiple spatial location areas corresponding to multiple layers are at different display distances from the viewing user. The higher the priority layer type, the closer the spatial location area is. Viewing user, therefore, since the control layer is closest to the current viewing user, it is convenient for the user to perform interactive operations, and the main emission layer is also closer to the current viewing user. Therefore, it is convenient for the current viewing user to be the first to notice the relevant information sent by him/her. information.

It should be noted that during actual execution, in different application scenarios, the methods of determining multiple spatial location areas of multiple layers in the virtual reality space are different based on priority information. Examples are as follows:

In some possible embodiments, considering that the virtual video in the virtual scene is relatively fixedly displayed in the virtual scene, the spatial position area of the corresponding layer is also relatively fixedly set, and different priorities are stored in the preset database. The spatial location area corresponding to the information, thereby querying the preset database according to the priority information to obtain multiple spatial location areas corresponding to multiple layers.

In some possible embodiments, considering that the corresponding layer is set in front of the video display position, in this embodiment, the video display position of the virtual reality video information in the virtual reality space is determined, and the video display position can be It is determined based on the position of the canvas that has been built to display the video (that is, the position of the virtual screen), and then, starting from the video display position, based on the preset distance interval and priority information, in order from low to high, in the direction closer to the user's current viewing position. , determine the spatial location area of each layer one by one to determine multiple spatial location areas of multiple layers. Among them, the preset distance interval can be calibrated based on experimental data.

In this embodiment, as shown in Figure 10A, if it is determined that the video display position of the virtual reality video information in the virtual reality space is P0, the preset distance interval is J1, and multiple layers are arranged in order from high to low according to the priority information The order is L1, L2, L3, L4 respectively. Then in the direction close to the user's current viewing position, determine the spatial location of L4. The area is located at J1 before P0. P1. In the direction close to the user's current viewing position, determine the spatial location of L3. The area is located at J1 before P1 and P2, in the direction closer to the user's current viewing position, determines that the spatial location area of L2 is located at J1 before P2, P3, in the direction close to the user's current viewing position, determines that the spatial location area of L1 is in front of P3 J1 at P4.

In some possible embodiments, considering the setting of the video display position of the corresponding layer and the user's line of sight direction of the viewing user, in this embodiment, the target layer corresponding to the highest priority is determined according to the priority information, and the target is determined The spatial location area of the layer in the virtual reality space. The way to determine the spatial location area of the target layer in the virtual reality space is different in different application scenarios. In some possible implementations, the distance between the user and the target layer can be determined in different application scenarios. The preset distance threshold between the line of sight direction and the user's current viewing position is the spatial location area; in some possible implementations, the total distance between the user's current viewing position and the video display position of the virtual reality video information in the virtual reality space can be determined. , taking the video display position as the starting point, the preset proportion threshold of the total distance is determined as the spatial position area, thereby preventing the displayed layer from being too close to the viewing user, resulting in limited information within the user's viewing angle.

Further, after determining the spatial location area of the target layer, taking the spatial location area as the starting point, and in order from high to low according to the preset distance interval and priority information, determine each other one by one in the direction away from the user's current viewing position. The spatial location area of a layer to determine multiple spatial location areas of multiple layers. The preset distance interval may be the same as the preset distance interval in the above embodiment, or may be different, and may be set according to scene requirements.

For example, in this embodiment, as shown in Figure 10B, the preset distance interval is J2, the multiple layers are L1, L2, L3, and L4 in order of priority information from high to low, and the target layer is L1, then determine the user's current viewing position as D, then determine the distance D to J3 in the direction away from the user's current viewing position as the spatial location area of L1, and determine the spatial location of L2 in the direction away from the user's current viewing position. The area is located at J2 before Z1. Z2, in the direction away from the user's current viewing position, determines that the spatial location area of L3 is located at J2 before Z2. Z3, in the direction away from the user's current viewing position, determines that the spatial location area of L4 is in front of Z3. J2 at Z4.

It should be noted that the location range corresponding to the spatial location area mentioned in the above embodiment can be determined according to the shape of the spatial location area, etc. The spatial location area corresponding to the same layer can be continuous, or it can be as shown in the above figure. 9 is divided into multiple modules. In some possible embodiments, considering the spatial characteristics of the virtual reality space, as shown in Figure 11, each layer is an arc-shaped area (non-shaded area in the figure) , the arc-shaped area is located within the viewing angle range of the viewing user, the spatial position area corresponding to each layer is located on the corresponding arc-shaped area (two layers are shown in the figure), and the circle corresponding to each layer The center position of the arc-shaped area is located in the direction of the user's line of sight corresponding to the user's current viewing position, so that the viewing user has a stronger three-dimensional viewing experience.

In summary, the display processing method based on the virtual reality space of the embodiment of the present disclosure determines the spatial location area of the layer based on the priority information of the layer. The spatial location area of different layers has different display distances from the user's current viewing position. Through structured layer settings, the hierarchical display of different layer information is satisfied, the depth information in the virtual reality space is fully utilized, and a three-dimensional display effect is achieved.

In order to implement the above embodiments, the present disclosure also proposes a display processing device based on virtual reality space.

Figure 12 is a schematic structural diagram of a display processing device based on virtual reality space provided by an embodiment of the present disclosure. The device can be implemented by software and/or hardware, and generally can be integrated in an electronic device to perform display processing based on virtual reality space. As shown in Figure 12, the device includes: a display processing module 1210, wherein,

The display processing module 1210 is configured to present virtual reality video information on a virtual screen in the virtual reality space in response to the user's operation of entering the virtual reality space; and to display multiple images in multiple spatial location areas in the virtual reality space. layer;

Each spatial location area has a different display distance from the user's current viewing position and is located in front of the virtual screen.

The virtual reality space-based display processing device provided by the embodiments of the present disclosure can execute the virtual reality space-based display processing method provided by any embodiment of the present disclosure, and has corresponding functional modules and beneficial effects of the execution method. Its implementation principles are similar. I won’t go into details here.

In order to implement the above embodiments, the present disclosure also proposes a computer program product, which includes a computer program/instructions. When the computer program/instructions are executed by a processor, the display processing method based on the virtual reality space in the above embodiments is implemented.

FIG. 13 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.

Referring specifically to FIG. 13 below, a schematic structural diagram of an electronic device 1300 suitable for implementing an embodiment of the present disclosure is shown. The electronic device 1300 in the embodiment of the present disclosure may include, but is not limited to, mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals ( Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG. 13 is only an example and should not bring any limitations to the functions and scope of use of the embodiments of the present disclosure.

As shown in Figure 13, the electronic device 1300 may include a processor (eg, central processing unit, graphics processor, etc.) 1301, which may be loaded into a random access memory according to a program stored in a read-only memory (ROM) 1302 or from a memory 1308 (RAM) 1303 to perform various appropriate actions and processes. In the RAM 1303, various programs and data required for the operation of the electronic device 1300 are also stored. The processor 1301, ROM 1302, and RAM 1303 are connected to each other through a bus 1304. An input/output (I/O) interface 1305 is also connected to bus 1304.

Generally, the following devices may be connected to the I/O interface 1305: input devices 1306 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speaker, vibration An output device 1307 such as a computer; a memory 1308 including a magnetic tape, a hard disk, etc.; and a communication device 1309. The communication device 1309 may allow the electronic device 1300 to communicate wirelessly or wiredly with other devices to exchange data. Although FIG. 13 illustrates electronic device 1300 with various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network via communication device 1309, or from memory 1308, or from ROM 1302. When the computer program is executed by the processor 1301, the above functions defined in the virtual reality space-based display processing method of the embodiment of the present disclosure are performed.

It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmed read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and server can communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. (e.g., communications network) interconnection. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or developed in the future network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.

The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: responds to the user's operation of entering the virtual reality space, and displays the virtual screen in the virtual reality space. Virtual reality video information is presented in the virtual reality space, and multiple layers are displayed in multiple spatial location areas in the virtual reality space. Each spatial location area has a different display distance from the user's current viewing position and is located in front of the virtual screen. Video information refers to virtual reality video information. As a result, the structured display of video-related layers between the virtual screen and the user's current viewing position is realized. Through the hierarchical setting of the distance between the layer and the user's current viewing position, the depth information in the virtual reality space is fully utilized. A three-dimensional display effect is achieved, which helps improve the user's viewing experience.

The electronic device may have computer program code for performing operations of the present disclosure written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, or a combination thereof. , also includes conventional procedural programming languages—such as "C" or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In situations involving remote computers, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider through Internet connection).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.

The units involved in the embodiments of the present disclosure can be implemented in software or hardware. Among them, the name of a unit does not constitute a limitation on the unit itself under certain circumstances.

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), Complex Programmable Logical device (CPLD) and so on.

In the context of this disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, laptop disks, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

The above description is only a description of the preferred embodiments of the present disclosure and the technical principles applied. Those skilled in the art should understand that the disclosure scope involved in the present disclosure is not limited to technical solutions composed of specific combinations of the above technical features, but should also cover solutions composed of the above technical features or without departing from the above disclosed concept. Other technical solutions formed by any combination of equivalent features. For example, a technical solution is formed by replacing the above features with technical features with similar functions disclosed in this disclosure (but not limited to).

Furthermore, although operations are depicted in a specific order, this should not be understood as requiring that these operations be performed in the specific order shown or performed in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims (14)

1. A display processing method based on virtual reality space, characterized by including the following steps: In response to the user's operation of entering the virtual reality space, virtual reality video information is presented in the virtual screen in the virtual reality space; and, multiple layers are respectively displayed in multiple spatial location areas in the virtual reality space; Each of the spatial location areas has a different display distance from the user's current viewing position and is located in front of the virtual screen. 2. The method of claim 1, wherein the multiple spatial location areas in the virtual reality space respectively display multiple layers, including: Obtain the layer types of multiple layers corresponding to the virtual reality video information; Determine multiple spatial location areas of the multiple layers in the virtual reality space according to the layer type; The layer messages in the corresponding layer are displayed according to the spatial location area. 3. The method of claim 2, wherein determining multiple spatial location areas of the multiple layers in the virtual reality space according to the layer type includes: Determine priority information of the plurality of layers according to the layer type; Multiple spatial location areas of the multiple layers in the virtual reality space are determined according to the priority information. 4. The method of claim 3, wherein determining the plurality of spatial location areas of the plurality of layers in the virtual reality space according to priority information includes: Determine the video display position of the virtual reality video information in the virtual reality space; Taking the video display position as the starting point, determine the spatial location area of each layer one by one in a direction close to the user's current viewing position according to the preset distance interval and the priority information in order from low to high, To determine multiple spatial location areas of the multiple layers. 5. The method of claim 3, wherein determining the plurality of spatial location areas of the plurality of layers in the virtual reality space according to priority information includes: Determine the target layer corresponding to the highest priority based on the priority information; Determine the spatial location area of the target layer in the virtual reality space; Taking the spatial location area as the starting point, determine the spatial location area of each other layer one by one in the direction away from the user's current viewing position according to the preset distance interval and the priority information in order from high to low. to determine multiple spatial location areas of the multiple layers. 6. The method of claim 3, wherein determining multiple spatial location areas of the multiple layers in the virtual reality space according to priority information includes: Query a preset database according to the priority information to obtain multiple spatial location areas corresponding to the multiple layers. 7. The method according to any one of claims 1-6, characterized in that, The spatial location area corresponding to each layer is located on the corresponding arc-shaped area, where, The center position of the arc-shaped area corresponding to each layer is located in the user's line of sight direction corresponding to the user's current viewing position. 8. The method according to any one of claims 1-6, characterized in that, The vertical coordinate values of each of the spatial location areas are different; and the horizontal coordinate values of each of the spatial location areas are not exactly the same, and/or the vertical coordinate values of each of the spatial location areas are not exactly the same. 9. The method according to any one of claims 2 to 6, characterized in that the layer types corresponding to the plurality of layers include: Operate multiple of the user interface layer, information flow display layer, gift display layer, and expression display layer. 10. The method of claim 2, wherein the display processing of layer messages in the corresponding layer according to the spatial location area includes: In response to obtaining the first layer message of the preset first type, determine the first layer corresponding to the first layer message; The first layer message is displayed in a spatial location area of the first layer. 11. The method of claim 10, wherein the display processing of layer messages in the corresponding layer according to the spatial location area includes: In response to obtaining the second layer message of the preset second type, adding the second layer message to the layer message queue of the second layer corresponding to the second layer message, In order to display the corresponding layer message in the spatial location area of the second layer according to the queue order in the layer message queue. 12. A display processing device based on virtual reality space, characterized by including: A display processing module configured to present virtual reality video information on a virtual screen in the virtual reality space in response to the user's operation of entering the virtual reality space; and, display the virtual reality video information in multiple spatial location areas in the virtual reality space respectively. multiple layers; Each of the spatial location areas has a different display distance from the user's current viewing position and is located in front of the virtual screen. 13. An electronic device, characterized in that the electronic device includes: processor; memory for storing instructions executable by the processor; The processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the display processing method based on the virtual reality space according to any one of the above claims 1-11. 14. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and the computer program is used to execute the virtual reality space-based virtual reality space described in any one of claims 1-11. Show processing method.