CN110427227A - Generation method, device, electronic equipment and the storage medium of virtual scene - Google Patents

Abstract

The embodiment of the present application discloses a method, device, electronic equipment and storage medium for generating a virtual scene. The method for generating a virtual scene includes: acquiring participation data of one or more terminal devices in a remote session; according to the participation data, arranging the virtual objects corresponding to each terminal device in the virtual session scene; As a result of position arrangement, the position of each virtual object in the virtual session scene is obtained; based on the position of the virtual object, a virtual session scene including the virtual object is generated. This method can generate a virtual session scene of a remote session, and improve the effect of the remote session.

Description

Method, device, electronic device and storage medium for generating virtual scene

technical field

The present application relates to the field of display technology, and more specifically, to a method, device, electronic device, and storage medium for generating a virtual scene.

Background technique

In recent years, with the rapid development of network technology and technology, more and more people use electronic devices for remote conversations (such as chatting, meetings, etc.). In a common remote conversation, the voice input by the user and the image collected by the camera are transmitted, but it is difficult to give the user the feeling of being there, resulting in poor conversation effect.

Contents of the invention

The embodiment of the present application proposes a method, device, system, terminal device and storage medium for generating a virtual scene, which can improve the effect of a remote session.

In the first aspect, the embodiment of the present application provides a method for generating a virtual scene, the method comprising: obtaining participation data of one or more terminal devices in a remote session; Arranging the positions of the corresponding virtual objects in the virtual conversation scene; obtaining the position of each virtual object in the virtual conversation scene according to the result of the position arrangement; based on the positions of the virtual objects, generating the virtual Object's virtual session scene.

In the second aspect, the embodiment of the present application provides a device for generating a virtual meeting scene, the device includes: a data acquisition module, a position arrangement module, a position acquisition module, and a scene generation module, wherein the data acquisition module is used for Acquiring the participation data of one or more terminal devices in the remote session; the position arrangement module is used to arrange the positions in the virtual session scene for the virtual objects corresponding to each of the terminal devices according to the participation data; The position obtaining module is used to obtain the position of each of the virtual objects in the virtual session scene according to the result of the position arrangement; the scene generation module is used to generate the virtual session scenarios.

In a third aspect, the embodiment of the present application provides an electronic device, one or more processors; memory; one or more application programs, wherein the one or more application programs are stored in the memory and configured To be executed by the one or more processors, the one or more programs are configured to execute the method for generating a virtual scene provided in the first aspect above.

In the fourth aspect, the embodiment of the present application provides a computer-readable storage medium, where program code is stored in the computer-readable storage medium, and the program code can be invoked by a processor to execute the virtual How the scene is generated.

The solution provided by this application obtains the participation data of one or more terminal devices in the remote session, and according to the participation data, arranges the positions of the virtual objects corresponding to each terminal device in the virtual session scene, and arranges the results according to the positions. The position of each virtual object in the virtual session scene is obtained, and based on the position of the virtual object, a virtual session scene including the virtual object is generated. Therefore, according to the participation data of the user's terminal equipment, the positions of the virtual objects of the terminal equipment participating in the remote session can be arranged, so that the virtual objects can be added to the corresponding positions in the remote session scene, and a virtual session scene for display can be obtained. Give users a more realistic feeling and improve the effect of remote sessions.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

Fig. 1 shows a schematic diagram of an application scenario applicable to this embodiment of the present application.

FIG. 2 shows another schematic diagram of an application scenario applicable to the embodiment of the present application.

Fig. 3 shows a flowchart of a method for generating a virtual scene according to an embodiment of the present application.

Fig. 4 shows a schematic diagram of a display effect provided according to an embodiment of the present application.

Fig. 5 shows a flowchart of a method for generating a virtual scene according to another embodiment of the present application.

Fig. 6 shows a flow chart of step S220 in the method for generating a virtual scene according to another embodiment of the present application.

Fig. 7 shows a schematic diagram of a display effect provided according to an embodiment of the present application.

Fig. 8 shows a schematic diagram of another display effect provided according to an embodiment of the present application.

Fig. 9 shows a flowchart of a method for generating a virtual scene according to yet another embodiment of the present application.

Fig. 10 shows a schematic diagram of a display effect provided according to an embodiment of the present application.

Fig. 11 shows a flowchart of a method for generating a virtual scene according to yet another embodiment of the present application.

FIG. 12 shows a structural block diagram of a device for generating a virtual scene provided by an embodiment of the present application.

Fig. 13 is a block diagram of a terminal device for executing the method for generating a virtual scene according to the embodiment of the present application according to the embodiment of the present application.

Fig. 14 is a block diagram of a server for executing the method for generating a virtual scene according to the embodiment of the present application according to the embodiment of the present application.

Fig. 15 is a storage unit for saving or carrying program codes for implementing the method for generating a virtual scene according to the embodiment of the present application.

Detailed ways

In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

The application scenarios of the method for generating a virtual scene provided by the embodiment of the present application are introduced below.

Please refer to FIG. 1 , which shows a schematic diagram of an application scenario of the method for generating a virtual scene provided by an embodiment of the present application. The application scenario includes an interaction system 10 that can be applied to a remote session. The interactive system 10 includes: a plurality of terminal devices 100 and a server 200 , wherein the terminal devices 100 are connected to the server 200 .

In some implementation manners, the terminal device 100 is communicatively connected to the server 200 through a network, so that data interaction between the terminal device 100 and the server 200 can be performed. Wherein, the terminal device 100 can communicate with the server 200 through the network where the router is located by accessing the network where the router is located. Of course, the terminal device 100 can also communicate with the server 200 through the data network.

In some implementation manners, the terminal device 100 may be a head-mounted display device, or a mobile device such as a mobile phone or a tablet. When the terminal device 100 is a head-mounted display device, the head-mounted display device may be an integrated head-mounted display device. The terminal device 100 can also be an intelligent terminal such as a mobile phone connected to an external/accessible head-mounted display device, that is, the terminal device 100 can be used as a processing and storage device of the head-mounted display device, and can be plugged into or connected to the external head-mounted display device , to display the virtual content on the head-mounted display device. In the remote session, the terminal device 100 can be used to display the virtual session scene of the remote session, and realize AR (Augmented Reality, augmented reality technology) display or VR (Virtual Reality, virtual reality technology) display of the scene picture of the virtual session scene , to improve the display effect of the scene screen in the remote session. In other implementation manners, the terminal device 100 may also be a display device such as a computer, a tablet computer, and a television, and the terminal device 100 may display a 2D (2Dimensions, two-dimensional) picture corresponding to a virtual conversation scene.

In some implementations, the terminal device 100 may collect information data in the remote session (for example, collect user's face information, voice data, etc.), so as to build a three-dimensional model based on the information data. In other embodiments, the terminal device 100 may also perform modeling based on pre-stored information data such as facial information, voice data, and body models, or may perform modeling in combination with pre-stored information data and collected information data. For example, the terminal device 100 can collect face information in real time to establish a face model, wherein the face information can include expression information and morphological action information (such as tilting the head, nodding, etc.), and then compare the face model with the preset body Models are integrated to save modeling and rendering time, and at the same time, users' facial expressions and morphological actions can be obtained in real time. In some implementation manners, the terminal device 100 may transmit the collected information data to the server 200 or other terminal devices 100 .

In some implementations, referring to FIG. 2, the interactive system 100 may also include an information collection device 300, which is used to collect the above-mentioned information data (for example, collect user's face information, voice data, etc.), and The collected information data is transmitted to the terminal device 100 or the server 200 . In some implementations, the information collection device 300 may include a camera, an audio module, etc., and may also include various sensors such as a light sensor and an acoustic sensor. As a specific implementation manner, the information collection device 300 may be a shooting device (such as an RGB-D depth camera) with functions of a common color camera (RGB) and a depth camera (Depth), so as to obtain the depth data of the captured user, Thus, the three-dimensional structure corresponding to the user is obtained. In a specific implementation manner, the information collection device 300 and the terminal device 100 may be in the same on-site environment in order to collect the information of the user corresponding to the terminal device 100, and the information collection device 300 and the terminal device 100 may or may not be connected. , is not limited here.

In some implementation manners, the above server 200 may be a local server or a cloud server, and the specific type of the server 200 may not be limited in this embodiment of the present application. In a remote session, the server 200 can be used to realize data interaction between multiple terminal devices 100/information collection devices 300, thereby ensuring data transmission and synchronization between multiple terminal devices 100/information collection devices 300, and realizing Virtual conversation scene, synchronization of audio and video data, data transmission between terminal device 100/information collection device 300, etc.

In some implementations, when there are at least two terminal devices 100 in the same on-site environment (for example, in the same room) among the multiple terminal devices 100 in the remote session, between the at least two terminal devices 100 in the same on-site environment It can also be connected by communication methods such as Bluetooth, WiFi (Wireless-Fidelity, wireless fidelity), ZigBee (Zifeng technology), or by wired communication methods such as data lines, so as to realize at least two terminal devices in the same site environment Interaction of data between 100. Of course, the connection manner between at least two terminal devices 100 in the same field environment may not be limited in this embodiment of the present application.

A specific method for generating a virtual scene will be introduced in the embodiments below with reference to the accompanying drawings.

Referring to Fig. 3, the embodiment of the present application provides a method for generating a virtual scene, the method for generating the virtual scene may include:

Step S110: Obtain the participation data of one or more terminal devices in the remote session.

A remote session refers to the process of remote interaction and communication between multiple terminals established through data communication. The participation data may be data acquired by the terminal device for participating in the remote session when the terminal device participates in the remote session. Each terminal device participating in the remote session can send the participation data to the server, so that the server constructs a virtual session scene according to the participation data of each terminal device in the remote session. Participation data may include one or more of the terminal device's corresponding user's identity information, the time when the terminal device joined the remote session, the spatial position of the terminal device in the real scene, the posture of the terminal device, and the location of the terminal device . Wherein, the user's identity information may include the user's name, serial number, job title, gender, and the like. The specific participation data may not be limited in this embodiment of the application. For example, the participation data may also include the device ID (IDentity, identification number) of the terminal device, the social relationship between users, the role of the user in the remote session, and the like.

In some implementation manners, the terminal device may collect the participation data, and then send the participation data to the server. In some other implementation manners, the participation data may also be collected by an on-site information collection device, and then the information collection device sends the participation data to the server.

In some implementations, the server (or any terminal device in the remote session) may obtain the participation data of the terminal devices participating in the remote session, so as to generate a virtual session scene according to the participation data of each terminal device participating in the session.

Step S120: According to the participation data, arrange the virtual objects corresponding to each terminal device in the virtual session scene.

In the embodiment of the present application, after the server obtains the participation data of the terminal devices in the remote session, it can arrange the position of each virtual object in the virtual session scene corresponding to the remote session according to the participation data. Wherein, the virtual object is a virtual object corresponding to each terminal device. The virtual session scene is a 3D (3Dimensions, three-dimensional) scene in the virtual space. The virtual session scene may include at least virtual objects, and the positions of each virtual object in the virtual session scene may be fixed relative to the world coordinate origin in the virtual space. Certainly, the specific content in the virtual conversation scene may not be limited. For example, the virtual conversation scene may also include a virtual conference table, a virtual tablecloth, a virtual decoration, and the like.

In some implementations, the virtual object may include an avatar model corresponding to the user, an avatar avatar, etc., and the specific virtual object may not be limited in this embodiment of the present application.

In some implementation manners, the server may arrange the positions of the virtual objects corresponding to each terminal device according to the pre-stored arrangement rules and participation data. Arrangement rules can be based on identity information, or based on the spatial position of the terminal device in the real scene, or based on the posture of the terminal device. It may also be a rule for location arrangement according to the time when the terminal equipment joins the remote session. For example, the remote session scene includes multiple different locations around the conference table, starting from a specified location among the multiple different locations, according to the age order of the users in the participation data, each terminal device The corresponding virtual objects are arranged in multiple different positions. Certainly, the arrangement rule may also be a rule arranged according to various participation data, and the specific arrangement rule may not be limited in this embodiment of the present application. In addition, different arrangement rules may also be determined according to different remote sessions, for example, the used arrangement rules may be determined according to the type of the remote session.

In some implementation manners, virtual objects corresponding to different terminal devices in the remote session scene are in different positions. By arranging the positions of the virtual objects corresponding to the terminal devices according to the participation data corresponding to each terminal device, the server can distinguish the positions of the virtual objects corresponding to different terminal devices in the virtual session scene, and the virtual objects corresponding to each terminal device Objects are mapped to engagement data, enhancing the realism of virtual sessions.

Step S130: Obtain the position of each virtual object in the virtual session scene according to the position arrangement result.

In some implementations, after the server arranges the virtual objects corresponding to each terminal device in the virtual session scene according to the participation data, it can obtain the information in the virtual session scene according to the result of the virtual object position arrangement. The position of each virtual object. Wherein, the position of the virtual object in the virtual session scene may be the position in the world coordinate system of the virtual space (that is, the position relative to the origin of the world coordinate in the world coordinate system).

Step S140: Based on the position of the virtual object, generate a virtual conversation scene including the virtual object.

After acquiring the position of each virtual object in the virtual session scene, the server can generate a virtual session scene according to the position of each virtual object.

In some implementations, the server can acquire the content data of the virtual object, and generate a virtual session scene including at least the virtual object according to the content data of the virtual object and the position of the virtual object in the virtual space. Wherein, the content data of the virtual object may be 3D model data of the virtual object, and the 3D model data may include the color of the model corresponding to the 3D model, model vertex coordinates, model outline data, and the like.

As an implementation manner, the content data of the virtual object may be pre-stored locally, and the server may acquire the content data of the virtual object corresponding to each terminal device locally. As another implementation manner, the content data of the virtual object may be pre-stored in the terminal device, and the server may obtain the corresponding content data of the virtual object from the terminal device.

In some implementations, the server may determine the rendering coordinates of each virtual object in the virtual space according to the position of each virtual object in the virtual session scene, that is, obtain the rendering position of each virtual object. Wherein, the rendering position can be used as the rendering coordinates of the virtual object, so as to realize that the virtual object is rendered at the rendering position. Wherein, the rendering coordinates refer to the three-dimensional space coordinates of the virtual object in the virtual space with the virtual camera as the origin (which can be regarded as the human eye as the origin).

Wherein, after the server obtains the rendering coordinates for rendering each virtual object in the virtual space, the server can construct each virtual object according to the content data of each virtual object, and render each virtual object according to the rendering coordinates of each virtual object , where the vertex coordinates and color values of each vertex in the virtual object can be obtained by rendering the virtual object. Since the content data may include 3D model data, the rendered virtual object may be 3D virtual content.

Therefore, after the virtual object is generated according to the position of the virtual object and the content data, a virtual conversation scene including at least the virtual object corresponding to each terminal device can be obtained. Of course, when the virtual session scene includes other virtual content, when generating the virtual session scene, the location and content data of other virtual content can also be obtained, and other virtual content can be generated so that the virtual session scene includes other virtual content. For example, when the virtual session scene includes a virtual chair, in addition to generating the virtual object according to the position of the virtual object and the content data of the virtual object, it is also necessary to generate a virtual chair according to the position of the virtual chair in the virtual space and the content data of the virtual chair. Chair, so that the generated virtual session scene includes the virtual object corresponding to the terminal device and the virtual chair.

In the embodiment of the present application, the generated virtual conversation scene can be used to generate the scene picture of the virtual conversation scene, and the terminal device can display the scene picture, so that the user can observe the 3D virtual conversation scene, and can observe the The position of the virtual object makes the user feel a strong sense of reality. For example, please refer to FIG. 4. FIG. 4 shows a scene diagram of a teleconference scene, wherein the terminal device 100 may be a head-mounted display device, and the user 601 is located around a physical table in a real scene. The display device observes the scene picture of the virtual conversation scene, and the scene picture of the virtual conversation scene may include virtual characters 701 of other users participating in the teleconference.

In some embodiments, operations such as obtaining the participation data of the terminal device in the remote session, arranging the position of the virtual object corresponding to the terminal device, obtaining the position of the virtual object, and generating the virtual session scene can also be completed by the terminal device .

The method for generating a virtual scene provided by the embodiment of the present application arranges the positions of the virtual objects of the terminal devices participating in the remote session according to the participation data of the user's terminal devices, so that the virtual objects are located at the corresponding positions in the remote session scene, and the user is obtained The virtual session scene for display can give the user a more realistic feeling and improve the effect of the remote session.

Referring to FIG. 5, another embodiment of the present application provides a method for generating a virtual scene, which may include:

Step S210: Obtain the participation data of one or more terminal devices in the remote session.

In the embodiment of the present application, for step S210, reference may be made to the content of the foregoing embodiments, which will not be repeated here.

Step S220: According to the participation data, arrange the virtual objects corresponding to each terminal device in the virtual session scene.

The participation data of the terminal device participating in the remote session may include: one or more of the user's identity information, the time of joining the remote session, the spatial position of the terminal device in the real scene, the posture of the terminal device, and the location of the terminal device. kinds of data. The specific participation data may not be limited in this embodiment of the application.

In some implementations, referring to FIG. 6, the server arranges the virtual objects corresponding to each terminal device in the virtual session scene according to the participation data, which may include:

Step S221: According to the participation data, determine the priority of the virtual object corresponding to each terminal device in the virtual session scene.

Wherein, in the virtual session scenario of the remote session, the virtual objects corresponding to different terminal devices have different priorities. This priority is used as a priority in position sorting, and the higher the priority of the virtual object, the earlier the virtual object is arranged in the virtual session scene.

Further, the priority of the virtual object corresponding to the terminal device in the virtual session scene may be determined by the participation data of the terminal device.

In some embodiments, the participation data includes at least the participation time when the terminal device participates in the remote session. Wherein, the participation time may be the time when the terminal device joins the remote session through the network. According to the participation data, determine the priority of the virtual object corresponding to each terminal device in the virtual session scene, which may include:

According to the order of participation time of each terminal device, the priority of the virtual object corresponding to each terminal device in the virtual session scene is sorted from high to low, and the priority of the virtual object corresponding to each terminal device is obtained.

Wherein, the server can sort the participation time corresponding to each terminal device according to the participation time in the participation data corresponding to each terminal device and in the order of the participation time, and the obtained sorting result can be determined as follows: The priority in the scene is sorted from high to low, so as to obtain the priority of the virtual object corresponding to each terminal device. For example, the corresponding relationship between the participation time of each terminal device and the priority of the virtual object corresponding to each terminal device, as shown in Table 1,

Table 1

Terminal Equipment Participation time priority device 4 time point 4 1 device 2 time point 2 2 device 3 time point 3 3 equipment 1 time point 1 4

As shown in the above table, the order of participation time of terminal devices is the order from top to bottom in Table 2, that is, time point 4 is earlier than time point 2, time point 2 is earlier than time point 3, and time point 3 is earlier than time point 1. The priority of the virtual object corresponding to the terminal device is lowered in order from top to bottom in Table 2, that is, the priority of the virtual object corresponding to device 4, the priority of the virtual object corresponding to device 2, and the priority of the virtual object corresponding to device 1. The priority and the priority of the virtual object corresponding to the device 1 decrease in order.

In some implementation manners, the participation data includes at least identity information corresponding to the terminal device, and the identity information corresponding to the terminal device may include user identity information, terminal identity information, and the like. The user's identity information may include the user's name (ID), job title, age, gender, user's role in the remote session (eg, speaker, audience), and the like. The identity information of the terminal may include the device ID of the terminal device and the like. Certainly, the specific identity information may not be limited.

Further, according to the participation data, determining the priority of the virtual object corresponding to each terminal device in the virtual session scene may include: obtaining the identity level corresponding to each terminal device according to the identity information of each terminal device; In order of identity level from high to low, the priority of the virtual objects corresponding to each terminal device in the virtual session scene is sorted from high to low to obtain the priority of the virtual object corresponding to each terminal device.

Wherein, the server can determine the identity level corresponding to the terminal device according to the job position, age, gender, role in the remote session, etc. in the identity information, and the identity level is different. For example, the identity level corresponding to the terminal device may be determined according to the level of the job position, and the order of the identity levels is determined by the order of the level of the job position. For another example, the identity level corresponding to the terminal device can be determined according to the age, and the order of the identity level can be arranged according to age from oldest to bottom, of course, it can also be arranged according to age from young to old. For another example, the identity level corresponding to the terminal device may be determined according to the level of the role in the remote session, and the order of identity levels is determined by the order of role levels. Also for example, the identity level may be determined according to whether the user is male or female, and the identity level of a female may be higher than that of a male, or the identity of a male may be substantially higher than that of a female. Of course, the manner of specifically determining the identity level of the terminal device may not be limited.

After the server obtains the identity level corresponding to each terminal device in the remote session, it can sort the identity level corresponding to each terminal device in the order of identity level from high to low, and the obtained sorting result can be determined as, The priority in the virtual session scene is sorted from high to low, so as to obtain the priority of the virtual object corresponding to each terminal device. For example, the identity of each terminal device basically corresponds to the priority of the virtual object corresponding to each terminal device, as shown in Table 2,

Table 2

Terminal Equipment status level priority device 3 level 3 1 equipment 1 level 2 2 device 2 level 1 3

As shown in the above table, the order of identity levels corresponding to terminal devices from high to low is the order from top to bottom in Table 3, that is, the identity level corresponding to device 3, the identity level corresponding to device 2, and the identity level corresponding to device 1 in order reduce. The priority of the virtual object corresponding to the terminal device is lowered in order from top to bottom in Table 3, that is, the priority of the virtual object corresponding to device 3, the priority of the virtual object corresponding to device 2, and the priority of the virtual object corresponding to device 1. Priority decreases in descending order.

Step S222: According to the priority of each virtual object, arrange the position of each virtual object in the virtual conversation scene.

After the server obtains the priority of the virtual object corresponding to each terminal device in the remote session, it can arrange the position of each virtual object in the virtual session scene according to the priority of each virtual object.

In some implementations, there are multiple set positions in the virtual session scene, and the set positions correspond to the priorities of the virtual objects. Wherein, if the set positions are different, the priorities of the virtual objects arranged at the set positions are different.

In a specific implementation, among the multiple set positions of the virtual session scene, the virtual objects arranged at the first position have the highest priority, and the virtual objects at other set positions adjacent to the first position have the priority in order Therefore, the virtual objects can be arranged in the set positions sequentially according to the order of the priority of the virtual objects from high to low. For example, referring to FIG. 7, a virtual conference table 801 is included in the virtual session scene, and a plurality of virtual seats may be distributed around the virtual conference table 801: virtual seat P0, virtual seat P7, virtual seat P6, virtual seat P5, virtual seat P1, Virtual seat P2, virtual seat P3, and virtual seat P4. The virtual objects arranged by the virtual seat P0 (target position) have the highest priority, and the virtual objects arranged by the virtual seat P7, virtual seat P6, virtual seat P5, virtual seat P1, virtual seat P2, virtual seat P3, and virtual seat P4 The priority of the virtual objects decreases in turn, and each virtual object can be arranged in the order of virtual seat P0, virtual seat P7, virtual seat P6, virtual seat P5, and virtual seat P1 according to the order of virtual object priority from high to low. , virtual seat P2, virtual seat P3, and virtual seat P4.

In a specific implementation manner, the priorities of the virtual objects to be arranged at multiple set positions in the virtual session scene are irregularly distributed. In this case, the priority of each virtual object and the The priority of the virtual object at the fixed position is arranged, and the position of the virtual object is arranged. For example, in FIG. 7, the priority levels of the virtual objects of virtual seat P0, virtual seat P7, virtual seat P6, virtual seat P5, virtual seat P1, virtual seat P2, virtual seat P3, and virtual seat P4 are respectively 8, 1, 2, 3, 7, 4, 5 and 6, the terminal device can directly arrange the virtual objects in multiple virtual seats according to the priority of the virtual objects.

In some embodiments, the server can obtain the identity information of each terminal device in the remote session, and determine the corresponding identity category according to the identity information. The identity category can be used to indicate the organizational unit to which the terminal device belongs, and terminals belonging to the same identity category can be The position of the virtual object corresponding to the device is set to a set position belonging to the same side in the virtual space. Furthermore, the server can also determine the priority of each virtual object set at the set position on the same side according to the identity level corresponding to each terminal device belonging to the same identity category, and arrange each virtual object in the same side according to the priority. corresponding setting position.

For example, the users participating in the remote session include employee 1 of company A, employee 2 of company A, employee 3 of company A, employee 4 of company B, employee 5 of company B, and employee 6 of company C, wherein, company B and Company C is Party A relative to Company A, and Company A is Party B relative to Company B and Company C. The virtual objects corresponding to Employee 1, Employee 2, and Employee 3 of Party B can be arranged on the same side, as Party A Employee 4, Employee 5, and Employee 6 of Party A are arranged on the same side, and employees of Company B and Company C may have different status levels, and they can be arranged in different positions on the same side according to different status levels. Location. For example, please refer to Figure 7, employee 1, employee 2 and employee 3 of company A as party B can be arranged on the virtual seat P7, virtual seat P6 and virtual seat P5 on the same side, as employee 4 and company of company B of party B Employees 5 of B and employees 6 of company C can be arranged on the virtual seat P4 , virtual seat P3 and virtual seat P2 on the same side.

Step S230: Obtain the position of each virtual object in the virtual session scene according to the position arrangement result.

In the embodiment of the present application, reference may be made to the contents of the foregoing embodiments for step S230, and details are not repeated here.

Step S240: Acquiring posture information and location information of the target device in the remote session.

After obtaining the position of the virtual object corresponding to each terminal device in the virtual session scene, the server can obtain the position of each virtual object in the world coordinate system of the virtual space according to the position of the virtual object (that is, relative to the world coordinate system in the world coordinate system). The position of the origin of coordinates), and generate a virtual session scene according to the position of each virtual object in the virtual space.

In some implementation manners, when the server generates a virtual session scene according to the position of each virtual object, it may acquire posture information and position information of the target device in the remote session. Wherein, the target device may be a terminal device to display a picture of a virtual conversation scene, for example, it may be a terminal device that acquires participation data, arranges virtual objects according to the participation data, and obtains the positions of virtual objects. Wherein, the attitude information of the target device may be the orientation and rotation angle of the target device, and the position information of the target device may be the position of the target device in the real scene.

Step S250: Obtain a first relative positional relationship between other virtual objects and the target device according to the position information and the position of the virtual object. The other virtual objects are virtual objects corresponding to other terminal devices except the target device.

After acquiring the location information and attitude information of the target device, the server may determine the first relative positional relationship between the virtual object to be displayed by the target device and the target device in the virtual space according to the location information of the target device and the location of the virtual object. Wherein, the virtual object to be displayed by the target device may be a virtual object corresponding to at least some terminal devices in the remote session except the target device.

In some embodiments, the server can determine other virtual objects and the target according to the relative position relationship between the position where other virtual objects need to be superimposed in the real scene and the target device, the position information of the target device, and the position of the virtual object in the virtual session scene. A first relative positional relationship between devices.

Step S260: Obtain first content data of other virtual objects.

In some implementation manners, the server may acquire the content data of the virtual object to be displayed by the target device, that is, acquire the first content data of other virtual objects. For a specific manner in which the server acquires content data, reference may be made to the contents of the foregoing embodiments, which will not be repeated here.

Step S270: Based on the first relative positional relationship and the first content data, generate a virtual conversation scene including other virtual objects.

In some implementations, after the server acquires the first relative positional relationship between other virtual objects and the target device in the virtual space and the first content data of other virtual objects, it can determine the The positions of other virtual objects in the virtual space, according to the positions of other virtual objects in the virtual space and the first content data, generate a virtual conversation scene including other virtual objects. Wherein, the manner in which the terminal device generates the virtual conversation scene according to the positions of other virtual objects in the virtual space and the first content data can refer to the contents of the foregoing embodiments, and details are not repeated here.

Certainly, the virtual conversation scene may also include other virtual contents, such as virtual table body, virtual chair, etc., and the terminal device may also generate other virtual contents, so that the generated virtual conversation scene includes virtual objects and other virtual contents.

Step S280: Generate a virtual scene picture for displaying on the target device according to the posture information and the virtual conversation scene.

In the embodiment of the present application, after the server generates the virtual conversation scene, when generating the virtual scene picture of the virtual conversation scene for display by the target device, it may be generated according to the posture information of the target device and the virtual conversation scene. Wherein, the virtual session scene is a 3D virtual scene. When the posture information of the target device is different, the virtual scene picture that the user needs to see is also different. The virtual scene picture corresponding to the posture information, and obtain the data of the virtual scene picture, and generate the virtual scene picture according to the data of the virtual scene picture, thus obtaining the virtual scene picture for displaying in the target device, that is, the virtual scene picture to be displayed by the target device Scene screen. Since the virtual scene picture corresponds to the posture information of the target device, the user corresponding to the target device can view the virtual picture in different viewing angle directions by changing the posture of the target terminal. Please refer to FIG. 8. FIG. 8 shows a scene diagram of a teleconference scene. User H can observe user B, user C, and user D through the head-mounted display device worn by user H under the posture of the currently worn head-mounted display device. And the virtual object corresponding to user E, user H can change the posture of the head-mounted display device by turning the head, so as to observe the virtual object corresponding to other users, for example, when the user H turns the head to the left, it can also See the virtual objects corresponding to other users such as user A.

In some implementations, the position of the virtual object in the virtual session scene can also be adjusted according to requirements. Therefore, the method for generating the virtual scene may also include:

Acquiring the location change request sent by the terminal device; responding to the location change request, adjusting the position of the virtual object corresponding to the terminal device sending the location change request in the virtual session scene.

Wherein, the position change request may carry the target position to be adjusted to, so that the server can adjust the position of the virtual object corresponding to the terminal device sending the position change request in the virtual session scene to the target position according to the position change request, so as to Meet the needs of users.

Further, in the virtual session scenario, the multiple positions of the virtual objects corresponding to multiple terminal devices may include the position of the virtual object corresponding to the terminal device of the presenter in the remote session, and the virtual object corresponding to the terminal device of the presenter. The location of the object can serve as the speaker location. The speaker position can be preset, and the user can also initiate a position change request through the terminal device, and the position change request is used to indicate that the position of the virtual object corresponding to the user's terminal device in the virtual session scene is adjusted to the speaker position , so that in the virtual session scene, the position of the virtual object corresponding to the terminal device that initiates the position acquisition request is adjusted to the position of the speaker. For example, in a teleconference scenario, a participant participating in a teleconference can initiate a position change request for the speaker position through a terminal device, so that the virtual object corresponding to the participant's terminal device is in the speaker position in the teleconference .

In some embodiments, the above steps may also be implemented by a terminal device.

The virtual scene generation method provided by the embodiment of the present application determines the priority of the virtual objects corresponding to each terminal device according to the participation data of the user's terminal device, and then arranges the positions of the virtual objects of the terminal device according to the priority , so that the virtual object is located at the corresponding position in the remote session scene, the virtual session scene for display is obtained, and the virtual scene picture of the virtual session scene is generated according to the posture information of the terminal device, so that the virtual scene picture seen by the user is consistent with the terminal device Corresponding to the posture information of the user, it gives the user a more realistic feeling and improves the effect of the remote session.

Referring to FIG. 9, another embodiment of the present application provides a method for generating a virtual scene, which may include:

Step S310: Obtain the participation data of one or more terminal devices in the remote session.

In the embodiment of the present application, for step S310, reference may be made to the contents of the foregoing embodiments, and details are not repeated here.

Step S320: Obtain the first terminal device in the first real scene in the remote session, and the second terminal device in the second real scene in the remote session, the first real scene is a live scene including a physical table, and the second real scene The scene is a remote scene relative to the live scene.

Among the multiple terminal devices in the remote session, some of the first terminal devices may be in the same first real scene, and the first real scene includes a physical table, and other second terminal devices are not in the first real scene, and are not in the first real scene. The second real scene of the physical table, wherein the other one or more second terminal devices may be in the same real scene, or may be in multiple different real scenes. When arranging the positions of the virtual objects, the server may first arrange the positions of the terminal devices in the first real scene, and then arrange the positions of the terminal devices in the second real scene. The second real scene is a remote scene relative to the live scene, that is, there is no other real scene in the first real scene in the remote session, and the second real scene may include multiple real scenes or one real scene.

In some implementations, the participation data may include the positioning location of the terminal device. The server may determine the first terminal device in the first real scene and the second terminal device in the second real scene according to the positioning position in the participation data of each terminal device.

Step S330: Obtain the relative spatial position information between the first terminal device and the physical table from the participation data of the first terminal device, and conduct a virtual conversation scene for the virtual object corresponding to the first terminal device according to the relative spatial position information position arrangement.

In some implementation manners, the participation data of the first terminal device may further include relative spatial position information between the first terminal device and the physical table. The relative spatial position information may include relative position information and posture information between the first terminal device and the physical table, and the posture information may be the orientation and rotation angle of the physical table relative to the first terminal device. The server may acquire relative spatial position information between the first terminal device and the physical table from the participation data of the first terminal device according to the participation data of the first terminal device.

Further, the virtual session scene includes multiple set positions, and the multiple set positions correspond to the multiple seats around the physical table respectively. As an implementation manner, the server may obtain the positional relationship between the first terminal device and the physical table according to the relative spatial position information of the first terminal device and the physical table, and according to the positional relationship between the first terminal device and the physical table, The set positions corresponding to each first terminal device in the virtual session scene are determined, so as to arrange the virtual objects corresponding to the first terminal devices.

Step S340: According to the position arrangement result of the virtual object corresponding to the first terminal device, obtain the remaining arrangement position in the virtual conversation scene.

After arranging the positions of the virtual objects corresponding to the first terminal device, the server may acquire the unarranged positions in the virtual session scene, and determine the unarranged positions as the remaining arranged positions in the virtual session scene, Wherein, the unarranged position may refer to a set position not corresponding to the first terminal device.

Step S350: According to the participation data of the second terminal device, arrange the virtual objects corresponding to the second terminal device in the remaining arrangement positions.

After obtaining the remaining arrangement positions in the virtual session scene, the server may arrange the positions of the virtual objects corresponding to the second terminal device according to the participation data of the second terminal device in the second real scene. According to the participation data of the second terminal device, the server arranges the virtual objects corresponding to the second terminal device in the remaining arrangement positions in a manner that can participate in the method of arranging the virtual objects according to the participation data in the foregoing embodiments. , such as the manner of arranging positions according to identity information, participation data, etc., which will not be repeated here.

Step S360: Obtain the position of each virtual object in the virtual session scene according to the position arrangement result.

Step S370: Based on the position of the virtual object, generate a virtual conversation scene including the virtual object.

In the embodiment of the present application, reference may be made to the contents of the foregoing embodiments for step S360 and step S370, and details are not repeated here.

Please refer to Fig. 10, Fig. 10 shows a scene diagram of a teleconference scene, users B, D, and H are in the first real scene, and users A, F, G, C, and E are in the second real scene , when arranging the positions, after arranging the positions of user B, user D and user H, user A, user F, user G, user C and user E can be arranged in the remaining arrangement positions. Through the head-mounted display device worn by user H, under the current posture of the head-mounted display device, user H can observe part of the physical table body, user B, and user D in the real scene, and can see the corresponding tables of user C and user E. dummy object.

In some implementation manners, the above steps may also be implemented by a terminal device.

The method for generating a virtual scene provided by the embodiment of the present application arranges the position of the virtual object corresponding to the first terminal device in the virtual conversation scene according to the relative spatial position information of the first terminal device relative to the physical table in the first real scene. According to the participation data of the second terminal device in the second reality scene, the position of the virtual object corresponding to the second terminal device in the virtual session scene is arranged so that the virtual object is located at the corresponding position in the remote session scene, and the obtained The virtual session scene used for display makes the positions of virtual objects in some virtual session scenes correspond to the positions of physical tables in the real scene, giving users a more realistic feeling and improving the effect of remote sessions.

Referring to FIG. 11 , another embodiment of the present application provides a method for generating a virtual scene, which may include:

Step S410: Obtain the participation data of one or more terminal devices in the remote session.

Step S420: According to the participation data, arrange the virtual objects corresponding to each terminal device in the virtual session scene.

Step S430: Obtain the position of each virtual object in the virtual session scene according to the position arrangement result.

In this embodiment of the present application, reference may be made to the contents of the foregoing embodiments for step S410, step S420, and step S430, and details are not repeated here.

Step S440: According to the number of terminal devices participating in the remote session, determine the corresponding number of virtual tables.

In some implementations, a virtual table may be included in the virtual session scene. The terminal device may also determine the number of terminal devices participating in the remote session, and determine the virtual table corresponding to the number. For example, when the number of terminal devices participating in the remote session is 6, the number of positions corresponding to the virtual table body is 6. For another example, if the number of positions corresponding to the virtual round table is at least 4, and the number of positions corresponding to the virtual square table is more than 4, then when the number of terminal devices participating in the remote session is 4 or less, the virtual table body is a virtual round table, participating in the remote session. When the number of session terminal devices is more than 4, the virtual table body is a virtual square table.

In some implementations, when the users participating in the remote session include the roles of Party A and Party B, the shape of the virtual table can also be determined according to the number of Party A. For example, if Party A has 2 companies, the virtual table body can be rectangular; if there are 5 companies, the virtual table body can be hexagonal, heptagonal, etc.

Step S450: Obtain posture information and location information of the target device in the remote session.

In this embodiment of the present application, reference may be made to the contents of the foregoing embodiments for step S450, and details are not repeated here.

Step S460: According to the position information and the position of other virtual objects relative to the virtual table, obtain a second relative positional relationship between other virtual objects and the target device, and obtain a third relative positional relationship between the virtual table and the target device, Other virtual objects are virtual objects corresponding to other terminal devices except the target device.

After obtaining the location information and posture information of the target device, the server can determine the first position between the virtual object to be displayed by the target device and the target device in the virtual space according to the location information of the target device and the positions of other virtual objects relative to the virtual table. The second relative positional relationship, and the third relative positional relationship between the virtual table body and the target device. Wherein, the virtual object to be displayed by the target device may be a virtual object corresponding to at least some terminal devices in the remote session except the target device. That is to say, when the target device displays the picture of the virtual conversation scene, it only needs to display the virtual objects corresponding to other terminal devices, so as to enhance the sense of reality when displaying the virtual conversation scene.

In some implementation manners, reference may be made to the foregoing embodiments for obtaining the second relative positional relationship between other virtual objects and the target device in the virtual space, which will not be repeated here.

In some implementation manners, the third relative positional relationship between the virtual table and the target device in the virtual session scene may correspond to the position information and posture information of the target device. As a specific implementation, the server can determine a reference plane in a real scene according to the position information and attitude information of the target device. The position where the virtual table body needs to be superimposed and displayed corresponds to the reference plane. The position in the virtual space can determine the third relative positional relationship between the virtual table body and the target device. The aforementioned reference plane may be a plane of an object in a real scene, such as a solid desktop, a plane where a marker is located, and the like. Therefore, the position of the virtual table body in the virtual conversation scene corresponds to the position information and posture information of the target device, which can enhance the sense of reality of the virtual conversation scene.

In addition, the attitude angle of the target device can also be obtained according to the attitude information of the target device. When the attitude angle of the target device reaches a set angle, the server can obtain the third relative positional relationship between the virtual table and the target device. That is to say, the target device can only display the virtual table body in the virtual session scene when the attitude angle of the target device reaches the set angle.

Step S470: Obtain the first content data of other virtual objects and the second content data of the virtual table.

In some implementation manners, the server may obtain the first content data of other virtual objects and the second content data of the virtual table. For a specific manner in which the server acquires content data, reference may be made to the contents of the foregoing embodiments, which will not be repeated here.

Step S480: Based on the second relative positional relationship, the third relative positional relationship, the first content data and the second content data, generate a virtual conversation scene including a virtual table and other virtual objects.

In the embodiment of the present application, the method for the server to generate the virtual conversation scene according to the second relative positional relationship, the third relative positional relationship, the first content data, and the second content data can refer to the content of the foregoing embodiments, and will not be repeated here. .

Step S490: Generate a virtual scene picture for displaying on the target device according to the posture information and the virtual conversation scene.

In the embodiment of the present application, reference may be made to the contents of the foregoing embodiments for step S490, and details are not repeated here.

In some embodiments, for a terminal device that subsequently joins a remote session, the position may be added on the basis of the position of the virtual object corresponding to the terminal device currently participating in the remote session. At this time, it may be determined whether the virtual table needs to be expanded or not It may be based on the addition of participation data (such as identity information, roles in the remote session, etc.) of the terminal device newly joining the remote session to an appropriate position, and adaptive adjustment of the position of the virtual object corresponding to the terminal device previously participating in the remote session.

In some implementation manners, the above steps may also be completed by a terminal device.

The method for generating a virtual scene provided by the embodiment of the present application can obtain a virtual scene picture for displaying on a target device. Since the virtual scene picture corresponds to the gesture information of the target device, the user corresponding to the target device can change the target terminal’s posture, and view the virtual screen in different viewing directions. In addition, the virtual scene screen includes a virtual table body, which can give users a more realistic remote session experience.

In the foregoing embodiments, the terminal device may be an external/connected head-mounted display device, and the head-mounted display device is connected to the server. Wherein, the head-mounted display device can only complete the display of the virtual screen, and the execution of the above-mentioned generation of the virtual scene can be completed by the server. After the server generates the virtual conversation scene, it transmits the virtual scene picture of the virtual conversation scene to the head-mounted display device. , the head-mounted display device can complete the display of the virtual scene picture.

Please refer to FIG. 12 , which shows a structural block diagram of an apparatus 400 for generating a virtual scene provided by the present application. The virtual scene generation device 400 includes: a data acquisition module 410 , a position arrangement module 420 , a position acquisition module 430 and a scene generation module 440 . Among them, the data acquisition module 410 is used to acquire the participation data of one or more terminal devices in the remote session; the position arrangement module 420 is used to arrange the positions of the virtual objects corresponding to each terminal device in the virtual session scene according to the participation data. The position acquisition module 430 is used to obtain the position of each virtual object in the virtual session scene according to the result of the position arrangement; the scene generation module 440 is used to generate a virtual session scene containing the virtual object based on the position of the virtual object.

In some implementations, the location arrangement module 420 can be specifically configured to: determine the priority of the virtual object corresponding to each terminal device in the virtual session scene according to the participation data; The virtual objects are arranged in the virtual session scene.

In some embodiments, the participation data includes the participation time of the terminal device participating in the remote session. The position arranging module 420 determines the priority of the virtual object corresponding to each terminal device in the virtual session scene according to the participation data, which may include: according to the order of the participation time of each terminal device, the virtual object corresponding to each terminal device is in the virtual session. The priority in the conversation scene is sorted from high to low, and the priority of the virtual object corresponding to each terminal device is obtained.

In some implementation manners, the participation data includes identity information corresponding to the terminal device. The location arrangement module 420 determines the priority of the virtual object corresponding to each terminal device in the virtual session scene according to the participation data, including: obtaining the identity level corresponding to each terminal device according to the identity information of each terminal device; The priority of the virtual objects corresponding to each terminal device in the virtual session scene is sorted from high to low to obtain the priority of the virtual object corresponding to each terminal device.

In some implementations, the location arrangement module 420 may be specifically configured to: obtain the first terminal device in the first reality scene in the remote session, and the second terminal device in the second reality scene in the remote session, the first reality The scene is an on-site scene including a physical table, and the second real scene is a remote scene relative to the on-site scene; the relative spatial position information between the first terminal device and the physical table is obtained from the participation data of the first terminal device, and according to Relative to the spatial position information, arrange the virtual objects corresponding to the first terminal device in the virtual conversation scene; obtain the remaining arrangement positions in the virtual conversation scene according to the position arrangement results of the virtual objects corresponding to the first terminal device; The participation data of the second terminal device arranges the virtual objects corresponding to the second terminal device in the remaining arrangement positions.

In some implementations, the scene generation module 440 can be specifically configured to: obtain the posture information and position information of the target device in the remote session; obtain the first relative position between other virtual objects and the target device according to the position information and the position of the virtual object. Positional relationship, other virtual objects are virtual objects corresponding to other terminal devices except the target device; obtain first content data of other virtual objects; based on the first relative positional relationship and the first content data, generate a virtual session including other virtual objects Scene: Generate a virtual scene picture for displaying in the target device according to the posture information and the virtual session scene.

In some implementations, the virtual session scene further includes a virtual table, and the position of the virtual object includes a position of the virtual object relative to the virtual table. The scene generation module 440 can be specifically used to: generate a virtual session scene containing the virtual object based on the position of the virtual object, including: according to the number of terminal devices participating in the remote session, determine the virtual table body corresponding to the number; obtain the object in the remote session The posture information and position information of the device; according to the position information, posture information and the position of other virtual objects relative to the virtual table body, obtain the second relative positional relationship between other virtual objects and the target device, and obtain the relationship between the virtual table body and the target device The third relative positional relationship among them, other virtual objects are virtual objects corresponding to other terminal devices except the target device; obtain the first content data of other virtual objects and the second content data of the virtual table body; based on the second relative positional relationship , the third relative positional relationship, the first content data and the second content data, generate a virtual conversation scene including a virtual table body and other virtual objects; generate a virtual scene picture for displaying in the target device according to the posture information and the virtual conversation scene .

In some implementations, the device 400 for generating a virtual scene may further include: a request acquisition module and a scene adjustment module. The request acquisition module can be used to obtain the location change request sent by the terminal device; the scene adjustment module can be used to respond to the location change request and adjust the position of the virtual object corresponding to the terminal device sending the location change request in the virtual session scene.

To sum up, the solution provided by this application obtains the participation data of one or more terminal devices in a remote session, and according to the participation data, arranges the virtual objects corresponding to each terminal device in the virtual session scene. According to the distribution result, the position of each virtual object in the virtual session scene is obtained, and based on the position of the virtual object, a virtual session scene including the virtual object is generated. Therefore, according to the participation data of the user's terminal equipment, the positions of the virtual objects of the terminal equipment participating in the remote session can be arranged, so that the virtual objects can be added to the corresponding positions in the remote session scene, and a virtual session scene for display can be obtained. Give users a more realistic feeling and improve the effect of remote sessions.

In this embodiment of the present application, the electronic device that executes the method for generating a virtual scene provided in the above embodiments may be a server or a terminal device.

Please refer to FIG. 13 , which shows a structural block diagram of a terminal device provided by an embodiment of the present application. The terminal device 100 may be a terminal device capable of running application programs, such as a smart phone, a tablet computer, and a head-mounted display device. The terminal device 100 in this application may include one or more of the following components: a processor 110, a memory 120, and one or more application programs, wherein one or more application programs may be stored in the memory 120 and configured to be executed by a or a plurality of processors 110, and one or more programs are configured to execute the methods described in the foregoing method embodiments.

Processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire terminal device 100, and executes or executes instructions, programs, code sets or instruction sets stored in the memory 120, and calls data stored in the memory 120 to execute Various functions of the terminal device 100 and processing data. Optionally, the processor 110 may use at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable LogicArray, PLA). implemented in the form of hardware. The processor 110 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used to render and draw the displayed content; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 110, but may be realized by a communication chip alone.

The memory 120 may include a random access memory (Random Access Memory, RAM), and may also include a read-only memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system and instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , instructions for implementing the following method embodiments, and the like. The storage data area can also store data created by the terminal device 100 during use, and the like.

In some embodiments, the terminal device 100 may further include an image sensor 130 for collecting images of real objects and scene images of target scenes. The image sensor 130 may be an infrared camera or a visible light camera, and the specific type is not limited in this embodiment of the present application.

In one embodiment, the terminal device is a head-mounted display device, which may include one or more of the following components in addition to the above-mentioned processor, memory and image sensor: a display module, an optical module, a communication module and a power supply.

The display module can include a display control unit. The display control unit is used for receiving the display image of the virtual content rendered by the processor, and then displaying and projecting the display image to the optical module, so that the user can watch the virtual content through the optical module. Wherein, the display device may be a display screen or a projection device, etc., and may be used to display images.

The optical module can adopt an off-axis optical system or a waveguide optical system, and the display image displayed by the display device can be projected to the user's eyes after passing through the optical module. While the user sees the display image projected by the display device through the optical module. In some embodiments, the user can also observe the real environment through the optical module, and feel the augmented reality effect of superimposing the virtual content and the real environment.

The communication module can be Bluetooth, WiFi (Wireless-Fidelity, wireless fidelity), ZigBee (Zifeng technology) and other modules, and the head-mounted display device can establish a communication connection with the terminal device through the communication module. The head-mounted display device communicated with the terminal device can perform information and command interaction with the terminal device. For example, the head-mounted display device may receive the image data sent by the terminal device through the communication module, and generate and display virtual content of the virtual world according to the received image data.

The power supply can supply power to the entire head-mounted display device to ensure the normal operation of each component of the head-mounted display device.

Please refer to FIG. 14 , which shows a structural block diagram of a server provided by an embodiment of the present application. The server 200 can be a cloud server, a local server, etc., and the server 200 can include one or more of the following components: a processor 210, a memory 220, and one or more application programs, wherein one or more application programs can be stored in the memory 220 and configured to be executed by one or more processors 210, and one or more programs are configured to execute the methods described in the foregoing method embodiments.

Please refer to FIG. 15 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. Program codes are stored in the computer-readable storage medium 800, and the program codes can be invoked by a processor to execute the methods described in the foregoing method embodiments.

The computer readable storage medium 800 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium (non-transitory computer-readable storage medium). The computer-readable storage medium 800 has a storage space for program code 810 for executing any method steps in the above-mentioned methods. These program codes can be read from or written into one or more computer program products. Program code 810 may, for example, be compressed in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not drive the essence of the corresponding technical solutions away from the spirit and scope of the technical solutions of the various embodiments of the present application.

Claims (10)

1. a kind of generation method of virtual scene, which is characterized in that the described method includes:

Obtain the participation data of one or more terminal device in remote session；

According to the participation data, the position in virtual session scene is carried out to the corresponding virtual objects of each terminal device Arrangement；

According to position arrangement as a result, obtaining the position of each virtual objects in the virtual session scene；

Based on the position of the virtual objects, the virtual session scene comprising the virtual objects is generated.

2. the method according to claim 1, wherein described according to the participation data, to each terminal The corresponding virtual objects of equipment carry out the position arrangement in virtual session scene, comprising:

According to the participation data, determine that the corresponding virtual objects of each terminal device are preferential in virtual session scene Grade；

According to the priority of each virtual objects, the position in the virtual session scene is carried out to each virtual objects Set arrangement.

3. according to the method described in claim 2, it is characterized in that, the participation data include that terminal device participation is described long-range It is the participation time of session, described according to the participation data, determine the corresponding virtual objects of each terminal device virtual Priority in session context, comprising:

The sequencing that the time is participated according to each terminal device, to the corresponding virtual objects of each terminal device virtual Priority in session context carries out sequence from high to low, obtains the preferential of the corresponding virtual objects of each terminal device Grade.

4. according to the method described in claim 2, it is characterized in that, the participation data include the corresponding identity letter of terminal device Breath, it is described according to the participation data, determine the corresponding virtual objects of each terminal device in virtual session scene In priority, comprising:

The corresponding level of identity of each terminal device is obtained according to the identity information of each terminal device；

According to the sequence from high to low of the corresponding level of identity of each terminal device, to each terminal device Priority of the corresponding virtual objects in virtual session scene carries out sequence from high to low, obtains each terminal device The priority of corresponding virtual objects.

5. the method according to claim 1, wherein described according to the participation data, to each terminal The corresponding virtual objects of equipment carry out the position arrangement in virtual session scene, comprising:

It obtains and is in first terminal equipment and the remote session in the remote session in the first reality scene The second terminal equipment of second reality scene, first reality scene are the field scene for including physics desk body, described second Reality scene is the remote scene of the relatively described field scene；

From the phase obtained in the participation data of the first terminal equipment between the first terminal equipment and the physics desk body To spatial positional information, and according to the relative tertiary location information, to the corresponding virtual objects of the first terminal equipment into Position arrangement in row virtual session scene；

It is obtained in the virtual session scene according to the position of the corresponding virtual objects of first terminal equipment arrangement result Residue arrangement position；

According to the participation data of the second terminal equipment, to the corresponding virtual objects of the second terminal equipment in the residue Arrangement carries out position arrangement in position.

6. the method according to claim 1, wherein the position based on the virtual objects, described in generation Virtual session scene, comprising:

Obtain the posture information and location information of target device in the remote session；

According to the positional information and the position of the virtual objects, it obtains between other virtual objects and the target device First relative positional relationship, other described virtual objects are that other terminal devices in addition to the target device are corresponding virtual right As；

Obtain the first content data of other virtual objects；

Based on first relative positional relationship and the first content data, generating includes the described of other virtual objects Virtual session scene；

The virtual scene for showing in the target device is generated according to the posture information and the virtual session scene Picture.

7. described the method according to claim 1, wherein the virtual session scene further includes virtual desk body The position of virtual objects includes the position of the relatively described virtual desk body of virtual objects；

The position based on the virtual objects generates the virtual session scene comprising the virtual objects, comprising:

According to the quantity for the terminal device for participating in the remote session, the virtual desk body corresponding with the quantity is determined；

Obtain the posture information and location information of target device in the remote session；

According to the positional information, the position of posture information and the relatively described virtual desk body of other virtual objects, obtain it is described its The second relative positional relationship between his virtual objects and the target device, and obtain the virtual desk body and set with the target Third relative positional relationship between standby, other described virtual objects are that other terminal devices in addition to the target device are corresponding Virtual objects；

Obtain the first content data of other virtual objects and the second content-data of the virtual desk body；

It is raw based on second relative positional relationship, third relative positional relationship, first content data and the second content-data At the virtual session scene for including the virtual desk body and other virtual objects；

The virtual scene for showing in the target device is generated according to the posture information and the virtual session scene Picture.

8. a kind of generating means of virtual meeting scene, which is characterized in that described device includes: data acquisition module, position row Cloth module, position acquisition module and scenario generating module, wherein

The data acquisition module is used to obtain the participation data of one or more terminal device in remote session；

Position arrangement module is used for according to the participation data, is carried out to the corresponding virtual objects of each terminal device Position arrangement in virtual session scene；

The position acquisition module be used for according to position arrange as a result, obtain in the virtual session scene it is each it is described virtually The position of object；

The scenario generating module is used for the position based on the virtual objects, generates the virtual session comprising the virtual objects Scene.

9. a kind of electronic equipment characterized by comprising

One or more processors；

Memory；

One or more application program, wherein one or more of application programs are stored in the memory and are configured To be executed by one or more of processors, one or more of programs are configured to carry out as claim 1-7 is any Method described in.

10. a kind of computer-readable storage medium, which is characterized in that be stored with journey in the computer-readable storage medium Sequence code, said program code can be called by processor and execute the method according to claim 1 to 7.