CN114911625A - Virtual object rendering method, device and system and electronic equipment - Google Patents

Abstract

The embodiment of the specification discloses a virtual object rendering method, a virtual object rendering device, a virtual object rendering system and electronic equipment, wherein the method comprises the following steps: acquiring a semi-transparent grid queue of an image frame to be rendered through a main thread, and sending a sequencing notice to a sequencing thread, wherein the semi-transparent grid queue comprises a plurality of semi-transparent grids, and one semi-transparent grid corresponds to one virtual object; the sequencing thread responds to a sequencing notice sent by the main thread, obtains the semi-transparent grids to be sequenced in the semi-transparent grid queue, and sequences the semi-transparent grids to be sequenced on the basis of the triangle index list of the semi-transparent grids to be sequenced so as to determine the rendering sequence of the triangular faces in the semi-transparent grids to be sequenced; after the sequencing thread finishes sequencing the plurality of semi-transparent grids in the semi-transparent grid queue, sending a sequencing completion notification to the main thread; the main thread receives the ordering completion notification and completes rendering of the virtual object in the image frame.

Description

Virtual object rendering method, device, system and electronic device

technical field

This document relates to the technical field of computer three-dimensional rendering, in particular to a virtual object rendering method, device, system and electronic device.

Background technique

As users have higher and higher requirements for game quality, in order to bring users a better visual experience, some characters' clothes need to have multiple layers of translucent effects, such as overlapping layers of yarn or silk clothes. However, when rendering multi-layered translucent clothes, there will be a problem of interspersed, that is, the rendering order of some triangular faces will be confused.

In the prior art, the overlapping part of a large grid is divided into layers, and then the grids are merged layer by layer from the back to the front to ensure the rendering order between layers. However, this method requires the artist to manually split the layers through the tool and then re-export the new fbx format file, which obviously increases the manual operation cost. Moreover, the exported file in fbx format can only guarantee that the effect in the static state is correct, but the effect in the moving state may still be wrong. For example, if the virtual object corresponding to the grid is rotated in the game, then the virtual object corresponding to The rendering order of the triangle sequence of the translucent mesh can no longer be guaranteed to be rendered from back to front, and the rendering effect will be wrong.

Therefore, how to ensure the rendering order of translucent meshes under static and dynamic conditions, and how to reduce the cost of manual operations during rendering, still needs to provide further solutions.

SUMMARY OF THE INVENTION

The purpose of the embodiments of this specification is to provide a virtual object rendering method, device, system and electronic device, so as to ensure the rendering order of the translucent mesh in static and dynamic conditions, and reduce the manual operation cost in the rendering process.

In order to solve the above-mentioned technical problems, the embodiments of this specification are implemented as follows:

In the first aspect, a virtual object rendering method is proposed, including:

Collect a translucent grid queue of image frames to be rendered through the main thread, and send a sorting notification to the sorting thread, the translucent grid queue includes a plurality of translucent grids, and one translucent grid corresponds to one virtual object;

The sorting thread, in response to the sorting notification sent by the main thread, acquires the semi-transparent meshes to be sorted in the semi-transparent mesh queue, and based on the triangle index list of the semi-transparent meshes to be sorted, for all the semi-transparent meshes to be sorted. Sorting the translucent meshes to be sorted to determine the rendering order of the triangular faces in the translucent meshes to be sorted;

After the sorting thread finishes sorting the plurality of translucent grids in the translucent grid queue, sending a sorting completion notification to the main thread;

The main thread receives the sorting completion notification and completes the rendering of the virtual objects in the image frame.

In a second aspect, a virtual object rendering system is proposed, the system includes a sorting thread and a main thread, wherein:

The main thread collects the translucent grid queue of the image frame to be rendered, and sends a sorting notification to the sorting thread. The translucent grid queue includes multiple translucent grids, and one translucent grid corresponds to a virtual grid. object;

The sorting thread performs the following single cycle process:

In response to the sorting notification sent by the main thread, obtain the semi-transparent meshes to be sorted in the semi-transparent mesh queue, and based on the triangle index list of the semi-transparent meshes to be sorted, perform sorting on the semi-transparent meshes to be sorted. Sorting the translucent meshes to determine the rendering order of the triangular faces in the translucent meshes to be sorted;

After completing the sorting of the plurality of translucent grids in the translucent grid queue, a sorting completion notification is sent to the main thread, so that the main thread receives the sorting completion notification and completes the image Rendering of virtual objects in the frame.

In a third aspect, a virtual object rendering device is proposed, including:

The acquisition unit collects the translucent grid queue of the image frame to be rendered through the main thread, and sends a sorting notification to the sorting thread, the translucent grid queue includes a plurality of translucent grids, and one translucent grid corresponds to one virtual object;

A sorting unit, where the sorting thread obtains the semi-transparent meshes to be sorted in the semi-transparent mesh queue in response to the sorting notification sent by the main thread, and based on the triangle index list of the semi-transparent meshes to be sorted , sort the translucent meshes to be sorted to determine the rendering order of the triangular faces in the translucent meshes to be sorted;

a sending unit, after the sorting thread completes the sorting of the plurality of translucent grids in the translucent grid queue, sends a sorting completion notification to the main thread;

A rendering unit, where the main thread receives the sorting completion notification and completes the rendering of the virtual objects in the image frame.

In a fourth aspect, an electronic device is provided, comprising:

processor; and

memory arranged to store computer-executable instructions which, when executed, cause the processor to:

Collect a translucent grid queue of image frames to be rendered through the main thread, and send a sorting notification to the sorting thread, the translucent grid queue includes a plurality of translucent grids, and one translucent grid corresponds to one virtual object;

The sorting thread, in response to the sorting notification sent by the main thread, acquires the semi-transparent meshes to be sorted in the semi-transparent mesh queue, and based on the triangle index list of the semi-transparent meshes to be sorted, for all the semi-transparent meshes to be sorted. Sorting the translucent meshes to be sorted to determine the rendering order of the triangular faces in the translucent meshes to be sorted;

After the sorting thread finishes sorting the plurality of translucent grids in the translucent grid queue, sending a sorting completion notification to the main thread;

The main thread receives the sorting completion notification and completes the rendering of the virtual objects in the image frame.

In a fifth aspect, a computer-readable storage medium is proposed, the computer-readable storage medium stores one or more programs that, when executed by an electronic device including a plurality of application programs, cause all The described electronic device performs the following actions:

Collect a translucent grid queue of image frames to be rendered through the main thread, and send a sorting notification to the sorting thread, the translucent grid queue includes a plurality of translucent grids, and one translucent grid corresponds to one virtual object;

The sorting thread, in response to the sorting notification sent by the main thread, acquires the semi-transparent meshes to be sorted in the semi-transparent mesh queue, and based on the triangle index list of the semi-transparent meshes to be sorted, for all the semi-transparent meshes to be sorted. Sorting the translucent meshes to be sorted to determine the rendering order of the triangular faces in the translucent meshes to be sorted;

After the sorting thread finishes sorting the plurality of translucent grids in the translucent grid queue, sending a sorting completion notification to the main thread;

The main thread receives the sorting completion notification and completes the rendering of the virtual objects in the image frame.

It can be seen from the technical solutions provided by the above embodiments of this specification that the solutions of the embodiments of this specification have at least one of the following technical effects:

In one or more embodiments provided in this specification, the sorting task of the translucent grid of the image frame to be rendered can be handed over to the sorting thread for execution alone, and the main thread is responsible for collecting the translucent grid queue of the image frame to be rendered, The translucent grid queue includes a plurality of translucent grids, and for each image frame, the virtual objects containing the translucent grids are rendered in real time through a multi-threading mechanism, so as to ensure that the image frame contains the translucent grids. The correctness of the rendering effect of the virtual object of the grid in the dynamic state. Moreover, the multi-threading mechanism is used to sort the translucent grids in each image frame, which also makes full use of the superior performance of multi-core CPUs, improves the sorting efficiency of the translucent grids, and saves the need to manually sort the translucent grids. expended resources.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present specification or the prior art, the following briefly introduces the accompanying drawings required in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments described in this specification. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative labor.

FIG. 1 is a schematic flowchart of an implementation of a virtual object rendering method provided by an embodiment of the present specification.

FIG. 2 is a schematic diagram of the workflow of the main thread in the virtual object rendering method provided according to an embodiment of the present specification.

FIG. 3 is a schematic diagram of the workflow of sorting threads in a virtual object rendering method provided according to an embodiment of the present specification.

FIG. 4 is a schematic structural diagram of a virtual object rendering system provided by an embodiment of the present specification.

FIG. 5 is a schematic structural diagram of a virtual object rendering apparatus provided by an embodiment of the present specification.

FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present specification.

Detailed ways

In order to make the objectives, technical solutions and advantages of this document more apparent, exemplary embodiments according to this document will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this document, not all of the embodiments of this document, and it should be understood that this document is not limited by the example embodiments described herein.

Embodiments of the present document will be described in more detail below with reference to the accompanying drawings. While certain embodiments of this document are shown in the drawings, it is to be understood that this document may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for the purpose of A more thorough and complete understanding of this document. It should be understood that the drawings and embodiments in this document are only used for exemplary purposes, and are not used to limit the protection scope of this document.

It should be understood that the various steps described in the method embodiments of this document may be performed in different orders and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of this document is not limited in this regard.

The term "including" and its variants used in this document are open to include, ie, "including but not limited to". The term "based on" is "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below.

It should be noted that the concepts such as "first" and "second" mentioned in this document are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or interdependence.

It should be noted that the modifications of "one" and "plurality" mentioned in this document are illustrative rather than restrictive, and those skilled in the art should understand that unless the context clearly indicates otherwise, they should be understood as "one or a plurality of" multiple".

The names of messages or information exchanged between multiple devices in the embodiments of this document are only used for illustrative purposes, and are not used to limit the scope of these messages or information.

In order to ensure the rendering order of the translucent mesh under static and dynamic conditions, and to reduce the manual operation cost in the rendering process, one or more embodiments of this specification provide a virtual object rendering method.

As described in the background art, the rendering order of the triangle sequence of the translucent mesh corresponding to the existing virtual object is still fixed when the virtual object is dynamic. This results in that when the virtual object changes the angle in the changing image frame, such as rotation, etc., the rendering is still performed according to the rendering order of the triangle sequence of the semi-transparent mesh in the initial state of the virtual image, and a rendering effect error occurs. Case.

In order to solve this problem, an embodiment of the present specification provides a virtual object rendering method. The virtual object rendering method can use the main thread to render the translucent mesh in the image frame to be rendered before each image frame is displayed to the user. The grid is collected and added to the translucent grid queue of the image frame, and then the sorting thread responds to the sorting notification sent by the main thread to obtain the translucent grid to be sorted in the translucent grid queue, and based on the to-be-sorted The triangular index list of the semi-transparent mesh, sort the semi-transparent mesh to be sorted to determine the rendering order of the triangular faces in the semi-transparent mesh to be sorted, and finally receive the sorting thread by the main thread to complete the semi-transparent mesh queue. Renders the dummy objects in the image frame after the sorting of the translucent mesh is notified. In this way, no matter how the virtual objects in the image frame are dynamically transformed, since the translucent grids corresponding to the virtual objects in each image frame are sorted, the image frame displayed to the user can avoid rendering errors. The problem.

FIG. 1 is a schematic diagram of an implementation flow of a virtual object rendering method provided by an embodiment of the present specification. The virtual object rendering method shown in FIG. 1 may include:

Step 110: Collect the translucent grid queue of the image frame to be rendered through the main thread, and send a sorting notification to the sorting thread. The translucent grid queue includes multiple translucent grids, and one translucent grid corresponds to one virtual object. .

The image frame may be an image frame in a game video, the image frame often contains multiple virtual objects, and some virtual objects may contain a translucent grid. When the virtual object is in a dynamic situation, such as rotation and other actions to change the angle of the virtual object, the translucent grid corresponding to the virtual object may have the problem of rendering interspersed, that is, the rendering effect will be wrong, which will give the user a bad visual experience. . In this case, before each image frame is displayed to the user, the embodiment of the present specification captures the translucent grid in the image frame, and adds the translucent grid in the image frame to the image frame to be rendered. The translucent grid queue, and then the main thread sends a sorting notification to the sorting thread, so as to use the multi-thread mechanism to complete the sorting task of the translucent grid corresponding to the avatar in the image frame.

Among them, multiple translucent grids are acquired by the main thread and added to the translucent grid queue.

It should be understood that since the main thread is responsible for the rendering work, in order to improve the sorting efficiency of the translucent grid, a multi-threading mechanism can be used to perform the rendering work of each image frame. Specifically, the main thread can be responsible for collecting the information in each image frame to be rendered. The work of resetting multiple translucent meshes and refreshing the triangle index list of the sorted translucent meshes, while the sorting work of the translucent meshes to be sorted can be performed by the sorting thread alone.

Because translucent grids have the problem of rendering interspersed, in order to improve the efficiency of collecting translucent grids, a special naming method can be agreed for the translucent grids, for example, "_a" can be added to the suffix; if The main thread recognizes that there is a newly added translucent mesh with the "_a" naming suffix in the image frame, then the main thread collects and adds it to the translucent mesh queue. And if the main thread recognizes that the translucent mesh with the "_a" named suffix in the image frame is removed from the virtual space, then the main thread deletes the translucent mesh from the translucent mesh queue.

Step 120, the sorting thread obtains the semi-transparent meshes to be sorted in the semi-transparent mesh queue in response to the sorting notification sent by the main thread, and based on the triangle index list of the semi-transparent meshes to be sorted, the semi-transparent meshes to be sorted Sorts to determine the rendering order of the triangular faces in the translucent mesh to be sorted.

Among them, the translucent grids in the translucent grid queue are translucent grids waiting to be sorted. When the sorting thread starts to execute, it can sequentially pull the translucent grids to be sorted from the translucent grid queue for execution. Sorting task, that is, the sorting task is performed by the sorting thread traversing the translucent grids to be sorted in the translucent grid queue.

Optionally, since translucent meshes are further divided into skinned meshes and non-skinned meshes, and when skinned meshes are sorted, it is also necessary to obtain the vertex list information after skinning, so as to improve the sorting of skinned meshes. accuracy. Specifically, based on the triangle index list of the semitransparent meshes to be sorted, the semitransparent meshes to be sorted are sorted, including:

Determine whether the translucent mesh to be sorted is a skinned mesh;

If the translucent mesh to be sorted is a skinned mesh, obtain the skinned vertex list information in the translucent mesh to be sorted based on the relevant data of the skinned mesh;

Determine the triangle index list of the translucent mesh to be sorted based on the skinned vertex list information in the translucent mesh to be sorted;

Sort the translucent meshes to be sorted based on the list of triangle indices of the translucent meshes to be sorted.

Among them, skinning is a term for 3D animation, and is also used in 3D games. It is a production technology of 3D animation. Based on the model created in 3D software, bones are added to the model. Since the bones and the model are independent of each other, in order to allow the bones to drive the model to produce reasonable motion, the technique of binding the model to the bones is called skinning. Since the skin moves with the bones, there may be problems with rendering interspersed when the bones are moving.

In order to solve this problem, the embodiments of the present specification can obtain the skinning matrix of each frame under the skinning grid dynamics, and the skinning matrix of each frame under the skinning grid dynamics, and obtain the skinning grid at the current moment (that is, the image frame time), and based on the skin matrix of the skinned mesh at the current time, determine the skinned vertex list information of the translucent mesh at the current time. Specifically, based on the relevant data of the skinned mesh, obtain the skinned vertex list information in the translucent mesh to be sorted, including:

Based on the bone matrix of the skinned mesh, the bone weight corresponding to each vertex in the skinned mesh, and the initial vertex list information of the skinned mesh, obtain the skinning matrix of each frame under the dynamic skinning mesh;

Based on the skinning matrix of each frame under the skinning mesh dynamics, obtain the skinning matrix of the skinning mesh at the image frame moment;

Based on the skinning matrix of the skinned mesh at the image frame time, the skinned vertex list information of the translucent mesh to be sorted at the current time is determined.

Optionally, if the translucent mesh to be sorted is not a skinned mesh, the vertex list information of the translucent mesh to be sorted can be directly obtained;

Based on the vertex list information in the translucent mesh to be sorted, the triangle index list of the translucent mesh to be sorted is determined.

Optionally, the sorting thread may sort the triangular faces in the semi-transparent mesh to be sorted according to the coordinates of the center points of each triangle in the triangle index list of the semi-transparent mesh to be sorted. Specifically, based on the coordinates of the center points of the triangles in the triangle index list of the translucent meshes to be sorted, sort the translucent meshes to be sorted, including:

Convert the coordinates of the center points of each triangle in the triangle index list of the translucent mesh to be sorted into the camera space to obtain the coordinates of the center points of each triangle in the camera space;

Determine the distance from the center point of each triangle to the camera in the camera space based on the coordinates of the center point of each triangle in the camera space;

Sort the triangle index list of the semi-transparent mesh to be sorted in descending order of the distance from the center point of each triangle to the camera in the camera space.

Optionally, in order to facilitate the triangle index list of the translucent mesh to be sorted, the coordinates of the center points of each triangle in the triangle index list of the translucent mesh to be sorted can be converted into camera space to determine each triangle. The distance of the center point from the camera. Specifically, according to the distance from the center point of each triangle to the camera in the camera space in descending order, sort the triangle index list of the semi-transparent mesh to be sorted, including:

Sort the triangle index list of the semi-transparent mesh to be sorted by insertion sort according to the distance from the center point of each triangle to the camera in the camera space in descending order.

Among them, insertion sort means that in the elements to be sorted, assuming that the previous n-1 (where n>=2) numbers are already sorted, now insert the nth number into the previously sorted sequence, Then find a suitable position for yourself, so that the sequence of inserting the nth number is also in order. The process of inserting all elements according to this method until the entire sequence is sorted is called insertion sort.

Step 130: After the sorting thread completes sorting the multiple translucent grids in the translucent grid queue, it sends a sorting completion notification to the main thread.

For example, after the main thread waits for the sorting thread to sort the translucent mesh, it can refresh the triangular index list after the translucent mesh is sorted, and after waiting for the main thread to refresh all of them, the main thread notifies the sorting thread to execute the next image frame The task of sorting the translucent grids in the middle is to sort the translucent grids in the translucent grid queue corresponding to the next image frame of the current image frame.

Among them, the main thread and the sorting thread can synchronize whether the sorting is completed or not by synchronizing the handle, specifically, the AutoResetEvent thread synchronization mechanism of the .NET library. Specifically, the sorting thread can call AutoResetEvent.WaitOne to wait for the signal. When the sorting thread completes sorting all the translucent grids in the translucent grid queue corresponding to the image frame, it can call the AutoResetEvent.Set method to send a signal to notify the main thread. Sorting is complete.

Step 140, the main thread receives the sorting completion notification and completes the rendering of the virtual objects in the image frame.

Optionally, in order to ensure the correctness of the rendering order of the triangle index list in the translucent mesh and avoid the problem of rendering interspersed, the main thread receives the sorting completion notification and completes the rendering of the virtual objects in the image frame, including:

The main thread receives the sorting completion notification and refreshes the triangle index list of multiple translucent meshes;

The main thread completes the rendering of the virtual objects in the image frame based on the refreshed triangle index list of multiple translucent meshes.

The main thread refreshes the triangle index lists of multiple translucent meshes, specifically, replacing the triangle index lists of multiple translucent meshes before sorting by the sorting thread with the triangle indices of multiple semitransparent meshes sorted by the sorting thread list, so that the main thread can complete the rendering of multiple virtual objects in the image frame based on the triangle index list of multiple translucent meshes sorted by the sorting thread.

Specifically, the rendering of the translucent mesh can be performed by the rendering engine, that is, the main thread passes the rendering task to the rendering engine, and the rendering engine is based on the refreshed translucent mesh in the image frame from front to back in the triangle index list of the translucent mesh order to render multiple virtual objects in the image frame.

2 is a schematic diagram of the workflow of a main thread in a virtual object rendering method provided according to an embodiment of the present specification, including:

Step 21, adding the translucent grid of the target virtual object to be sorted into the translucent grid queue.

Step 22: Determine whether the single cycle of the sorting thread ends.

If the single loop of the sorting thread ends, step 23 is executed.

Step 23: Refresh the triangle index list of multiple translucent meshes in the translucent mesh queue.

Step 24: Determine whether the triangular index lists of multiple translucent meshes in the translucent mesh queue are refreshed.

Step 25, notify the sorting thread to start the next cycle.

At this point, the sorting thread can pull the semi-transparent grid to be sorted from the semi-transparent grid queue of the next image frame for sorting.

3 is a schematic diagram of the workflow of sorting threads in a virtual object rendering method provided according to an embodiment of the present specification, including:

Step 31: Traverse the translucent meshes to be sorted in the new translucent mesh queue to determine whether they are skin meshes.

If the translucent mesh to be sorted is a skinned mesh, go to step 33 , and if the translucent mesh to be sorted is not a skinned mesh, go to step 32 .

Step 32, acquiring vertex list information.

If the translucent mesh to be sorted is not a skinned mesh, the vertex list information of the translucent mesh to be sorted can be directly obtained.

Step 33: Obtain the vertex list information after skinning.

If the translucent mesh to be sorted is a skinned mesh, you need to obtain the skinned vertex list information.

Step 34: Determine the triangle index list and sort based on the triangle index list.

In one or more embodiments provided in this specification, the sorting task of the translucent grid of the image frame to be rendered can be handed over to the sorting thread for execution alone, and the main thread is responsible for collecting the translucent grid queue of the image frame to be rendered, The translucent grid queue includes a plurality of translucent grids, and for each image frame, the virtual objects containing the translucent grids are rendered in real time through a multi-threading mechanism, so as to ensure that the image frame contains the translucent grids. The correctness of the rendering effect of the virtual object of the grid in the dynamic state. Moreover, the multi-threading mechanism is used to sort the translucent grids in each image frame, which also makes full use of the superior performance of multi-core CPUs, improves the sorting efficiency of the translucent grids, and saves the need to manually sort the translucent grids. expended resources.

FIG. 4 is a schematic structural diagram of a virtual object rendering system provided by an embodiment of the present specification. The system of FIG. 4 may include a main thread 401 and a sorting thread 402, where:

The main thread 401 collects a translucent grid queue of image frames to be rendered, and sends a sorting notification to the sorting thread. The translucent grid queue includes multiple translucent grids, and one translucent grid corresponds to one virtual object;

The sorting thread 402 performs the following single cycle process:

In response to the sorting notification sent by the main thread, obtain the semi-transparent meshes to be sorted in the semi-transparent mesh queue, and based on the triangle index list of the semi-transparent meshes to be sorted, perform sorting on the semi-transparent meshes to be sorted. Sorting the translucent meshes to determine the rendering order of the triangular faces in the translucent meshes to be sorted;

After completing the sorting of the plurality of translucent grids in the translucent grid queue, a sorting completion notification is sent to the main thread, so that the main thread receives the sorting completion notification and completes the image Rendering of virtual objects in the frame.

Optionally, when the sorting thread 402 performs the step of sorting the semi-transparent meshes to be sorted based on the triangular index list of the semi-transparent meshes to be sorted, specifically:

determining whether the translucent mesh to be sorted is a skin mesh;

If the translucent mesh to be sorted is a skinned mesh, obtain skinned vertex list information in the translucent mesh to be sorted based on the relevant data of the skinned mesh;

determining, based on the skinned vertex list information in the translucent mesh to be sorted, a triangle index list of the translucent mesh to be sorted;

The semi-transparent meshes to be sorted are sorted based on the list of triangle indices of the semi-transparent meshes to be sorted.

Optionally, when the sorting thread 402 executes the step of acquiring the skinned vertex list information in the translucent mesh to be sorted based on the relevant data of the skinned mesh, it specifically executes:

Based on the bone matrix of the skinned mesh, the bone weights corresponding to the vertices in the skinned mesh, and the initial vertex list information of the skinned mesh, obtain each frame under the dynamic condition of the skinned mesh skin matrix;

Obtaining the skin matrix of the skin mesh at the image frame moment based on the skin matrix of each frame under the skin mesh dynamics;

Based on the skinning matrix of the skinned mesh at the current moment, the skinned vertex list information of the translucent mesh to be sorted at the image frame moment is determined.

Optionally, when the sorting thread 402 executes the step of sorting the semi-transparent meshes to be sorted based on the triangular index list of the semi-transparent meshes to be sorted, specifically:

determining the center point of each triangle in the triangle index list of the semitransparent mesh to be sorted;

The semitransparent meshes to be sorted are sorted based on the coordinates of the center points of the triangles in the triangle index list of the semitransparent meshes to be sorted.

Optionally, when the sorting thread 402 executes the step of sorting the translucent grid based on the coordinates of the center points of each triangle in the triangle index list of the translucent grid, it specifically executes:

Sort the triangle index list of the translucent mesh by insertion sort according to the distance from the center point of each triangle to the camera in the camera space in descending order.

Optionally, when the sorting thread 402 performs the step of sorting the semi-transparent meshes to be sorted based on the coordinates of the center points of each triangle in the triangle index list of the semi-transparent meshes to be sorted , the specific implementation:

Converting the coordinates of the center points of the triangles in the triangle index list of the translucent mesh to be sorted into the camera space to obtain the coordinates of the center points of the triangles in the camera space;

determining the distance between the center point of each triangle and the camera in the camera space based on the coordinates of the center point of each triangle in the camera space;

Sort the triangle index list of the semi-transparent mesh to be sorted in descending order of the distance between the center point of each triangle and the camera in the camera space.

Optionally, the sorting thread 402 executes a list of triangle indices of the translucent meshes to be sorted in descending order of the distance between the center point of each triangle and the camera in the camera space. When sorting the steps, execute:

Sort the triangle index list of the semi-transparent mesh to be sorted by insertion sort according to the distance from the center point of each triangle to the camera in the camera space in descending order.

Optionally, when the main thread 401 executes the steps of receiving the sorting completion notification and completing the rendering of the virtual objects in the image frame, it specifically executes:

The main thread receives the sorting completion notification, and refreshes the triangle index list of the plurality of translucent meshes;

The main thread renders a plurality of virtual objects corresponding to the plurality of translucent grids based on the refreshed triangle index list of the plurality of translucent grids, so as to complete the virtual objects in the image frame rendering.

For the specific implementation of the relevant steps in the embodiment shown in FIG. 4 , reference may be made to the specific implementation of the corresponding steps in the embodiments shown in FIG. 1 to FIG. 3 , and details of one or more embodiments of this specification are not repeated here.

The virtual object rendering system provided in this specification can hand over the sorting task of the translucent grid of the image frame to be rendered to the sorting thread alone, and the main thread is responsible for collecting the translucent grid queue of the image frame to be rendered. The grid queue includes multiple translucent grids. For each image frame, the virtual objects containing the translucent grids are rendered in real time through a multi-threading mechanism, so as to ensure that the virtual objects containing the translucent grids are included in the image frame. The correctness of the rendering effect of the object in the dynamic state. Moreover, the multi-threading mechanism is used to sort the translucent grids in each image frame, which also makes full use of the superior performance of multi-core CPUs, improves the sorting efficiency of the translucent grids, and saves the need to manually sort the translucent grids. expended resources.

FIG. 5 is a schematic structural diagram of a virtual object rendering apparatus 500 provided by an embodiment of the present specification. Referring to FIG. 5, in a software implementation, the virtual object rendering apparatus 500 may include:

The collection unit 501 collects the translucent grid queue of the image frame to be rendered through the main thread, and sends a sorting notification to the sorting thread. The translucent grid queue includes a plurality of translucent grids, and one translucent grid corresponds to a virtual object;

Sorting unit 502, the sorting thread obtains the semi-transparent meshes to be sorted in the semi-transparent mesh queue in response to the sorting notification sent by the main thread, and based on the triangle index of the semi-transparent meshes to be sorted List, sort the translucent meshes to be sorted to determine the rendering order of the triangular faces in the translucent meshes to be sorted;

The sending unit 503, after the sorting thread completes the sorting of the plurality of translucent grids in the translucent grid queue, sends a sorting completion notification to the main thread;

The rendering unit 504, the main thread receives the sorting completion notification and completes the rendering of the virtual object in the image frame.

The virtual object rendering apparatus provided by the embodiments of this specification can hand over the sorting task of the translucent grid of the image frame to be rendered to the sorting thread alone for execution, and the main thread is responsible for collecting the translucent grid queue of the image frame to be rendered. The translucent grid queue includes multiple translucent grids, and for each image frame, the virtual objects containing the translucent grids are rendered in real time through a multi-threading mechanism to ensure that the image frames contain translucent grids. The correctness of the rendering effect of the virtual object in the dynamic state. Moreover, the multi-threading mechanism is used to sort the translucent grids in each image frame, which also makes full use of the superior performance of multi-core CPUs, improves the sorting efficiency of the translucent grids, and saves the need to manually sort the translucent grids. expended resources.

Optionally, in an implementation manner, when the sorting unit 502 sorts the semi-transparent meshes to be sorted based on the triangle index list of the semi-transparent meshes to be sorted, the sorting unit 502 specifically executes:

determining whether the translucent mesh to be sorted is a skinned mesh;

If the translucent mesh to be sorted is a skinned mesh, obtain skinned vertex list information in the translucent mesh to be sorted based on the relevant data of the skinned mesh;

determining, based on the skinned vertex list information in the translucent mesh to be sorted, a triangle index list of the translucent mesh to be sorted;

The semi-transparent meshes to be sorted are sorted based on the list of triangle indices of the semi-transparent meshes to be sorted.

Optionally, in an implementation manner, the sorting unit 502 acquires the skinned vertex list information in the translucent mesh to be sorted based on the relevant data of the skinned mesh, and specifically executes: :

Based on the skeleton matrix of the skinned mesh, the bone weights corresponding to the vertices in the skinned mesh, and the initial vertex list information of the skinned mesh, obtain each frame under the dynamic condition of the skinned mesh skin matrix;

Obtaining the skin matrix of the skin mesh at the image frame moment based on the skin matrix of each frame under the skin mesh dynamics;

Based on the skinning matrix of the skinned mesh at the current moment, the skinned vertex list information of the translucent mesh to be sorted at the image frame moment is determined.

Optionally, in an implementation manner, the sorting unit 502 sorts the semi-transparent meshes to be sorted based on the triangle index list of the semi-transparent meshes to be sorted, and specifically performs:

determining the center point of each triangle in the triangle index list of the semitransparent mesh to be sorted;

The semi-transparent meshes to be sorted are sorted based on the coordinates of the center points of the triangles in the triangle index list of the semi-transparent meshes to be sorted.

Optionally, in an implementation manner, the sorting unit 502 executes the sorting based on the coordinates of the center points of each triangle in the triangle index list of the semi-transparent mesh to be sorted. The grid is sorted, and the specific implementation is as follows:

Converting the coordinates of the center points of the triangles in the triangle index list of the translucent mesh to be sorted into the camera space to obtain the coordinates of the center points of the triangles in the camera space;

determining the distance between the center point of each triangle and the camera in the camera space based on the coordinates of the center point of each triangle in the camera space;

Sort the triangle index list of the semi-transparent mesh to be sorted in descending order of the distance between the center point of each triangle and the camera in the camera space.

Optionally, in an implementation manner, the sorting unit 502 performs the sorting of the half-to-be-sorted half of the triangles according to the distance from the center point of each triangle to the camera in the camera space in descending order. Sort the triangle index list of the transparent mesh, specifically:

Sort the triangle index list of the semi-transparent mesh to be sorted by insertion sort according to the distance from the center point of each triangle to the camera in the camera space in descending order.

Optionally, in an implementation manner, the rendering unit 504 receives the sorting completion notification and completes the rendering of the virtual object in the image frame when executing the main thread, and specifically executes:

The main thread receives the sorting completion notification, and refreshes the triangle index list of the plurality of translucent meshes;

The main thread renders a plurality of virtual objects corresponding to the plurality of translucent grids based on the refreshed triangle index list of the plurality of translucent grids, so as to complete the virtual objects in the image frame rendering.

The virtual object rendering apparatus 500 can implement the methods of the method embodiments shown in FIGS. 1 to 3 . For details, reference may be made to the virtual object rendering apparatus methods of the embodiments shown in FIGS. 1 to 3 , which will not be repeated.

FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present specification. Referring to FIG. 6 , at the hardware level, the electronic device includes a processor, and optionally an internal bus, a network interface, and a memory. The memory may include memory, such as high-speed random-access memory (Random-Access Memory, RAM), or may also include non-volatile memory (non-volatile memory), such as at least one disk memory. Of course, the electronic equipment may also include hardware required for other services.

The processor, the network interface, and the memory can be connected to each other through an internal bus, which can be an ISA (Industry Standard Architecture, industry standard architecture) bus, a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus or an EISA (Extended Industry Standard) bus. StandardArchitecture, extended industry standard structure) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one bidirectional arrow is shown in FIG. 6, but it does not mean that there is only one bus or one type of bus.

memory for storing programs. Specifically, the program may include program code, and the program code includes computer operation instructions. The memory may include memory and non-volatile memory and provide instructions and data to the processor.

The processor reads the corresponding computer program from the non-volatile memory into the memory and then executes it, forming a virtual object rendering device on a logical level. The processor executes the program stored in the memory, and is specifically used to perform the following operations:

Collect a translucent grid queue of image frames to be rendered through the main thread, and send a sorting notification to the sorting thread, the translucent grid queue includes a plurality of translucent grids, and one translucent grid corresponds to one virtual object;

The sorting thread, in response to the sorting notification sent by the main thread, acquires the semi-transparent meshes to be sorted in the semi-transparent mesh queue, and based on the triangle index list of the semi-transparent meshes to be sorted, for all the semi-transparent meshes to be sorted. Sorting the translucent meshes to be sorted to determine the rendering order of the triangular faces in the translucent meshes to be sorted;

After the sorting thread finishes sorting the plurality of translucent grids in the translucent grid queue, sending a sorting completion notification to the main thread;

The main thread receives the sorting completion notification and completes the rendering of the virtual objects in the image frame.

The electronic device provided by the embodiments of this specification can hand over the sorting task of the translucent grid of the image frame to be rendered to the sorting thread alone for execution, and the main thread is responsible for collecting the translucent grid queue of the image frame to be rendered. The grid queue includes multiple translucent grids. For each image frame, the virtual objects containing the translucent grids are rendered in real time through a multi-threading mechanism, so as to ensure that the virtual objects containing the translucent grids are included in the image frame. The correctness of the rendering effect of the object in the dynamic state. Moreover, the multi-threading mechanism is used to sort the translucent grids in each image frame, which also makes full use of the superior performance of multi-core CPUs, improves the sorting efficiency of the translucent grids, and saves the need to manually sort the translucent grids. expended resources.

The above-mentioned methods performed by the virtual object rendering apparatus disclosed in the embodiments shown in FIG. 1 to FIG. 3 of this specification may be applied to a processor, or implemented by a processor. A processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above-mentioned method can be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software. The above-mentioned processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; it may also be a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit ( Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods, steps and logic block diagrams disclosed in the embodiments of this specification can be implemented or executed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the methods disclosed in conjunction with the embodiments of this specification may be directly embodied as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art. The storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware.

The electronic device can also execute the methods shown in FIGS. 1 to 3, and implement the functions of the virtual object rendering apparatus in the embodiment shown in FIG.

The embodiments of the present specification also provide a computer-readable storage medium, where the computer-readable storage medium stores one or more programs, and the one or more programs include instructions, and the instructions, when used by a portable electronic device including a plurality of application programs During execution, the portable electronic device can be made to execute the method of the embodiment shown in FIG. 1 to FIG. 3 , and is specifically configured to execute the following operations:

Collect a translucent grid queue of image frames to be rendered through the main thread, and send a sorting notification to the sorting thread, the translucent grid queue includes a plurality of translucent grids, and one translucent grid corresponds to one virtual object;

The sorting thread, in response to the sorting notification sent by the main thread, acquires the semi-transparent meshes to be sorted in the semi-transparent mesh queue, and based on the triangle index list of the semi-transparent meshes to be sorted, for all the semi-transparent meshes to be sorted. Sorting the translucent meshes to be sorted to determine the rendering order of the triangular faces in the translucent meshes to be sorted;

After the sorting thread finishes sorting the plurality of translucent grids in the translucent grid queue, sending a sorting completion notification to the main thread;

The main thread receives the sorting completion notification and completes the rendering of the virtual objects in the image frame.

The computer-readable storage medium provided by the embodiments of this specification can hand over the sorting task of the translucent grid of the image frame to be rendered to the sorting thread alone for execution, and the main thread is responsible for collecting the translucent grid queue of the image frame to be rendered, The translucent grid queue includes a plurality of translucent grids, and for each image frame, the virtual objects containing the translucent grids are rendered in real time through a multi-threading mechanism, so as to ensure that the image frame contains the translucent grids. The correctness of the rendering effect of the virtual object of the grid in the dynamic state. Moreover, the multi-threading mechanism is used to sort the translucent grids in each image frame, which also makes full use of the superior performance of multi-core CPUs, improves the sorting efficiency of the translucent grids, and saves the need to manually sort the translucent grids. expended resources.

Of course, in addition to software implementations, the electronic devices in this specification do not exclude other implementations, such as logic devices or the combination of software and hardware, etc. That is to say, the execution subjects of the following processing procedures are not limited to each logic unit. It can also be a hardware or logic device.

The foregoing describes specific embodiments of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve desirable results. Additionally, the processes depicted in the figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

In a word, the above descriptions are only preferred embodiments of the present specification, and are not intended to limit the protection scope of the present specification. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this specification shall be included within the protection scope of this specification.

The systems, devices, modules or units described in the above embodiments may be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or A combination of any of these devices.

Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or which are inherent to such a process, method, article of manufacture, or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture, or device that includes the element.

Each embodiment in this specification is described in a progressive manner, and the same and similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, as for the system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for related parts, please refer to the partial descriptions of the method embodiments.

Claims (11)

1. A virtual object rendering method, comprising:

acquiring a semi-transparent grid queue of an image frame to be rendered through a main thread, and sending a sequencing notice to a sequencing thread, wherein the semi-transparent grid queue comprises a plurality of semi-transparent grids, and one semi-transparent grid corresponds to one virtual object;

the sequencing thread responds to a sequencing notice sent by the main thread, obtains the semi-transparent grids to be sequenced in the semi-transparent grid queue, and sequences the semi-transparent grids to be sequenced on the basis of a triangle index list of the semi-transparent grids to be sequenced so as to determine the rendering sequence of triangular faces in the semi-transparent grids to be sequenced;

after the sequencing thread finishes sequencing the plurality of semi-transparent grids in the semi-transparent grid queue, sending a sequencing completion notification to the main thread;

the main thread receives the ordering completion notification and completes rendering of the virtual object in the image frame.

2. The method of claim 1, sorting the semi-transparent meshes to be sorted based on the triangle index list of semi-transparent meshes to be sorted, comprising:

determining whether the semi-transparent grids to be sorted are skin grids;

if the semi-transparent mesh to be sorted is a skinned mesh, acquiring the skinned vertex list information in the semi-transparent mesh to be sorted based on the relevant data of the skinned mesh;

determining a triangle index list of the semi-transparent mesh to be sorted based on the skinned vertex list information in the semi-transparent mesh to be sorted;

and sorting the semi-transparent grids to be sorted based on the triangle index list of the semi-transparent grids to be sorted.

3. The method of claim 2, wherein obtaining the information of the covered vertex list in the semi-transparent mesh to be sorted based on the relevant data of the covered mesh comprises:

acquiring each frame of skinned matrix under the skinned mesh dynamic state based on the bone matrix of the skinned mesh, the bone weight corresponding to each vertex in the skinned mesh and the initial vertex list information of the skinned mesh;

based on each frame of skin matrix under the skin grid dynamic state, obtaining the skin matrix of the skin grid at the image frame moment;

and determining the skinned vertex list information of the semi-transparent grids to be sequenced at the image frame time based on the skinned matrix of the skinned grids at the current time.

4. The method of claim 1, sorting the semi-transparent meshes to be sorted based on the triangle index list of semi-transparent meshes to be sorted, comprising:

determining the central point of each triangle in the triangle index list of the semi-transparent grids to be sorted;

and sorting the semi-transparent grids to be sorted based on the coordinates of the center points of the triangles in the triangle index list of the semi-transparent grids to be sorted.

5. The method of claim 4, sorting the semi-transparent meshes to be sorted based on coordinates of center points of triangles in the triangle index list of the semi-transparent meshes to be sorted, comprising:

converting the coordinates of the center point of each triangle in the triangle index list of the semi-transparent grids to be sorted into a camera space to obtain the coordinates of the center point of each triangle in the camera space;

determining a distance of the center point of each triangle from a camera in the camera space based on coordinates of the center point of each triangle under the camera space;

and sorting the triangle index lists of the semi-transparent grids to be sorted according to the sequence of the distances from the central points of the triangles to the cameras in the camera space from large to small.

6. The method of claim 5, wherein sorting the triangle index list of the semi-transparent meshes to be sorted in order of decreasing distance of the center point of each triangle from the camera in the camera space comprises:

and sorting the triangle index lists of the semi-transparent grids to be sorted in an insertion sorting mode according to the sequence of the distances from the central points of the triangles to the cameras in the camera space from large to small.

7. The method of claim 1, the main thread receiving the sort complete notification and completing rendering of virtual objects in the image frame, comprising:

the main thread receives the ordering completion notice and refreshes the triangle index lists of the plurality of semi-transparent grids;

and rendering a plurality of virtual objects corresponding to the plurality of semi-transparent grids by the main thread based on the refreshed triangle index lists of the plurality of semi-transparent grids so as to complete the rendering of the virtual objects in the image frame.

8. A virtual object rendering system, the system comprising a main thread and an ordering thread, wherein:

the main thread collects a semi-transparent grid queue of the image frame to be rendered and sends a sequencing notice to the sequencing thread, wherein the semi-transparent grid queue comprises a plurality of semi-transparent grids, and one semi-transparent grid corresponds to one virtual object;

the sequencing thread executes the following single-loop process:

in response to a sorting notification sent by the main thread, obtaining semi-transparent grids to be sorted in the semi-transparent grid queue, and sorting the semi-transparent grids to be sorted based on a triangle index list of the semi-transparent grids to be sorted to determine a rendering order of triangular faces in the semi-transparent grids to be sorted;

and after finishing sequencing the plurality of semi-transparent grids in the semi-transparent grid queue, sending a sequencing completion notice to the main thread, so that the main thread receives the sequencing completion notice and finishes the rendering of the virtual objects in the image frame.

9. A virtual object rendering apparatus, comprising:

the system comprises an acquisition unit, a display unit and a processing unit, wherein the acquisition unit acquires a semi-transparent grid queue of an image frame to be rendered through a main thread and sends a sequencing notice to a sequencing thread, the semi-transparent grid queue comprises a plurality of semi-transparent grids, and one semi-transparent grid corresponds to a virtual object;

the sorting unit is used for responding to a sorting notice sent by the main thread by the sorting thread, acquiring the semi-transparent grids to be sorted in the semi-transparent grid queue, and sorting the semi-transparent grids to be sorted based on the triangle index list of the semi-transparent grids to be sorted so as to determine the rendering sequence of the triangular surfaces in the semi-transparent grids to be sorted;

a sending unit, configured to send a sorting completion notification to the main thread after the sorting thread completes sorting the multiple semi-transparent grids in the semi-transparent grid queue;

and the main thread receives the sequencing completion notification and completes the rendering of the virtual object in the image frame.

10. An electronic device, comprising:

a processor; and

a memory arranged to store computer executable instructions that, when executed, cause the processor to:

acquiring a semi-transparent grid queue of an image frame to be rendered through a main thread, and sending a sequencing notice to a sequencing thread, wherein the semi-transparent grid queue comprises a plurality of semi-transparent grids, and one semi-transparent grid corresponds to one virtual object;

the sequencing thread responds to a sequencing notice sent by the main thread, obtains the semi-transparent grids to be sequenced in the semi-transparent grid queue, and sequences the semi-transparent grids to be sequenced on the basis of a triangle index list of the semi-transparent grids to be sequenced so as to determine the rendering sequence of triangular faces in the semi-transparent grids to be sequenced;

after the sequencing thread finishes sequencing the plurality of semi-transparent grids in the semi-transparent grid queue, sending a sequencing completion notification to the main thread;

the main thread receives the ordering completion notification and completes rendering of the virtual object in the image frame.

11. A computer-readable storage medium storing one or more programs that, when executed by an electronic device including a plurality of application programs, cause the electronic device to:

acquiring a semi-transparent grid queue of an image frame to be rendered through a main thread, and sending a sequencing notice to a sequencing thread, wherein the semi-transparent grid queue comprises a plurality of semi-transparent grids, and one semi-transparent grid corresponds to one virtual object;

the sequencing thread responds to a sequencing notice sent by the main thread, obtains the semi-transparent grids to be sequenced in the semi-transparent grid queue, and sequences the semi-transparent grids to be sequenced on the basis of a triangle index list of the semi-transparent grids to be sequenced so as to determine the rendering sequence of triangular faces in the semi-transparent grids to be sequenced;

after the sequencing thread finishes sequencing the plurality of semi-transparent grids in the semi-transparent grid queue, sending a sequencing completion notification to the main thread;

the main thread receives the ordering completion notification and completes rendering of the virtual object in the image frame.

Images