CN115063518A - Trajectory rendering method, device, electronic device and storage medium - Google Patents

Abstract

The embodiment of the application discloses a track rendering method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a track to be rendered, wherein the track to be rendered is a sliding track of a touch object in a three-dimensional space; generating three-dimensional model data based on the track to be rendered; and generating a three-dimensional graffiti rendering result corresponding to the track to be rendered based on the three-dimensional model data and the material capture mapping. In a three-dimensional space, the texture capture map is used for drawing images, so that the drawn images can simulate real physical illumination effects, and the reality sense can be better.

Description

Trajectory rendering method, device, electronic device and storage medium

technical field

The present application belongs to the technical field of virtual reality, and specifically relates to a trajectory rendering method, device, electronic device and storage medium.

Background technique

During the operation of a virtual reality/augmented reality (VR/AR for short) device, objects visible to the user are rendered. However, the images rendered by the related rendering methods are all pure colors, so that the rendered images have no feedback of ambient light, thus lacking realism.

SUMMARY OF THE INVENTION

In view of the above problems, the present application proposes a trajectory rendering method, apparatus, electronic device, and storage medium, so as to improve the above problems.

In a first aspect, an embodiment of the present application provides a trajectory rendering method, the method includes: acquiring a to-be-rendered trajectory, where the to-be-rendered trajectory is a sliding trajectory of a touch object in a three-dimensional space; based on the to-be-rendered trajectory, generating three-dimensional model data; and generating a three-dimensional graffiti rendering result corresponding to the track to be rendered based on the three-dimensional model data and the material capture map.

In a second aspect, an embodiment of the present application provides a trajectory rendering device, the device includes: a trajectory acquiring unit, configured to acquire a trajectory to be rendered, where the trajectory to be rendered is a sliding trajectory of a touch object in a three-dimensional space; data A generating unit is configured to generate three-dimensional model data based on the track to be rendered; a rendering unit is configured to capture a map based on the three-dimensional model data and the material, and generate a three-dimensional graffiti rendering result corresponding to the track to be rendered.

In a third aspect, embodiments of the present application provide an electronic device, including one or more processors and a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to Executed by the one or more processors, the one or more programs are configured to perform the above-described methods.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, wherein the foregoing method is executed when the program code is executed.

Embodiments of the present application provide a trajectory rendering method, apparatus, electronic device, and storage medium. First, obtain the track to be rendered, which is the sliding track of the touch object in the three-dimensional space, then generate 3D model data based on the track to be rendered, and then capture the map based on the 3D model data and the material to generate the track corresponding to the to-be-rendered track. 3D Doodle rendering result. Through the above method, in the three-dimensional space, the image is drawn through the material capture map, so that the drawn image can simulate the real physical lighting effect, so that it can be more realistic.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 shows a schematic diagram of an application scenario of a trajectory rendering method proposed by an embodiment of the present application;

FIG. 2 shows a schematic diagram of a track to be rendered proposed by an embodiment of the present application;

FIG. 3 shows a schematic diagram of an application scenario of a trajectory rendering method proposed by an embodiment of the present application;

FIG. 4 shows a schematic diagram of an application scenario of a trajectory rendering method proposed by an embodiment of the present application;

FIG. 5 shows a flowchart of a trajectory rendering method proposed by an embodiment of the present application;

FIG. 6 shows a schematic diagram of a track to be rendered in an embodiment of the present application;

FIG. 7 shows a schematic diagram of three-dimensional model data generated in an embodiment of the present application;

FIG. 8 shows a flowchart of a trajectory rendering method proposed by another embodiment of the present application;

FIG. 9 shows a schematic diagram of a Bezier curve in another embodiment of the present application;

FIG. 10 shows a schematic diagram of a track to be rendered in another embodiment of the present application;

11 shows a schematic diagram of acquiring a circle corresponding to a trajectory point in another embodiment of the present application;

12 shows a schematic diagram of obtaining a reference point from a circle corresponding to a trajectory point in another embodiment of the present application;

13 shows a schematic diagram of three-dimensional model data generated in another embodiment of the present application;

FIG. 14 shows a flowchart of a trajectory rendering method proposed by still another embodiment of the present application;

FIG. 15 shows a schematic diagram of preset three-dimensional model data in still another embodiment of the present application;

FIG. 16 shows a schematic diagram of dividing preset three-dimensional model data in still another embodiment of the present application;

17 shows a schematic diagram of three-dimensional model data generated in still another embodiment of the present application;

FIG. 18 shows a flowchart of a trajectory rendering method proposed by another embodiment of the present application;

FIG. 19 shows a schematic diagram of a MatCap map generated in another embodiment of the present application;

FIG. 20 shows a schematic diagram of a three-dimensional graffiti rendering result generated in another embodiment of the present application;

FIG. 21 shows a structural block diagram of a trajectory rendering apparatus proposed by an embodiment of the present application;

FIG. 22 shows a structural block diagram of a trajectory rendering apparatus proposed by an embodiment of the present application;

FIG. 23 shows a structural block diagram of an electronic device or a server in the present application for executing the trajectory rendering method according to an embodiment of the present application;

FIG. 24 shows a storage unit in the present application for storing or carrying program codes for implementing the trajectory rendering method according to the embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

Virtual Reality/Augmented Reality (VR/AR for short) is a virtual simulation system that can be constructed, experienced and interacted with. . Realistic scenes and models provide an immersive experience. At present, it is mostly used in games, film and television, animation, military and other fields.

In the research of related trajectory rendering methods, the inventor found that related trajectory rendering methods rely heavily on handheld sensor hardware to collect trajectory points drawn by users, and the drawn graphics cannot be well integrated into VR/AR scene settings, or In the collected virtual or real lighting scenes, most of the images drawn by related rendering methods are pure colors, and there is no feedback from ambient light, thus lacking realism.

Therefore, the inventor proposes the trajectory rendering method, apparatus, electronic device and storage medium in the present application. First, obtain the track to be rendered, which is the sliding track of the touch object in the three-dimensional space, then generate 3D model data based on the track to be rendered, and then capture the map based on the 3D model data and the material to generate the track corresponding to the to-be-rendered track. 3D Doodle rendering result. Through the above method, in the three-dimensional space, the image is drawn through the material capture map, so that the drawn image can simulate the real physical lighting effect, so that it can be more realistic.

Please refer to FIG. 1 , which is a schematic diagram of an application scenario of the trajectory rendering method provided by an embodiment of the present application.

As shown in FIG. 1 , the trajectory rendering method provided by this embodiment of the present application can be applied to the application scenario shown in FIG. 1 . At the same time, users can draw track points or images in three-dimensional space through fingers or touch objects according to the content displayed in the VR/AR device. Exemplarily, when the user is wearing a VR/AR device and is playing a game, if the VR/AR device shows that the user needs to control the character in the game to move down, the user can use a finger or a touch object to move in the three-dimensional A downward trajectory is drawn in the space, as shown in FIG. 2 . The trajectory in FIG. 2 is a downward trajectory drawn by a user in a three-dimensional space through a finger or a touch object.

Optionally, in this embodiment of the present application, the provided trajectory rendering method may be executed by an electronic device. In this manner performed by the electronic device, all steps in the trajectory rendering method provided by the embodiments of the present application may be performed by the electronic device. For example, as shown in FIG. 3 , the trajectory to be rendered can be acquired by the trajectory acquisition device of the electronic device 100, and then the acquired trajectory to be rendered can be transmitted to the processor, so that the processor can generate 3D model data in real time based on the trajectory to be rendered , and further, the processor may also capture the map based on the 3D model data and the material to generate a 3D graffiti rendering result corresponding to the track to be rendered.

Furthermore, the trajectory rendering method provided by the embodiment of the present application may also be executed by a server (cloud). Correspondingly, in this method executed by the server, the electronic device can obtain the image drawn by the user's finger, and send the image drawn by the user's finger to the server synchronously, and then the server can recognize the image drawn by the user's finger in real time to obtain the to-be-rendered image. track, so that the server can generate 3D model data based on the track to be rendered; based on the 3D model data and the material capture map, generate a 3D graffiti rendering result corresponding to the track to be rendered.

In addition, the electronic device and the server can also be cooperatively executed. In this manner of cooperative execution by the electronic device and the server, some steps in the trajectory rendering method provided by the embodiments of the present application are executed by the electronic device, while other parts of the steps are executed by the server.

Exemplarily, as shown in FIG. 4 , the electronic device 100 may execute a trajectory rendering method including: acquiring a to-be-rendered trajectory, where the to-be-rendered trajectory is a sliding trajectory of a touch object in a three-dimensional space, and then the server 200 executes For the to-be-rendered track, three-dimensional model data is generated; based on the three-dimensional model data and the material capture map, a three-dimensional graffiti rendering result corresponding to the to-be-rendered track is generated.

It should be noted that, in this way of co-execution by the electronic device and the server, the steps performed by the electronic device and the server respectively are not limited to the way described in the above example. In practical applications, the electronic device can be dynamically adjusted according to the actual situation. The steps performed by the device and the server separately.

It should be noted that the electronic device 100 can be not only the smart phone shown in FIG. 1 and FIG. 2 , but also a car device, a wearable device, a tablet computer, a notebook computer, a smart speaker, a VR/AR device, etc. . The server 200 may be an independent physical server, or may be a server cluster or a distributed system composed of multiple physical servers.

The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Referring to FIG. 5 , a trajectory rendering method provided by an embodiment of the present application is applied to an electronic device or server as shown in FIG. 3 or FIG. 4 , and the method includes:

Step S110: Acquire a track to be rendered, where the track to be rendered is a sliding track of the touch object in the three-dimensional space.

In this embodiment of the present application, the track to be rendered is a sliding track for which three-dimensional graphics need to be drawn. The touch object can be an item that the user can use to draw a sliding trajectory in a certain application scenario. For example, in a VR game scene, the touch object can be the controller held by the user or the user's finger. This is not specifically limited.

As an approach, the track to be rendered may be pre-stored in a cloud server or a sliding track in a preset storage area, and the track to be rendered may also be a sliding track acquired in real time. As one of the methods, when the track to be rendered is a sliding track pre-stored in a cloud server or a preset storage area, the corresponding sliding trajectories in different scenarios can be obtained in advance, and then the corresponding sliding tracks in different scenarios can be obtained in advance. Tracks are stored in cloud servers or preset storage areas. Among them, when storing the corresponding sliding trajectories in different application scenarios, you can first set different identifiers for different application scenarios, and set different numbers for the sliding trajectories corresponding to different application scenarios, and establish application scenarios and sliding trajectories. corresponding relationship. Optionally, if there are multiple sliding tracks corresponding to an application scenario, when setting numbers for the multiple sliding tracks, the multiple sliding tracks may be numbered according to a preset number sequence. Among them, the preset numbering order can be the order of the numbers from small to large, the order of the numbers from large to small, or the order of the time when the sliding track is obtained, according to the order of the numbers from small to large, etc., which is not specified here. limited. For example, if there are 3 sliding tracks in a VR game scene, the acquisition time of sliding track 1 is December 1, the acquisition time of sliding track 2 is December 5, and the acquisition time of sliding track 3 is On December 2nd, if the above three sliding tracks are numbered according to the sequence of the acquisition time of the sliding tracks and the sequence of numbers from small to large, the number of the sliding track 1 can be 001, and the number of the sliding track 3 can be 002, the number of the sliding track 2 can be 003.

After the sliding tracks corresponding to different application scenarios are stored in the above manner, when the track to be rendered needs to be obtained, the current application scenario can be identified first, and then when the current application scenario is identified, the current application scenario can be identified from the cloud server or The sliding track corresponding to the application scene is obtained from the preset storage area, and the obtained sliding track is used as the track to be rendered to be obtained. Optionally, when acquiring the sliding trajectories corresponding to the application scene, if there are multiple sliding trajectories corresponding to the application scene, the corresponding multiple sliding trajectories can be used as the to-be-rendered trajectories to be acquired; Any one of the sliding trajectories is used as the track to be rendered to be acquired; alternatively, the sliding track with the smallest or largest number among the corresponding multiple sliding trajectories can also be used as the track to be rendered to be acquired, which is not specified here. limited.

Further, each application scenario may be divided into multiple sub-application scenarios, and a corresponding relationship between each sub-application scenario and a sliding track may be established, and each sub-application scenario may correspond to a sliding track. Wherein, when each application scenario is divided into multiple sub-application scenarios, it can be divided according to different application stages. For example, in a VR game application scenario, the VR game application scenario can be divided into two sub-application scenarios according to whether the game characters need to be operated or not. . Wherein, the sliding track corresponding to the sub-application scene that requires the operation of the game character is the sliding track that controls the rotation of the game character; the sliding track corresponding to the sub-application scene that does not require the operation of the game character is the sliding track of clicking the device.

After each application scenario is divided into multiple sub-application scenarios, when the track to be rendered needs to be obtained, the corresponding sub-application scenario can be determined after the application scenario is found, and then the corresponding sliding track can be found as the track to be rendered to be obtained. .

As another method, in the case where the track to be rendered is a sliding track obtained in real time, when the user wears the VR/AR device, the user can draw the sliding track in the three-dimensional space in real time through the touch object. Of course, the user can also draw the sliding trajectory according to the running game scene in the VR/AR device.

Step S120: Generate three-dimensional model data based on the track to be rendered.

In this embodiment of the present application, a preset method may be used to generate three-dimensional model data having the same shape as the track to be rendered based on the shape of the track to be rendered and the coordinates of each track point in the track to be rendered. Exemplarily, if the track to be rendered is shown in FIG. 6 , the generated three-dimensional model data is shown in FIG. 7 .

Step S130: Based on the 3D model data and the material capture map, generate a 3D graffiti rendering result corresponding to the track to be rendered.

In this embodiment of the present application, the material capture map is also called a MatCap (Material Capture) map. The MatCap texture is a preset material used to add some display effects to the model. It is a pre-generated texture that stores information such as lighting and reflection, and uses the normal direction for sampling at runtime. The 3D graffiti rendering result is 3D model data with MatCap material effect.

As a way, the 3D model data can be rendered according to the MatCap map to generate 3D model data with MatCap material effects.

In different application scenarios, the generated material capture maps can be different, and then the 3D model data can be rendered through different material capture maps to obtain 3D model data with different MatCap material effects. Exemplarily, when the VR game is running, when the preset 3D model data needs to be displayed in the VR game scene, the preset 3D model data can be rendered according to the target MatCap texture, so as to display the preset with MatCap material effect in the game scene. 3D model data.

In this embodiment of the present application, when 3D model data with MatCap material effects is generated based on 3D model data and material capture maps, the 3D model data with MatCap material effects can be generated by using the MatCap Shader method.

Among them, MatCap Shader is a next-generation rendering solution that can replace or even surpass PBR (Physically-Based Rendering) at some levels. The basic idea of MatCap Shader is to use the texture of a specific shader as the view-space environment map of the current material to achieve the display of reflective material objects with uniform surface shading. Considering that the projections of all normals of the object are in the range of x(-1,1), y(-1,1), forming a circle, so the area where the lighting information is stored in the MatCap map is a circle. Shader based on the idea of MatCap can provide no lighting, just provide one or more suitable MatCap maps as a "guide" for lighting results.

In a trajectory rendering method provided by the present application, a to-be-rendered trajectory is first obtained, where the to-be-rendered trajectory is a sliding trajectory of a touch object in a three-dimensional space, then based on the to-be-rendered trajectory, three-dimensional model data is generated, and then based on the three-dimensional model data and The material captures the map to generate the 3D graffiti rendering result corresponding to the track to be rendered. Through the above method, in the three-dimensional space, the image is drawn through the material capture map, so that the drawn image can simulate the real physical lighting effect, so that it can be more realistic.

Referring to FIG. 8 , a trajectory rendering method provided by an embodiment of the present application is applied to an electronic device or server as shown in FIG. 3 or FIG. 4 , and the method includes:

Step S210 : collecting a drawing image of the touch object in a three-dimensional space by using an image collecting device.

In this embodiment of the present application, the image acquisition device may be an electronic device with an image acquisition function, such as a mobile phone, a camera, an image sensor, and the like. Optionally, the touch object is a user's finger, the drawn image of the touch object is an image drawn by the user's finger, and the drawn image of the user's finger collected by the image acquisition device may include the track to be rendered, the user's finger, and a background image.

As a way, in order to reduce the hardware cost, the finger and the image acquisition device can be used as the input device. In response to the image capturing instruction, the image capturing device starts capturing the image drawn by the user's finger. The image acquisition instruction may be an instruction sent by an external device that establishes a communication connection with the image acquisition device, or may be an instruction triggered when an application program in the image acquisition device is detected to start running, which is not specifically limited herein.

When collecting the images drawn by the user's finger, the image acquisition device may continuously collect multiple frames of the images drawn by the user's finger, or may collect the images drawn by the user's finger at preset time intervals. As one of the methods, in the case where the image acquisition device continuously collects multiple frames of images drawn by the user's finger, in the chronological order, the images drawn by the user's finger change rapidly; In the case where the images drawn by the user's finger are collected at time intervals, the change of the images drawn by the user's finger is slow in the time sequence. That is to say, it can be determined according to the speed of change in the time sequence of the image drawn by the user's finger, which method is used to collect the image drawn by the user's finger. The speed of the change of the user's finger-drawing images can be judged by judging whether the similarity between the collected adjacent frames of the user's finger-drawing images is less than the preset similarity, and whether the similarity between the adjacent frames of the user's finger-drawing images is less than the preset similarity. Whether the acquisition time interval is less than the preset time interval is determined. When the similarity between the user's finger-drawn images in adjacent frames is less than the preset similarity, and the acquisition time interval of the user's finger-drawn images in adjacent frames is less than the preset time interval, it is determined that the user's finger-drawn images change rapidly; When the similarity between the user's finger-drawn images in adjacent frames is greater than or equal to the preset similarity, and the acquisition time interval of the user's finger-drawn images in adjacent frames is greater than or equal to the preset time interval, it is determined that the user's finger-drawn images change slowly. The preset similarity is a preset maximum similarity for determining that the image drawn by the user's finger changes rapidly, and the preset time interval is a preset maximum time interval for determining that the image drawn by the user's finger changes rapidly.

Exemplarily, the preset similarity may be set to 60%, and the preset time interval may be set to 5s. Then in the above situation, if the similarity between the adjacent frames of the user's finger-drawn images collected by the image acquisition device is 55%, and the acquisition time interval of the adjacent frames of the user's finger-drawn images is 4.5s, then it can be judged that the user The finger-drawing images change rapidly, so when acquiring the user's finger-drawing images subsequently, the image acquisition device can continuously collect multiple frames of the user's finger-drawing images.

Optionally, when the image collection device collects the image drawn by the user's finger, only one of the methods may be used to obtain the image drawn by the user's finger, or two methods may be used simultaneously to obtain the image drawn by the user's finger. For example, in a VR game application scenario, if the image drawn by the user's finger changes slowly in the early stage of the game, and the image drawn by the user's finger changes rapidly in the middle and later stages of the game, the image capture device is collecting the image drawn by the user's finger. When the user's finger is drawn at a preset time interval, the image collection device can continuously collect multiple frames of the user's finger-drawn image when it reaches the middle and late game stages.

Step S220 : Identify multiple track points in the image drawn by the touch object.

In the embodiments of the present application, the finger recognition and tracking technology can be used to identify the image drawn by the user's finger, and identify the position of the user's finger in the three-dimensional space, that is, identify the coordinates of the trajectory point of the finger sliding in the current user's finger-drawing image. , the output track point set.

Step S230: Perform smoothing processing on the plurality of trajectory points to obtain the to-be-rendered trajectory corresponding to the plurality of trajectory points.

In this embodiment of the present application, the track points included in the image drawn by the user's finger may be smoothed by using a Bezier curve to obtain a track to be rendered. Among them, the Bezier curve is shown in Figure 9. The Bezier curve is the basic tool for computer graphics and image modeling, and it is one of the most widely used basic lines for circular modeling. Bezier curve creates and edits graphics by controlling four points on the curve (start point P0, end point P3 and two separate intermediate points P1, P2).

Step S240: Establish a track point combination based on every two adjacent track points in the track to be rendered, so as to obtain multiple track point combinations.

In the embodiment of the present application, the track points in the track to be rendered are divided into track point combinations, and all the track points included in the track to be rendered are divided into one track point combination for every two adjacent track points. Divide to obtain a combination of multiple trajectory points. Exemplarily, as shown in FIG. 10 , the track to be rendered includes track point a, track point b, track point c, track point d, track point e, track point f, and track point g. When dividing the trajectory point combination, the trajectory point a and the trajectory point b are divided into a trajectory point combination, the trajectory point b and the trajectory point c are divided into a trajectory point combination, the trajectory point c and the trajectory point d are divided into a trajectory point combination Combination, trajectory point d and trajectory point e are divided into a trajectory point combination, trajectory point e and trajectory point f are divided into a trajectory point combination, trajectory point f and trajectory point g are divided into a trajectory point combination, and 6 A combination of track points.

Step S250: Obtaining the respective circles corresponding to the two track points in each track point combination, wherein the center corresponding to the circle is each track point.

In the embodiment of the present application, each trajectory point corresponds to a circle, the line connecting the point on the circle and the trajectory point is perpendicular to the vector formed by two adjacent trajectory points, and the point on the circle and the trajectory point The connecting line is equal to the preset radius, as shown in Figure 11.

Step S260: Obtain a preset number of reference points on the circumference corresponding to the combination of trajectory points with the preset smoothness corresponding to each combination of trajectory points, so as to obtain the reference points corresponding to the combination of trajectory points.

In this embodiment of the present application, the preset smoothness is used to represent the probability that a graph formed by connecting lines of acquired reference points resembles a circle. Wherein, the larger the preset smoothness is, the more circle-like the graph composed of the acquired reference points is, and the smaller the preset smoothness is, the less the graph composed of the acquired reference points is like a circle. The preset smoothness is a preset smoothness used to obtain a preset number of reference points on the circumference corresponding to each trajectory point.

As a method, a preset number of reference points are taken on the circumference corresponding to each track point combination according to the preset smoothness and the same interval. Wherein, when a preset number of reference points are taken on a circle corresponding to each track point combination, the reference points are taken at the same position of the two corresponding circles. Exemplarily, as shown in FIG. 12 , in FIG. 12 , the reference point a1 and the reference point b1 are at the same position corresponding to the circumference, and the reference point an and the reference point bn are at the same position corresponding to the circumference.

Among them, the same interval can be understood as determining the number of reference points to be obtained according to the preset smoothness, and then dividing the circle corresponding to the trajectory points into a corresponding number of radians, and taking reference points at each divided position to obtain a corresponding number of radians. reference point.

Step S270: Generate three-dimensional model data corresponding to the to-be-rendered trajectory based on the reference point corresponding to each trajectory point combination and the trajectory points included in each trajectory point combination.

In the embodiment of the present application, the reference points taken at the same position on the circumference corresponding to each trajectory point combination are connected, and each trajectory point is connected with the reference point taken on the corresponding circumference, so as to obtain the The 3D model data corresponding to the rendering track. As shown in FIG. 13 , the reference points taken on the circumference of the trajectory point a include a1,...,an, and the reference points taken on the circumference corresponding to the trajectory point b include b1,...,bn. When connecting, a1 and b1 are reference points in the same position, so a1 and b1 are connected; an and bn are reference points in the same position, so an and bn are connected; the trajectory point a is respectively connected with a1, ...,an are connected, and the trajectory point b is connected with b1,...,bn respectively.

Step S280: Based on the 3D model data and the material capture map, generate a 3D graffiti rendering result corresponding to the track to be rendered.

In a trajectory rendering method provided by the present application, first, an image drawn by a touch object in a three-dimensional space is collected by an image acquisition device, a plurality of trajectory points in the drawn image of the touch object are identified, and the plurality of trajectory points are smoothed to obtain The tracks to be rendered corresponding to multiple track points, and then a track point combination is established based on every two adjacent track points in the track to be rendered, so as to obtain multiple track point combinations, and two track points in each track point combination are obtained respectively. The corresponding circles, and then with the preset smoothness corresponding to each combination of trajectory points, take a preset number of reference points on the circle corresponding to the combination of trajectory points to obtain the reference points corresponding to each combination of trajectory points, and finally based on each combination of trajectory points. The reference points corresponding to each track point combination and the track points included in each track point combination generate 3D model data corresponding to the track to be rendered, and then capture the map based on the 3D model data and material to generate the 3D graffiti rendering corresponding to the track to be rendered. result. Through the above method, a preset number of reference points are taken on the circumference corresponding to the combination of trajectory points by the preset smoothness, so that the obtained 3D model data can be closer to the 3D model data of the shape of the trajectory to be rendered, so that the obtained 3D model data to be rendered can be obtained. The 3D graffiti rendering results corresponding to the trajectory are more realistic.

Referring to FIG. 14, a trajectory rendering method provided by an embodiment of the present application is applied to the electronic device or server as shown in FIG. 3 or 4, and the method includes:

Step S310 : collecting a drawing image of the touch object in a three-dimensional space by using an image collecting device.

Step S320 : Identify multiple track points in the image drawn by the touch object.

Step S330: Perform smoothing processing on the plurality of trajectory points to obtain the to-be-rendered trajectory corresponding to the plurality of trajectory points.

Step S340: Acquire preset three-dimensional model data.

In the embodiment of the present application, the preset three-dimensional model data is a preset cylinder model with a fixed size and shape. The preset three-dimensional model data may be pre-stored in a cloud server or a preset storage area, and when the preset three-dimensional model data needs to be acquired, the preset three-dimensional model data may be acquired from the cloud server or the preset storage area. Exemplarily, as shown in FIG. 15 , FIG. 15 shows a preset three-dimensional model data. Optionally, the preset three-dimensional model data may also be a sphere model or a cube model with a fixed size and shape.

Step S350: Obtain the sum of the distances between every two adjacent track points in the track to be rendered.

In this embodiment of the present application, the distance between every two adjacent track points is a straight-line distance between the two track points. As a method, the straight-line distance between each two adjacent track points in the track to be rendered is calculated first, and then all the calculated straight-line distances are added to obtain the sum of the distances.

Step S360: Scale the length of the preset three-dimensional model data to be the same as the sum of the distances to obtain the scaled preset three-dimensional model data.

In this embodiment of the present application, if the length of the preset three-dimensional model data is greater than the calculated sum of distances, the length of the preset three-dimensional model data is compressed to be the same as the sum of the distances; if the length of the preset three-dimensional model data is If the length is less than the calculated sum of distances, the length of the preset 3D model data will be enlarged, and the enlargement value is the same as the sum of distances.

In this embodiment of the present application, if the preset three-dimensional model data is a cylinder model as shown in FIG. 15 , the length of the preset three-dimensional model data may be the height of the cylinder model; if the preset three-dimensional model data is a sphere model, the length of the preset 3D model can be the diameter length of the sphere model; if the preset 3D model data is a cube model, then the length of the preset 3D model data can be the length of the side length of the cube model.

Step S370: Based on the ratio between the distance between each two adjacent trajectory points and the sum of the distances, divide the scaled preset three-dimensional model data vertically to obtain each two adjacent trajectory points respectively. Corresponding reference 3D model die data.

In the embodiment of the present application, the ratio of the straight-line distance between each two adjacent trajectory points to the sum of the distances is calculated, and the scaled preset three-dimensional model is divided longitudinally according to the corresponding ratio to obtain every two adjacent trajectory points. The trajectory points corresponding to the reference 3D model data. The vertical division refers to dividing the scaled preset three-dimensional model data according to the y-axis direction of the established coordinate system. Exemplarily, as shown in Figure 16, the y-axis direction is the direction perpendicular to the ground, and the track to be rendered is abc, according to the linear distance L1 between the track point a and the track point b, and the distance between the track point b and the track point c. The straight-line distance L2 of the Divide into the first reference model data (ab area) and the second reference 3D model data (bc area), and obtain the reference 3D model data corresponding to the trajectory point a and the trajectory point b, and the reference 3D model corresponding to the trajectory point b and the trajectory point c. data, and then the vertex coordinates of each reference 3D model data can be known. Wherein, the vertex of each reference three-dimensional model data is a point on the circumference of the section of each reference three-dimensional model data, and the section is obtained by dividing vertically according to the ratio.

Step S380: Calculate the vertices of the reference three-dimensional model data corresponding to each two adjacent trajectory points based on the coordinates of each two adjacent trajectory points and the slope of the vector formed by each two adjacent trajectory points. , to obtain the 3D model data.

In the embodiment of the present application, a corresponding vector is obtained according to the coordinates of each two adjacent trajectory points, and then a corresponding slope can be calculated based on the calculated vector, so that the coordinates of each two adjacent trajectory points and the corresponding Slope, calculate the coordinates of the vertices of the corresponding reference 3D model data, if the calculated coordinates are different from the preset coordinates, then update the preset coordinates based on the calculated coordinates to obtain the updated reference 3D model data, Then, the three-dimensional model data after each updated coordinate is spliced to obtain three-dimensional model data corresponding to the track to be rendered. After updating the vertex coordinates of the reference three-dimensional model data shown in FIG. 16 , the three-dimensional model data shown in FIG. 17 can be obtained.

Step S390: Based on the 3D model data and the material capture map, generate a 3D graffiti rendering result corresponding to the track to be rendered.

In a trajectory rendering method provided by the present application, first, an image drawn by a touch object in a three-dimensional space is collected by an image acquisition device, a plurality of trajectory points in the drawn image of the touch object are identified, and the plurality of trajectory points are smoothed to obtain The tracks to be rendered corresponding to the multiple track points, then the preset 3D model data is obtained, the sum of the distances between every two adjacent track points in the track to be rendered is obtained, and the height of the preset 3D model data is scaled to the distance The sum is the same, and the scaled preset 3D model data is obtained, and then based on the ratio of the distance between each two adjacent trajectory points to the sum of the distances, the scaled preset 3D model data is divided vertically to obtain respectively The reference 3D model data corresponding to each two adjacent trajectory points, and then based on the coordinates of each two adjacent trajectory points and the slope of the vector formed by each two adjacent trajectory points, for each two adjacent trajectory points. The vertices of the reference 3D model data corresponding to the trajectory points of the 3D model are calculated to obtain the 3D model data, and finally the 3D graffiti rendering result corresponding to the to-be-rendered trajectory is generated based on the 3D model data and the material capture map. Through the above method, by dividing the preset three-dimensional model data into a plurality of reference three-dimensional model data, the vertex coordinates of the reference model data can be updated according to the coordinates of every two trajectory points and the slope of the vector formed by the two trajectory points. , obtain 3D model data that is closer to the shape of the track to be rendered, and then use the material capture map to draw the 3D model data, so that the drawn image can simulate the real physical lighting effect.

Referring to FIG. 18 , a trajectory rendering method provided by an embodiment of the present application is applied to an electronic device or server as shown in FIG. 3 or FIG. 4 , and the method includes:

Step S410: Acquire a track to be rendered, where the track to be rendered is a sliding track of the touch object in the three-dimensional space.

Step S420: Generate three-dimensional model data based on the track to be rendered.

Step S430: Acquire a preset brush material, preset lighting information, and a preset sphere model, and generate a material capture map.

In this embodiment of the present application, the preset brush material can be generated based on a preset texture map and a preset color, wherein the preset texture map can be obtained in advance from a texture map library, and the preset color can be any preset color. color. The preset lighting information may be pre-set in the virtual space, or may also be acquired by an AR device, where the preset lighting information includes light source coordinates and lighting intensity. The preset sphere model is a commonly used shader.

According to the preset brush material, preset lighting information and preset sphere model, a MatCap map with specific material and lighting information effects can be generated, and the generated MatCap map can be shown in Figure 19.

Step S440: Based on the 3D model data and the material capture map, generate a 3D graffiti rendering result corresponding to the track to be rendered.

In the embodiment of the present application, the generated three-dimensional graffiti rendering result can be shown in FIG. 20 , and it can be seen from FIG. 20 that the three-dimensional graffiti rendering result can well reflect the physical lighting effect.

Step S450: Transform the style of the three-dimensional graffiti rendering result.

In the embodiment of the present application, for many graffiti beginners, it is always impossible to draw the lines and curves they like, and the line color selection is often unsatisfactory. At this time, the graffiti auxiliary function can be used to input user input The result of the trajectory is intelligently smoothed and straightened, and even when graffitiing some numbers or fonts, it can be automatically replaced with stylized fonts and numbers through real-time communication technology (RTC technology). After graffiti, the style can also be transferred according to the graffiti environment. Make the picture more artistic. Optionally, the preset style can also be obtained locally on the terminal, and then the style of the 3D graffiti rendering result can be replaced with the preset style.

Step S460: Share and display the three-dimensional graffiti rendering result through the network.

In the embodiment of the present application, in the multi-person interaction scene in the virtual world, the 3D graffiti rendering result can be shared with others through the network, and the process of generating the 3D graffiti rendering result can be reproduced synchronously in front of others, which can be used as a 3D virtual world. A new way of socializing, similar to leaving a message on a bulletin board, graffiti is more personal and stylized than the ordinary old-fashioned font display.

In a trajectory rendering method provided by the present application, a trajectory to be rendered is first obtained, 3D model data is generated based on the trajectory to be rendered, then a preset brush material, preset lighting information and a preset sphere model are obtained, a material capture map is generated, and then a texture capture map is generated. Based on the 3D model data and material capture map, the 3D graffiti rendering result corresponding to the track to be rendered can be generated, and then the style of the 3D graffiti rendering result can be transformed through real-time communication technology, and the 3D graffiti rendering result can be shared. Through the above method, the image is drawn through the material capture map, so that the drawn image can simulate the real physical lighting effect.

Referring to FIG. 21 , a trajectory rendering apparatus 500 provided by an embodiment of the present application, the apparatus 500 includes:

The trajectory acquisition unit 510 is configured to acquire a to-be-rendered trajectory, where the to-be-rendered trajectory is a sliding trajectory of the touch object in the three-dimensional space.

In one way, the trajectory acquisition unit 510 is specifically configured to collect a drawn image of the touch object in a three-dimensional space through an image acquisition device; identify multiple trajectory points in the drawn image of the touch object; Smoothing is performed to obtain the to-be-rendered trajectories corresponding to the plurality of trajectory points.

The data generating unit 520 is configured to generate three-dimensional model data based on the track to be rendered.

As a way, the data generating unit 520 is specifically configured to establish a trajectory point combination based on every two adjacent trajectory points in the to-be-rendered trajectory, so as to obtain multiple trajectory point combinations; respectively obtain two trajectory point combinations in each trajectory point combination. A circle corresponding to each trajectory point, wherein the center corresponding to the circle is each trajectory point; with the preset smoothness corresponding to each trajectory point combination, a preset number of reference points are obtained on the circle corresponding to the trajectory point combination to obtain a reference point corresponding to each trajectory point combination; based on the reference point corresponding to each trajectory point combination and the trajectory points included in each trajectory point combination, generate three-dimensional model data corresponding to the to-be-rendered trajectory.

As another way, the data generating unit 520 is specifically configured to obtain preset three-dimensional model data; obtain the sum of the distances between every two adjacent track points in the track to be rendered; The length of the distance is scaled to be the same as the sum of the distances to obtain the scaled preset three-dimensional model data; based on the ratio of the distance between each two adjacent trajectory points to the sum of the distances, the scaled The preset 3D model data is divided vertically, and the reference 3D model model data corresponding to each two adjacent trajectory points are obtained respectively; based on the coordinates of each two adjacent trajectory points, and the composition of each two adjacent trajectory points Calculate the slope of the vector of the reference three-dimensional model data corresponding to every two adjacent trajectory points to obtain the three-dimensional model data.

The rendering unit 530 is configured to generate a three-dimensional graffiti rendering result corresponding to the to-be-rendered track based on the three-dimensional model data and the material capture map.

Referring to FIG. 22, the apparatus 500 further includes:

The texture generation unit 540 is used for acquiring preset brush material, preset lighting information and preset sphere model, and generating a texture capture texture.

The processing unit 550 is configured to transform the style of the three-dimensional graffiti rendering result through real-time communication technology.

Optionally, the processing unit 550 is specifically configured to share and display the three-dimensional graffiti rendering result through a network.

It should be noted that the apparatus embodiments in the present application correspond to the foregoing method embodiments, and the specific principles in the apparatus embodiments may refer to the content in the foregoing method embodiments, which will not be repeated here.

An electronic device or server provided by the present application will be described below with reference to FIG. 23 .

Referring to FIG. 23 , based on the above-mentioned trajectory rendering method and apparatus, an embodiment of the present application further provides another electronic device or server 800 that can execute the above-mentioned trajectory rendering method. The electronic device or server 800 includes one or more (only one shown in the figure) a processor 802, a memory 804, and a network module 806 that are coupled to each other. Wherein, the memory 804 stores a program that can execute the content in the foregoing embodiments, and the processor 802 can execute the program stored in the memory 804 .

The processor 802 may include one or more processing cores. The processor 802 uses various interfaces and lines to connect various parts of the entire server 800, and executes the server by running or executing the instructions, programs, code sets or instruction sets stored in the memory 804, and calling the data stored in the memory 804. 800's various functions and processing data. Optionally, the processor 802 may employ at least one of a digital signal processing (Digital Signal Processing, DSP), a Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and a Programmable Logic Array (Programmable Logic Array, PLA) implemented in hardware. The processor 802 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used for rendering and drawing of the display content; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 802, and is implemented by a communication chip alone.

The memory 804 may include random access memory (Random Access Memory, RAM), or may include read-only memory (Read-Only Memory). Memory 804 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 804 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , instructions for implementing the following method embodiments, and the like. The storage data area may also store data created by the electronic device or the server 800 in use (eg, phone book, audio and video data, chat record data) and the like.

The network module 806 is used for receiving and sending electromagnetic waves, realizing mutual conversion between electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices, for example, communicate with an audio playback device. The network module 806 may include various existing circuit elements for performing these functions, eg, antennas, radio frequency transceivers, digital signal processors, encryption/decryption chips, subscriber identity module (SIM) cards, memory, etc. . The network module 806 can communicate with various networks such as the Internet, an intranet, a wireless network, or communicate with other devices through a wireless network. The aforementioned wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network. For example, the network module 806 may interact with the base station for information.

Please refer to FIG. 24 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable storage medium 900 stores program codes, and the program codes can be invoked by the processor to execute the methods described in the above method embodiments.

The computer-readable storage medium 900 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 900 includes a non-transitory computer-readable storage medium. Computer readable storage medium 900 has storage space for program code 910 to perform any of the method steps in the above-described methods. These program codes can be read from or written to one or more computer program products. Program code 910 may be compressed, for example, in a suitable form.

In a trajectory rendering method, device, electronic device and storage medium provided by the present application, a trajectory to be rendered is obtained first, and the trajectory to be rendered is a sliding trajectory of a touch object in a three-dimensional space, and then a three-dimensional model is generated based on the trajectory to be rendered Then, based on the 3D model data and the material capture map, the 3D graffiti rendering result corresponding to the track to be rendered is generated. Through the above method, in the three-dimensional space, the image is drawn through the material capture map, so that the drawn image can simulate the real physical lighting effect, so that it can be more realistic.

The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the spirit of the present invention and the scope protected by the claims, many forms can be made, which all belong to the protection of the present invention.

Claims (10)

1. A method of trajectory rendering, the method comprising:

acquiring a track to be rendered, wherein the track to be rendered is a sliding track of a touch object in a three-dimensional space;

generating three-dimensional model data based on the track to be rendered;

and generating a three-dimensional doodle rendering result corresponding to the track to be rendered based on the three-dimensional model data and the material capture mapping.

2. The method of claim 1, wherein the obtaining the trajectory to be rendered comprises:

acquiring a touch object drawing image in a three-dimensional space through image acquisition equipment;

identifying a plurality of track points in the touch object drawing image;

and smoothing the plurality of track points to obtain the to-be-rendered track corresponding to the plurality of track points.

3. The method of claim 1, wherein generating three-dimensional model data based on the trajectory to be rendered comprises:

establishing track point combinations based on every two adjacent track points in the track to be rendered to obtain a plurality of track point combinations;

respectively obtaining respective corresponding circumferences of two track points in each track point combination, wherein the center corresponding to the circumference is each track point;

acquiring a preset number of reference points on a circumference corresponding to the track point combination according to the preset smoothness corresponding to each track point combination to obtain a reference point corresponding to each track point combination;

and generating three-dimensional model data corresponding to the track to be rendered based on the reference point corresponding to each track point combination and the track points included in each track point combination.

4. The method of claim 1, wherein generating three-dimensional model data based on the trajectory to be rendered comprises:

acquiring preset three-dimensional model data;

acquiring the sum of the distances between every two adjacent track points in the track to be rendered;

the length of the preset three-dimensional model data is zoomed to be the same as the sum of the distances, and the zoomed preset three-dimensional model data is obtained;

longitudinally dividing the scaled preset three-dimensional model data based on the ratio of the distance between every two adjacent track points to the sum of the distances to respectively obtain reference three-dimensional model data corresponding to every two adjacent track points;

and respectively calculating the vertex of the reference three-dimensional model data corresponding to each two adjacent track points based on the coordinates of each two adjacent track points and the slope of the vector formed by each two adjacent track points so as to obtain the three-dimensional model data.

5. The method of claim 1, wherein generating a three-dimensional graffiti rendering result corresponding to the trajectory to be rendered based on the three-dimensional model data and a material capture map further comprises:

and acquiring preset brush materials, preset illumination information and a preset sphere model, and generating a material capture mapping.

6. The method according to any one of claims 1-5, further comprising:

and transforming the style of the three-dimensional graffiti rendering result.

7. The method according to any one of claims 1-5, further comprising:

and sharing and displaying the three-dimensional graffiti rendering result through a network.

8. A trajectory rendering apparatus, characterized in that the apparatus comprises:

the track acquisition unit is used for acquiring a track to be rendered, wherein the track to be rendered is a sliding track of a touch object in a three-dimensional space;

the data generation unit is used for generating three-dimensional model data based on the track to be rendered;

and the rendering unit is used for generating a three-dimensional graffiti rendering result corresponding to the track to be rendered based on the three-dimensional model data and the material capture mapping.

9. An electronic device, comprising one or more processors; one or more programs stored in the memory and configured to be executed by the one or more processors to perform the method of any of claims 1-7.

10. A computer-readable storage medium, having program code stored therein, wherein the program code when executed by a processor performs the method of any of claims 1-7.

Images