CN114299217A - Water surface rendering method and device, mobile terminal and storage medium - Google Patents

Abstract

Embodiments of the present invention provide a water surface rendering method, device, mobile terminal, and storage medium. The method includes: completing rendering processing in the opaque rendering stage through a rendering pipeline corresponding to the mobile terminal, so as to obtain the scene color in the opaque rendering stage; In the rendering process, based on the scene color in the opaque rendering stage, the rendering process is performed to obtain the scene color to be sampled; in the translucent rendering stage in the rendering pipeline, the sampling process is performed on the scene color to be sampled to obtain the reflection effect data and refraction effect data of the water surface respectively. . It realizes the rendering of the reflection effect and refraction effect of the water surface, so that the effect of the water surface rendered on the PC and the mobile terminal is consistent, so that the effect of the water surface rendered on the mobile terminal can meet the artistic requirements, thereby improving the user's experience in the game. experience.

Description

Water surface rendering method, device, mobile terminal and storage medium

technical field

The present invention relates to the technical field of image rendering, and in particular, to a water surface rendering method, device, mobile terminal and storage medium.

Background technique

UE4 (Unreal Engine 4) realizes the rendering of the water surface in the game world through the water surface rendering system (SingleLayerWater, the system responsible for water surface rendering in UE4). The water surface rendering system not only supports the PC (Personal Computer, personal computer) side, but also supports mobile end. However, due to the performance difference between the PC and the mobile terminal, for the mobile terminal, the use of the water surface rendering system has many limitations and lack of functional characteristics. For example, the mobile terminal lacks real-time reflection effects and lacks refraction effects. This makes the effect of the water surface rendered on the PC side and the mobile terminal too different. The effect of the water surface rendered on the mobile terminal does not meet the artistic requirements, and the user experience is not good.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a water surface rendering method, device, mobile terminal, and storage medium, so as to make the water surface effects rendered by the PC terminal and the mobile terminal consistent, so that the effect of the water surface rendered by the mobile terminal can reach the artistic level requirements, so as to improve the user's experience in the game.

In a first aspect, an embodiment of the present invention provides a water surface rendering method, which includes:

Complete the rendering processing of the opaque rendering stage through the rendering pipeline corresponding to the mobile terminal, so as to obtain the scene color of the opaque rendering stage;

In the rendering pipeline, rendering processing is performed based on the scene color of the opaque rendering stage to obtain the scene color to be sampled;

In the translucent rendering stage in the rendering pipeline, the color of the scene to be sampled is sampled to obtain reflection effect data and refraction effect data of the water surface, respectively.

Optionally, the rendering processing based on the scene color of the opaque rendering stage includes:

Create render textures;

The scene color of the opaque rendering stage stored in the color buffer is bound as an input, and the rendering texture is set as a rendering target to perform rendering processing.

Optionally, the scene color of the opaque rendering stage stored in the binding color buffer is used as input, and the rendering texture is set as a rendering target, and rendering processing is performed, including:

In the pixel shader, sampling processing and encoding processing are performed on the scene color of the opaque rendering stage stored in the color buffer, and the processing result of the sampling processing and the encoding processing is output to the rendering texture.

Optionally, performing sampling processing on the color of the scene to be sampled to obtain reflection effect data on the water surface, including:

In the pixel shader, obtain the fragment currently to be processed, and determine the world space coordinates of the reflected point corresponding to the fragment;

obtaining the depth of the reflected point corresponding to the coordinates of the reflected point;

If the depth of the reflected point satisfies the preset condition, the color of the scene to be sampled is sampled and decoded to obtain reflection effect data on the water surface.

Optionally, the determining the world space coordinates of the reflected point corresponding to the fragment includes:

Obtain the coordinates corresponding to the fragment in the screen space;

Determine the coordinates corresponding to the fragment in the world space based on the coordinates corresponding to the fragment in the screen space;

Get the position of the fragment relative to the camera;

determining a reflection vector based on the position of the segment relative to the camera;

Steps a preset distance along the direction of the reflection vector from the corresponding coordinates of the fragment in the world space to obtain the world space coordinates of the reflected point corresponding to the fragment.

Optionally, if the depth of the reflected point satisfies a preset condition, then performing sampling processing and decoding processing on the color of the scene to be sampled, including:

obtain the fragment depth corresponding to the fragment;

If the depth of the reflected point is greater than the depth of the segment, and the angle between the sight vector of the camera and the reflection vector is greater than a preset angle, sampling processing and decoding processing are performed on the color of the scene to be sampled.

Optionally, performing sampling processing on the color of the scene to be sampled to obtain refraction effect data on the water surface, including:

In the pixel shader, obtain the fragment that needs to be processed currently, and determine the coordinates corresponding to the water surface part corresponding to the fragment in the screen space;

get the degree of distortion;

Offset the coordinates corresponding to the fragment in the screen space based on the distortion degree to obtain sampling coordinates;

The color of the scene to be sampled is sampled by the sampling coordinates to obtain the refraction effect data of the water surface.

Optionally, the obtaining the distortion degree includes:

Get pixel normals and vertex normals in camera space;

determining the difference between the vertex normal and the pixel normal;

The degree of distortion is obtained by multiplying the difference by the index of refraction.

In a second aspect, an embodiment of the present invention provides a water surface rendering device, including:

The opaque rendering module is used to complete the rendering processing of the opaque rendering stage through the rendering pipeline corresponding to the mobile terminal, so as to obtain the scene color of the opaque rendering stage;

a full-screen rendering module, configured to perform rendering processing based on the scene color in the opaque rendering stage in the rendering pipeline to obtain the scene color to be sampled;

The sampling module is used for sampling the color of the scene to be sampled in the translucent rendering stage in the rendering pipeline, so as to obtain the reflection effect data and the refraction effect data of the water surface respectively.

Optionally, the full-screen rendering module is used for:

Create render textures;

The scene color of the opaque rendering stage stored in the color buffer is bound as an input, and the rendering texture is set as a rendering target to perform rendering processing.

Optionally, the full-screen rendering module is used for:

In the pixel shader, sampling processing and encoding processing are performed on the scene color of the opaque rendering stage stored in the color buffer, and the processing result of the sampling processing and the encoding processing is output to the rendering texture.

Optionally, the sampling module is used for:

In the pixel shader, obtain the fragment currently to be processed, and determine the world space coordinates of the reflected point corresponding to the fragment;

obtaining the depth of the reflected point corresponding to the coordinates of the reflected point;

If the depth of the reflected point satisfies the preset condition, the color of the scene to be sampled is sampled and decoded to obtain reflection effect data on the water surface.

Optionally, the sampling module is used for:

Obtain the coordinates corresponding to the fragment in the screen space;

Determine the coordinates corresponding to the fragment in the world space based on the coordinates corresponding to the fragment in the screen space;

Get the position of the fragment relative to the camera;

determining a reflection vector based on the position of the segment relative to the camera;

Steps a preset distance along the direction of the reflection vector from the corresponding coordinates of the fragment in the world space to obtain the world space coordinates of the reflected point corresponding to the fragment.

Optionally, the sampling module is used for:

obtain the fragment depth corresponding to the fragment;

If the depth of the reflected point is greater than the depth of the segment, and the angle between the sight vector of the camera and the reflection vector is greater than a preset angle, sampling processing and decoding processing are performed on the color of the scene to be sampled.

Optionally, the sampling module is used for:

In the pixel shader, obtain the fragment that needs to be processed currently, and determine the coordinates corresponding to the water surface part corresponding to the fragment in the screen space;

get the degree of distortion;

Offset the coordinates corresponding to the fragment in the screen space based on the distortion degree to obtain sampling coordinates;

The color of the scene to be sampled is sampled by the sampling coordinates to obtain the refraction effect data of the water surface.

Optionally, the sampling module is used for:

Get pixel normals and vertex normals in camera space;

determining the difference between the vertex normal and the pixel normal;

The degree of distortion is obtained by multiplying the difference by the index of refraction.

In a third aspect, an embodiment of the present invention provides a mobile terminal, which includes a processor and a memory, wherein executable code is stored on the memory, and when the executable code is executed by the processor, the The processor may at least implement the water surface rendering method in the first aspect.

In a fourth aspect, an embodiment of the present invention provides a non-transitory machine-readable storage medium, where executable code is stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of a mobile terminal At the time, the processor can at least implement the water surface rendering method in the first aspect.

By adopting the present invention, the scene color in the opaque rendering stage can be acquired, and then full-screen rendering is performed based on the scene color in the opaque rendering stage to obtain the scene color to be sampled. Finally, the color of the scene to be sampled can be sampled to obtain the reflection effect data and the refraction effect data of the water surface respectively. Through the above method, the rendering of the reflection effect and the refraction effect of the water surface is realized, so that the effect of the water surface rendered by the PC terminal and the mobile terminal is consistent, so that the effect of the water surface rendered by the mobile terminal can meet the artistic requirements, thereby improving the user experience. experience in the game.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 is a schematic flowchart of a water surface rendering method according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of an effect of water surface rendering provided by an embodiment of the present invention;

3 is a schematic structural diagram of a water surface rendering apparatus according to an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a," "the," and "the" as used in the embodiments of the present invention and the appended claims are intended to include the plural forms as well, unless the context clearly dictates otherwise, "a plurality" Generally at least two are included.

Depending on the context, the words "if", "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, the phrases "if determined" or "if detected (the stated condition or event)" can be interpreted as "when determined" or "in response to determining" or "when detected (the stated condition or event)," depending on the context )" or "in response to detection (a stated condition or event)".

In addition, the sequence of steps in the following method embodiments is only an example, and is not strictly limited.

FIG. 1 is a flowchart of a water surface rendering method provided by an embodiment of the present invention, and the method can be applied to a mobile terminal. As shown in Figure 1, the method includes the following steps:

101. Complete the rendering processing of the opaque rendering stage through the rendering pipeline corresponding to the mobile terminal, so as to obtain the scene color of the opaque rendering stage.

102. In the rendering pipeline, perform rendering processing based on the scene color in the opaque rendering stage to obtain the scene color to be sampled.

103. In the translucent rendering stage in the rendering pipeline, perform sampling processing on the color of the scene to be sampled, so as to obtain reflection effect data and refraction effect data of the water surface respectively.

In the practical application of the present invention, the process of rendering the water surface in the rendering pipeline in the mobile terminal is divided into several stages, including an opaque rendering stage, a translucent rendering stage, and the like. The order of execution of these stages is: opaque rendering stage; translucent rendering stage. That is to say, after completing the previous stage, it goes to the next stage for rendering processing.

The first thing to enter is the opaque rendering stage. In this stage, the opaque objects in the scene can be rendered, and after rendering, the scene color corresponding to the opaque rendering stage will be output. During the opaque rendering process, the RenderTarget can be used as the rendering target, so that the scene colors corresponding to the opaque rendering stage will be accumulated and output to the RenderTarget.

Among them, accumulation means that if there are some other scene colors in RenderTarget before the opaque rendering stage, the output scene color after rendering processing in the opaque rendering stage will be superimposed with some other scene colors originally in RenderTarget. If the opaque rendering stage is the first executed rendering stage and there are no other rendering stages before it, then there are no other scene colors in the RenderTarget, and only the scene color corresponding to the opaque rendering stage in the RenderTarget after the cumulative output.

Based on this, when the cumulative output is mentioned in the embodiment of the present invention, it refers to superimposing the scene color obtained by the rendering process in the current rendering stage to some other scene colors originally in the RenderTarget, and the final superposition result still exists in the RenderTarget.

In the rendering pipeline, the scene color of the opaque rendering stage can be used for rendering processing to obtain the scene color to be sampled. Optionally, the process of using the scene color of the opaque rendering stage for rendering processing may be implemented as: creating a rendering texture (RenderTexture); binding the scene color of the opaque rendering stage stored in the color buffer (ColorBuffer) as input, and using The rendering texture is set as the rendering target (RenderTarget) for rendering processing.

In some alternative embodiments, the render texture may be named SceneColorCopy. Through the above operations, the scene colors obtained through the above rendering processing are cumulatively output to SceneColorCopy.

In some optional embodiments, the data format corresponding to the SceneColorCopy may be set to RGBA32.

In some optional embodiments, the size of the SceneColorCopy may be set to be smaller than the resolution of the final rendered picture. For example, if the resolution of the final rendered picture is 1920*1080, the size of SceneColorCopy can be set to 960*540 or 480*270 accordingly.

It is understandable that the smaller the size of SceneColorCopy, the lower the calculation amount of the mobile terminal, and the higher the rendering performance of the mobile terminal. However, if the size of the SceneColorCopy is too low, the resulting reflections and refractions will be blurred.

Optionally, the scene color of the opaque rendering stage stored in the aforementioned binding color buffer is used as input, and the rendering texture is set as the rendering target, and the process of rendering processing can be implemented as: ), perform sampling processing and encoding processing on the scene color of the opaque rendering stage stored in the color buffer, and output the processing results of the sampling processing and encoding processing to the rendering texture.

It should be noted that in the above process, the scene color sampled from the color buffer needs to be encoded because the data format of the scene color stored in the color buffer may be R16G16B16A16, and the dark part can be improved to a certain extent through encoding processing. detail and preserve precision.

In some optional embodiments, the scene color can be encoded by the following functions:

Pow(Color*0.1,0.25)

Among them, Pow() is an exponential function used in the high-level shader language HLSL.

After the above rendering process is completed, the color of the scene to be sampled may be sampled to obtain reflection effect data and refraction effect data of the water surface, respectively. That is to say, the scene color in SceneColorCopy can be sampled to obtain the reflection effect data and the refraction effect data of the water surface respectively.

It should be noted that the reflection and refraction effects of rendering the water surface are completed in the translucent rendering stage. In the translucent rendering stage, the water surface model is rendered, and the reflection and refraction effects of the water surface are rendered. The rendering processing in the translucent rendering stage is realized through multiple drawing commands (ie, Draw commands, which refer to the call of the CPU to the graphics drawing interface, and the CPU instructs the GPU to perform rendering operations by calling the graphics library (directx/opengl) interface). For the first Draw command in the translucent rendering stage (the first Draw command is used to render the SingleLayerWater model, and the SingleLayerWater model can be used to simulate the effect of a transparent water surface), you can use SceneColorCopy and the depth buffer (DepthBuffer) as input, The reflection, refraction and other processing of the water surface in the water surface rendering method provided in the embodiment of the present invention is implemented in the geometry channel (BasePass, BasePass refers to the Pass for water surface rendering, which is used for rendering the water surface). Among them, DepthBuffer is set to read only and not write.

Optionally, the process of performing sampling processing on the color of the scene to be sampled to obtain the reflection effect data on the water surface can be implemented as follows: in the pixel shader, the fragment that needs to be processed currently is obtained, and the world space coordinate of the reflected point corresponding to the fragment is determined; The depth of the reflected point corresponding to the reflected point is obtained; if the depth of the reflected point satisfies the preset condition, the color of the scene to be sampled is sampled and decoded to obtain the reflection effect data on the water surface.

In some optional embodiments, the encoded scene color sampled from the scene color to be sampled can be decoded by the following function:

Pow(Color',4)*10

Among them, Color' represents the encoded scene color obtained by encoding the scene color Color.

In this embodiment of the present invention, a screen space reflection (Screen Space Reflection, SSR) is used to realize the reflection effect processing of the water surface. In this process, the fragment processed by the pixel shader is the fragment corresponding to the water surface model, and the pixel shader will render each fragment to be rendered in turn. For the fragment currently to be processed, in some optional embodiments, optionally, the process of determining the world space coordinates of the reflected point corresponding to the fragment currently to be processed may be implemented as: obtaining the corresponding fragment in the screen space based on the corresponding coordinates of the fragment in the screen space, determine the corresponding coordinates of the fragment in the world space; obtain the position of the fragment relative to the camera; determine the reflection vector based on the position of the fragment relative to the camera; from the fragment corresponding to the world space The coordinates of , step a preset distance in the direction of the reflection vector to obtain the world space coordinates of the reflected point.

It should be noted that each segment to be rendered corresponds to a part of the water surface. For the fragment that needs to be processed currently, it corresponds to a reflected point in the screen space, and the world space coordinate of the reflected point can be determined by the above method.

After determining the world space coordinates of the reflected point corresponding to the fragment currently to be processed, the depth of the reflected point corresponding to the reflected point can be obtained. Specifically, the world space coordinates of the reflected point can be mapped to the screen space by means of UV sampling to obtain the screen space coordinates of the reflected point, and the DepthBuffer is sampled based on the screen space coordinates of the reflected point to obtain the corresponding point of the reflected point. depth.

Next, it is judged whether the depth of the reflected point satisfies the preset condition. If the depth of the reflected point satisfies the preset condition, the SceneColorCopy can be sampled and decoded to obtain the reflection effect data of the water surface. Specifically, the screen space coordinates of the reflected points can be used as sampling coordinates, and the sampling coordinates can be used to perform sampling processing on SceneColorCopy to obtain undecoded color data. Then, decoding processing can be performed on the undecoded color data, and the decoded data can be used as the color reflected by the water surface, that is, the reflected color of the pixel corresponding to the segment to be processed currently.

Optionally, the above judgment process can be implemented as: obtaining the depth of the segment corresponding to the segment; if the depth of the reflected point is greater than the depth of the segment, and the angle between the sight vector of the camera and the reflection vector is greater than the preset angle, then sample SceneColorCopy. processing and decoding processing.

In some optional embodiments, the above-mentioned preset angle may be 90°.

It should be noted that the coordinates (SvPosition) corresponding to the water surface part corresponding to the fragment in the screen space can be obtained, and then the fragment depth corresponding to the fragment can be determined based on the SvPosition.

In some optional embodiments, if the obtained reflection effect is flickering in view, blurring processing may be performed in the above-mentioned process of sampling SceneColorCopy. Specifically, a sampler (including but not limited to a Gather sampler) can be used to sample the color of 4 pixels and take an average value.

The process of rendering reflection effects is described above, and the process of rendering refraction effects is described below. Optionally, the process of sampling the scene color to be sampled to obtain the refraction effect data of the water surface can be implemented as follows: in the pixel shader, obtain the fragment that needs to be processed currently, and determine the corresponding water surface part of the fragment in the screen space. Coordinates; obtain the distortion degree; offset the corresponding coordinates of the fragment in the screen space based on the distortion degree to obtain the sampling coordinates; sample the color of the scene to be sampled through the sampling coordinates, and obtain the refraction effect data of the water surface, that is, the current fragment to be processed. The color of the refraction of the corresponding pixel point.

It should be noted that, when the value of the distortion degree is larger, the offset degree of the sampling coordinates relative to the corresponding coordinates of the fragment in the screen space is larger.

Optionally, the above-mentioned process of obtaining the degree of distortion may be implemented as: obtaining the pixel normal and the vertex normal in the camera space (View space); determining the difference between the vertex normal and the pixel normal; multiplying the difference by the refraction coefficient. , to get the degree of distortion.

It should be noted that the above-mentioned pixel normal is the pixel normal of the pixel corresponding to the fragment that the pixel shader currently needs to process. The pixel normal is calculated in the material editor, and the flow of the water surface can be realized based on this pixel normal. Effect. The above vertex normals are obtained by transferring the vector (0, 0, 1) of the tangent space to the View space. The above-mentioned refraction coefficient is a given value in the material, that is, the refraction coefficient corresponds to the material, and different materials correspond to different refraction coefficients.

In addition, because the part below the water surface has been sampled, AlphaBlend (a function used to display an image with a specified transparency) is no longer needed, and the alpha in the output color needs to be changed to 1.

It should be noted that the height fog effect in the mobile terminal is calculated in BasePass, which means that the fog effect of underwater objects is included in SceneColorCopy. If the fog effect of the water surface is calculated again after the normal water surface rendering, the fog effect of the transparent area will be increased. In the embodiment of the present invention, the fog effect of the underwater object may be calculated in the pixel shader based on the depth, and the color of the fog effect may be subtracted when calculating the distortion. However, because the above process is implemented in the pixel shader, the processing performance of the mobile terminal is poor.

Optionally, after sampling the color of the scene to be sampled by sampling coordinates to obtain refraction effect data on the water surface, the method provided by the embodiment of the present invention may further include: acquiring vertex fog data calculated in a vertex shader, and refraction of the water surface. The effect data minus the fog data for this vertex.

Through observation, it is found that the transparent areas of the water surface are mostly shallow water, and the depth difference between the water surface and the water bottom is not large, so the vertex fog calculated in the water surface VS (vertex shader) can be used to replace the scene fog calculated in the pixel shader. By directly subtracting the vertex fog data when calculating the distortion, the steps of calculating the fog effect of underwater objects in the pixel shader can be saved, which can greatly improve the processing performance of the mobile terminal.

In addition, for the ColorScaleBehindWater function in UE4 (the material node responsible for receiving the underwater color in the shader of UE4 SingleLayerWater), the related technology cannot use this function on the mobile terminal, and the method provided by the embodiment of the present invention is used. Getting the scene color also solved the problem.

Optionally, the method provided by the embodiment of the present invention may further include: obtaining the fragment depth and the depth in the depth buffer (DepthBuffer) through the SceneDepthWithoutWater (scene depth map without water depth) node in the material editor; Go to the depth in the DepthBuffer to get the depth difference; if the depth difference is less than the preset threshold, the highlight reflection effect is removed.

In some optional embodiments, the GTAO (Ground Truth Ambient Occlusion) effect (an effect obtained by an ambient light occlusion algorithm) of the water surface in the mobile terminal can also be removed. The mobile terminal supports the use of the SceneDepthWithoutWater node to obtain the depth in the material editor. You can use the fragment depth and the depth difference in the DepthBuffer to hide the reflection effect of the shore (wherein, if the depth difference is less than the preset threshold, the shore can be determined. ), which allows a natural transition between the water surface and the shore.

An example of the effect of the water surface finally rendered by the method provided by the embodiment of the present invention is shown in FIG. 2 .

By adopting the present invention, the scene color in the opaque rendering stage can be acquired, and then full-screen rendering is performed based on the scene color in the opaque rendering stage to obtain the scene color to be sampled. Finally, the color of the scene to be sampled can be sampled to obtain the reflection effect data and the refraction effect data of the water surface respectively. Through the above method, the rendering of the reflection effect and the refraction effect of the water surface is realized, so that the effect of the water surface rendered by the PC terminal and the mobile terminal is consistent, so that the effect of the water surface rendered by the mobile terminal can meet the artistic requirements, thereby improving the user experience. experience in the game.

The water surface rendering apparatus according to one or more embodiments of the present invention will be described in detail below. Those skilled in the art can understand that these water surface rendering apparatuses can be configured by using commercially available hardware components through the steps taught in this solution.

FIG. 3 is a schematic structural diagram of a water surface rendering device according to an embodiment of the present invention. As shown in FIG. 3 , the device includes:

The opaque rendering module 31 is used to complete the rendering process of the opaque rendering stage through the rendering pipeline corresponding to the mobile terminal, so as to obtain the scene color of the opaque rendering stage;

A full-screen rendering module 32, configured to perform rendering processing based on the scene color in the opaque rendering stage in the rendering pipeline to obtain the scene color to be sampled;

The sampling module 33 is configured to perform sampling processing on the color of the scene to be sampled in the translucent rendering stage in the rendering pipeline, so as to obtain the reflection effect data and the refraction effect data of the water surface respectively.

Optionally, the full-screen rendering module 32 is used for:

Create render textures;

The scene color of the opaque rendering stage stored in the color buffer is bound as an input, and the rendering texture is set as a rendering target to perform rendering processing.

Optionally, the full-screen rendering module 32 is used for:

In the pixel shader, sampling processing and encoding processing are performed on the scene color of the opaque rendering stage stored in the color buffer, and the processing result of the sampling processing and the encoding processing is output to the rendering texture.

Optionally, the sampling module 33 is used for:

In the pixel shader, obtain the fragment that needs to be processed currently, and determine the world space coordinates of the reflected point corresponding to the fragment;

obtaining the depth of the reflected point corresponding to the coordinates of the reflected point;

If the depth of the reflected point satisfies the preset condition, the color of the scene to be sampled is sampled and decoded to obtain reflection effect data on the water surface.

Optionally, the sampling module 33 is used for:

Obtain the coordinates corresponding to the fragment in the screen space;

Determine the coordinates corresponding to the fragment in the world space based on the coordinates corresponding to the fragment in the screen space;

Get the position of the fragment relative to the camera;

determining a reflection vector based on the position of the segment relative to the camera;

Stepping a preset distance along the direction of the reflection vector from the corresponding coordinates of the fragment in the world space, the world space coordinates of the reflected point corresponding to the fragment are obtained.

Optionally, the sampling module 33 is used for:

obtain the fragment depth corresponding to the fragment;

If the depth of the reflected point is greater than the depth of the segment, and the angle between the sight vector of the camera and the reflection vector is greater than a preset angle, sampling processing and decoding processing are performed on the color of the scene to be sampled.

Optionally, the sampling module 33 is used for:

In the pixel shader, obtain the fragment that needs to be processed currently, and determine the world space coordinates of the corresponding reflected point corresponding to the fragment;

get the degree of distortion;

Offset the coordinates corresponding to the fragment in the screen space based on the distortion degree to obtain sampling coordinates;

The color of the scene to be sampled is sampled by the sampling coordinates to obtain the refraction effect data of the water surface.

Optionally, the sampling module 33 is used for:

Get pixel normals and vertex normals in camera space;

determining the difference between the vertex normal and the pixel normal;

The degree of distortion is obtained by multiplying the difference by the index of refraction.

The apparatus shown in FIG. 3 can execute the water surface rendering method provided in the embodiments shown in the foregoing FIG. 1 to FIG. 2 . For the detailed execution process and technical effects, refer to the descriptions in the foregoing embodiments, which will not be repeated here.

In a possible design, the structure of the water surface rendering apparatus shown in FIG. 3 may be implemented as a mobile terminal. As shown in FIG. 4 , the mobile terminal may include: a processor 91 and a memory 92 . Wherein, the memory 92 stores executable codes, and when the executable codes are executed by the processor 91, the processor 91 can at least implement the implementation provided in the embodiments shown in the foregoing FIG. 1 to FIG. 2 . water surface rendering method.

Optionally, the mobile terminal may further include a communication interface 93 for communicating with other devices.

In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium, where executable codes are stored on the non-transitory machine-readable storage medium, and when the executable codes are executed by the processor of the mobile terminal, The processor can at least implement the water surface rendering method provided in the above-mentioned embodiments shown in FIG. 1 to FIG. 2 .

The apparatus embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.

From the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and certainly can also be implemented by combining hardware and software. Based on this understanding, the above-mentioned technical solutions can be embodied in the form of computer products in essence or that make contributions to the prior art. In the form of a computer program product embodied on a medium (including but not limited to disk storage, CD-ROM, optical storage, etc.).

The water surface rendering method provided by the embodiment of the present invention may be executed by a certain program/software, the program/software may be provided by the network side, and the mobile terminal mentioned in the foregoing embodiment may download the program/software to a local non-easy In the volatile storage medium, and when it needs to execute the aforementioned water surface rendering method, the program/software is read into the memory by the CPU, and then the program/software is executed by the CPU to realize the water surface rendering method provided in the foregoing embodiment. , and the execution process may refer to the schematic diagrams in the aforementioned FIG. 1 to FIG. 2 .

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (11)

1. A method of water surface rendering, comprising:

finishing the rendering processing of an opaque rendering stage through a rendering pipeline corresponding to the mobile terminal to obtain the scene color of the opaque rendering stage;

in the rendering pipeline, rendering processing is carried out based on the scene color of the opaque rendering stage to obtain the color of the scene to be sampled;

and in a semi-transparent rendering stage in the rendering pipeline, sampling the color of the scene to be sampled so as to respectively obtain reflection effect data and refraction effect data of the water surface.

2. The method of claim 1, wherein the rendering based on the scene color of the opaque rendering stage comprises:

creating a rendering texture;

and binding the scene color of the opaque rendering stage stored in the color buffer as input, setting the rendering texture as a rendering target, and performing rendering processing.

3. The method according to claim 2, wherein the binding color buffer stores the scene color of the opaque rendering stage as an input, and sets the rendering texture as a rendering target, and performs the rendering process, including:

and in a pixel shader, sampling and encoding the scene color of the opaque rendering stage stored in the color buffer, and outputting the processing results of the sampling and encoding to the rendering texture.

4. The method according to claim 1, wherein the sampling the scene color to be sampled to obtain the reflection effect data of the water surface comprises:

in a pixel shader, acquiring a fragment which needs to be processed currently, and determining world space coordinates of a reflected point corresponding to the fragment;

acquiring the depth of the reflected point corresponding to the reflected point;

and if the depth of the reflected point meets a preset condition, sampling and decoding the color of the scene to be sampled to obtain reflection effect data of the water surface.

5. The method of claim 4, wherein determining world space coordinates of the reflected point corresponding to the segment comprises:

acquiring the corresponding coordinates of the fragments in a screen space;

determining the corresponding coordinates of the segment in the world space based on the corresponding coordinates of the segment in the screen space;

acquiring a position of the segment relative to a camera;

determining a reflection vector based on the position of the segment relative to the camera;

and stepping a preset distance along the direction of the reflection vector from the corresponding coordinate of the segment in the world space to obtain the world space coordinate of the reflected point.

6. The method according to claim 5, wherein if the depth of the reflected point satisfies a preset condition, performing sampling processing and decoding processing on the color of the scene to be sampled includes:

acquiring the depth of the segment corresponding to the segment;

and if the depth of the reflected point is greater than the depth of the segment, and an included angle between a sight line vector of the camera and the reflection vector is greater than a preset angle, sampling and decoding the color of the scene to be sampled.

7. The method according to claim 1, wherein the sampling the scene color to be sampled to obtain the refraction effect data of the water surface comprises:

in a pixel shader, acquiring a fragment which needs to be processed currently, and determining a corresponding coordinate of a water surface part corresponding to the fragment in a screen space;

acquiring the distortion degree;

shifting the corresponding coordinates of the segments in the screen space based on the distortion degree to obtain sampling coordinates;

and sampling the color of the scene to be sampled through the sampling coordinates to obtain the refraction effect data of the water surface.

8. The method of claim 7, wherein said obtaining a degree of distortion comprises:

acquiring a pixel normal and a vertex normal of a camera space;

determining a difference of the vertex normal minus the pixel normal;

multiplying the difference by the refractive index to obtain the degree of distortion.

9. A water surface rendering apparatus, comprising:

the opaque rendering module is used for finishing the rendering processing of an opaque rendering stage through a rendering pipeline corresponding to the mobile terminal so as to obtain the scene color of the opaque rendering stage;

a full screen rendering module, configured to perform, in the rendering pipeline, rendering processing based on the scene color of the opaque rendering stage to obtain a scene color to be sampled;

and the sampling module is used for sampling the colors of the scene to be sampled in a semitransparent rendering stage in the rendering pipeline so as to respectively obtain reflection effect data and refraction effect data of the water surface.

10. A mobile terminal, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to perform a water surface rendering method as defined in any one of claims 1-8.

11. A non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of a mobile end, causes the processor to perform the surface rendering method of any one of claims 1-8.

Images