CN114638925A - A rendering method and device based on screen space - Google Patents

Abstract

The present application provides a screen space-based rendering method and device to improve system performance. The method includes: acquiring a trigger instruction; acquiring image data of at least one frame of image; in response to the trigger instruction, rendering the image data in a specified mode to obtain at least one frame of rendered image, and the specified mode includes the following One of the modes: a first mode, a second mode, and a third mode, the first mode is a screen space reflective SSR mode, the second mode is a screen space ambient light occlusion SSAO mode, and the third mode It is a combination mode of SSR and SSAO; the rendered image of the at least one frame is output.

Description

A rendering method and device based on screen space

technical field

The present application relates to the technical field of computer graphics, and in particular, to a screen space-based rendering method and device.

Background technique

Currently, there are some technologies based on screen space in the field of real-time rendering, these technologies are to provide global illumination effects with lower precision but can realize real-time calculation. For example, screen space reflection (SSR) is a rendering technique that uses screen space for reflected lighting; screen space ambient occlusion (SSAO) is a screen space-based ambient light occlusion rendering technology.

With the continuous improvement of the performance of electronic equipment systems, in order to obtain a more realistic image display effect, SSAO rendering and SSR rendering are respectively performed on the image in the prior art. For example, the image is first rendered SSAO, and then based on the SSAO rendering The rendered image undergoes another SSR rendering. However, since each frame of image needs to be rendered in real time, if SSAO and SSR technologies are used to render images in real time in sequence, there will be defects of consuming system performance and increasing system power consumption. Therefore, the existing screen space-based rendering technology needs to be further optimized.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a screen space-based rendering method and device, which are used to optimize system performance in a scenario where SSAO and/or SSR technology is used to render a displayed image in real time.

In a first aspect, an embodiment of the present application provides a screen space-based rendering method, the method includes: acquiring a trigger instruction; acquiring image data of at least one frame of image; Rendering is performed to obtain at least one frame of rendered images, the specified mode includes one of the following modes: a first mode, a second mode, and a third mode, the first mode is a screen space reflection SSR mode, so The second mode is a screen space ambient light occlusion SSAO mode, and the third mode is a combined mode of SSR and SSAO; the at least one frame of the rendered image is output.

Compared with the way of performing SSR rendering and SSAO rendering for the image data to be rendered once in the prior art, the method provided by the embodiment of the present application can realize the rendering of the combined mode of SSR and SSAO for the image data to be rendered; and, It may also be determined to render the image data in SSR and/or SSAO mode in response to the configuration instructions. In this way, compared with the prior art, the method provided by the embodiments of the present application improves flexibility and optimizes system performance.

In a possible design, the specified mode is the third mode, the image data includes a plurality of pixels in the at least one frame of image; the image data is rendered in the specified mode to obtain The rendered image of at least one frame includes: selecting a first pixel point set corresponding to each pixel point in the plurality of pixel points for each pixel point of the plurality of pixel points; based on the first pixel point Perform SSR calculation on a set of pixels to obtain a color value; perform SSAO calculation based on the first set of pixels to obtain an occlusion value; render each pixel according to the color value and the occlusion value to obtain at least A frame of the rendered image.

In the above design, in the process of SSAO calculation, the first set of pixels selected for each pixel point obtained in the process of SSR calculation is multiplexed, so that the first pixel point set of each pixel point obtained in the process of SSR calculation is made. A set of pixels can be used not only for continuing SSR calculation, but also for SSAO calculation. Therefore, this design reduces the calculation process of selecting the first set of pixels for each pixel in the process of SSAO calculation, thereby reducing the need for The amount of calculation is reduced, and the power consumption is reduced.

In a possible design, the image data further includes the line-of-sight vector and the normal of each pixel point; the multiple pixel points are each pixel point of the multiple pixel points respectively Selecting a first set of pixel points corresponding to each pixel point includes: determining a reflected light direction based on a line of sight vector and a normal of each pixel point; selecting from the plurality of pixel points in the reflected light direction Select the first set of pixels.

In the above design, an implementation method of selecting the first pixel point set for each pixel point is given. By determining the reflected light direction for each pixel point, and further selecting the first pixel point set in the reflected light direction, the first pixel point set can be selected based on the reflected light direction. The first set of pixels selected in the reflected light direction obtains the color value of the pixel points intersecting with the reflected light direction, and then SSR rendering is implemented through the pixels corresponding to each pixel point intersecting with the reflected light direction.

In a possible design, the performing the SSAO calculation based on the first set of pixels includes: selecting at least one other ambient light direction based on the reflected light direction; At least one second pixel point set is selected from the plurality of pixel points; SSAO calculation is performed based on the first pixel point set and the at least one second pixel point set.

In the above design, based on the first pixel point set selected for each pixel point obtained in the SSR calculation process, the first pixel point set obtained in the SSR calculation process can be reused, and when the SSAO calculation is performed, at least one ambient light direction may be selected for SSAO Therefore, it can be considered that the reflected light direction used in the SSR calculation process is used as one of the ambient light directions, and based on this, other ambient light directions are selected, thereby realizing the SSAO calculation process compared with the prior art. In terms of the need to select the second pixel point set according to each ambient light direction, when the present application is implemented, the calculation amount of selecting the sampling point set in one of the ambient light directions is reduced, thereby reducing system power consumption.

In a possible design, before rendering each pixel point according to the color value and the occlusion value to obtain at least one frame of rendered image, the method further includes: and performing time domain filtering with the masking value.

In the above design, compared with the prior art, it is necessary to perform temporal filtering on the obtained color values before performing SSR rendering on the image data, and it is necessary to perform temporal filtering on the obtained occlusion values before performing SSAO rendering. In the embodiment of the application, the obtained color value and occlusion value can be filtered together, thereby reducing the processing process of time domain filtering, thereby reducing system consumption.

In a possible design, the image data belongs to a material with reflective ability, and the specified mode is the third mode.

In the above design, since SSR rendering is necessary for the materials with reflective ability in the scene to be rendered, before rendering in the combined mode of SSR and SSAO, it is determined that the image data to be rendered is a material with reflective ability. , and then perform SSR and SSAO combined mode rendering based on this part of the image data, avoiding unnecessary calculations, thereby reducing system power consumption and improving system performance.

In a second aspect, an embodiment of the present application further provides a screen space-based rendering device, the device includes an acquisition unit, a processing unit, and an output unit; wherein, the acquisition unit is used to acquire a trigger instruction; image data; the processing unit, configured to render the image data in a specified mode in response to the trigger instruction to obtain at least one frame of rendered image, where the specified mode includes one of the following modes: A mode, a second mode, and a third mode, the first mode is a screen space reflective SSR mode, the second mode is a screen space ambient light occlusion SSAO mode, and the third mode is a combined SSR and SSAO mode; The output unit is configured to output the at least one frame of the rendered image.

In a possible design, the specified mode is the third mode, and the image data includes multiple pixels in the at least one frame of image; the processing unit is specifically configured to: In the pixel points, a first pixel point set corresponding to each pixel point is respectively selected for each pixel point in the plurality of pixel points; SSR calculation is performed based on the first pixel point set to obtain a color value; SSAO calculation is performed on the first pixel point set to obtain an occlusion value; and each pixel point is rendered according to the color value and the occlusion value to obtain at least one frame of rendered image.

In a possible design, the image data further includes the line of sight vector and normal of each pixel; the processing unit is specifically configured to: determine based on the line of sight vector and normal of each pixel Reflecting light direction; selecting the first pixel point set from the plurality of pixel points in the reflected light direction.

In a possible design, the processing unit is specifically configured to: select at least one other ambient light direction based on the reflected light direction; select at least one other ambient light direction from among the plurality of pixels in the other ambient light direction Selecting at least one second pixel point set; and performing SSAO calculation based on the first pixel point set and the at least one second pixel point set.

In a possible design, the processing unit is further configured to, before rendering each pixel point according to the color value and the occlusion value to obtain at least one frame of rendered image, The color values and the occlusion values are temporally filtered.

In a possible design, the image data belongs to a material with reflective ability, and the specified mode is the third mode.

In a third aspect, an embodiment of the present application further provides a computing device, where the computing device includes a processor and a memory, the memory is coupled to the processor, and optionally further includes a display screen. The processor executes the program instructions in the memory to perform the method provided by the first aspect or any possible design of the first aspect. The display screen is used for displaying information to the user under the triggering of the processor.

In a fourth aspect, the present application provides a computing device cluster, where the computing device cluster includes at least one computing device as provided in the third aspect.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium is used to store computer instructions, and when the computer instructions are executed on a computer, the computer is made to execute the above-mentioned first aspect or any of the possible designs described.

In a sixth aspect, an embodiment of the present application provides a computer program product, where the computer program product is used to store computer instructions, and when the computer instructions are executed on a computer, the computer can execute the first aspect or any one of the above possible designs of the method described.

In a seventh aspect, an embodiment of the present application provides a chip system, where the chip system includes a processor, and may further include a memory, for implementing the method described in the first aspect or any possible design. The chip system can be composed of chips, and can also include chips and other discrete devices.

For the beneficial effects of the second to seventh aspects and implementations thereof, reference may be made to the description of the method of the first aspect and the beneficial effects of the implementations thereof.

Description of drawings

1 is a schematic structural diagram of a computer system according to an embodiment of the present application;

2a is a schematic flowchart of a screen space-based rendering method provided by an embodiment of the present application;

2b is another schematic flowchart of a screen space-based rendering method provided by an embodiment of the present application;

FIG. 3a is a schematic diagram for introducing the reflection principle provided by an embodiment of the present application;

FIG. 3b is a schematic diagram of calculating a reflection intersection according to an embodiment of the present application;

4a is a schematic diagram of selecting an ambient light direction according to an embodiment of the present application;

FIG. 4b is a schematic diagram of calculating an occlusion value according to an embodiment of the present application;

FIG. 5a is an example diagram after SSR rendering provided by an embodiment of the present application;

FIG. 5b is an example diagram after SSAO rendering provided by an embodiment of the present application;

FIG. 6 is a structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 7 is a schematic structural diagram of a screen space-based rendering apparatus according to an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

A possible application scenario of the present application is described below.

Referring to FIG. 1, which is a schematic structural diagram of a computer system according to an embodiment of the present application, applicable to the field of computer graphics, the computer system at least includes a central processing unit (CPU) and a graphics processing unit (graphics processing unit, GPU) and the display device, through the cooperative work between the CPU, the GPU and the display device, to realize the drawing of the image by the computer and display on the display device. in,

The CPU is used to perform three-dimensional (3D) modeling, thereby obtaining a 3D scene. For example, common 3D scenes include game scenes and the like.

The GPU is used to render the 3D scene obtained by the CPU, thereby obtaining image data that can be output on the display device, which can also be understood as image data in the screen space. A more realistic display effect of 3D scenes can also be obtained through GPU rendering. For example, the SSR rendering involved in the background art is used to increase the reflection effect in the 3D scene, which improves the color sense of the 3D scene; SSAO rendering is used for the 3D scene. The ambient light occlusion effect is added to the scene, which improves the layering of the 3D scene.

The display device is used to display the 3D scene after rendering on the GPU.

Based on the description in the background art, currently, SSR rendering and SSAO rendering of the image data of the scene to be rendered are generally based on multi-pass rendering technology, that is, SSAO calculation is performed in one rendering pass (PASS), and SSR calculation is performed in another PASS; then, After performing temporal filtering on the calculation results of the two PASS respectively, the image of the scene to be rendered is rendered twice; finally, the rendered rendering is obtained. Moreover, since SSAO rendering and SSR rendering are post-processing effects based on screen space, in order to achieve SSAO rendering and SSR rendering, in each PASS, the sampling points in the scene to be rendered are converted into pixels in the screen space, The processing of obtaining the depth value of the pixel in the screen space, obtaining the normal information of the pixel, etc. according to the depth map of the scene to be rendered. However, separately performing SSAO rendering and SSR rendering on the images of the scene to be rendered has the disadvantage of a large amount of computation, which will consume system performance, increase system power consumption, and lead to poor user experience.

In view of this, the present application provides a rendering method based on screen space, which can be rendered from SSAO mode, SSR mode rendering, or consider combining SSAO rendering and SSR rendering process, and realize the combination of SSAO and SSR in one PASS. Selecting a mode for rendering in the mode rendering enables the rendering technology to have more options, which improves flexibility and optimizes system performance compared with the prior art. The following describes an implementation process of a screen space-based rendering method provided by the present application through multiple embodiments.

In the following embodiments of the present application, "plurality" refers to two or more than two, and in the embodiments of the present application, "plurality" may also be understood as "at least two". "At least one" can be understood as one or more, such as one, two or more. For example, including at least one refers to including one, two or more, and does not limit which ones are included. For example, including at least one of A, B, and C, then including A, B, C, A and B, A and C, B and C, or A and B and C. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone. In addition, the character "/", unless otherwise specified, generally indicates that the related objects are an "or" relationship. Unless stated to the contrary, ordinal numbers such as "first" and "second" mentioned in the embodiments of the present application are used to distinguish multiple objects, and are not used to limit the order, sequence, priority, or importance of multiple objects.

In order to more clearly understand the contents introduced in the following embodiments, the terms and nouns that may be involved in the following are described, including:

1) The screen space, usually a two-dimensional space, is a two-dimensional representation of the 3D scene obtained by performing multiple coordinate transformations on the 3D scene established in the three-dimensional object space, thereby realizing the display on the display device as two-dimensional. image. Wherein, the implementation method of performing multiple coordinate transformations of the created 3D scene from the object space to obtain the image data in the screen space can refer to the implementation methods in the prior art, and the method provided by the present application is based on the post-processing of the obtained image data in the screen space. Therefore, the present application will not describe the coordinate transformation in detail.

Among them, the image data in the screen space is composed of multiple pixel points, and the frame buffer (G-buffer) stores the line of sight vector, color value, normal, depth value and other information corresponding to each pixel point. In the process of rendering based on screen space, first obtain image data of at least one frame of image of the scene to be rendered in screen space, and when rendering multiple pixels included in one frame of image data, you can combine the pixels in screen space Other surrounding pixels are implemented to facilitate rendering. For example, SSR rendering and SSAO rendering are technologies that implement rendering based on screen space.

Referring to FIG. 2a , a schematic flowchart of a rendering method in a screen space provided by an embodiment of the present application includes: Step S201 : obtaining a trigger instruction. Among them, the trigger instruction is used to determine the mode of rendering. An optional example, the trigger instruction is generated by the electronic device based on the processing capability of the chip. For example, if the processing capability of the chip is relatively strong, the generated trigger instruction is used to determine the rendering of the image data in the third mode, that is, to achieve Rendering is performed in the combined mode of SSR and SSAO; if the processing capability of the chip is weak, the generated trigger instruction is used to determine whether to perform SSR rendering or SSAO rendering on the image data. Or, in another optional example, the trigger instruction can also be generated according to the user's configuration. For example, if the user wants to get a more realistic game screen and selects the high-rendering mode, the corresponding generated trigger instruction is used for Determine the rendering of the image data in the third mode; if the user has a general demand for the rendering mode, but is more concerned about the system power consumption, and selects the rendering in the first mode or the second mode, the corresponding generated trigger command is used to determine the image data. The data is rendered by SSR or SSAO.

Step S202: Acquire image data of at least one frame of images of the scene to be rendered in the screen space. Exemplarily, assuming that the scene to be rendered is a game scene, in the process of playing the game, it is necessary to perform real-time rendering on the multi-frame images that constitute the dynamic picture of the game, and based on the introduction of the foregoing content, it can be obtained that SSR rendering and SSAO rendering are based on screen space. Therefore, in order to realize the rendering of the scene to be rendered, image data of at least one frame of image of the scene to be rendered in the screen space is acquired. Specifically, the required image data is read from the G-buffer, and the acquired image data is image data without SSR and/or SSAO rendering.

Step S203: In response to the trigger instruction, render the image data in a specified mode to obtain at least one frame of rendered image, where the specified mode includes one of the following modes: a first mode, a second mode, and a third mode, the first mode is a screen space reflective SSR mode, the second mode is a screen space ambient light occlusion SSAO mode, and the third mode is a combined SSR and SSAO mode. Exemplarily, each frame of image is rendered in a specified mode based on image data of each frame of image, to obtain each frame of image after rendering.

Step S204: Output the at least one frame of the rendered image. Exemplarily, after the rendered image is obtained, the rendered image data may be read and displayed by the display device included in the computer system as shown in FIG. 1 . Exemplarily, at least one frame of the rendered image is dynamically played, and the like.

By responding to the trigger instruction, the image data is rendered in one of the first mode, the second mode, and the third mode according to the trigger instruction, thereby outputting the rendered image. In this way, an appropriate rendering mode can be selected to render the image data to be rendered based on the judgment of the chip performance or the judgment of the business requirements, which optimizes the system performance and further improves the user experience.

In order to better understand the implementation process of rendering in the combination mode of SSR and SSAO provided by the embodiment of the present application, referring to FIG. 2b, another schematic flowchart of a screen space-based rendering method provided by the embodiment of the present application, the present application During implementation, the rendering is performed based on the design idea of combining SSR rendering and SSAO rendering with PASS. For example, the rendering of the combined mode of SSR and SSAO is realized through SSAO_SSR PASS in Figure 2b. The implementation process includes the following steps:

Step S1: Acquire a plurality of pixels in the image data and the depth values, normals, etc. of the pixels. Exemplarily, the SSR and/or SSAO rendering in the present application is implemented based on the screen space, so the image data of the scene to be rendered in the screen space is obtained first. Specifically, after determining the sampling points converted to the screen space in the scene to be rendered, the determined sampling points are converted to pixels in the screen space, and the display positions of the pixels are represented by two-dimensional coordinates in the screen space, for example It can be represented by (x, y); and, in order to represent the exact position of the sampling point in the scene to be rendered, it can also be represented by a depth value in the screen space, for example, it can be represented by z.

Step S2: For each pixel point in the plurality of pixel points, a first pixel point set corresponding to each pixel point is respectively selected from the plurality of pixel points included in the image data. Exemplarily, selecting the corresponding first pixel point set for each pixel point is obtained during the SSR calculation process. In order to better understand the SSR calculation, the reflection principle involved in the SSR calculation is first introduced in combination with the content shown in Figure 3a. Tracing is opposite to ray reverse tracing, which is ray tracing with the object as the starting point). After the eye looks at the reflection plane from any line of sight, it can be seen at point B on the reflection plane that the line of sight intersects the object in the direction of the reflected light. The pixel point (referred to as the reflection intersection point in the following embodiments) is, for example, the pixel point A on the object. According to the reflection principle introduced, some reflection effects due to the existence of reflected light can be seen on the reflection plane, such as the imaging effect in the mirror, the reflection in the water surface, etc. Optionally, for each pixel included in the image data, select a first set of pixels through the following steps, including: Step S21: Determine the reflected light direction based on the line of sight vector and normal of each pixel. Step S22: Selecting the first pixel point set from the plurality of pixel points in the reflected light direction.

Exemplarily, acquiring reflected light data converted from the reflected light into the screen space, where the reflected light data includes two-dimensional coordinates of multiple sampling points selected when stepping on the reflected light and depth values of the multiple sampling points; Starting from the position of the pixel point on the screen, select sampling points in the direction of the reflected light in sequence; determine the pixel points in the image data that have the same two-dimensional coordinates as the sampling point selected on the reflected light; compare the pixels with the same two-dimensional coordinates The sampling point and the depth value of the pixel point; if the depth value of the pixel point is less than the depth value of the sampling point on the reflected light, return to the steps of selecting sampling points in the direction of the reflected light in turn, until the depth value of the sampling point on the reflected light Less than or equal to the depth value of the pixel, the reflection intersection is obtained. In this way, the pixel points involved in the process of determining the reflection intersection point are the first pixel point set selected for the pixel point.

Referring to Fig. 3b, for example, there is a pixel point L0 to be rendered in the image data, the direction of the reflected light of L0 is determined, and the sampling points are selected in sequence along the reflected light direction from L0, and then the image data has the same position as the sampling point. Pixel points, such as L1-L7 in Figure 3b, compare the depth value of the up-sampling point of the reflected light at the same position with the depth value of the pixel point in the image, the depth value of the pixel point L1 is smaller than the depth value of the up-sampling point of the reflected light at the same position, Continue to compare pixel points L2, L3 . . . and so on, until it is determined that the depth value of pixel point L7 is equal to the depth value of the reflected light sampling point at the same position, then use pixel point L7 as the reflection intersection. The pixel points L1-L7 are the first pixel point set selected by the pixel point L0.

Step S2': Perform SSAO calculation based on the first pixel point set, and determine the pixel point with the largest depth value in the first pixel point set. Exemplarily, the SSAO calculation is similar to the SSR calculation, and is also processed in units of pixels included in the image data, and in the process of performing the SSAO calculation for each pixel included in the image data, it is necessary to rely on the surrounding area of each pixel. A number of other pixels are processed as sampling points. Taking any pixel in the image data as an example, the light and dark effect of the pixel on the display screen is determined according to the occlusion of the pixel to be rendered by other pixels with higher depth values around the pixel. It is understandable The brightness value of the concave place is relatively dark, and the brightness value of the convex place is relatively bright. Therefore, in the process of SSAO calculation, a set of pixel points is selected for each pixel point, and the pixel point with the largest depth value in the set of pixel points is calculated. The occlusion value of the pixel is obtained, and then the illumination intensity of the ambient light of the pixel is determined by the occlusion value.

The specific implementation is that, in general, a possible implementation of selecting a pixel point set for each pixel point is to first select multiple ambient light directions based on each pixel point, wherein the multiple ambient light directions surround The pixels to be rendered are evenly distributed. For example, two ambient light directions with a certain angle (usually 180°) and four ambient light directions that are perpendicular to each other (that is, the angle between each two ambient light directions is 90°) can be selected. °), 8 ambient light directions (the angle between each two ambient light directions is 45°) and other ambient light directions. Among them, the more ambient light directions are selected, the more suitable the ambient light shading effect obtained after SSAO calculation is to the real scene. However, based on the consideration of system performance and power consumption, the selected ambient light can be determined according to the computing power of the system chip. the number of directions. Secondly, in each ambient light direction selected for each pixel point, multiple other pixel points are selected from the pixel point as a set of pixel points in each ambient light direction. The number of pixels selected in the pixel set can also be determined according to the computing capability of the system chip, for example, 4, 8 or more pixels can be selected in each ambient light direction to obtain the pixel set; the same Therefore, the more pixels selected in each ambient light direction, the more suitable the ambient light occlusion effect obtained after SSAO calculation is to fit the real scene.

From the content introduced above, it can be obtained that if the image data is rendered in the combined mode of SSR and SSAO, the first set of pixels is selected in the reflected light direction of each pixel during the SSR calculation in step S2, and Ambient light has the characteristics of scattering, so when performing SSAO calculation for each pixel point, the conditions of the selected multiple ambient light points can be uniformly distributed around each pixel point. An optional example, the first pixel point set selected in the SSR process can be reused during the SSAO calculation process. When the application is implemented, the reflected light direction of each pixel point is used as the first ambient light direction, and the The first set of pixels is used as the set of pixels selected by each pixel in the direction of the first ambient light. For example, step S2' directly continues the SSAO calculation based on the set of pixels obtained in step S2, so that it is not necessary to perform the SSAO calculation as in the prior art. , in the process of SSR calculation, a set of pixel points is selected once, and in the process of SSAO calculation, a set of pixel points is selected again, so the calculation amount in the calculation process of SSR and SSAO is reduced by the embodiment of the present application, thereby reducing the system power consumption.

In addition, during the SSAO calculation process, multiple ambient light directions can be selected for processing. During the implementation of this application, after the first ambient light direction of the reflected light direction is obtained based on the SSR calculation, an optional implementation can also be performed through The following steps continue to perform SSAO calculation, including: Step S2'1: Select at least one other ambient light direction based on the reflected light direction.

Exemplarily, referring to Fig. 4a, following the introduction in Fig. 3a, it is assumed that 4 ambient light directions are selected for pixel B for SSAO calculation. During implementation, the reflected light direction is taken as the first ambient light direction of pixel B, and then The second ambient light direction, the third ambient light direction, and the fourth ambient light direction are selected based on the first ambient light direction, wherein the four selected ambient light directions may be two adjacent ambient light directions perpendicular to each other in the screen space relation.

Step S2'2: Select at least one second pixel point set from the plurality of pixel points in the other ambient light directions. Exemplarily, the implementation of selecting the second pixel point in other ambient light directions may be, starting from each pixel point, sequentially selecting a specified number of pixel points in each other ambient light direction as each other ambient light direction. The second set of pixels. The specified number may be preset, for example, 4 or 8 pixels are selected.

Step S2'3: Perform SSAO calculation based on the first pixel point set and the at least one second pixel point set. Exemplarily, after obtaining the first pixel point set and at least one second pixel point set, the pixel point with the largest depth value in each pixel point set is respectively determined. For example, referring to FIG. 4b, assuming that another ambient light direction is selected as the second ambient light direction, for the pixel A to be rendered, the first set of pixels in the first ambient light direction includes B1, B2, B3, B4, where B4 has the maximum depth value; the second set of pixel points in the second ambient light direction includes C1, C2, C3, and C4, where C4 has the maximum depth value.

The present application provides an embodiment of performing SSR calculation based on the first pixel point set and performing SSAO calculation based on the first pixel point set, so as to realize the sharing of pixel point sets and pixel point information in the process of SSR calculation and SSAO calculation, so that the In the scenario where SSR and SSAO are combined for rendering, part of the calculation amount is reduced, so it is not necessary to select a set of pixels for each pixel in the process of SSR calculation as in the prior art, and obtain the pixel points and store them in G - The pixel information in the buffer is calculated once; in the process of SSAO calculation, a set of pixels is selected for each pixel in each selected ambient light direction one by one, and the obtained pixels are stored in the G-buffer The pixel information in the , and perform multiple calculations. For example, assuming that 2 ambient light directions are selected for SSAO calculation, in the prior art, the pixel point set needs to be acquired twice when SSAO calculation is performed, and the pixel point set needs to be acquired once when SSR calculation is performed, so it is necessary to obtain a total of Processing of pixel point sets three times; and through the method provided in this application, a pixel point set is obtained when performing SSR calculation, and when performing SSAO calculation, it can be processed based on the pixel point set obtained in the SSR calculation, so it is only necessary to obtain a second set of pixel points. Only one set of pixel points is required. Therefore, in the implementation of the present application, SSAO calculation and SSR calculation can be realized by acquiring the set of pixel points twice, thereby reducing the amount of calculation. It should be noted that since the image data contains multiple pixels, and the scene to be rendered contains image data of multiple frames of images, if one pixel can reduce a part of the calculation amount, the rendering process of the multiple frames of images contained in the scene to be rendered is performed. , it will reduce the amount of calculation, which can reduce the power consumption of the system and improve the user experience.

In addition, by SSAO calculation and multiplexing of the first set of pixels selected in the SSR calculation process, a more realistic and accurate rendering effect can also be achieved. The reason is that if the roughness of the surface of the object is larger, since in the process of SSR calculation, the pixels are selected sequentially from each pixel in the direction of the reflected light until the pixel that intersects with the reflected light is calculated. The number of pixels included in the pixel point set in the SSR calculation process is determined according to the roughness of the object where the pixel points are located in the scene to be rendered. When the application is implemented, the pixel point set selected in the SSR calculation process is continued to be used for SSAO calculation, which may contain more pixels than the pixel point set selected when SSAO independent calculation is implemented in the prior art. For example, in the process of SSR calculation, 7 pixels may be obtained in the direction of reflected light, and then the reflection intersection point is obtained, while the original calculation of SSAO requires that 4 pixels be selected in each ambient light direction as Pixel point set, so when the first pixel point set selected in the reflected light direction is used as the pixel point set in the first ambient light direction in the SSAO calculation process, the number of pixels included in the pixel point set for SSAO calculation is 7 Therefore, the number of selected pixels is increased, so that a more realistic shading effect can be obtained, which is more in line with the real scene.

Step S3: Acquire the color value of the reflection intersection obtained in Step S2. Step S3': Calculate the occlusion value for SSAO based on the pixel with the maximum depth value obtained in Step S2'. Wherein, the execution order of steps S3 and S3' is not limited, and may be processed in parallel by different threads, or may be executed in random order.

Exemplarily, after obtaining multiple pixels with the maximum depth value in multiple ambient light directions selected for each pixel, it is assumed that they are represented by h1, h2, ..., hn, and then for each pixel, according to Information such as h1, h2, ..., hn values, and normals are calculated to obtain the occlusion value of each pixel through the existing occlusion value formula used for SSAO rendering. Among them, the occlusion value is used to adjust the illumination intensity of the ambient light displayed by each pixel point. The light intensity of the ambient light is smaller.

Step S4: Combine and output the occlusion value and the color value. An optional example, based on the color value obtained after the SSR calculation, can generally be represented by three variables, such as R (red), G (green), B (blue), and the general color value information can be represented by RGBA (alpha, the alpha channel is generally used as an opacity parameter) is carried in the four-channel color space, so it can be obtained that the utilization of the A channel is low when performing SSR rendering on image data based on color values. Therefore, when the present application is implemented, the occlusion value obtained after the SSAO calculation can be merged into the A channel of the four-channel color space used to carry the color value after the SSR calculation. That is, the output result of SSAO_SSR PASS is a four-dimensional variable containing the color value for SSR rendering and the occlusion value for SSAO rendering. For example, the expression form of the four-dimensional variable can be (R, G, B, O), where , the R, G, B represent the color value respectively, and the O represents the occlusion value.

By combining the output of the occlusion value used for SSAO rendering and the color value used for SSR rendering, it can be achieved that when displayed on a display device, a scene rendering with SSR and SSAO combined mode rendering can be obtained through one rendering. There is no need to separately perform SSAO rendering and SSR rendering on the scene to be rendered as in the prior art, so that the scene rendering process can be obtained only after two rendering processes.

Step S5: The occlusion value and the color value output in step S4 are used as input, and time domain filtering is performed. In order to make the final rendering scene rendering smoother, in the prior art, after obtaining the occlusion value and the color value, it is necessary to perform temporal filtering on the occlusion value and the color value respectively, so that the SSAO rendering and SSR rendering obtain Rendering results are optimized. When the application is implemented, the combined output based on the color value and the occlusion value is a four-dimensional variable, so the four-dimensional variable can be used as an input and input into a filter for temporal filtering to implement a smoothing operation. Therefore, the embodiments provided by the present application can implement the filtering operation on the color value used for SSR rendering and the occlusion value used for SSAO rendering through one input filter operation, thereby reducing the number of operations for temporal filtering. Thus, system performance is improved, system consumption is reduced, and user experience is improved.

Step S6: Output the scene rendering after SSAO and SSR rendering. Exemplarily, the calculation results of SSR and SSAO after each frame of image data is subjected to temporal filtering are obtained by step S5, and the calculation results are superimposed on the original image data, so that the scene effect after SSAO and SSR rendering can be output. picture.

In addition, since SSR rendering is performed for multiple pixels contained in an object with reflective capability, a possible implementation is that, before performing SSR and SSAO calculations through SSAO_SSR PASS, you can The material of each associated object (the material of some objects has reflective ability, such as mirror surface, water surface, etc.) determines the corresponding pixel point after the object is converted to the screen space, and uses the image data belonging to the material with emissive ability as input. Image data for rendering in the combined mode of SSR and SSAO.

In order to better understand the scene renderings displayed on the display device after SSR rendering and SSAO rendering, the following describes the interface display effects after SSR rendering and SSAO rendering through Figures 5a and 5b, respectively.

The effect after SSR rendering is described in conjunction with Figure 5a, and the mirror is used as an example to illustrate. Before SSR rendering is not performed, the basic shape and color information of the mirror can only be seen from the image displayed on the screen of the display device, as shown in Figure 5a As shown in 1 in the mirror, no reflection can be seen in the mirror, and the sense of color is lacking. After SSR rendering is performed, based on the SSR calculation of multiple pixels included in the mirror surface, the color values of the pixels intersecting in the reflected light direction are obtained, so the color values of the reflected intersections are displayed in the corresponding pixels. In this way, the display of objects intersecting with reflected light can be seen in the mirror surface, so as to obtain a more realistic mirror look and feel, and improve the color sense of the image, as shown in 2 in Figure 5a.

Combined with Figure 5b to illustrate the effect after SSAO rendering, the curtain is used as an example to illustrate. Before SSAO rendering is not performed, the basic shape and color information of the curtain can only be seen from the image displayed on the screen of the display device, as shown in Figure 5b As shown in 1, only the basic shape of the curtain can be seen, curtain rod, curtain edge, etc. After SSAO rendering is performed, different occlusion values are calculated based on different pixel points. After shading and adjusting the illumination intensity of the ambient light of the pixel points through the occlusion value, the illumination intensity of the ambient light of different pixels can be adjusted by different pixels. To reflect the sense of hierarchy, that is, you can see the folded shape of the curtain, and then obtain a more realistic appearance of the curtain, as shown in 2 in Figure 5b.

Based on the content introduced above, the present application mainly uses three aspects to achieve the purpose of reducing the occupation of computing resources, reducing the amount of calculation, thereby reducing the power consumption of the system and improving the performance of the system. The three aspects include: the first aspect: the SSAO calculation multiplexes the first pixel point set selected by the SSR calculation. The second aspect: Combine the occlusion value of SSAO rendering with the color value of SSR rendering and output. The third aspect: time-domain filtering is performed on the occlusion value rendered by SSAO and the color value rendered by SSR at the same time.

The following is a more accurate description of the improvement of system performance by using a screen space-based rendering method provided by the present application in conjunction with the test results. The following description is combined with Table 1, as follows:

Table 1

Number of sampling points current technology first the second aspect the third aspect Total revenue 32 18.7 21.2 (+13.3%) 22.4 (+5.6%) 23.7 (+5.8%) +23.1% 16 21.2 23.7 (+11.7%) 24.6 (+4.1%) 25.7 (+4.4%) +20.2% 8 24.5 27.1 (+10.6%) 27.2 (+0.1%) 28.3 (+4%) +14.7% 2 26.3 27.8 (+5.7%) 26.1 (-6.1%) 27.5 (+5.2%) +4.8%

According to the above Table 1, compared with the technical implementation scheme adopted in the prior art, the system performance can be improved in three aspects in this application, and the system performance can be improved by adopting at least one aspect of the implementation. , if the implementation of the three aspects is adopted at the same time, the maximum benefit can be achieved in improving the system performance. For example, when the number of sampling points in Table 1 is 32, the system performance can be improved by 13.3% through the first aspect (that is, the SSAO calculation reuses the first set of pixels selected by the SSR calculation), and the second aspect (that is, the shading of the SSAO rendering) can be improved by 13.3%. value and the color value of SSR rendering) can improve the system performance by 5.6%, and through the third aspect (that is, temporal filtering of the occlusion value of SSAO rendering and the color value of SSR rendering at the same time), the system performance can be improved by 5.8% , if the three aspects are used for rendering at the same time, the total benefit of the system performance can be improved by 23.1%.

The rendering method based on the screen space provided by the above embodiments of the present application may be executed by various computing devices, and the computing device may be an electronic device. The electronic devices may include, but are not limited to, personal computers, server computers, handheld or laptop devices, mobile devices (such as cell phones, mobile phones, tablet computers, personal digital assistants, media players, etc.), consumer electronic devices, small Computers, mainframe computers, mobile robots, drones, etc.

In the following embodiments, taking the computing device as an electronic device as an example, the screen space-based rendering method provided in the embodiment of the present application is introduced. A screen space-based rendering method provided by an embodiment of the present application is applicable to the electronic device as shown in FIG. 6 , and the specific structure of the electronic device is briefly introduced below. Referring to FIG. 6 , a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application is shown. As shown in FIG. 6 , the electronic device 600 may include a processor 610 and a collection device 620 . The processor 610 processes the data acquired by the collection device 620 . In this embodiment of the present application, the data acquired by the collection device 620 is, for example, the data of the scene to be rendered.

The processor 610 is the control center of the electronic device 600, uses various interfaces and lines to connect various parts of the entire electronic device, and executes various functions and/or functions of the electronic device 600 by running or executing the software programs and/or data stored in the memory. Data processing. The processor 610 may include one or more processing units. For example, the processing units included in the processor 610 may be the CPU and GPU involved in the foregoing embodiments, and may also be an application processor (application processor, AP), which performs modulation and demodulation processing. device, image signal processor (ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, neural-network processing unit (neural-network processing unit) , NPU), etc. one or more. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. Among them, the NPU is a neural-network (NN) computing processor. By borrowing the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process the input information and can continuously learn by itself. Applications such as intelligent cognition of the electronic device 600 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.

The capturing device 620 may include a camera 621 for capturing images or videos. The camera 621 may be a common camera or a focusing camera. Further, the camera 621 can be used to capture RGB images. The acquisition device 620 may also include one or more sensors 622, such as image sensors, infrared sensors, laser sensors, pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, acceleration sensors, speed sensors, distance sensors, proximity light sensors, environmental sensors One or more of sensors such as light sensor, fingerprint sensor, touch sensor, temperature sensor, or bone conduction sensor. The image sensor is, for example, a time of flight (TOF) sensor or a structured light sensor. The acceleration sensor and the speed sensor can form an inertial measurement unit (IMU), and the IMU can measure the three-axis attitude angle (or angular rate) and acceleration of the object.

The electronic device may also include memory 630 . The memory 630 may be used to store software programs and data, and the processor 610 may execute various functional applications and data processing of the electronic device 600 by running the software programs and data stored in the memory 630 . The memory 630 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function (such as an image acquisition function, an image recognition function, etc.), etc.; The use of the electronic device 600 creates data (such as audio data, textual information, image data, semantic maps, etc.), and the like. Additionally, memory 630 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The electronic device may also include a display device 640 including a display panel 641 for displaying information input by the user, information provided to the user, or one or more of various menu interfaces of the electronic device 600 . In the embodiment of the present application, the display device 640 is mainly used to display the display interface effect after real-time rendering based on the embodiment of the present application. Optionally, the display panel 641 may include a liquid crystal display (liquid crystal display, LCD) or an organic light-emitting diode (organic light-emitting diode, OLED) or the like.

The electronic device 600 may further include an input device 650 for receiving input numerical information, character information or contact touch operations/non-contact gestures, and generating signal inputs related to user settings and function control of the electronic device 600 . In this embodiment of the present application, the input device 650 can receive a user operation on the display interface displayed by the display device 640, so as to render the rendering scene in combination with the user operation, for example, according to the user's operation on the game interface, the game scene can be rendered Rendering, outputting special effects corresponding to user operations, etc.

In some embodiments, the processor 610 may include one or more interfaces. The interface may include a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a general-purpose serial interface bus (universal serial bus, USB) interface and so on.

The MIPI interface can be used to connect the processor 610 with peripheral devices such as the display device 640 and the camera 621 . The MIPI interface includes a camera 621 serial interface (camera serial interface, CSI), a display serial interface (displayserial interface, DSI), and the like. In some embodiments, the processor 610 communicates with the camera 621 through a CSI interface to implement the photographing function of the electronic device 600 . The processor 610 communicates with the display device 640 through the DSI interface to implement the display function of the electronic device 600 .

The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface may be used to connect the processor 610 with the camera 621, the display device 640, the sensor 622, and the like.

The USB interface is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface can be used to connect a charger to charge the electronic device 600, and can also be used to transmit data between the electronic device 600 and peripheral devices. The interface can be used to connect other electronic devices, such as augmented reality (AR) devices and the like.

It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 600 . In other embodiments of the present application, the electronic device 600 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

Although not shown in FIG. 6 , the electronic device 600 may also include other possible functional modules such as a radio frequency (RF) circuit, a power supply, a flash, an external interface, a key, a motor, etc., which will not be described herein again.

Based on the above introduction, the embodiments of the present application provide a screen space-based rendering method and apparatus, which can be applied to the electronic device architecture shown in FIG. 6 . The method therein can provide a screen space-based rendering scheme that optimizes system functions. In the embodiments of the present application, the method and the device are based on the same technical concept. Since the principles of the method and the device for solving problems are similar, the embodiments of the device and the method can be referred to each other, and repeated descriptions will not be repeated.

In the embodiments of the present application, the computing device is the electronic device 600 as an example for description, but the embodiments of the present application are not limited to be executed by other types of computing devices. The screen space-based rendering method provided by the embodiment of the present application may be executed by the electronic device 600 shown in FIG. 6 , for example, by the processor 610 in the electronic device 600 .

For the above method flow, an embodiment of the present application further provides a screen space-based rendering apparatus, and the specific implementation of the apparatus may refer to the above method flow. Based on the same inventive concept, an embodiment of the present application further provides a screen space-based rendering device, which may be the processor 610 shown in FIG. 6 or a software device applied to the processor 610, and the device may be used to execute FIG. 2a - The flow shown in Figure 4b. 7, the device 700 includes an acquisition unit 701, a processing unit 702, and an output unit 703; wherein, the acquisition unit 701 is used to acquire a trigger instruction; acquire image data of at least one frame of image; the processing unit 702, use In response to the trigger instruction, the image data is rendered in a specified mode to obtain at least one frame of rendered image, and the specified mode includes one of the following modes: a first mode, a second mode, and a first mode. Three modes, the first mode is the screen space reflection SSR mode, the second mode is the screen space ambient light occlusion SSAO mode, and the third mode is the combined SSR and SSAO mode; the output unit 703 is used for outputting The at least one frame of the rendered image.

In a possible design, the specified mode is the third mode, and the image data includes multiple pixels in the at least one frame of image; the processing unit 702 is specifically configured to: in the multiple For each pixel point in the plurality of pixel points, select a first pixel point set corresponding to each pixel point respectively; perform SSR calculation based on the first pixel point set to obtain a color value; SSAO calculation is performed on the first pixel point set to obtain an occlusion value; and each pixel point is rendered according to the color value and the occlusion value to obtain at least one frame of rendered image.

In a possible design, the image data further includes the line of sight vector and normal of each pixel; the processing unit 702 is specifically configured to: based on the line of sight vector and normal of each pixel determining the reflected light direction; and selecting the first pixel point set from the plurality of pixel points in the reflected light direction.

In a possible design, the processing unit 702 is specifically configured to: select at least one other ambient light direction based on the reflected light direction; select at least one other ambient light direction from the multiple pixel points in the other ambient light direction At least one second set of pixels is selected from among the set; SSAO calculation is performed based on the first set of pixels and the at least one set of second pixels.

In a possible design, the processing unit 702 is further configured to, before rendering each pixel point according to the color value and the occlusion value to obtain at least one frame of rendered image, The color value and the occlusion value are temporally filtered.

In a possible design, the image data belongs to a material with reflective ability, and the specified mode is the third mode.

It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and other division methods may be used in actual implementation. Each functional unit in the embodiments of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units, or may be implemented in the form of a combination of software and hardware.

According to the method provided by the embodiments of the present application, the present application further provides a computer-readable storage medium, where the computer-readable medium stores program codes, and when the program codes are run on a computer, the computer is made to execute FIGS. 2 a to 4 b The method of any one of the illustrated embodiments.

According to the method provided by the embodiment of the present application, the present application further provides a system, which includes the aforementioned one or more terminal display devices and one or more network devices.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server, or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The available media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, high-density digital video discs (DVDs)), or semiconductor media (eg, solid state discs, SSD)) etc.

The electronic equipment in the above-mentioned apparatus embodiments corresponds to the electronic equipment in the method embodiments, and corresponding steps are performed by corresponding modules or units, for example, the communication unit (transceiver) performs the steps of receiving or sending in the method embodiments, except for sending, Steps other than receiving may be performed by a processing unit (processor). For functions of specific units, reference may be made to corresponding method embodiments. The number of processors may be one or more.

The terms "component", "module", "system" and the like are used in this specification to refer to a computer-related entity, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component may be, but is not limited to, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. By way of illustration, both an application running on a computing device and the computing device may be components. One or more components may reside within a process and/or thread of execution, and a component may be localized on one computer and/or distributed between two or more computers. In addition, these components can execute from various computer readable media having various data structures stored thereon. A component may, for example, be based on a signal having one or more data packets (eg, data from two components interacting with another component between a local system, a distributed system, and/or a network, such as the Internet interacting with other systems via signals) Communicate through local and/or remote processes.

Those of ordinary skill in the art will appreciate that the various illustrative logical blocks and steps described in connection with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware accomplish. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, removable hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program codes .

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. should be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims (15)

1. a rendering method based on screen space, is characterized in that, comprises: Get trigger command; Obtain image data of at least one frame of image; In response to the trigger instruction, the image data is rendered in a specified mode to obtain at least one frame of rendered image, and the specified mode includes one of the following modes: a first mode, a second mode, and a third mode mode, the first mode is a screen space reflection SSR mode, the second mode is a screen space ambient light occlusion SSAO mode, and the third mode is a combined SSR and SSAO mode; The at least one frame of the rendered image is output. 2. The method according to claim 1, wherein the specified mode is the third mode, and the image data comprises a plurality of pixels in the at least one frame of image; The rendering of the image data in a specified mode to obtain at least one frame of rendered image includes: selecting a first pixel point set corresponding to each pixel point for each pixel point in the plurality of pixel points from the plurality of pixel points; Perform SSR calculation based on the first set of pixel points to obtain a color value; SSAO calculation is performed based on the first set of pixel points to obtain an occlusion value; Render each pixel point according to the color value and the occlusion value to obtain at least one frame of rendered image. 3. The method according to claim 2, wherein the image data further comprises the line-of-sight vector and the normal of each pixel point; The selecting the first pixel point set corresponding to each pixel point in the plurality of pixel points for each pixel point in the plurality of pixel points respectively includes: Determine the reflected light direction based on the line-of-sight vector and the normal of each pixel; The first set of pixel points is selected from the plurality of pixel points in the reflected light direction. 4. The method according to claim 3, wherein the performing SSAO calculation based on the first set of pixel points comprises: Selecting at least one other ambient light direction based on the reflected light direction; selecting at least one second set of pixels from the plurality of pixels in the other ambient light directions; SSAO calculation is performed based on the first set of pixels and the at least one second set of pixels. 5. The method according to any one of claims 2 to 4, wherein before rendering each pixel point according to the color value and the occlusion value to obtain at least one frame of rendered image, The method also includes: Temporal filtering is performed on the color value and the occlusion value. 6 . The method according to claim 1 , wherein the image data belongs to a material with reflective ability, and the specified mode is the third mode. 7 . 7. A screen space-based rendering device, wherein the device comprises an acquisition unit, a processing unit, and an output unit; Wherein, the obtaining unit is used to obtain the trigger instruction; Obtain image data of at least one frame of image; The processing unit is configured to, in response to the trigger instruction, render the image data in a specified mode to obtain at least one frame of rendered image, where the specified mode includes one of the following modes: a first mode, a The second mode and the third mode, the first mode is a screen space reflection SSR mode, the second mode is a screen space ambient light occlusion SSAO mode, and the third mode is a combination of SSR and SSAO mode; The output unit is configured to output the at least one frame of the rendered image. 8. The device according to claim 7, wherein the specified mode is the third mode, and the image data comprises a plurality of pixels in the at least one frame of image; The processing unit is specifically used for: selecting a first pixel point set corresponding to each pixel point for each pixel point in the plurality of pixel points from the plurality of pixel points; Perform SSR calculation based on the first set of pixel points to obtain a color value; SSAO calculation is performed based on the first set of pixel points to obtain an occlusion value; Render each pixel point according to the color value and the occlusion value to obtain at least one frame of rendered image. 9. The apparatus according to claim 8, wherein the image data further comprises a line of sight vector and a normal of each pixel; The processing unit is specifically used for: Determine the reflected light direction based on the line-of-sight vector and the normal of each pixel; The first set of pixel points is selected from the plurality of pixel points in the reflected light direction. 10. The apparatus according to claim 9, wherein the processing unit is specifically configured to: Selecting at least one other ambient light direction based on the reflected light direction; selecting at least one second set of pixels from the plurality of pixels in the other ambient light directions; SSAO calculation is performed based on the first set of pixels and the at least one second set of pixels. 11. The apparatus according to any one of claims 8 to 10, wherein the processing unit is further configured to render each pixel point according to the color value and the occlusion value to obtain at least the occlusion value. Temporal filtering is performed on the color value and the occlusion value before a frame of rendered image. 12 . The device according to claim 7 , wherein the image data belongs to a material with reflective ability, and the specified mode is the third mode. 13 . 13. A computing device, characterized in that the computing device comprises a processor and a memory; the memory, storing computer program instructions; The processor invokes computer program instructions in the memory to perform the method of any of claims 1-6. 14. A computing device cluster, comprising a plurality of computing devices as claimed in claim 13. 15. A computer program product comprising computer instructions which, when executed on a computing device, cause the computer to perform the method of any one of claims 1 to 6.

Images