CN115706725A - Method and device for acquiring decoding rendering configuration, electronic equipment and storage medium - Google Patents

Abstract

Provided are a decoding and rendering configuration acquisition method, device, electronic equipment, and storage medium, relating to the field of decoding and rendering in image processing technology, including: acquiring a default configuration; The stream is decoded and rendered to obtain the output frame rate and single frame delay; if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, and/or, the default The single frame delay under the configuration is greater than or equal to the second threshold, and the default configuration is adjusted to obtain the optimal configuration; wherein, the difference between the input frame rate under the optimal configuration and the output frame rate under the optimal configuration The value is less than the first threshold, and the single frame delay under the optimal configuration is less than the second threshold; the method provided by this application can determine the optimal frame rate and delay requirements for some business scenarios that require extreme experience. Optimum configuration, in order to give full play to the limit capability of the current equipment.

Description

Acquisition method, device, electronic device and storage medium of decoding rendering configuration

technical field

The embodiments of the present application relate to the field of decoding and rendering in image processing technology, and more specifically, relate to a method, device, electronic device and storage medium for acquiring a decoding and rendering configuration.

Background technique

At present, video applications are roughly divided into three categories: video calls, video players, and screen sharing. Video call applications are oriented to low-latency scenarios and have no special requirements for high resolution and high frame rate. They pay more attention to single-frame decoding delay. Generally, in this scenario, the video resolution is 480p to 720p, and the video frame rate is 30fps. For single-frame decoding delay, generally compare the single-frame decoding delay of different decoding chips (H264/H265/…) to find the configuration with the smallest delay; of course, some decoding chips may have decoding frames. This factor is also taken into account in the optimal configuration. Video player applications are oriented to high-resolution scenarios, and have no hard requirements on the video frame rate and single-frame decoding delay. Generally, the video frame rate in this scenario is only required to reach 30fps, and it does not care about chip decoding and storing frames. As long as the decoding output frame rate is stable; compared to the video frame rate and single frame decoding delay, video player applications pay more attention to the highest resolution supported by the decoding chip (H264/H265/…). Screen sharing-related applications are oriented to high-resolution and low-latency scenarios, and the decoding frame rate is generally required to be between 15fps and 30fps. In addition, screen sharing related applications will not only consider the highest resolution supported by the decoder chip (H264/H265/…), but also consider the frame storage of the decoder chip.

However, for some business scenarios that require an extreme experience, such as a business scenario that requires both the output frame rate and the single-frame decoding delay, none of the above three scenarios can meet the experience requirements.

Contents of the invention

Embodiments of the present application provide a decoding and rendering configuration acquisition method, device, electronic device, and storage medium, which can determine the optimal configuration that takes into account the output frame rate and delay requirements, so as to exert the limit capability of the current device.

On the one hand, it provides a method for obtaining decoded rendering configuration, including:

Get the default configuration;

Under the default configuration, obtain the video code stream and decode and render the video code stream to obtain the output frame rate and single frame delay;

If the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, and/or, the single frame delay under the default configuration is greater than or equal to the second threshold, the The default configuration is adjusted to obtain an optimal configuration; wherein, the difference between the input frame rate under the optimal configuration and the output frame rate under the optimal configuration is less than the first threshold, and a single frame under the optimal configuration The delay is less than the second threshold.

On the other hand, a device for acquiring a decoding rendering configuration is provided, including:

Acquisition unit, used to obtain the default configuration;

The decoding and rendering unit is used to obtain the video code stream and decode and render the video code stream under the default configuration to obtain the output frame rate and single frame delay;

The adjustment unit is used for if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, and/or, the single frame delay under the default configuration is greater than or equal to the first threshold Two thresholds, adjust the default configuration to obtain the optimal configuration; wherein, the difference between the input frame rate under the optimal configuration and the output frame rate under the optimal configuration is less than the first threshold, and the optimal configuration The single frame delay under the configuration is less than the second threshold.

In another aspect, an electronic device is provided, comprising:

A processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to execute the above method for obtaining the decoding and rendering configuration.

In another aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores computer instructions. When the computer instructions are read and executed by a processor of a computer device, the computer device executes the acquisition of the decoding and rendering configuration described above. method.

Based on the above technical solution, the terminal device obtains the default configuration, and decodes and renders the acquired video stream under the default configuration to obtain the output frame rate under the default configuration and the single frame delay under the default configuration. The difference between the input frame rate and the output frame rate under the default configuration is greater than or equal to the first threshold, and/or, the single frame delay under the default configuration is greater than or equal to the second threshold, and the terminal device performs the default configuration Adjust to obtain the optimal configuration, which means that the terminal device first detects the obtained default configuration, obtains the output frame rate and single frame delay under the default configuration, and then determines the output frame rate and Whether the single frame delay meets the standard conditions of the optimal configuration. If the output frame rate and single frame delay obtained under the default configuration are both up to standard, then the default configuration is determined as the optimal configuration. If the output frame obtained under the default configuration is If any one or both of the output frame rate and single frame delay is not up to standard, adjust the default configuration to obtain the optimal configuration that meets the output frame rate and single frame delay; on the one hand, due to the optimal The difference between the input frame rate under the configuration and the output frame rate under the optimal configuration is less than the first threshold, which is equivalent to, considering various decoding business scenarios that need to meet the frame rate requirements, it can ensure that the optimal configuration can be obtained The output frame rate of meets the requirements of the preset output frame rate, and has a certain degree of universality; Decoding business scenarios with delay requirements can ensure that the single frame delay obtained under the optimal configuration meets the preset delay requirements, and it also has a certain degree of universality.

That is, the method provided by this application checks whether the output frame rate and single frame delay obtained under the default configuration are up to the standard. If either or both of the output frame rate and single frame delay obtained under the default configuration fail to meet the standard, Then adjust the default configuration until the optimal configuration that satisfies both the output frame rate and single frame delay is obtained, which is equivalent to either or both of the output frame rate and single frame delay under the default configuration If none of them meet the standard, a limited number of adjustments are made on the basis of the default configuration to obtain the optimal configuration that meets the requirements of the output frame rate and single frame delay, which not only meets the requirements of some extreme business pairs but also takes into account the output frame rate and single frame delay demand, and exert the limit capacity of the current equipment to improve the utilization rate of the equipment.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present application. Those of ordinary skill in the art can also obtain other drawings based on these drawings without any creative effort.

FIG. 1 is an explanatory diagram of static capability detection for hardware decoding and rendering provided by an embodiment of the present application.

FIG. 2 is an explanatory diagram of dynamic capability detection for hardware decoding and rendering provided by the embodiment of the present application.

Fig. 3 is a schematic flowchart of a method for acquiring a decoding rendering configuration provided by an embodiment of the present application.

FIG. 4 is another schematic flow chart of the method for acquiring a decoding rendering configuration provided by an embodiment of the present application.

Fig. 5 is a schematic block diagram of an apparatus for acquiring a decoding rendering configuration provided by an embodiment of the present application.

FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

The application can be applied to the field of image decoding, video decoding, hardware video decoding, dedicated circuit video decoding, and real-time video decoding. For example, the solution of the present application can be combined with the Audio Video Coding Standard (AVS). For example, H.264/Audio Video Coding (AVC) standard, H.265/High Efficiency Video Coding (HEVC) standard and H.266/Versatile Video Coding (VVC) standard.

More specifically, the present application relates to a method for obtaining a decoded rendering configuration, which can be implemented by a device for obtaining a decoded rendering configuration. It should be noted that the device for obtaining the decoding and rendering configuration provided in the embodiment of the present application can be integrated in a terminal device, and the terminal device includes any integrated device for obtaining the decoding and rendering configuration, has the ability to access the Internet, and is usually equipped with various operating systems , Devices with strong video processing capabilities, such terminal devices include but are not limited to smart mobile phones, tablet computers and other small personal portable devices, such as handheld computers (Personal Digital Assistant, PDA), electronic books (electronic book, E-book ), etc., the application does not specifically limit this, of course, the device provided by the embodiment of the application can also be integrated in the server, the server can include an independently running server or a distributed server, and can also include a server composed of multiple servers Clusters or distributed systems can also provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, and big data and artificial intelligence platforms. The cloud server of the cloud computing service, the server can be connected directly or indirectly through wired or wireless communication, which is not limited in this application.

In order to facilitate the understanding of the solution of the present application, the relevant terms involved in the present application are described below.

Decoding hoarding frame: refers to the phenomenon that the hardware decoder starts to output the decoded image after passing in a certain number of video frames.

Single frame delay: refers to the time difference between the hardware decoder inputting a frame of video frame and the hardware decoder outputting the frame of video image; for decoding chips that do not store frames, the decoding single frame delay is the real decoding delay; The decoding chip, the delay of decoding a single frame will include the storage time of the previous few frames.

Input frame rate: Points to the frequency of the video stream sent by the decoder.

Output frame rate: refers to the frequency at which the decoder outputs video image frames.

Single frame reference: Refers to the image content of the current frame and the previous frame when the video frame is encoded.

Multi-frame reference: Refers to the image content of the current frame and previous frames when encoding a video frame; for some frame storage models, multi-frame reference will lead to an increase in the number of frames stored by the chip.

In order to meet the high-resolution, high frame rate, and low-latency video applications, it is necessary to try different decoding and rendering configurations to tap the maximum capabilities of the device to obtain the optimal configuration. In order to facilitate the understanding of the decoding and rendering configurations in this application scheme, The hardware decoding and rendering configuration is described below.

The decoding and rendering configuration may include: chip type, resolution of video code stream, input frame rate, rendering control type, frame dropping strategy and reference method of encoding parameters.

Wherein, the chip type may include: H264, H265, VP9, AVS, etc.

The resolution of the video code stream can include: 720p, 1080p, 2K, 4K resolution.

The input frame rate may include: 50fps, 60fps, etc.

The type of rendering control may vary according to different systems. Taking the Android platform as an example, the type of rendering control may include Surface View and Texture View.

Frame dropping policies may include: dropping frames and not dropping frames. For example, the display refreshes the screen according to the vertical synchronous signal, and for a 60Hz display device, the vertical synchronous signal is once every 16ms. Among them, in the case of frame loss, that is, multiple video images are continuously sent in two vertical synchronization signals, and only the last video image sent in is displayed; the opening of frame loss will reduce the smoothness of the picture; it should be noted that , the current rendering frequency of most monitors is 60Hz. In the case of no frame loss, the decoding frame rate can only support up to 60fps, but if there is decoding jitter or network jitter, the accumulation of delay will gradually increase the delay of decoding and rendering. At this time, you also need to enable frame loss. To reduce the overall low latency. As for the decoding frame rate of 50fps, since the upper limit frequency of rendering of the device has not been reached, even if there is decoding jitter or network jitter, there is no need to enable frame loss.

The encoding parameter reference manner may include: multi-frame reference and single-frame reference. Since the specific coding semantics will affect the single-frame decoding delay, for some chips, the number of coded reference frames will affect the number of chip decoded frames, thereby affecting the decoding delay, so the single-frame reference method needs to be used for such chips .

Optionally, the decoding and rendering configuration is a decoding and rendering configuration for hardware decoding; wherein, hardware decoding is different from software decoding, and software decoding is equivalent to a process of decompression when playing video, which can be handled by a central processing unit (CPU). However, as the resolution increases, it is difficult for ordinary CPUs to support the work of data decompression, and it is necessary to use a graphics card (GPU) to handle such repeated decoding tasks with large amounts of data.

In order to facilitate the understanding of the decoding and rendering configuration in the solution of the present application, the detection of the decoding and rendering configuration will be described in detail below with reference to FIGS. 1 to 2 .

It should be noted that the detection of the decoding rendering configuration may include the detection of the static capability of the device and the detection of the dynamic capability of the device.

Fig. 1 is a schematic block diagram of a static capability provided by an embodiment of the present application.

As shown in FIG. 1 , static capabilities may include hardware decoding capabilities and rendering capabilities; further, hardware decoding capabilities may include chip types and chip capabilities. Optionally, the chip capability may be a resolution supported by the chip. Rendering capabilities may include rendering widget types and rendering widget capabilities. Optionally, the rendering control capability may include a frame dropping policy.

It should be noted that the static capability detection refers to obtaining detailed hardware parameter information directly from the hardware interface of the device, that is, the device can obtain the static capability of the device through the static capability detection method.

For example, the chip type may include H264/H265/VP9/AVS, etc., and the chip capability may be parameters such as the resolution supported by each chip. For example, the rendering control type may include Surface View, Texture View, etc. of the Android platform, and the rendering control capability may include a frame dropping policy supported by the control, wherein the frame dropping policy may include frame dropping or no frame dropping.

FIG. 2 is a schematic flowchart of a dynamic capability detection method 200 provided by an embodiment of the present application.

As shown in Figure 2, the method 200 includes:

S210, setting an input frame rate.

S220, setting a reference mode of encoding parameters.

S230, detecting, decoding and rendering capabilities in real time.

Specifically, the method 200 can detect or acquire dynamic capabilities in real time based on the obtained static capabilities of the device, based on the set input frame rate and the set reference mode of encoding parameters. That is, the video code stream is transmitted in real time at the set input frame rate, and the encoding parameters are determined by the set reference method, and the video code stream is decoded and rendered to obtain the output frame rate and single frame delay of the device in real time. , to detect the dynamic capability of the device. Since the increase of the input frame rate will increase the operating frequency of the device, resulting in faster decoding, so, generally, the single frame delay of most devices will change with the input frame rate. The higher the input frame rate, the faster the decoding speed. The lower the frame delay. Therefore, different input frame rates will have different single-frame delays, that is, the input frame rate needs to be detected as a configuration during the device dynamic capability detection stage.

To sum up, in combination with FIG. 1 to FIG. 2 , firstly, the static capability of the device can be acquired; secondly, the dynamic capability of the device can be detected to obtain the current configuration of the device.

The detection of the static capability and the detection of the dynamic capability of the device will be described with examples below.

For example, on a TV device on an Android platform, it is necessary to find an optimal configuration that satisfies high resolution, high frame rate, and low latency.

The static capability detection of the device is as follows:

The chip type supports H264 and H265, the decoding resolution supports 720p and 1080p, the rendering control types include Surface View and Texture View, and the frame dropping strategy supports frame dropping and non-dropping, so there are 16 combinations in total.

In the dynamic capability detection stage of the device, it is necessary to detect the performance of the device at two decoding input frame rates (50fps and 60fps), and at the same time, it is necessary to detect the reference method of the encoding parameters (single-frame reference method and multi-frame reference method) Therefore, there are a total of 64 combinations of static capability detection combined with hardware decoding and rendering of the device. In order to tap the ultimate decoding and rendering capabilities of the chip, it is necessary to try all the above decoding and rendering configurations. Since the integrity detection requires 64 times to obtain the optimal configuration of the device, if the detection time for each configuration is 10 seconds, the entire detection process takes 640 seconds, and the efficiency is relatively low.

Based on this, embodiments of the present application provide a method, device, electronic device, and storage medium for acquiring a decoded rendering configuration. In the method provided in the embodiment of the present application, a complete decoding and rendering configuration test is performed on multiple devices in advance, and a default configuration is obtained after the test is completed. When the new device starts for the first time, it will be adjusted on the basis of the default configuration to obtain the optimal configuration, and the optimal configuration that matches the device will be stored, so that the subsequent official startup can directly use the optimal configuration stored locally, that is, , the method provided by this application selects the configuration with the highest occurrence frequency and the best decoding and rendering effect among multiple devices as the default configuration, if the output frame rate under the default configuration and the single frame delay under the default configuration are not up to the standard When the default configuration is adjusted, the number of detections to obtain the optimal configuration can be reduced, the detection time can be saved, and the detection efficiency can be improved.

FIG. 3 is a schematic flowchart of a method 300 for acquiring a decoding rendering configuration provided by an embodiment of the present application.

It should be understood that the method for acquiring the decoding and rendering configuration may be performed by a terminal device integrated with the acquisition device for the decoding and rendering configuration, or may be performed by a server integrated with the acquisition device for the decoding and rendering configuration. The terminal device implementation of the apparatus for obtaining the decoding and rendering configuration is taken as an example, and the method for obtaining the decoding and rendering configuration provided in this application is described in detail.

S301, obtaining a default configuration;

S302. Under the default configuration, acquire a video code stream and decode and render the video code stream to obtain an output frame rate and a single frame delay;

S303, if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, and/or, the single frame delay under the default configuration is greater than or equal to the second threshold, Adjusting the default configuration to obtain an optimal configuration; wherein, the difference between the input frame rate under the optimal configuration and the output frame rate under the optimal configuration is less than the first threshold, and the optimal configuration under the The single frame delay is less than the second threshold.

In other words, the terminal device obtains the default configuration, and decodes and renders the obtained video stream under the default configuration to obtain the output frame rate under the default configuration and the single-frame delay under the default configuration. If the input frame under the default configuration rate and the output frame rate under the default configuration is greater than or equal to the first threshold, and/or, the single frame delay under the default configuration is greater than or equal to the second threshold, then the terminal device adjusts the default configuration, to get the optimal configuration.

For example, the first threshold can take a value within 10% of the input frame rate in the default configuration. If the input frame rate is 60fps, the first threshold can be 5fps or 3fps, which is equivalent to the optimal configuration. The input frame rate and the output frame rate are very close, and the video image with a high frame rate can be output under the optimal configuration; of course, the first threshold can also be set according to the needs of the business scene, and the high frame rate may not be achieved, as long as It only needs to meet the requirements of actual business scenarios, and this application does not make specific limitations on this. For example, the second threshold may be the reciprocal of the input frame rate of the video code stream; for another example, the second threshold may be the reciprocal of the input frame rate of the video code stream and the chip's time when the video code stream is decoded and rendered. The product of the number of frames; in addition, the default configuration can be any combination of configurations in the device, and can also be the configuration with the best decoding and rendering effect detected by other devices. For example, the default configuration can be a combination of Figure 1 and Figure 2 The configuration with the best decoding and rendering effect of other devices is obtained; of course, the default configuration can also only limit some parameters of the default configuration, and the remaining parameters are determined through dynamic detection. For example, there are some models whose H265 decoding ability is stronger than H264, but the decoding output frame rate and single frame decoding delay of H264/H265 can meet the standard under the default configuration, you can set the chip type of the default configuration to unknown type, in In the dynamic detection stage, the optimal decoding chip type is first detected on the device to determine the optimal default configuration, and then the subsequent detection logic is performed.

It should be noted that the default configuration is also adjusted based on other methods to obtain the optimal configuration; for example, if the resolution under the default configuration is greater than the third threshold, the default configuration is adjusted to obtain the optimal configuration; It is equivalent to, considering the business requirements for resolution in business scenarios, based on this, the first threshold, the second threshold, and the third threshold can be determined to meet the output frame rate, single frame delay, and resolution. Decoding the configuration with the best rendering effect, of course, through the setting of the first threshold, the second threshold, and the third threshold, the optimal configuration that takes into account high frame rate, high resolution, and low delay can be detected to meet the requirements of high Output frame rate, low single frame delay and high resolution business requirements.

Based on the above technical solution, the terminal device first detects the obtained default configuration, obtains the output frame rate and single frame delay under the default configuration, and then determines whether the output frame rate and single frame delay obtained under the default configuration meet the The optimal configuration meets the standard conditions. If the output frame rate and single frame delay obtained under the default configuration are up to the standard, the default configuration is determined as the optimal configuration. If the output frame rate and single frame delay obtained under the default configuration are If either or both of them fail to meet the standard, adjust the default configuration to obtain the optimal configuration that meets the output frame rate and single frame delay; on the one hand, due to the input frame rate under the optimal configuration The difference between the output frame rate and the optimal configuration is less than the first threshold, which means that considering various decoding business scenarios that need to meet the frame rate requirements, it can ensure that the output frame rate obtained under the optimal configuration meets the predetermined Assuming that the output frame rate requirement has certain universality; on the other hand, since the single frame delay under the optimal configuration is less than the second threshold, it is equivalent to considering various decoding services that need to meet the delay requirement Scenarios, it can ensure that the single frame delay obtained under the optimal configuration meets the requirements of the preset delay, and it also has a certain degree of universality.

In addition, if the default configuration is the configuration with the highest frequency of appearance among multiple devices and the best decoding and rendering effect, compared to trying all decoding and rendering configurations to determine the optimal configuration, a limited number of detections are performed on the basis of the default configuration. In order to determine the optimal configuration, the detection efficiency can be improved.

That is, the method provided by this application checks whether the output frame rate and single frame delay obtained under the default configuration are up to the standard. If either or both of the output frame rate and single frame delay obtained under the default configuration fail to meet the standard, Then adjust the default configuration until the optimal configuration that satisfies both the output frame rate and single frame delay is obtained, which is equivalent to either or both of the output frame rate and single frame delay under the default configuration If none of them meet the standard, a limited number of adjustments are made on the basis of the default configuration to obtain the optimal configuration that meets the requirements of the output frame rate and single frame delay, which not only meets the requirements of some extreme business pairs but also takes into account the output frame rate and single frame delay demand, and exert the limit capacity of the current equipment to improve the utilization rate of the equipment.

In some embodiments of the present application, S303 may include:

If the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, adjust the chip type, reduce the input frame rate and reduce the resolution at least one of the Adjust the output frame rate under the default configuration to get the optimal configuration;

If the default single frame delay is greater than or equal to the second threshold, the optimal configuration is obtained by adjusting at least one of the rendering control type and frame dropping strategy to adjust the single frame delay under the default configuration.

In other words, if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, the terminal device adjusts the chip type, reduces the input frame rate, and reduces the resolution at least One item adjusts the output frame rate under the default configuration until the difference between the input frame rate under the adjusted configuration and the output frame rate under the adjusted configuration is less than the first threshold, that is, the adjusted configuration is optimal configuration; similarly, if the default single-frame delay is greater than or equal to the second threshold, the terminal device adjusts the single-frame delay under the default configuration by adjusting at least one of the rendering control type and the frame loss strategy, Until the single frame delay under the adjusted configuration is less than the second threshold, that is, the adjusted configuration is the optimal configuration.

For example, the chip type may be H264/H265, etc.; as another example, the rendering control type of an Android platform device may include Surface View or Texture View; the frame dropping policy may include dropping frames or not dropping frames.

In some embodiments of the present application, S303 may include:

If the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, the first configuration is obtained by adjusting the chip type under the default configuration;

If the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is less than the first threshold, determine the first configuration as the optimal configuration;

If the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is greater than or equal to the first threshold, adjust the output frame rate under the first configuration to obtain the optimal configuration .

In other words, if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, the terminal device obtains the first configuration by adjusting the chip type under the default configuration; if The difference between the input frame rate under the first configuration and the output frame rate under the first configuration is less than the first threshold, the terminal device determines the first configuration as the optimal configuration; if the first configuration under the If the difference between the input frame rate and the output frame rate under the first configuration is greater than or equal to the first threshold, the terminal device adjusts the output frame rate under the first configuration to obtain the optimal configuration.

In some embodiments of the present application, if the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is greater than or equal to the first threshold, the chip type under the first configuration Adjust to the chip type with the highest output frame rate to obtain the second configuration; adjust the output frame rate under the second configuration by reducing at least one of the input frame rate and the resolution to obtain the optimal configuration.

In other words, if the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is greater than or equal to the first threshold, the terminal device adjusts the chip type under the first configuration to the output frame rate The highest chip type to obtain the second configuration; the terminal device then adjusts the output frame rate under the second configuration by reducing at least one of the input frame rate and the resolution to obtain the optimal configuration.

If the adjustment of the chip type can no longer meet the requirements of the output frame rate and single frame delay under the optimal configuration, the second configuration can be obtained by adjusting the chip type to the chip type with the highest output frame rate, and the second configuration On the basis of lowering at least one of the input frame rate and lowering the resolution, the output frame rate is adjusted to obtain the optimal configuration; The solution provided by the application takes into account the impact of the input frame rate and resolution on the decoding configuration. On the other hand, after trying to adjust the chip type, if the difference between the input frame rate and the output frame rate cannot be satisfied. The type is adjusted to the chip type with the highest output frame rate, and on this basis, at least one of the input frame rate and resolution is reduced. Compared with directly reducing the input frame rate or resolution, the output frame rate can be relatively guaranteed. High frame rate or relatively guaranteed video stream resolution is high resolution.

In some embodiments of the present application, adjustment is made by reducing the output frame rate under the second configuration at least once to obtain the third configuration; if the input frame rate under the third configuration and the output frame under the third configuration rate difference is less than the first threshold, then determine the third configuration as the optimal configuration; if the difference between the input frame rate under the third configuration and the output frame rate under the third configuration is greater than or equal to the For the first threshold, the output frame rate under the third configuration is adjusted to obtain the optimal configuration.

In other words, the terminal device obtains the third configuration by reducing the input frame rate under the second configuration at least once; if the difference between the input frame rate under the third configuration and the output frame rate under the third configuration is less than the first A threshold, the terminal device determines the third configuration as the optimal configuration; if the difference between the input frame rate under the third configuration and the output frame rate under the third configuration is greater than or equal to the first threshold, then The terminal device adjusts the output frame rate under the third configuration to obtain the optimal configuration.

In some embodiments of the present application, the fourth configuration is obtained by reducing the resolution under the second configuration at least once; if the difference between the input frame rate under the fourth configuration and the output frame rate under the fourth configuration is less than the first threshold, determining the fourth configuration as the optimal configuration; if the difference between the input frame rate under the fourth configuration and the output frame rate under the fourth configuration is greater than or equal to the first threshold, Then adjust the output frame rate under the fourth configuration to obtain the optimal configuration.

In other words, the terminal device reduces the resolution under the second configuration at least once to obtain the fourth configuration; if the difference between the input frame rate under the fourth configuration and the output frame rate under the fourth configuration is less than the first threshold , the terminal device determines the fourth configuration as the optimal configuration; if the difference between the input frame rate under the fourth configuration and the output frame rate under the fourth configuration is greater than or equal to the first threshold, the terminal device The output frame rate under the fourth configuration is adjusted to obtain the optimal configuration.

In some embodiments of the present application, the optimal configuration is obtained by sequentially reducing the input frame rate under the second configuration and the resolution under the second configuration at least once; or sequentially reducing the input frame rate under the second configuration at least once resolution and the input frame rate under the second configuration to obtain the optimal configuration.

In other words, the terminal device adjusts the output frame rate under the second configuration by first reducing the input frame rate under the second configuration at least once, and then reducing the resolution under the second configuration, so as to obtain the optimal configuration; or The terminal device sequentially reduces the resolution under the second configuration at least once, and then reduces the input frame rate under the second configuration, and adjusts the output frame rate under the second configuration to obtain the optimal configuration.

In some embodiments of the present application, S303 may include:

If the single frame delay under the default configuration is greater than or equal to the second threshold, adjust the rendering control type under the default configuration to obtain the fifth configuration;

If the single frame delay under the fifth configuration is less than the second threshold, then determine the fifth configuration as the optimal configuration;

If the single frame delay under the fifth configuration is greater than or equal to the second threshold, the fifth configuration is adjusted to obtain the optimal configuration.

In other words, if the single frame delay under the default configuration is greater than or equal to the second threshold, the terminal device adjusts the rendering control type under the default configuration to obtain the fifth configuration; if the single frame delay under the fifth configuration is less than The second threshold, the terminal device determines the fifth configuration as the optimal configuration; if the single frame delay under the fifth configuration is greater than or equal to the second threshold, the terminal device adjusts the fifth configuration, to get the optimal configuration.

For example, for devices on the Android platform, the rendering control type may include Surface View and Texture View, and rendering performance may vary under different rendering control configurations.

It should be noted that the terminal device can configure the rendering control type in the decoding rendering device in advance, and when the rendering control type needs to be adjusted, the terminal device can directly adjust the rendering control type under the default configuration.

When adjusting the single frame delay under the default configuration, the method provided by this application takes into account that the rendering control of the device may not have enough performance at the current rendering frame rate, and the rendering control type needs to be switched, that is, the solution provided by this application starts from modifying the rendering The perspective of control type can determine the optimal configuration to meet the needs of delay business scenarios.

In some embodiments of the present application, S303 may include:

If the single frame delay under the default configuration is greater than or equal to the second threshold, then adjust the frame loss policy under the default configuration to obtain the sixth configuration;

If the single frame delay under the sixth configuration is less than the second threshold, then determine the sixth configuration as the optimal configuration;

If the single frame delay under the sixth configuration is greater than or equal to the second threshold, the sixth configuration is adjusted to obtain the optimal configuration.

In other words, if the single frame delay under the default configuration is greater than or equal to the second threshold, the terminal device adjusts the frame loss strategy under the default configuration to obtain the sixth configuration; if the single frame delay under the sixth configuration is less than The second threshold, the terminal device determines the sixth configuration as the optimal configuration; if the single frame delay under the sixth configuration is greater than or equal to the second threshold, the terminal device adjusts the sixth configuration, to get the optimal configuration.

It should be noted that the frame dropping policy may include frame dropping and no frame dropping. In addition, since most models have a display frequency upper limit of 60Hz, high frame rate scenarios often require a decoding frame rate of 60fps, and the upper limit of display frequency of many devices is also 60fps. The internal decoding and rendering frequency exceeds 60fps. Therefore, the method provided by this application takes into account the use of an appropriate rendering frame loss strategy, which can effectively reduce delay and reduce the cumulative effect of delay caused by network jitter. It should be noted that the terminal device can configure the frame dropping policy in the decoding and rendering device in advance, and when the frame dropping policy needs to be adjusted, the terminal device can directly adjust the frame dropping policy under the default configuration.

When adjusting the single frame delay under the default configuration, the method provided by this application takes into account that the device may have a rendering bottleneck, and the frame loss strategy needs to be adjusted, that is, the solution provided by this application can determine the satisfaction of The optimal configuration required by the delay business scenario, and the cumulative effect of delay caused by network jitter can also be reduced by adjusting the frame loss strategy.

In some embodiments of the present application, method 300 may further include:

If the chip under the optimal configuration is a frame chip, the encoding parameters are determined based on multi-frame reference;

If the chip under the optimal configuration is a non-frame chip, the encoding parameter is determined based on a single frame reference.

For example, for the Android platform, for most frame chips, specific coding semantics (for example, the number of reference frames) will affect the number of frames decoded by the chip. The frame reference method has fewer stored frames, so that the decoding delay of a single frame is lower; and for chips that do not store frames, for better video quality, the multi-frame reference method can be used to determine the encoding parameters.

It should be noted that there is generally no frame hoarding phenomenon on the Windows and Mac terminals, but there are still phenomena that different encoding parameters affect the decoding and rendering performance. At this time, it is still necessary to detect the optimal encoding parameters in this link.

By considering the impact of encoding parameters on the decoding and rendering capabilities of the device under the optimal configuration, the optimal encoding configuration is determined, and finally the optimal configuration that takes into account encoding, decoding, and rendering is realized.

In some embodiments of the present application, before S301, the method may further include:

The configuration with the highest occurrence frequency among the multiple configurations is determined as the default configuration; the multiple configurations include the configuration with the best decoding and rendering effect when performing a decoding and rendering test for each of the multiple devices.

Exemplarily, to select the default configuration of the TV device on the Android platform, it is necessary to conduct an integrity test on a certain range of TV devices on the Android platform in advance, and select the configuration with the highest frequency of occurrence and the best decoding and rendering effect as the TV device on the Android platform The default configuration; for example, the default configuration can be H264+1080p+60fps+SurfaceView+no frame loss+video encoding multi-frame reference; where H264 is the chip type under the default configuration, and 1080p is the resolution of the video stream under the default configuration , 60fps is the input frame rate under the default configuration, Surface View is the control type under the default configuration, no frame loss is the frame loss strategy under the default configuration, and video encoding multi-frame reference is the reference method of encoding parameters under the default configuration.

Since the configuration with the highest frequency of occurrence among the configurations with the best decoding and rendering effects corresponding to multiple devices is determined as the default configuration, that is, the default configuration is obtained based on a certain number of devices and has certain universality. The default configuration of most devices is the optimal configuration; for the rest of the devices, only some configuration adjustments need to be made on the default configuration to find the optimal configuration. The configuration with the highest occurrence frequency in the configurations is determined as the default configuration, which can reduce the number of detection times for detecting the optimal configuration and improve detection efficiency.

In some embodiments of the present application, the second threshold is the reciprocal of the input frame rate of the video code stream; or the second threshold is the reciprocal of the input frame rate of the video code stream and the decoding and rendering of the video code stream The product of the number of frames of the time chip.

In other words, for a chip that does not decode frames, the second threshold can be 1/input frame rate; for a chip that decodes frames, the single frame delay needs to consider the number of frames stored by the chip. For example, for a chip that decodes 3 frames, the video image of the nth frame will be output from the decoder only when the video code stream of the n+4th frame is input, because the single frame delay at this time will additionally calculate the previous 3 frame frames Time, that is, 1/input frame rate*3, that is, the second threshold may be 1/decoding input frame rate*(1+number of stored frames).

By determining the second threshold as the reciprocal of the input frame rate of the video code stream; or determining the second threshold as the reciprocal of the input frame rate of the video code stream and the seven frames of the chip when the video code stream is decoded and rendered The product of the number is equivalent to that the single frame delay under the optimal configuration is less than the theoretical value of the time difference between the hardware decoder passing in a frame of video and the hardware decoder outputting the frame of video, that is, achieving low latency under the optimal configuration It can meet the low-latency business requirements in extreme business scenarios.

FIG. 4 is another schematic flowchart of a method 400 for acquiring a decoding rendering configuration provided by an embodiment of the present application. It should be understood that the method for acquiring the decoding and rendering configuration may be performed by a terminal device integrated with the acquisition device for the decoding and rendering configuration, or may be performed by a server integrated with the acquisition device for the decoding and rendering configuration. The implementation of the terminal device of the apparatus for obtaining a decoding and rendering configuration is taken as an example, and another schematic flow of the method for obtaining a decoding and rendering configuration provided in this application is described in detail.

S401. The terminal device obtains a default configuration.

S402. The terminal device obtains the output frame rate under the default configuration and the single frame delay under the default configuration.

S403. The terminal device determines whether the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is smaller than a first threshold? When the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, execute S404; the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is less than When the first threshold is reached, execute S411.

S404. The terminal device adjusts the chip type under the default configuration to obtain the first configuration.

S405. The terminal device determines whether the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is smaller than a first threshold? When the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is greater than or equal to the first threshold, execute S406; the input frame rate under the first configuration and the output frame rate under the first configuration If the difference is smaller than the first threshold, execute S411.

S406. The terminal device adjusts the chip type under the first configuration to the chip type with the highest output frame rate to obtain the second configuration.

S407. The terminal device reduces the input frame rate under the current configuration.

S408. The terminal device determines whether the difference between the input frame rate under the configuration after the input frame rate is reduced and the output frame rate under the configuration after the input frame rate is reduced is smaller than a first threshold? When the difference between the input frame rate under the configuration after the input frame rate is reduced and the output frame rate under the configuration after the input frame rate is reduced is greater than or equal to the first threshold, execute S409; When the difference between the input frame rate and the output frame rate under the configuration after the input frame rate is reduced is smaller than the first threshold, execute S411.

S409, reducing the resolution under the configuration after the input frame rate is reduced, to obtain a new current configuration.

S410. The terminal device determines whether the difference between the input frame rate under the new current configuration and the output frame rate under the new current configuration is smaller than a first threshold? When the difference between the input frame rate under the new current configuration and the output frame rate under the new current configuration is greater than or equal to the first threshold, determine the new current configuration as the current configuration, and perform S407; under the new current configuration When the difference between the input frame rate and the output frame rate under the new current configuration is smaller than the first threshold, execute S411.

S411, the terminal device determines whether the single frame delay under the default configuration is less than the second threshold; when the single frame delay under the default configuration is greater than or equal to the second threshold, execute S412; the single frame delay under the default configuration is less than the second threshold When the threshold is two, the default configuration is the optimal configuration, and S415 is executed.

S412. The terminal device adjusts the rendering control type and the frame dropping strategy to obtain the sixth configuration.

S413. The terminal device determines whether the single frame delay under the sixth configuration is smaller than the second threshold? If the single frame delay under the sixth configuration is less than the second threshold, then the sixth configuration is the optimal configuration, and execute S415; if the single frame delay under the sixth configuration is greater than or equal to the second threshold, execute S414.

S414. The terminal device adjusts the sixth configuration to obtain an optimal configuration.

S415. Does the terminal device need to modify the reference method for determining the coding parameters under the optimal configuration? If the reference mode of the encoding parameter under the optimal configuration needs to be modified, execute S416; if the reference mode of the encoding parameter under the optimal configuration does not need to be modified, execute S417.

S416, the terminal device modifies the reference mode of the encoding parameter.

S417, the terminal device obtains an optimal configuration that takes into account the optimal configuration of encoding, decoding, and rendering.

In other words, the terminal device first detects the default configuration to obtain the output frame rate and single frame delay under the default configuration. If both the output frame rate and single frame delay obtained under the default configuration meet the standard, the default configuration is the optimal configuration, and the optimal encoding parameters are detected on the basis of the optimal configuration. If the output frame rate under the default configuration meets the standard, and the single-frame decoding delay under the default configuration does not meet the standard, you need to modify the configuration parameters that support rendering capabilities. If the decoding output frame rate under the default configuration does not meet the standard, first modify the decoding chip type under the default configuration, then reduce the decoding input frame rate, and then reduce the decoding resolution until the decoding output frame rate that meets the conditions of the optimal configuration is detected. .

It should be noted that the default configuration may be the configuration with the highest occurrence frequency among the configurations with the best decoding and rendering effects corresponding to multiple devices. For example, on a TV device on an Android platform, configurations that need to be detected include: chip types include H264 and H265, decoding resolutions include 1080p and 720p, input frame rates include 60fps and 50fps, and rendering control types include Surface View and Texture View , The rendering frame loss strategy includes frame loss and no frame loss, and the reference methods of encoding parameters include single frame reference and multi-frame reference. There are 64 combinations in total, and 64 times are required for complete detection. However, under this default configuration, the configuration with the highest frequency among the configurations with the best decoding and rendering effects corresponding to multiple devices, the first detection of the default configuration is completed, and the results of most devices are that the output frame rate reaches the standard, If the delay of a single frame meets the standard and there is no frame hoarding phenomenon in decoding, the default configuration is the optimal configuration at this time, that is, only one detection is required at this time. On the basis of the optimal configuration, for the frame storage chip, an additional detection of the encoding parameter reference mode is required, and a total of two detections are required. In the case that the output frame rate is up to the standard and the single frame delay is not up to the standard (that is, the decoding ability is sufficient and the rendering performance is insufficient), it only needs to add 3 additional detections (one detection is required to adjust the rendering control type, and one detection is required to adjust the frame loss strategy. Once, for the frame chip to increase the reference mode detection of encoding parameters once), and select the optimal rendering configuration. Even in the worst case (both the output frame rate and the single frame delay are not up to standard), it is far below the 64 times of full detection.

Based on the above technical solution, the terminal device first detects the obtained default configuration, obtains the output frame rate and single frame delay under the default configuration, and then determines whether the output frame rate and single frame delay obtained under the default configuration meet the standard , if both of them meet the standard, the default configuration is determined as the optimal configuration, if either or both of the output frame rate and single frame delay obtained under the default configuration are not up to standard, then the default configuration is determined Adjust to obtain the optimal configuration that meets the output frame rate and single frame delay; on the one hand, because the difference between the input frame rate under the optimal configuration and the output frame rate under the optimal configuration is less than the first The threshold is equivalent to, considering various decoding business scenarios that need to meet the frame rate requirements, it can ensure that the output frame rate obtained under the optimal configuration meets the preset output frame rate requirements, and has a certain degree of universality; on the other hand , since the single frame delay under the optimal configuration is less than the second threshold, it is equivalent to, considering various decoding business scenarios that need to meet the delay requirements, it can ensure that the single frame delay obtained under the optimal configuration meets the predetermined The requirement of delay time also has a certain degree of universality.

In addition, if the default configuration is the configuration with the highest frequency of appearance among multiple devices and the best decoding and rendering effect, compared to trying all decoding and rendering configurations to determine the optimal configuration, a limited number of detections are performed on the basis of the default configuration. In order to determine the optimal configuration, the detection efficiency can be improved.

That is, the method provided by this application checks whether the output frame rate and single frame delay obtained under the default configuration are up to the standard. If either or both of the output frame rate and single frame delay obtained under the default configuration fail to meet the standard, Then adjust the default configuration until the optimal configuration that satisfies both the output frame rate and single frame delay is obtained, which is equivalent to either or both of the output frame rate and single frame delay under the default configuration If none of them meet the standard, a limited number of adjustments are made on the basis of the default configuration to obtain the optimal configuration that meets the requirements of the output frame rate and single frame delay, which not only meets the requirements of some extreme business pairs but also takes into account the output frame rate and single frame delay demand, and exert the limit capacity of the current equipment to improve the utilization rate of the equipment.

It should be noted that in the above description, the "standard" involved includes "output frame rate up to standard" and "single frame delay up to standard"; "output frame rate up to standard" means that if the input frame rate and When the difference of the output frame rate under this configuration is less than the first threshold, the output frame rate under this configuration meets the standard; similarly, "single frame delay meets the standard" means that the single frame delay under a certain configuration is less than the second threshold , then the single frame delay under this configuration meets the standard.

It should be noted that in the above description, the terms "first\second\third\fourth\fifth\sixth" are only used to distinguish similar objects, and do not represent a specific ordering of objects. It is understood that "first\second\third\fourth\fifth\sixth" can be exchanged for a specific order or sequence if allowed, and should not be a limitation of this application.

It should be noted that, in the embodiment of the present invention, the term "and/or" is only an association relationship describing associated objects, indicating that there may be three relationships. Specifically, A and/or B may mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in this article generally indicates that the contextual objects are an "or" relationship.

The preferred embodiments of the present application have been described in detail above in conjunction with the accompanying drawings. However, the present application is not limited to the specific details in the above embodiments. Within the scope of the technical concept of the present application, various simple modifications can be made to the technical solutions of the present application. These simple modifications all belong to the protection scope of the present application. For example, the various specific technical features described in the above specific implementation manners can be combined in any suitable manner if there is no contradiction. Separately. As another example, any combination of various implementations of the present application can also be made, as long as they do not violate the idea of the present application, they should also be regarded as the content disclosed in the present application.

It should also be understood that in the various method embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the order of execution, and the order of execution of the processes should be determined by their functions and internal logic, and should not be used in this application. The implementation of the examples constitutes no limitation.

The method provided by the embodiment of the present application is described above, and the device provided by the embodiment of the present application is described below.

FIG. 5 is a schematic block diagram of an apparatus 500 for acquiring a decoding rendering configuration provided by an embodiment of the present application.

As shown in FIG. 5, the acquisition device 500 of the decoded rendering configuration may include but not limited to:

An acquisition unit 510, configured to acquire a default configuration;

The decoding and rendering unit 520 is configured to obtain the video code stream and decode and render the video code stream under the default configuration, so as to obtain the output frame rate and single frame delay;

The adjustment unit 530 is configured to if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to a first threshold, and/or, the single frame delay under the default configuration is greater than or equal to The second threshold is to adjust the default configuration to obtain an optimal configuration; wherein, the difference between the input frame rate under the optimal configuration and the output frame rate under the optimal configuration is smaller than the first threshold, and the optimal The single frame delay under the optimal configuration is less than the second threshold.

In some embodiments of the present application, the adjustment unit 530 can be used to:

If the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, adjust the chip type, reduce the input frame rate and reduce the resolution at least one of the Adjust the output frame rate under the default configuration to get the optimal configuration;

If the default single frame delay is greater than or equal to the second threshold, the optimal configuration is obtained by adjusting at least one of the rendering control type and frame dropping strategy to adjust the single frame delay under the default configuration.

In some embodiments of the present application, the adjustment unit 530 can also be used to:

If the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, the first configuration is obtained by adjusting the chip type under the default configuration;

If the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is less than the first threshold, then determine the first configuration as the optimal configuration;

If the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is greater than or equal to the first threshold, then adjust the output frame rate under the first configuration to obtain the optimal configuration.

In some embodiments of the present application, the adjustment unit 530 can also be used to:

If the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is greater than or equal to the first threshold, adjust the chip type under the first configuration to the chip type with the highest output frame rate, to get the second configuration;

The output frame rate under the second configuration is adjusted by reducing at least one of the input frame rate and the resolution, so as to obtain the optimal configuration.

In some embodiments of the present application, the adjustment unit 530 can also be used to:

Obtaining a third configuration by reducing the input frame rate under the second configuration at least once;

If the difference between the input frame rate under the third configuration and the output frame rate under the third configuration is less than the first threshold, then determine the third configuration as the optimal configuration;

If the difference between the input frame rate under the third configuration and the output frame rate under the third configuration is greater than or equal to the first threshold, then adjust the output frame rate under the third configuration to obtain the optimal configuration.

In some embodiments of the present application, the adjustment unit 530 can also be used to:

obtaining a fourth configuration by reducing the resolution under the second configuration at least once;

If the difference between the input frame rate under the fourth configuration and the output frame rate under the fourth configuration is less than the first threshold, then determine the fourth configuration as the optimal configuration;

If the difference between the input frame rate under the fourth configuration and the output frame rate under the fourth configuration is greater than or equal to the first threshold, then adjust the output frame rate under the fourth configuration to obtain the optimal configuration.

In some embodiments of the present application, the adjustment unit 530 can also be used to:

The optimal configuration is obtained by sequentially reducing the input frame rate under the second configuration and the resolution under the second configuration at least once; or

The optimal configuration is obtained by sequentially reducing the resolution under the second configuration and the input frame rate under the second configuration at least once.

In some embodiments of the present application, the adjustment unit 530 can also be used to:

If the single frame delay under the default configuration is greater than or equal to the second threshold, adjust the rendering control type under the default configuration to obtain the fifth configuration;

If the single frame delay under the fifth configuration is less than the second threshold, then determine the fifth configuration as the optimal configuration;

If the single frame delay under the fifth configuration is greater than or equal to the second threshold, the fifth configuration is adjusted to obtain the optimal configuration.

In some embodiments of the present application, the adjustment unit 530 can also be used to:

If the single frame delay under the default configuration is greater than or equal to the second threshold, then adjust the frame loss policy under the default configuration to obtain the sixth configuration;

If the single frame delay under the sixth configuration is less than the second threshold, then determine the sixth configuration as the optimal configuration;

If the single frame delay under the sixth configuration is greater than or equal to the second threshold, the sixth configuration is adjusted to obtain the optimal configuration.

In some embodiments of the present application, the device 500 may further include:

The determination unit is specifically used to determine the encoding parameters based on multi-frame reference if the chip under the optimal configuration is a frame chip; if the chip under the optimal configuration is a non-frame chip, then based on single frame reference way to determine the encoding parameters.

In some embodiments of the present application, the determination unit can also be used for:

The configuration with the highest occurrence frequency among the multiple configurations is determined as the default configuration; the multiple configurations include the configuration with the best decoding and rendering effect when performing a decoding and rendering test for each of the multiple devices.

In some embodiments of the present application, the determining unit can also be used for: the second threshold is the reciprocal of the input frame rate of the video code stream; or the second threshold is the reciprocal of the input frame rate of the video code stream The product of the number of frames of the chip when the video code stream is decoded and rendered.

It should be understood that the device embodiment and the method embodiment may correspond to each other, and similar descriptions may refer to the method embodiment. To avoid repetition, details are not repeated here. For example, the apparatus 500 may correspond to a corresponding body that executes the methods 300 to 400 in the embodiments of the present application, and each unit in the apparatus 500 is to implement the corresponding processes in the methods 300 to 400 respectively. For the sake of brevity, details are not repeated here.

It should also be understood that the various units in the device 500 involved in the embodiment of the present application may be separately or all combined into one or several other units to form, or one (some) of the units may be further divided into functional Multiple smaller units can realize the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In practical applications, the functions of one unit may also be realized by multiple units, or the functions of multiple units may be realized by one unit. In other embodiments of the present application, the apparatus 500 may also include other units. In practical applications, these functions may also be implemented with the assistance of other units, and may be implemented cooperatively by multiple units. According to another embodiment of the present application, a general-purpose computing device including a general-purpose computer such as a central processing unit (CPU), a random access storage medium (RAM), a read-only storage medium (ROM) and a storage element Run a computer program (including program code) capable of executing each step involved in the corresponding method on the computer to construct the device 500 involved in the embodiment of the present application, and implement the method for obtaining the decoding and rendering configuration in the embodiment of the present application. Wherein, the computer program may be recorded in, for example, a computer-readable storage medium, loaded in the electronic device through the computer-readable storage medium, and run therein, to implement the corresponding method of the embodiment of the present application.

In other words, the units mentioned above can be implemented in the form of hardware, can also be implemented by instructions in the form of software, and can also be implemented in the form of a combination of software and hardware. Specifically, each step of the method embodiment in the embodiment of the present application can be completed by an integrated logic circuit of the hardware in the processor and/or instructions in the form of software, and the steps of the method disclosed in the embodiment of the present application can be directly embodied as hardware The execution of the decoding processor is completed, or the combination of hardware and software in the decoding processor is used to complete the execution. Optionally, the software may be located in mature storage media in the field such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, and registers. The storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps in the above method embodiments in combination with its hardware.

FIG. 6 is a schematic structural diagram of an electronic device 600 provided by an embodiment of the present application.

As shown in FIG. 6 , the electronic device 600 includes at least a processor 610 and a computer-readable storage medium 620 . Wherein, the processor 610 and the computer-readable storage medium 620 may be connected through a bus or in other ways. The computer-readable storage medium 620 is used for storing a computer program 621 , and the computer program 621 includes computer instructions, and the processor 610 is used for executing the computer instructions stored in the computer-readable storage medium 620 . The processor 610 is the calculation core and the control core of the electronic device 600, which is suitable for implementing one or more computer instructions, specifically for loading and executing one or more computer instructions so as to realize corresponding method procedures or corresponding functions.

As an example, the processor 610 may also be called a central processing unit (Central Processing Unit, CPU). The processor 610 may include but not limited to: a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) Or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

As an example, the computer-readable storage medium 620 can be a high-speed RAM memory, or a non-volatile memory (Non-VolatileMemory), such as at least one disk memory; computer readable storage medium. Specifically, the computer-readable storage medium 620 includes, but is not limited to: volatile memory and/or non-volatile memory. Wherein, the non-volatile memory may be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electronically programmable Erase Programmable Read-Only Memory (Electrically EPROM, EEPROM) or Flash. The volatile memory can be Random Access Memory (RAM), which acts as an external cache. By way of illustration and not limitation, many forms of RAM are available such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double DataRate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (synch link DRAM, SLDRAM ) and direct memory bus random access memory (Direct Rambus RAM, DR RAM).

In one implementation, the electronic device 600 may be the acquiring device 500 for decoding and rendering configuration shown in FIG. 5; computer instructions are stored in the computer-readable storage medium 620; The computer instructions stored in the medium 620 are used to implement the corresponding steps in the method embodiments shown in FIGS. To avoid repetition, I won't repeat them here.

According to another aspect of the present application, the embodiment of the present application further provides a computer-readable storage medium (Memory). The computer-readable storage medium is a storage device in the electronic device 600 and is used to store programs and data. For example, computer readable storage medium 620 . It can be understood that the computer-readable storage medium 620 here may include a built-in storage medium in the electronic device 600 , and of course may also include an extended storage medium supported by the electronic device 600 . The computer-readable storage medium provides storage space, and the storage space stores the operating system of the electronic device 600 . Moreover, one or more computer instructions adapted to be loaded and executed by the processor 610 are also stored in the storage space, and these computer instructions may be one or more computer programs 621 (including program codes).

The electronic device 600 may further include: a transceiver 630 , and the transceiver 630 may be connected to the processor 610 or the computer-readable storage medium 620 .

Wherein, the computer-readable storage medium 620 can control the transceiver 630 to communicate with other devices, specifically, can send information or data to other devices, or receive information or data sent by other devices. Transceiver 630 may include a transmitter and a receiver. The transceiver 630 may further include antennas, and the number of antennas may be one or more.

According to another aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. For example, computer program 621 . At this time, the electronic device 600 may be a computer, the processor 610 reads the computer instructions from the computer-readable storage medium 620, and the processor 610 executes the computer instructions, so that the computer executes the decoding and rendering configurations provided in the above-mentioned various optional ways method of obtaining .

In other words, when implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the procedures of the embodiments of the present application are run in whole or in part or the functions of the embodiments of the present application are realized. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, from a website, computer, server, or data center via Wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) transmission to another website site, computer, server or data center.

Those skilled in the art can appreciate that the units and process steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

Finally, it should be noted that the above is only a specific embodiment of the application, but the scope of protection of the application is not limited thereto. Any person familiar with the technical field can easily think of changes or modifications within the technical scope disclosed in this application. Replacement should be covered within the protection scope of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims (15)

1. A method for acquiring a decoding rendering configuration, comprising: Get the default configuration; Under the default configuration, acquire a video code stream and decode and render the video code stream to obtain an output frame rate and a single frame delay; If the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to a first threshold, and/or, the single frame delay under the default configuration is greater than or equal to a second threshold , adjust the default configuration to obtain an optimal configuration; wherein, the difference between the input frame rate under the optimal configuration and the output frame rate under the optimal configuration is less than the first threshold, and the The single frame delay under the optimal configuration is less than the second threshold. 2. The method according to claim 1, wherein if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to a first threshold, and/or , if the single frame delay under the default configuration is greater than or equal to the second threshold, then adjust the default configuration to obtain an optimal configuration, including: If the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, at least one of adjusting the chip type, reducing the input frame rate, and reducing the resolution Item adjusts the output frame rate under the default configuration to obtain the optimal configuration; If the default single-frame delay is greater than or equal to the second threshold, adjust the single-frame delay under the default configuration by adjusting at least one of the rendering control type and the frame loss strategy to obtain the maximum Optimal configuration. 3. The method according to claim 1, wherein if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to a first threshold, and/or , if the single frame delay under the default configuration is greater than or equal to the second threshold, then adjust the default configuration to obtain an optimal configuration, including: If the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first threshold, the first configuration is obtained by adjusting the chip type under the default configuration; If the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is less than the first threshold, then determine the first configuration as the optimal configuration; If the difference between the input frame rate under the first configuration and the output frame rate under the first configuration is greater than or equal to the first threshold, then adjust the output frame rate under the first configuration to get the optimal configuration. 4. The method according to claim 3, wherein the adjusting the output frame rate under the first configuration to obtain the optimal configuration comprises: adjusting the chip type under the first configuration to the chip type with the highest output frame rate to obtain a second configuration; Adjusting the output frame rate under the second configuration by reducing at least one of the input frame rate and the resolution, so as to obtain the optimal configuration. 5. The method according to claim 4, wherein the output frame rate under the second configuration is adjusted by reducing at least one of the input frame rate and the resolution, so as to obtain the optimum Optimal configuration, including: obtaining a third configuration by reducing the input frame rate under the second configuration at least once; If the difference between the input frame rate under the third configuration and the output frame rate under the third configuration is smaller than the first threshold, then determine the third configuration as the optimal configuration; If the difference between the input frame rate under the third configuration and the output frame rate under the third configuration is greater than or equal to the first threshold, then adjust the output frame rate under the third configuration, so that get the optimal configuration. 6. The method according to claim 4, wherein the output frame rate under the second configuration is adjusted by reducing at least one of the input frame rate and the resolution, so as to obtain the optimum Optimal configuration, including: obtaining a fourth configuration by reducing the resolution under the second configuration at least once; If the difference between the input frame rate under the fourth configuration and the output frame rate under the fourth configuration is smaller than the first threshold, then determine the fourth configuration as the optimal configuration; If the difference between the input frame rate under the fourth configuration and the output frame rate under the fourth configuration is greater than or equal to the first threshold, then adjust the output frame rate under the fourth configuration, so that get the optimal configuration. 7. The method according to claim 4, wherein the output frame rate under the second configuration is adjusted by reducing at least one of the input frame rate and the resolution, so as to obtain the optimum Optimal configuration, including: The optimal configuration is obtained by sequentially reducing the input frame rate under the second configuration and the resolution under the second configuration at least once; or The optimal configuration is obtained by sequentially reducing the resolution under the second configuration and the input frame rate under the second configuration at least once. 8. The method according to any one of claims 1 to 7, wherein if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first A threshold, and/or, if the single frame delay under the default configuration is greater than or equal to a second threshold, then adjust the default configuration to obtain an optimal configuration, including: If the single frame delay under the default configuration is greater than or equal to the second threshold, then adjust the rendering control type under the default configuration to obtain a fifth configuration; If the single frame delay under the fifth configuration is less than the second threshold, then determine the fifth configuration as the optimal configuration; If the single frame delay under the fifth configuration is greater than or equal to the second threshold, then adjust the fifth configuration to obtain the optimal configuration. 9. The method according to any one of claims 1 to 7, wherein if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to the first A threshold, and/or, if the single frame delay under the default configuration is greater than or equal to a second threshold, then adjust the default configuration to obtain an optimal configuration, including: If the single frame delay under the default configuration is greater than or equal to the second threshold, then adjust the frame loss strategy under the default configuration to obtain the sixth configuration; If the single frame delay under the sixth configuration is less than the second threshold, then determine the sixth configuration as the optimal configuration; If the single frame delay under the sixth configuration is greater than or equal to the second threshold, then adjust the sixth configuration to obtain the optimal configuration. 10. The method according to any one of claims 1 to 7, further comprising: If the chip under the optimal configuration is a frame chip, then determine the coding parameters based on multi-frame reference; If the chip under the optimal configuration is a non-frame chip, then determine the encoding parameters based on a single frame reference. 11. The method according to any one of claims 1 to 7, wherein, before obtaining the default configuration, the method further comprises: Determining the configuration with the highest occurrence frequency among the multiple configurations as the default configuration; the multiple configurations include the configuration with the best decoding and rendering effect when performing a decoding and rendering test for each of the multiple devices. 12. The method according to any one of claims 1 to 7, wherein the second threshold is the reciprocal of the input frame rate of the video code stream; or the second threshold is the video code stream The product of the reciprocal of the input frame rate of the stream and the number of frames of the chip when decoding and rendering the video code stream. 13. An acquisition device for decoding and rendering configuration, comprising: Acquisition unit, used to obtain the default configuration; A decoding and rendering unit, configured to obtain a video code stream and decode and render the video code stream under the default configuration, so as to obtain an output frame rate and a single frame delay; An adjustment unit, configured to if the difference between the input frame rate under the default configuration and the output frame rate under the default configuration is greater than or equal to a first threshold, and/or, the single frame delay under the default configuration is greater than or equal to the second threshold, the default configuration is adjusted to obtain an optimal configuration; wherein, the difference between the input frame rate under the optimal configuration and the output frame rate under the optimal configuration is less than the first A threshold, and the single frame delay under the optimal configuration is less than the second threshold. 14. An electronic device, characterized in that it comprises: A processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to execute the method according to any one of claims 1 to 12. 15. A computer-readable storage medium, characterized by being used for storing a computer program, the computer program causing a computer to execute the method according to any one of claims 1 to 12.

Images