CN115348454A - A video transmission processing method and terminal equipment - Google Patents

Abstract

The application provides a video transmission processing method and terminal equipment, and relates to the technical field of video transmission. Firstly, acquiring initialization parameters, wherein the initialization parameters comprise an n-1 frame parameter, an nth frame parameter, a decoder parameter and a display parameter; wherein, the n-1 th frame is a decoded video frame, the n-th frame is a video frame to be decoded, and n is more than or equal to 2; then, determining a target segment suggestion value of the nth frame according to the initialization parameter, and generating a time point for controlling a display to read the nth frame video frame from a cache according to the target segment suggestion value; the video decoder decodes the video frames to be decoded according to the segments, and each frame of the video frames to be decoded is divided into a plurality of segments. The video transmission processing method and the terminal equipment have the advantage of shortening video transmission delay.

Description

A video transmission processing method and terminal equipment

technical field

The present application relates to the technical field of video transmission, and in particular, to a video transmission processing method and terminal equipment.

Background technique

With the rapid development of network transmission speed and video processing technology, applications such as remote desktop, cloud computer, and cloud game are gradually popularized, which has higher requirements for shortening video transmission and display delay. After the remote video is transmitted to the terminal device, it needs to be decoded by the video decoding processor and then written to the cache (DMA-buffer), and then the display processor is notified to read the cache and display it. The delay from decoding to displaying images is a key concern of terminal equipment. In addition to unilaterally improving the decoding speed, the notification and transmission of images from the decoder to the display is also a new breakthrough point.

In the prior art, the transmission of the image from the decoder to the display usually needs to wait until the complete frame is decoded and written to the buffer before notifying the display terminal through the upper layer software. Therefore, there will be a delay of at least one frame from video decoding to display.

To sum up, there is a problem of relatively large video transmission delay in the prior art.

Contents of the invention

The purpose of the present application is to provide a video transmission processing method and terminal equipment to solve the problem of relatively large video transmission delay in the prior art.

In order to achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:

In the first aspect, the embodiment of the present application provides a video transmission processing method, which is applied to the control module of the terminal device, and the terminal device also includes a video decoder, a cache, and a display, and the cache is connected to the decoder, the The display is connected, and the control module is respectively connected to the decoder and the display in communication; the method includes:

Obtain initialization parameters, wherein the initialization parameters include n-1th frame parameters, nth frame parameters, decoder parameters and display parameters; wherein, the n-1th frame is a decoded video frame, and the nth frame is a video to be decoded frame, and n≥2;

Determine the suggested value of the target segment of the nth frame according to the initialization parameters, and generate a time point for controlling the display to read the video frame of the nth frame from the buffer according to the suggested value of the target segment; wherein, the video decoding The device decodes the video frames to be decoded by segments, and each video frame to be decoded is divided into multiple segments.

Optionally, the suggested value of the target segment satisfies the formula:

VSn=f(VBn-1, VSn-1, VSEn-1, VEn-1, DSn-1, DVn-1, DBn-1, Tn-1, Tn);

Among them, f() represents a function, VSn represents the proposed value of the target segment of the nth frame, VBn-1 represents the time point when the decoding of the n-1th frame starts, VSn-1 represents the proposed value of the target segment of the n-1th frame, VSEn -1 indicates the time point when the decoding of the target segment of the n-1th frame is completed, VEn-1 indicates the time point when the decoding of the n-1th frame is completed, and DSn-1 indicates that the display is controlled to read the n-th from the buffer The time point of 1 video frame segment; DVn-1 indicates the time point when the display actually starts to read the n-1th video frame from the buffer, and DBn-1 indicates the time point when the n-1th frame begins to display image data , Tn-1 represents the actual decoding time of the n-1th frame, and Tn represents the predicted decoding time of the nth frame.

Optionally, the predicted decoding time of the nth frame satisfies the formula:

Tn=f(Cn-1, Cn, Tn-1, Pn-1, Pn, F)

Among them, Tn represents the predicted decoding time of frame n, Cn-1 represents the size of the compressed code stream of frame n-1, Cn represents the size of the compressed code stream of frame n, and Pn-1 represents the type of frame n-1 , Pn represents the type of the nth frame, and F represents the type of video decoder.

Optionally, the step of generating a time point for controlling the display to read the nth video frame segment from the buffer according to the target segment suggestion value includes:

sending the target segment suggestion value to the video decoder;

When the decoding completion signal of the target segment sent by the video decoder is received, the time point for controlling the display to read the nth video frame segment from the buffer is determined.

Optionally, the time point at which the display is controlled to read the nth video frame segment from the cache satisfies the formula:

DSn=f(VSn, DSn-1, DVn-1)

Among them, DSn represents the time point for controlling the display to read the nth video frame segment from the buffer, VSn represents the time point for receiving the decoding completion signal of the nth frame target segment, and DSn-1 represents the time point for controlling the display to read from the cache The time point at which the n-1th video frame segment is read from the cache, and DVn-1 represents the time point at which the display actually starts to read the n-1th video frame from the cache.

Optionally, after the step of generating a time point for controlling the display to read the nth video frame segment from the buffer according to the target segment suggestion value, the method further includes:

When receiving the nth frame sent by the video decoder to complete the decoding signal, it is judged whether there is a next video frame to be decoded;

If so, repeat the steps of obtaining the initialization parameters and determining the suggested value of the target segment of the nth frame according to the initialization parameters until all video frames to be decoded are decoded.

Optionally, before the step of obtaining initialization parameters, the method further includes:

Judging whether the current video frame to be decoded is the first frame; if not, performing the step of obtaining initialization parameters; if yes, generating the current suggested value of the target segment according to the preset value.

On the other hand, the embodiment of the present application also provides a terminal device, the terminal device includes a video decoder, a cache, a display, and a control module, the cache is respectively connected to the decoder and the display, and the control The modules are respectively connected in communication with the decoder and the display; wherein,

The video decoder is used to decode the video frame to be decoded by segment;

The control module is used to obtain initialization parameters, determine the suggested value of the target segment of the nth frame according to the initialization parameters, and generate and control the display to read the nth frame of video from the buffer according to the suggested value of the target segment. time point; wherein, the initialization parameter configuration includes the n-1th frame parameter, the nth frame parameter, the decoder parameter and the display parameter; wherein, n≥2;

The display is used to start reading the nth video frame from the buffer according to the time point signal of the control module.

Optionally, each of the video frame segments includes 16a rows, where a≥1.

Optionally, the regulating module includes a computing unit, a first communication unit, a second communication unit, and a control unit, and the control unit is connected to the computing unit, the first communication unit, and the second communication unit respectively , the first communication unit is used to connect to a video decoder, and the second communication unit is used to connect to a display.

Compared with the prior art, the present application has the following beneficial effects:

The present application provides a video transmission processing method and a terminal device. The video transmission processing method is applied to the control module of the terminal device. The terminal device also includes a video decoder, a cache and a display. The cache is respectively connected to the decoder and the display. The control module Communicate with the decoder and the display respectively, and first obtain initialization parameters, wherein the initialization parameters include the n-1th frame parameter, the nth frame parameter, the decoder parameter and the display parameter; wherein, the n-1th frame is a decoded video frame , the nth frame is the video frame to be decoded, and n≥2; then determine the suggested value of the target segment of the nth frame according to the initialization parameters, and generate the time to control the display to read the nth video frame from the buffer according to the suggested value of the target segment point; wherein, the video decoder decodes the video frame to be decoded by segments, and each frame of the video frame to be decoded is divided into multiple segments. On the one hand, since the application divides the video frame to be decoded into multiple segments for decoding, it can shorten the delay from the frame level to the segment level, effectively shortening the video transmission delay. On the other hand, by adding a control module, the time point at which the display reads the decoded video frame from the cache is regulated in real time, which ensures the continuity of the video frame reading, avoids the situation of advanced reading and writing or overwriting, and improves the The quality of the video display.

In order to make the above-mentioned purpose, features and advantages of the present application more comprehensible, preferred embodiments will be described in detail below together with the accompanying drawings.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the accompanying drawings used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, so It should be regarded as a limitation on the scope, and those skilled in the art can also obtain other related drawings based on these drawings without creative work.

Fig. 1 is a schematic block diagram of a terminal device provided in the prior art.

FIG. 2 is a schematic diagram of modules of a terminal device provided in an embodiment of the present application.

FIG. 3 is an exemplary flowchart of a video transmission processing method provided by an embodiment of the present application.

FIG. 4 is a schematic diagram of signal transmission of a terminal device provided by an embodiment of the present application.

110-control module; 120-video decoder; 130-display; 140 cache.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. The components of the embodiments of the application generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations.

Accordingly, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the application. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

It should be noted that like numerals and letters denote similar items in the following figures, therefore, once an item is defined in one figure, it does not require further definition and explanation in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second" and the like are only used to distinguish descriptions, and cannot be understood as indicating or implying relative importance.

It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is a relationship between these entities or operations. There is no such actual relationship or order between them. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

In the description of the present application, it should be noted that the orientation or positional relationship indicated by the terms "upper", "lower", "inner", "outer" etc. is based on the orientation or positional relationship shown in the drawings, or the The usual orientation or positional relationship of the application product when used is only for the convenience of describing the application and simplifying the description, rather than indicating or implying that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, therefore It should not be construed as a limitation of the application.

In the description of this application, it should also be noted that, unless otherwise clearly stipulated and limited, the terms "setting" and "connection" should be understood in a broad sense, for example, it can be a fixed connection or a detachable connection, or Integral connection; it can be mechanical connection or electrical connection; it can be direct connection or indirect connection through an intermediary, and it can be the internal communication of two components. Those of ordinary skill in the art can understand the specific meanings of the above terms in this application in specific situations.

Some implementations of the present application will be described in detail below in conjunction with the accompanying drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.

As mentioned in the background technology, when video transmission is performed in the prior art, the image is transmitted from the decoder to the display, and it usually needs to wait until the complete frame is decoded and written to the buffer before notifying the display terminal through the upper layer software. Therefore, from video decoding to display There will be a delay of at least one frame.

For example, please refer to Figure 1. During the image transmission process, when the terminal device receives the video signal, it needs to decode the video data through the video decoding processor first, wherein the video data includes undecoded image frame 1, undecoded image frame 2. Undecoded image frame 3... When the video decoding processor decodes, it needs to write the decoded image frame to the cache, and then the display reads the decoded image frame 1, image frame 2, and image frame sequentially from the cache 3….

On this basis, in the prior art, the way of reading and writing image frames is generally in units of frames, that is, when the video decoding processor decodes image frame 1, the display cannot read data from the cache at this time, and when the video decoding process After the device has decoded image frame 1, it writes the decoded image frame 1 into the cache, and starts to continue decoding image frame 2 at the same time. At this time, the display reads image frame 1 from the cache for display; and when the video decoding processor has already After the image frame 2 is decoded, the decoded image frame 2 is written into the cache, and at the same time, the image frame 3 continues to be decoded. At this time, the display reads the image frame 2 from the cache for display, and so on.

It can be seen that there is at least one frame delay in the video frame reading and writing method in the prior art, and there is also a certain delay in data reading and writing itself, and a certain delay in data transmission. Therefore, in practical applications, when reading and writing video frames In the process, the delay will be greater than one frame, resulting in a large delay.

At present, there are also some schemes for image decoding and display synchronization, but in terms of synchronization mechanism, it is only checked and controlled according to the address of the read and write pointer, and the time point of notification display is not accurately calculated, which is easy in different video scenarios. In the case of advanced reading and writing or overwriting, there is no maximum possible delay in shortening the notification display.

In view of this, the embodiment of the present application provides a video transmission processing method, by dividing each video frame into multiple segments, and setting the control module to control the time point at which the display reads the video frame segments from the cache , to shorten the delay of video reading and writing, and there will be no situation of advanced reading and writing or overwriting.

It should be noted that this video transmission processing method can be applied to the control module of the terminal device, please refer to Figure 2, the terminal device also includes a video decoder, a cache and a display, the cache is connected to the decoder and the display respectively, and the control module is connected to the decoding device, display communication connection. Among them, the video frame can be split into multiple fragments, and the video decoder can analyze the video frame according to the fragments, and then can reduce the read and write delay in the video transmission process from the frame level to the fragment level.

As shown in Figure 2, the image frame n to be decoded is split into 5 segments, which are segment 0, segment 1, segment 2, segment 3, and segment 4. After the video decoder decodes segment 0, segment 0 is stored in cache, while continuing to decode segment 1, the display can read the decoded data from the cache for display.

Theoretically, if the video decoder decodes segment 1, and the monitor reads segment 0 from the cache and starts to display, the delay is only 1 segment. When the image frame n to be decoded is split into 5 segments, the delay It can be shortened by 80%, greatly shortening the delay of the reading and writing process. At the same time, the video decoder and display share a buffer, thereby reducing unnecessary data copying and delay.

As an implementation, the number of lines of each segment needs to be aligned with the number of lines of the decoding block, and its number of lines can be 16a lines, a≥1. For example, when splitting a frame of image into multiple segments, each The segment can be 16 lines, 32 lines, or 64 lines, etc., which is not limited here. It can be understood that the smaller the number of rows in each segment, the lower the latency in the read and write process. Therefore, the number of rows of each fragment provided in this application is set to 16. On this basis, when the number of rows of each segment is set, the segments divided into each video frame are also fixed, for example, the number of segments divided into each video frame is fixed at 400.

Although the number of fragments divided into each frame is the same, due to the difference in the type of each frame, the size of the compressed code stream of each video frame is also different. Therefore, the time required to parse each fragment is also different. For example, for The time required for parsing each segment in the I frame needs to be longer than the time length of each segment in the P frame.

On this basis, if the monitor is controlled to read the parsed fragments from the cache for display according to a fixed delay, it obviously cannot meet the actual demand. For example, control the display to read data from the cache by delaying a segment. Since the delay is short, if the resolution of a segment in a certain frame takes a long time, it will cause its write The time point in the cache is lagging behind. During this process, the display cannot read video frame fragments from the cache for display, resulting in discontinuous display process and prone to blurred screens. For example, Fragment A, Fragment B, and Fragment C are continuous, and the delay is set to 1 fragment. When parsing Fragment A, it takes 1ms, and when parsing Fragment 2, it also takes 1ms. However, the data volume of Fragment C is relatively large. It takes a long time to parse, and it takes 3ms. Therefore, when the display reads data from the cache, read fragment A at the 1st millisecond and display it, and read fragment B at the 2nd millisecond and display it. At the 3rd millisecond, because the video decoder is analyzing the segment C at this time, the reading data of the display is interrupted, and a blurred screen may eventually appear.

If the delay is set too long, although it can ensure that the monitor can continuously read the parsed video frame fragments from the cache, the delay may be close to the frame level, which has no obvious effect on shortening the delay, and it is easy to appear The case of overwriting.

Therefore, the present application sets up a control module, and uses the control module to control the display to read the time point of the decoded video frame segment from the cache, so as to ensure that there is no advance reading or writing or overwriting, as far in advance as possible Notifications are displayed to reduce latency.

The following is an exemplary description of the video processing method provided by this application:

As an optional implementation, please refer to Figure 3, the video processing method includes:

S102. Obtain initialization parameters, where the initialization parameters include n-1th frame parameters, nth frame parameters, decoder parameters, and display parameters; where n-1th frame is a decoded video frame, and nth frame is a video to be decoded frame, and n≥2;

S104, determine the suggested value of the target segment of the nth frame according to the initialization parameter, and generate a time point for controlling the display to read the video frame of the nth frame from the cache according to the suggested value of the target segment; wherein, the video decoder performs decoding on the video frame by segment Decoding, and each video frame to be decoded is divided into multiple segments.

That is to say, in this application, the relevant initialization parameters are actually obtained through the control module, and then the time required for decoding the current frame is estimated according to the initialization parameters, and the time point at which the display reads the video frame fragment from the cache is determined accordingly, so as to shorten as much as possible delay. For example, when the video decoder decodes the n-1th frame, it takes 3ms, then when the video decoder decodes to the 10th segment, the control module controls the display to read and display the decoded video segment from the cache; when It takes 9ms for the video decoder to decode the nth frame, and when the video decoder decodes to the 30th segment, the control module controls the display to read the decoded video segment from the cache and display it. By adjusting the time point when the display starts to read data from the cache in real time, it is ensured that the display is notified in advance as much as possible without advanced reading or writing or overwriting, thereby shortening the video transmission delay.

It should be noted that, on the one hand, since the control module is directly connected to the video decoder and the buffer, data transmission can be performed directly, which reduces the possible delay in the data synchronization process, and is conducive to further shortening the processing time of video transmission. delay. On the other hand, the control module provided in the present application may be a software control module or a hardware control module, which is not limited here.

In an optional implementation, the target fragment suggestion value satisfies the formula:

VSn=f(VBn-1, VSn-1, VSEn-1, VEn-1, DSn-1, DVn-1, DBn-1, Tn-1, Tn);

Among them, f() represents a function, VSn represents the proposed value of the target segment of the nth frame, VBn-1 represents the time point when the decoding of the n-1th frame starts, VSn-1 represents the proposed value of the target segment of the n-1th frame, VSEn -1 indicates the time point when the target fragment of the n-1th frame is decoded, VEn-1 indicates the time point when the n-1th frame is decoded, and DSn-1 indicates that the display is controlled to read the n-1th frame video frame from the cache The time point of the segment; DVn-1 indicates the time point when the display actually starts to read the n-1th frame of video frame from the cache, DBn-1 indicates the time point when the n-1th frame starts to display image data, and Tn-1 indicates the time point of the n-1th frame The actual decoding time of n-1 frame, Tn represents the predicted decoding time of the nth frame.

That is, the target segment suggestion value VSn described in this application is associated with VBn-1, VSn-1, VSEn-1, VEn-1, DSn-1, DVn-1, DBn-1, Tn-1, Tn respectively. On this basis, when the video decoder needs to decode the video frame, it will first send the relevant information of the video frame to the control module, so that the control module can refer to the working conditions of the previous frame and combine the actual output parameters of the current frame to estimate The point at which the display starts reading data from the buffer while the current frame is being processed.

Specifically, when the video decoder starts decoding, it sends a decoding start signal VBn to the control module, and the control module takes the time point when it receives the decoding start signal as the time point when the nth frame starts decoding. At the same time, when the decoding of the nth frame is completed, a decoding completion signal will be sent to the control module, and similarly, the control module will use the time point when the decoding is completed as the time point when the decoding of the nth frame is completed.

And, the predicted decoding time of the nth frame satisfies the formula:

Tn=f(Cn-1, Cn, Tn-1, Pn-1, Pn, F)

Among them, Tn represents the predicted decoding time of frame n, Cn-1 represents the size of the compressed code stream of frame n-1, Cn represents the size of the compressed code stream of frame n, and Pn-1 represents the type of frame n-1 , Pn represents the type of the nth frame, and F represents the type of video decoder.

That is, the predicted decoding time is associated with the size of the compressed code stream, the video frame type, and the decoder type. Among them, the video frame types include I frame, B frame and P frame (take H264 as an example). Generally speaking, the compressed code stream sizes of I frame, B frame and P frame are different, so the time required for decoding is different. , the relationship of time required for decoding is I frame>B frame>P frame. The types of decoders include H264, HEVC, AV1, etc. For different types, the functional relationship of the above formula may be different.

For example, when a certain decoder is working, the compressed code stream size of P frame is 20K, and decoding takes 2ms; the compressed code stream size of I frame is 30K, and decoding needs 3ms.

And, as an implementation, the step of generating the time point for controlling the display to read the nth video frame segment from the cache according to the target segment suggestion value includes:

S1041. Send the suggested value of the target segment to the video decoder.

S142, when receiving the decoding completion signal of the target segment sent by the video decoder, determine the time point for controlling the display to read the nth video frame segment from the cache.

Wherein, after the control module obtains the initialization parameters, it will generate the suggested value VSn of the target segment, and send the suggested value VSn of the target segment to the video decoder. Send the target segment to complete the decoding signal VSEn, the control module will receive the time point of the target segment to complete the decoding signal VSEn as the time point when the target segment of the nth frame completes decoding, and send a control signal DSn to the display to control the display to read from the buffer. fetch data.

Optionally, the time point at which the control display reads the nth video frame segment from the cache satisfies the formula:

DSn=f(VSn, DSn-1, DVn-1)

Among them, DSn indicates the time point when the control display reads the nth video frame segment from the buffer, that is, the display switching time point, VSn indicates the time point when the decoding completion signal of the nth frame target segment is received, and DSn-1 indicates that the control display device starts from The time point at which the n-1th video frame segment is read from the cache, and DVn-1 indicates the time point at which the display actually starts to read the n-1th video frame from the cache.

Among them, after receiving the control signal DSn, the display will read the nth video frame segment from the cache at the next VSYNC. Understandably, since it takes a certain amount of time to display the n-1th frame, although the time indicated by DSn The time point represented by DVn is close to the time point represented by DVn but there is still a certain time interval. For example, the time point represented by DVn is delayed by a few tenths of milliseconds from the time point represented by DSn. There is still a certain black frame at the border of the display, therefore, the time point at which the image data starts to be displayed will be later than the time point represented by DVn, that is, the time point represented by DBn will be later than the time point represented by DVn.

As an implementation, after step 104, the method also includes:

S106, when receiving the decoding signal of the nth frame sent by the video decoder, judging whether there is a next video frame to be decoded;

If so, repeat the steps of obtaining the initialization parameters and determining the suggested value of the target segment of the nth frame according to the initialization parameters until all video frames to be decoded are decoded.

As an implementation, before the step of obtaining initialization parameters, the method further includes:

S101-1. Determine whether the current video frame to be decoded is the first frame; if not, execute the step of acquiring initialization parameters; if yes, execute S101-2.

S101-2. Generate the current suggested value of the target segment according to a preset value.

Based on the above implementation, the embodiment of the present application also provides a terminal device, the terminal device includes a video decoder, a cache, a display and a control module, the cache is connected to the decoder and the display respectively, and the control module communicates with the decoder and the display respectively Connection; wherein, the video decoder is used to decode the video frame to be decoded by segment; the control module is used to obtain the initialization parameters, determine the suggested value of the target segment of the nth frame according to the initialization parameter, and generate the control display from the buffer according to the suggested value of the target segment Read the time point of the nth video frame; wherein, the initialization parameter configuration includes the n-1th frame parameter, the nth frame parameter, the decoder parameter and the display parameter; wherein, n≥2; the display is used to control the time of the module The dot signal starts reading the nth video frame from the buffer.

Optionally, each video frame segment includes 16a rows, where a≥1.

And, the control module includes a calculation unit, a first communication unit, a second communication unit and a control unit, the control unit is respectively connected to the calculation unit, the first communication unit and the second communication unit, the first communication unit is used to connect the video decoder, The second communication unit is used to connect the display.

To sum up, the present application provides a video transmission processing method and a terminal device. The video transmission processing method is applied to the control module of the terminal device. The terminal device also includes a video decoder, a cache and a display, and the cache is connected to the decoder and the display respectively. , the control module communicates with the decoder and the display respectively, and first obtains the initialization parameters, wherein the initialization parameters include the n-1th frame parameters, the nth frame parameters, the decoder parameters and the display parameters; wherein, the n-1th frame is Decode the video frame, the nth frame is the video frame to be decoded, and n≥2; then determine the suggested value of the target segment of the nth frame according to the initialization parameters, and generate and control the monitor to read the nth frame of video from the cache according to the suggested value of the target segment The time point of the frame segment; wherein, the video decoder decodes the video frame to be decoded by segment, and each frame of the video frame to be decoded is divided into multiple segments. On the one hand, since the application divides the video frame to be decoded into multiple segments for decoding, it can shorten the delay from the frame level to the segment level, effectively shortening the video transmission delay. On the other hand, by adding a control module, the time point at which the display reads the decoded video frame from the cache is regulated in real time, which ensures the continuity of the video frame reading, avoids the situation of advanced reading and writing or overwriting, and improves the The quality of the video display.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the present application. For those skilled in the art, there may be various modifications and changes in the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of this application shall be included within the protection scope of this application.

It will be apparent to those skilled in the art that the present application is not limited to the details of the exemplary embodiments described above, but that the present application can be implemented in other specific forms without departing from the spirit or essential characteristics of the present application. Therefore, the embodiments should be regarded as exemplary and not restrictive in all points of view, and the scope of the application is defined by the appended claims rather than the foregoing description, and it is intended that the scope of the present application be defined by the appended claims rather than by the foregoing description. All changes within the meaning and range of equivalents of the elements are embraced in this application. Any reference sign in a claim should not be construed as limiting the claim concerned.

Claims (10)

1. A video transmission processing method, characterized in that, it is applied to a control module of a terminal device, and the terminal device also includes a video decoder, a buffer and a display, and the buffer is connected to the decoder and the display respectively, The control module is respectively connected to the decoder and the display in communication; the method includes: Obtain initialization parameters, wherein the initialization parameters include n-1th frame parameters, nth frame parameters, decoder parameters and display parameters; wherein, the n-1th frame is a decoded video frame, and the nth frame is a video to be decoded frame, and n≥2; Determine the suggested value of the target segment of the nth frame according to the initialization parameters, and generate a time point for controlling the display to read the video frame of the nth frame from the buffer according to the suggested value of the target segment; wherein, the video decoding The device decodes the video frames to be decoded by segments, and each video frame to be decoded is divided into multiple segments. 2. The video transmission processing method according to claim 1, wherein the suggested value of the target segment satisfies the formula: VSn=f(VBn-1, VSn-1, VSEn-1, VEn-1, DSn-1, DVn-1, DBn-1, Tn-1, Tn); Among them, f() represents a function, VSn represents the proposed value of the target segment of the nth frame, VBn-1 represents the time point when the decoding of the n-1th frame starts, VSn-1 represents the proposed value of the target segment of the n-1th frame, VSEn -1 indicates the time point when the decoding of the target segment of the n-1th frame is completed, VEn-1 indicates the time point when the decoding of the n-1th frame is completed, and DSn-1 indicates that the display is controlled to read the n-th from the buffer The time point of 1 video frame segment; DVn-1 indicates the time point when the display actually starts to read the n-1th video frame from the buffer, and DBn-1 indicates the time point when the n-1th frame begins to display image data , Tn-1 represents the actual decoding time of the n-1th frame, and Tn represents the predicted decoding time of the nth frame. 3. The video transmission processing method according to claim 2, wherein the predicted decoding time of the nth frame satisfies the formula: Tn=f(Cn-1, Cn, Tn-1, Pn-1, Pn, F) Among them, Tn represents the predicted decoding time of frame n, Cn-1 represents the size of the compressed code stream of frame n-1, Cn represents the size of the compressed code stream of frame n, and Pn-1 represents the type of frame n-1 , Pn represents the type of the nth frame, and F represents the type of video decoder. 4. The video transmission processing method according to claim 1, wherein the step of generating and controlling the display to read the nth frame video frame segment from the cache according to the target segment suggestion value comprises: sending the target segment suggestion value to the video decoder; When the decoding completion signal of the target segment sent by the video decoder is received, the time point for controlling the display to read the nth video frame segment from the buffer is determined. 5. The video transmission processing method as claimed in claim 4, characterized in that, the time point for controlling the display to read the nth frame video frame segment from the cache satisfies the formula: DSn=f(VSn, DSn-1, DVn-1) Among them, DSn represents the time point for controlling the display to read the nth video frame segment from the buffer, VSn represents the time point for receiving the decoding completion signal of the nth frame target segment, and DSn-1 represents the time point for controlling the display to read from the cache The time point at which the n-1th video frame segment is read from the cache, and DVn-1 represents the time point at which the display actually starts to read the n-1th video frame from the cache. 6. The video transmission processing method according to claim 1, characterized in that, after the step of generating and controlling the display to read the nth video frame segment from the buffer according to the target segment suggestion value , the method also includes: When receiving the nth frame sent by the video decoder to complete the decoding signal, it is judged whether there is a next video frame to be decoded; If so, repeat the steps of obtaining the initialization parameters and determining the suggested value of the target segment of the nth frame according to the initialization parameters until all video frames to be decoded are decoded. 7. The video transmission processing method according to claim 1, wherein, before the step of obtaining initialization parameters, the method further comprises: Judging whether the current video frame to be decoded is the first frame; if not, performing the step of obtaining initialization parameters; if yes, generating the current suggested value of the target segment according to the preset value. 8. A terminal device, characterized in that the terminal device comprises a video decoder, a cache, a display and a control module, the cache is connected to the decoder and the display respectively, and the control module is connected to the control module respectively The decoder and the display are connected in communication; wherein, The video decoder is used to decode the video frame to be decoded by segment; The control module is used to obtain initialization parameters, determine the suggested value of the target segment of the nth frame according to the initialization parameters, and generate and control the display to read the nth frame of video from the buffer according to the suggested value of the target segment. time point; wherein, the initialization parameter configuration includes the n-1th frame parameter, the nth frame parameter, the decoder parameter and the display parameter; wherein, n≥2; The display is used to start reading the nth video frame from the buffer according to the time point signal of the control module. 9. The terminal device according to claim 8, wherein each of the video frame segments comprises 16a lines, where a≥1. 10. The terminal device according to claim 8, wherein the control module comprises a computing unit, a first communication unit, a second communication unit, and a control unit, and the control unit communicates with the computing unit, the The first communication unit is connected to the second communication unit, the first communication unit is used to connect to a video decoder, and the second communication unit is used to connect to a display.

Images