CN114339378A - Audio and video code stream processing method and device and electronic equipment - Google Patents

Abstract

Embodiments of the present invention provide a method, an apparatus, and an electronic device for processing audio and video code streams. The method includes: generating a transport stream according to the received signal, filtering out an audio and video code stream from the transport stream, the audio and video code stream including the packaged elementary code stream PES data, and writing the PES data into a multi-level memory of the memory. In the ring buffers, the PES data includes at least one start code, the position of the at least one start code in the plurality of ring buffers is identified, the physical address corresponding to the position is obtained, and the physical address is Recorded in the start code buffer of the memory, in response to the generated interrupt notification signal, parse the PES data according to the physical address to generate a compressed audio and video frame, and write the compressed audio and video frame into the in at least one frame buffer in the memory. The embodiment of the present invention reduces frame loss and jamming caused by long delay.

Description

A method, device and electronic device for processing audio and video code streams

【Technical field】

The present invention relates to the field of television, in particular to a method, device and electronic device for processing audio and video code streams.

【Background technique】

At present, the mainstream method of processing audio and video streams in live TV is to process the received signal and then output the transport stream. The demultiplexer (Demux) hardware is based on the PacketIdentifier (PID) value set by the driver software. Filter out the Packet Elementary Stream (PES) data in the transport stream, write the PES data into the buffer allocated by the driver software for the hardware, and parse the data in the buffer byte by byte through the driver software , and perform the framing operation to copy the compressed audio and video frames completed by framing to the upper-layer user space.

The driver software is private and implemented by each manufacturer. According to the reference code of the google DTV Hal layer of the Android S platform, there will be multiple copy operations during the parsing process of compressed audio and video frames, and the data will be frequently transmitted in the kernel and upper user space, and will consumes a lot of memory.

However, when parsing PES data byte-by-byte parsing and framing operation will cause the player to freeze when playing high-resolution code streams because the framing efficiency is too low, and the smooth playback of TV programs cannot be guaranteed. Copying the compressed audio and video frames completed by framing to the upper user space through the driver software will reduce the system performance.

[Content of the invention]

In view of this, the embodiments of the present invention provide a processing method, device, electronic device and storage medium for audio and video code streams, so as to solve the system performance degradation, low frame rate and delay caused by copying and compressing audio and video frames in the prior art. The problem of frame dropping and freezing caused by a long time.

In one aspect, the present invention provides a method for processing audio and video streams, the method comprising:

Generate a transport stream according to the received signal;

Filter out the audio and video code stream from the transport stream, and the audio and video code stream includes the packaged elementary code stream PES data;

Writing the PES data into a plurality of ring buffers in the memory, the PES data including at least one start code;

Identifying the position of the at least one start code in the plurality of ring buffers to obtain a physical address corresponding to the position;

recording the physical address in the start code buffer of the memory;

In response to the generated interrupt notification signal, the PES data is parsed according to the physical address to generate a compressed audio and video frame, and the compressed audio and video frame is written into at least one frame buffer in the memory.

Optionally, the filtering out the audio and video streams from the transport stream includes:

Filter the transport stream through the set packet identifier PID to generate the audio and video stream.

Optionally, before the PES data is parsed according to the physical address to generate a compressed audio and video frame in response to the generated interrupt notification signal, the method further includes:

Identifying the number of the at least one start code in the plurality of ring buffers, and generating the number of the start codes corresponding to each of the ring buffers;

Record the number of the start codes into the corresponding ring buffer.

Optionally, before recording the physical address in the start code buffer of the memory, the method further includes:

Allocate a buffer of a specified size, and use the buffer of the specified size as the start code buffer.

Optionally, the writing of the compressed audio and video frames into at least one frame buffer in the memory includes:

Determine whether to use independent buffering for buffering or non-independent buffering for buffering;

If it is determined that the independent buffering mode is used for buffering, each compressed audio and video frame is written into the corresponding frame buffer;

If it is determined that the non-independent buffering mode is used for buffering, all the compressed audio and video frames are written into a frame buffer.

Optionally, before the identifying the positions of the at least one start code in the plurality of ring buffers, the method further includes:

Set at least one start code according to the encoding specification of the code stream.

Optionally, obtain the number of the start codes in the ring buffer;

Reading the physical addresses of the start codes in the ring buffer corresponding to the number of the start codes in the start code buffer;

Find out the start code corresponding to the physical address in the ring buffer according to the physical address;

In the PES data, the start code corresponding to the physical address starts to detect the part that meets the frame boundary coding rule, and the part that meets the frame boundary coding rule is determined as the frame boundary;

Framing is performed according to the identified frame boundaries to generate the compressed audio and video frames.

On the other hand, an embodiment of the present invention provides an apparatus for processing audio and video streams, including:

The generation module is used to generate the transport stream according to the received signal;

A filtering module, configured to filter out an audio and video code stream from the transport stream, where the audio and video code stream includes PES data;

a first writing module, configured to write the PES data into multiple ring buffers of the memory, the PES data including at least one start code;

a first identification module, configured to identify the position of the at least one start code in the plurality of ring buffers to obtain a physical address corresponding to the position;

a first recording module, for recording the physical address in the start code buffer of the memory;

A parsing module, configured to parse the PES data according to the physical address to generate a compressed audio and video frame in response to the generated interrupt notification signal;

The second writing module is configured to write the compressed audio and video frames into at least one frame buffer in the memory.

On the other hand, an embodiment of the present invention provides a storage medium, characterized in that the storage medium includes a stored program, wherein when the program is run, a device where the stored medium is located is controlled to execute the above-mentioned audio and video code streams. Approach.

On the other hand, an embodiment of the present invention provides a first electronic device, which is characterized by comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor When the computer program is executed, the above-mentioned audio and video code stream processing method is realized.

In the technical solution provided by the embodiment of the present invention, a transport stream is generated according to the received signal, and an audio and video code stream is filtered out from the transport stream. The data is written into multiple ring buffers in the memory, the PES data includes at least one start code, the position of the at least one start code in the multiple ring buffers is identified, and the physical address corresponding to the position is obtained , record the physical address in the start code buffer of the memory, and in response to the generated interrupt notification signal, parse the PES data according to the physical address to generate a compressed audio and video frame, and compress the compressed audio and video frames. The audio and video frames are written into at least one frame buffer in the memory, which reduces the system performance degradation caused by copying and compressing the audio and video frames, improves the frame rate, and reduces the frame loss caused by the long delay. .

【Description of drawings】

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings used in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

1 is a flowchart of a method for processing audio and video code streams according to an embodiment of the present invention;

2 is a schematic diagram of a data transmission provided by an embodiment of the present invention;

3 is a schematic diagram of an internal identification provided by an embodiment of the present invention;

4 is a schematic diagram of a buffer search principle according to an embodiment of the present invention;

5 is a schematic diagram of an apparatus for processing audio and video code streams according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of an electronic device according to an embodiment of the present invention.

【Detailed ways】

In order to better understand the technical solutions of the present invention, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

It should be understood that the described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise.

It should be understood that the term "and/or" used in this document is only an association relationship to describe the associated objects, indicating that there may be three kinds of relationships, for example, A and/or B, which may indicate that A exists alone, and A and B exist at the same time. B, there are three cases of B alone. In addition, the character "/" in this document generally indicates that the related objects are an "or" relationship.

It should be understood that although the terms first, second, third, etc. may be used in the embodiments of the present invention to describe numbers, etc., these numbers should not be limited to these terms. These terms are only used to distinguish numbers from one another. For example, the first number may also be referred to as the second number, and similarly, the second number may also be referred to as the first number without departing from the scope of the embodiments of the present invention.

Depending on the context, the word "if" as used herein can be interpreted as "at" or "when" or "in response to determining" or "in response to detecting." Similarly, the phrases "if determined" or "if detected (the stated condition or event)" can be interpreted as "when determined" or "in response to determining" or "when detected (the stated condition or event)," depending on the context )" or "in response to detection (a stated condition or event)".

FIG. 1 is a flowchart of a method for processing audio and video code streams according to an embodiment of the present invention. As shown in FIG. 1 , the method includes:

Step 101: Generate a transport stream according to the received signal.

The steps in the embodiments of the present invention may be performed by electronic devices, including but not limited to smart TVs, mobile phones, tablet computers, personal computers, etc. For example, the electronic devices may also include other electronic devices capable of watching mobile TV programs.

In this embodiment of the present invention, the signal may be a radio frequency signal.

In this embodiment of the present invention, the electronic device includes a chip, and Demux hardware is integrated in the chip, for example, the chip is a TV chip.

In this embodiment of the present invention, the electronic device includes a tuner, a demodulator, a register, and Demux hardware.

In this embodiment of the present invention, a tuner and a demodulator may be used to process the received signal to generate a transport stream.

Step 102: Filter out an audio and video code stream from the transport stream, where the audio and video code stream includes PES data.

In this embodiment of the present invention, steps 102 to 105 can be performed by Demux hardware. In the embodiment of the present invention, the transport stream is filtered by the set PID to generate the audio and video code stream, for example, the audio and video code stream is a digital television (Digital Television, DTV) audio and video code stream.

In this embodiment of the present invention, the transport stream may include code stream data in various formats, such as audio and video code streams, subtitles, and service information. Demux hardware can separate code stream data in various formats, such as audio and video code streams, subtitles, and service information tables.

In the embodiment of the present invention, after the transport stream is generated, the transport stream is filtered according to the set PID, and the code stream corresponding to the PID is filtered out. PID is a numerical value, and each data type in the same transport stream corresponds to a unique PID value. Therefore, through the set PID, the audio and video stream corresponding to the PID can be filtered out from the transport stream.

In the embodiment of the present invention, after the transport stream is generated, the transport stream is filtered according to the PID set by the driver software, and the code stream corresponding to the PID is filtered out.

In this embodiment of the present invention, a transport stream refers to a single data stream formed by combining one or more PES data having a common time reference or an independent time reference. The elementary code stream is divided into multiple sub-elementary code streams, and each sub-elementary code stream is packaged with the corresponding header to form PES data, and the PES data is used as the payload of the transport stream to be carried by the transport stream packets. When the sub-elementary stream is packaged to form multiple PES data, the data amount of each PES data may be different or the same.

Step 103: Write PES data into multiple ring buffers in the memory, where the PES data includes at least one start code.

In the embodiment of the present invention, the memory can be dynamically allocated, and the allocated memory is organized into a circular linked list, and the circular linked list includes the physical address of the ring buffer. The memory corresponding to the physical address is obtained according to the physical address of the ring buffer in the ring linked list, and the PES data is written into the ring buffer corresponding to the physical address.

In the embodiment of the present invention, the driver software can dynamically allocate memory, and organize the allocated memory into a circular linked list, and the circular linked list includes the physical address of the ring buffer. Write PES data into the ring buffer corresponding to the physical address according to the physical address stored in the linked list.

FIG. 2 is a schematic diagram of a data transmission provided by an embodiment of the present invention. As shown in FIG. 2 , the memory includes multiple ring buffers, and each ring buffer has the same size, and multiple PES data are sequentially written into the multiple ring buffers In (dscr), one PES data can occupy multiple ring buffers. If one PES data has been written into the ring buffer, but the last written ring buffer has not been filled, when new PES data is written, the New PES data is written to a new ring buffer. For example, to write two PES packets into the ring buffer, first write the first PES data (PES data1) into the first ring buffer, after the first ring buffer is full, write the remaining data of the first PES into the following Ring buffer until the first PES data is written. After all the first PES data is written into the ring buffer, the first ring buffer and the second ring buffer are filled, and the third ring buffer is only partially filled. When writing the second PES data, write the second PES data (PES data2) into the ring buffer starting from the fourth ring buffer. If the fourth ring buffer is full, continue to write the following ring buffers until the second PES All data is written to the ring buffer.

Step 104: Identify the positions of at least one start code in multiple ring buffers to obtain a physical address corresponding to the position.

In the embodiment of the present invention, before the identifying the positions of the at least one start code in the plurality of ring buffers, the method further includes: setting at least one start code according to a coding specification of the code stream.

In this embodiment of the present invention, the start code is set according to the coding specifications of different code streams. For example, for the H264 code stream, the start code may be set to 0x00000148 and the like.

In the embodiment of the present invention, the start code is set according to the coding specifications of different code streams through the driver software.

In this embodiment of the present invention, the start code may be set to one or multiple, and the start code itself is also a part of the PES encoding. The same start code can be recognized more than one in a ring buffer. For example, if the start code is set to 0x00000148, if three codes of 0x00000148 are identified in a ring buffer, the identified three codes of 0x00000148 are all confirmed as the start code. According to the identified start codes, the physical address corresponding to each start code in the ring buffer is obtained.

In this embodiment of the present invention, the register includes a set start code, and the Demux hardware obtains the start code in the register. The position of the start code is identified, the position of the start code in each ring buffer is identified, and the physical address corresponding to the position is obtained, and each physical address contains 4 bytes.

Step 105: Record the physical address in the start code buffer of the memory.

In this embodiment of the present invention, before step 105, the method further includes: allocating a buffer of a specified size, and using the buffer of the specified size as the start code buffer.

In this embodiment of the present invention, the start code buffer is used to store addresses of different start codes in the ring buffer. Dynamically allocate a buffer of the specified size and use the buffer of the specified size as the start code buffer. For example, specify a size of 1k. The start code buffer is called, and the physical address corresponding to each start code in the ring buffer is sequentially written into the start code buffer.

In the embodiment of the present invention, a buffer of a specified size is dynamically allocated by the driver software, and the buffer of the specified size is used as the start code buffer.

Step 106: In response to the generated interrupt notification signal, analyze the PES data according to the physical address to generate a compressed audio and video frame, and write the compressed audio and video frame into at least one frame buffer in the memory.

In this embodiment of the present invention, before step 106, the steps include: identifying the number of the at least one start code in the plurality of ring buffers, and generating the number of the start codes corresponding to each of the ring buffers, Record the number of the start codes into the corresponding ring buffer.

FIG. 3 is a schematic diagram of an internal identification provided by an embodiment of the present invention. As shown in FIG. 3 , the number of start codes in each ring buffer is identified according to the start code set by the driver software. An internal identifier scode_cnt is generated internally, and the number of start codes existing in each ring buffer is recorded through the internal identifier scode_cnt. For example, if a ring buffer includes the internal identifier scode_cnt: 2, it means that the ring buffer includes 2 start codes.

In the embodiment of the present invention, after all PES data are written into the ring buffer, the Demux hardware is interrupted, and the interrupt service routine (Interrupt Service Routines, ISR) in the driver software is notified to parse the PES data in the ring buffer.

In the embodiment of the present invention, the generating of compressed audio and video frames by parsing the PES data includes:

Step 1061: Acquire the number of the start codes in the ring buffer.

In the embodiment of the present invention, parsing the PES data to generate the compressed audio and video frames includes sequentially parsing the data in multiple ring buffers, and obtaining the number of start codes of the internal identification records in the currently parsing ring buffer. For example, the internal identifier of the first ring buffer is scode_cnt: 2. When parsing the data in the first ring buffer, the number of start codes in the current ring buffer is obtained according to the internal identifier scode_cnt: 2.

Step 1062: Read the physical addresses of the start codes in the ring buffer in the number corresponding to the number of the start codes in the start code buffer.

FIG. 4 is a schematic diagram of a buffer search principle provided by an embodiment of the present invention. As shown in FIG. 4 , the number of physical addresses acquired in the start code buffer is determined according to the acquired number of start codes in the ring buffer , find in the start code buffer the number of physical addresses corresponding to the number of start codes in the currently parsed ring buffer. When parsing the data in the new ring buffer, the number of physical addresses corresponding to the number of start codes in the current ring buffer is obtained from the position where the last physical address obtained in the start code buffer ends. For example, the internal identification of the first ring buffer is scode_cnt: 2, and the internal identification of the second ring buffer is scode_cnt: 3. When parsing the PES data in the first ring buffer, according to the internal identification scode_cnt: 2, in the start code buffer Obtain the first physical address (Address 1) and the second physical address (Address 2) in the When there is PES data in the second ring buffer, the third physical address (Address 3), the fourth physical address (Address 4) and the fifth physical address (Address5) are obtained in the start code buffer according to the internal identifier scode_cnt: 3, The third physical address, the fourth physical address and the fifth physical address are used as the physical addresses corresponding to the three start codes in the second ring buffer.

Step 1063: Find the start code corresponding to the physical address in the ring buffer according to the physical address.

Step 1064: In the PES data, start from the start code corresponding to the physical address to detect the part conforming to the frame boundary coding rule, and determine the part conforming to the frame boundary coding rule as the frame boundary.

In the embodiment of the present invention, the position of the start code in the ring buffer is searched, and the data following the start code is detected according to the start code found in the position. Due to the different encoding methods, the encoding rules are also different. According to the encoding rules currently used, the part of the data that conforms to the frame boundary rules in the PES data is detected, and the part of the data that conforms to the frame boundary rules is determined as the frame boundary.

Step 1065: Perform framing according to the identified frame boundaries to generate the compressed audio and video frames.

In the embodiment of the present invention, the start code in the ring buffer is found through the physical address in the start code buffer, and the frame boundary is identified according to the start code, so that the frame boundary can be quickly identified, so it is not necessary to parse the entire code word by word. The stream can complete the framing operation.

In the embodiment of the present invention, the writing of the compressed audio and video frames into at least one frame buffer in the memory includes:

Step 1066: Determine whether to use an independent buffering mode for buffering or a non-independent buffering mode to perform buffering. If it is determined that the independent buffering mode is used for buffering, step 1067 is executed; if it is determined that the non-independent buffering mode is used for buffering, step 1068 is executed.

In the embodiment of the present invention, the frame buffer is allocated in the upper-layer user space, the handle of the frame buffer is passed to the driver software, and the frame buffer is mapped to convert the address of the frame buffer into the kernel virtual address, so that the Upper user space and driver software can share the frame buffer. The compressed audio and video frames parsed by PES data are directly written into the frame buffer. Since the upper user space and the driver software can share the compressed audio and video frames in the frame buffer, the copy operation between the kernel and the user space is avoided.

In the embodiment of the present invention, the address of the frame buffer is converted into a kernel virtual address by the driver software, so that the upper-layer user space and the driver software can share the frame buffer.

In the embodiment of the present invention, the buffering mode to be used may be preset. If it is detected that the preset buffering mode is an independent buffering mode, it is determined that the independent buffering mode is used for buffering; if it is detected that the preset buffering mode is a non-independent buffering mode mode, it is determined to use the non-independent buffering mode for buffering.

Step 1067: Write each compressed audio and video frame into the corresponding frame buffer.

In the embodiment of the present invention, when independent buffering is used for buffering, multiple frame buffers are generated, and one compressed audio and video frame is written into each frame buffer, that is, one frame buffer only includes one compressed audio and video frame.

In the embodiment of the present invention, when buffering is performed in an independent buffering manner, multiple frame buffers are generated, and a compressed audio and video frame is written into each frame buffer through driving software.

Step 1068: Write all the compressed audio and video frames into a frame buffer.

In the embodiment of the present invention, when buffering is performed in a non-independent buffering manner, only one frame buffer is generated, and all the compressed audio and video frames are written into this frame buffer, and the compressed audio and video frames are written according to the written compressed audio and video frames. The position records a corresponding offset position, and the offset position is recorded every time a compressed audio and video frame is written, and the offset position is determined as the position where the next compressed audio and video frame is written.

In the embodiment of the present invention, when buffering is performed in a non-independent buffering manner, only one frame buffer is generated, and all compressed audio and video frames are written into this one frame buffer through the driver software.

In the technical solution provided by the embodiment of the present invention, a transport stream is generated according to the received signal, and an audio and video code stream is filtered out from the transport stream. The data is written into multiple ring buffers in the memory, the PES data includes at least one start code, the position of the at least one start code in the multiple ring buffers is identified, and the physical address corresponding to the position is obtained , record the physical address in the start code buffer of the memory, and in response to the generated interrupt notification signal, parse the PES data according to the physical address to generate a compressed audio and video frame, and compress the compressed audio and video frames. The audio and video frames are written into at least one frame buffer in the memory, which reduces the system performance degradation caused by copying and compressing the audio and video frames, improves the frame rate, and reduces the frame loss caused by the long delay. .

FIG. 5 is a schematic structural diagram of an apparatus for processing audio and video code streams according to an embodiment of the present invention. As shown in FIG. 5 , the apparatus includes: a generating module 1, a filtering module 2, a first writing module 3, a first identifying module Module 4 , first recording module 5 , parsing module 6 and second writing module 7 .

In this embodiment of the present invention, the generating module 1 is configured to generate a transport stream according to the received signal. The filtering module 2 is configured to filter out an audio and video code stream from the transport stream, where the audio and video code stream includes PES data. The first writing module 3 is configured to write the PES data into multiple ring buffers in the memory, where the PES data includes at least one start code. The first identification module 4 is configured to identify the position of the at least one start code in the plurality of ring buffers to obtain a physical address corresponding to the position. The first recording module 5 is used for recording the physical address into the start code buffer of the memory. The parsing module 6 is configured to parse the PES data according to the physical address in response to the generated interrupt notification signal to generate a compressed audio and video frame. The second writing module 7 is configured to write the compressed audio and video frames into at least one frame buffer in the memory.

In this embodiment of the present invention, the filtering module 2 is specifically configured to filter the transport stream by using the set PID to generate the audio and video stream.

In this embodiment of the present invention, the device further includes: a second identification module 8 and a second recording module 9 . The second identification module 8 is configured to identify the number of the at least one start code in the plurality of ring buffers, and generate the number of the start code corresponding to each of the ring buffers. The second recording module 9 is configured to record the number of the start codes into the corresponding ring buffer.

In this embodiment of the present invention, the apparatus further includes: a distribution module 10 . The allocation module 10 is configured to allocate a buffer of a specified size, and use the buffer of the specified size as the start code buffer.

In this embodiment of the present invention, the second writing module 7 includes a judging submodule 71 and a writing submodule 72 . The judging sub-module 71 is used for judging whether to use an independent buffering mode for buffering or a non-independent buffering mode for buffering. The writing submodule 72 is used to write each compressed audio and video frame into the corresponding frame buffer if the judging submodule 71 judges that the independent buffering mode is used for buffering; if the judging submodule 71 judges that the non-independent If buffering is used for buffering, all the compressed audio and video frames are written into a frame buffer.

In this embodiment of the present invention, the device further includes a setting module 11 . The setting module 11 is configured to set at least one start code according to the encoding specification of the code stream.

In the embodiment of the present invention, the parsing module 6 includes an acquisition sub-module 61 , a reading sub-module 62 , a search sub-module 63 , a detection sub-module 64 and a framing sub-module 65 . The obtaining sub-module 61 is configured to obtain the number of the start codes in the ring buffer. The reading submodule 62 is configured to read, from the start code buffer, the physical addresses of the start codes in the ring buffer corresponding to the number of the start codes. The search sub-module 63 is configured to search for the start code corresponding to the physical address in the ring buffer according to the physical address. The detection submodule 64 is configured to detect the part conforming to the frame boundary coding rule from the start code corresponding to the physical address in the PES data, and determine the part conforming to the frame boundary coding rule as the frame boundary. The framing sub-module 65 is configured to perform framing according to the identified frame boundary to generate the compressed audio and video frames.

In the technical solution provided by the embodiment of the present invention, a transport stream is generated according to the received signal, and an audio and video code stream is filtered out from the transport stream. The data is written into multiple ring buffers in the memory, the PES data includes at least one start code, the position of the at least one start code in the multiple ring buffers is identified, and the physical address corresponding to the position is obtained , record the physical address in the start code buffer of the memory, and in response to the generated interrupt notification signal, parse the PES data according to the physical address to generate a compressed audio and video frame, and compress the compressed audio and video frames. The audio and video frames are written into at least one frame buffer in the memory, which reduces the system performance degradation caused by copying and compressing the audio and video frames, improves the frame rate, and reduces the frame loss caused by the long delay. .

An embodiment of the present invention provides a storage medium, where the storage medium includes a stored program, wherein when the program is run, a device where the stored medium is located is controlled to execute the embodiment of the above-mentioned processing method for audio and video code streams.

An embodiment of the present invention provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the above-mentioned audio and video when executing the computer program An embodiment of a code stream processing method.

FIG. 6 is a schematic diagram of an electronic device according to an embodiment of the present invention. As shown in FIG. 6 , the electronic device 20 in this embodiment includes: a processor 21 , a memory 22 , and a processor 21 that is stored in the storage 22 and can be accessed on the processor 21 . The running computer program 23, when the computer program 23 is executed by the processor 21, implements the processing method applied to the audio and video code stream in the embodiment. To avoid repetition, details are not repeated here. Alternatively, when the computer program is executed by the processor 21, the functions of each model/unit in the apparatus for processing audio and video code streams in the embodiment are implemented. To avoid repetition, details are not repeated here.

The electronic device 20 includes, but is not limited to, a processor 21 and a memory 22 . Those skilled in the art can understand that FIG. 6 is only an example of the electronic device 20, and does not constitute a limitation to the electronic device 20. It may include more or less components than the one shown, or combine some components, or different components For example, the electronic device may also include an input and output device, a network access device, a bus, and the like.

The so-called processor 21 may be a central processing unit (Central Processing Unit, CPU), and may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 22 may be an internal storage unit of the electronic device 20 , such as a hard disk or a memory of the electronic device 20 . The memory 22 can also be an external storage device of the electronic device 20, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash memory card (Flash card) equipped on the electronic device 20. Card), etc. Further, the memory 22 may also include both an internal storage unit of the electronic device 20 and an external storage device. The memory 22 is used to store computer programs and other programs and data required by the electronic device. The memory 22 may also be used to temporarily store data that has been or will be output.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above may refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided by the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined. Either it can be integrated into another system, or some features can be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units.

The above-mentioned integrated units implemented in the form of software functional units can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (Processor) to execute the methods described in the various embodiments of the present invention. some steps. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes .

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the present invention. within the scope of protection.

Claims (10)

1. a processing method of audio and video code stream, is characterized in that, described method comprises: Generate a transport stream according to the received signal; Filter out the audio and video code stream from the transport stream, and the audio and video code stream includes the packaged elementary code stream PES data; Writing the PES data into a plurality of ring buffers in the memory, the PES data including at least one start code; Identifying the position of the at least one start code in the plurality of ring buffers to obtain a physical address corresponding to the position; recording the physical address in the start code buffer of the memory; In response to the generated interrupt notification signal, the PES data is parsed according to the physical address to generate a compressed audio and video frame, and the compressed audio and video frame is written into at least one frame buffer in the memory. 2. The method according to claim 1, wherein, filtering out the audio and video code stream from the transport stream, comprising: Filter the transport stream through the set packet identifier PID to generate the audio and video stream. 3. method according to claim 1, is characterized in that, described in response to the interrupt notification signal of generation, before described PES data is parsed according to described physical address to generate compressed audio and video frames, also comprises: Identifying the number of the at least one start code in the plurality of ring buffers, and generating the number of the start codes corresponding to each of the ring buffers; Record the number of the start codes into the corresponding ring buffer. 4. The method according to claim 1, wherein before the recording the physical address into the start code buffer of the memory, the method further comprises: Allocate a buffer of a specified size, and use the buffer of the specified size as the start code buffer. 5. The method according to claim 1, wherein the writing of the compressed audio and video frames into at least one frame buffer in the memory comprises: Determine whether to use independent buffering for buffering or non-independent buffering for buffering; If it is determined that the independent buffering mode is used for buffering, each compressed audio and video frame is written into the corresponding frame buffer; If it is determined that the non-independent buffering mode is used for buffering, all the compressed audio and video frames are written into a frame buffer. 6. The method according to claim 1, wherein before the identifying the positions of the at least one start code in the plurality of ring buffers, the method further comprises: Set at least one start code according to the encoding specification of the code stream. 7. The method according to claim 3, wherein the described PES data is analyzed to generate compressed audio and video frames, comprising: obtaining the number of the start codes in the ring buffer; Reading the physical addresses of the start codes in the ring buffer corresponding to the number of the start codes in the start code buffer; Find out the start code corresponding to the physical address in the ring buffer according to the physical address; In the PES data, the start code corresponding to the physical address starts to detect the part that meets the frame boundary coding rule, and the part that meets the frame boundary coding rule is determined as the frame boundary; Framing is performed according to the identified frame boundaries to generate the compressed audio and video frames. 8. a processing device of audio and video code stream, is characterized in that, comprises: The generation module is used to generate the transport stream according to the received signal; A filtering module, configured to filter out an audio and video code stream from the transport stream, where the audio and video code stream includes PES data; a first writing module, configured to write the PES data into multiple ring buffers of the memory, the PES data including at least one start code; a first identification module, configured to identify the position of the at least one start code in the plurality of ring buffers to obtain a physical address corresponding to the position; a first recording module, for recording the physical address in the start code buffer of the memory; A parsing module, configured to parse the PES data according to the physical address to generate a compressed audio and video frame in response to the generated interrupt notification signal; The second writing module is configured to write the compressed audio and video frames into at least one frame buffer in the memory. 9. a storage medium, it is characterised in that the storage medium comprises a stored program, wherein, when the program is run, the device where the stored medium is controlled to execute the audio-video code described in any one of claims 1 to 7 Stream processing method. 10. An electronic device, characterized in that it comprises a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the computer program as claimed in the claims The method for processing audio and video code streams according to any one of 1 to 7.

Images