CN108419041B - Video data processing method and device - Google Patents
Video data processing method and device Download PDFInfo
- Publication number
- CN108419041B CN108419041B CN201710071682.9A CN201710071682A CN108419041B CN 108419041 B CN108419041 B CN 108419041B CN 201710071682 A CN201710071682 A CN 201710071682A CN 108419041 B CN108419041 B CN 108419041B
- Authority
- CN
- China
- Prior art keywords
- byte code
- abstraction layer
- network abstraction
- code stream
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title description 2
- 238000000034 method Methods 0.000 claims abstract description 36
- 238000012545 processing Methods 0.000 claims abstract description 22
- 230000006855 networking Effects 0.000 claims description 43
- 230000006854 communication Effects 0.000 claims description 17
- 238000004891 communication Methods 0.000 claims description 17
- 238000012163 sequencing technique Methods 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 5
- 238000005538 encapsulation Methods 0.000 claims description 4
- 238000000605 extraction Methods 0.000 claims description 3
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 10
- 229910002056 binary alloy Inorganic materials 0.000 description 7
- 238000004590 computer program Methods 0.000 description 7
- 238000012544 monitoring process Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000002159 abnormal effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000007175 bidirectional communication Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides a method and a device for processing video data, which are applied to a video network, wherein the method comprises the following steps: after an original byte code stream of video data is received, identifying a network abstraction layer unit from the original byte code stream and determining whether the type of the network abstraction layer unit is a preset type; when the type of the network abstraction layer unit is a preset type, the network abstraction layer unit is extracted, then the extracted network abstraction layer unit is recombined to obtain a target byte code stream, and the target byte code stream is sent to a video network playing terminal.
Description
Technical Field
The present invention relates to the field of video networking technologies, and in particular, to a method and an apparatus for processing video data.
Background
With the rapid development of network technologies, bidirectional communications such as video conferences and video teaching are widely popularized in the aspects of life, work, learning and the like of users.
At present, with the popularization and development of video networking services in the national range, video networking high-definition video networking interaction plays a very important role in government departments and other industries, for example, in the field of security protection, after video data are collected by remote video monitoring through monitoring equipment, the video data are packaged and then sent to a video networking server, and then sent to a video networking terminal through the video networking server, for example, a set top box is decoded and then played, so that remote video monitoring is realized.
At present, when a video data acquisition end packs video data, useless data or abnormal data are often added, so that the problems of black screen, unsmooth card and picture loss and jitter of hardware decoders such as a set top box and the like during decoding are caused.
Disclosure of Invention
In view of the above, embodiments of the present invention are proposed to provide a method and apparatus for video data processing that overcome or at least partially solve the above-mentioned problems.
In order to solve the above problem, an embodiment of the present invention discloses a method for processing video data, which is applied to a video network, wherein the video network comprises a video network server and a video network playing terminal, and the method comprises:
when an original byte code stream of video data is received, identifying a network abstraction layer unit from the original byte code stream;
determining whether the type of the network abstraction layer unit is a preset type;
when the type of the network abstraction layer unit is determined to be a preset type, extracting the network abstraction layer unit;
recombining the extracted network abstraction layer units to obtain a target byte code stream;
and sending the target byte code stream to a video network server through a video network, wherein the video network server is used for sending the target byte code stream to a video network playing terminal.
Preferably, the network abstraction layer unit includes a start code, and the step of identifying the network abstraction layer unit from the original byte code stream of the video data when the original byte code stream is received includes:
receiving an original byte code stream of video data;
detecting whether the original byte code stream contains the start code or not;
and if so, determining the original byte code stream from the start code to the next start code as a network abstraction layer unit.
Preferably, the step of determining whether the type of the network abstraction layer unit is a preset type includes:
acquiring the type byte code of the network abstraction layer unit;
judging whether the type byte code is a preset byte code or not;
and if so, determining that the type of the network abstraction layer unit is a preset type.
Preferably, the step of obtaining the type bytecode of the network abstraction layer unit includes:
acquiring byte codes of the designated positions of the network abstraction layer units;
and taking the byte code of the specified position as a type byte code.
Preferably, the step of recombining the extracted network abstraction layer units to obtain the target byte code stream includes:
determining the sequence of each network abstraction layer unit in the original byte code stream;
sequencing the extracted network abstraction layer units according to the sequence;
and recombining the sequenced network abstraction layer units to obtain a target byte code stream.
Preferably, the step of sending the target byte code stream to a video network server through a video network includes:
packaging the target byte code stream to obtain a video data packet;
and sending the video data packet to the video networking server through a data communication link distributed by the video networking server.
The embodiment of the invention also provides a device for processing video data, which is applied to the video network, wherein the video network comprises a video network server and a video network playing terminal, and the device comprises:
the device comprises an identification module, a storage module and a processing module, wherein the identification module is used for identifying a network abstraction layer unit from an original byte code stream of video data when the original byte code stream is received;
the preset type determining module is used for determining whether the type of the network abstraction layer unit is a preset type;
the extraction module is used for extracting the network abstraction layer unit when the type of the network abstraction layer unit is determined to be a preset type;
the target byte code stream combination module is used for recombining the extracted network abstraction layer units to obtain a target byte code stream;
and the sending module is used for sending the target byte code stream to a video network server through a video network, and the video network server is used for sending the target byte code stream to a video network playing terminal.
Preferably, the network abstraction layer unit includes a start code, and the identification module includes:
the receiving submodule is used for receiving an original byte code stream of the video data;
the detection submodule is used for detecting whether the original byte code stream contains the start code or not;
and the determining submodule is used for determining the original byte code stream from the start code to the next start code as a network abstraction layer unit.
Preferably, the preset type determining module includes:
a type byte code obtaining submodule, configured to obtain a type byte code of the network abstraction layer unit;
the preset byte code judging submodule is used for judging whether the type byte code is a preset byte code or not;
and the preset type determining submodule is used for determining that the type of the network abstraction layer unit is a preset type.
Preferably, the type bytecode obtaining sub-module includes:
a specified bytecode acquiring unit, configured to acquire a bytecode at a specified location of the network abstraction layer unit;
a type bytecode determining unit, configured to use the bytecode at the specified location as a type bytecode.
Preferably, the target byte code stream combination module includes:
the order determination submodule is used for determining the order of each network abstraction layer unit in the original byte code stream;
the sequencing submodule is used for sequencing the extracted network abstraction layer units according to the sequence;
and the combining submodule is used for recombining the sequenced network abstraction layer units to obtain the target byte code stream.
Preferably, the sending module includes:
the encapsulation submodule is used for encapsulating the target byte code stream to obtain a video data packet;
and the sending submodule is used for sending the video data packet to the video networking server through a data communication link distributed by the video networking server.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, after an original byte code stream of video data is received, a network abstraction layer unit is identified from the original byte code stream, and whether the type of the network abstraction layer unit is a preset type is determined; when the type of the network abstraction layer unit is a preset type, the network abstraction layer unit is extracted, then the extracted network abstraction layer unit is recombined to obtain a target byte code stream, and the target byte code stream is sent to a video network playing terminal.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
FIG. 1 is a flow chart of the steps of a method embodiment of video data processing of the present invention;
FIG. 2 is a flow chart of a process for video data according to the present invention;
FIG. 3 is a block diagram of an embodiment of an apparatus for video data processing according to the present invention;
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a flowchart illustrating steps of an embodiment of a method for processing video data according to the present invention is shown, where the method may be applied to a video network, where the video network includes a video network server and a video network playing terminal, and the method specifically includes the following steps:
in the embodiment of the invention, the video data can be data collected by a monitoring terminal (camera) of the video network, the video data collected by the monitoring terminal of the video network can be coded into an original byte code stream of the video data by an H.264 coding standard, compared with other existing video coding standards, the H.264 coding can provide more excellent image quality under the same bandwidth, and the compression efficiency under the same image quality is improved by about 2 times compared with other standards (MPEG 2). The h.264 encoding method may be to encode the video data into a byte stream format, for example, into a 16-ary byte stream.
H.264 is to address the differences in network transmission among different applications. Two layers are defined: VCL (Video Coding Layer) is responsible for efficient Video content presentation, NAL (Network abstraction Layer) is responsible for packetizing and transmitting data in the appropriate manner required by the Network. The NAL uses NALU (network abstraction layer unit) as a unit to support the transmission of encoded data in a packet switching technology based network. Therefore, after receiving the original byte stream of the video data, the network abstraction layer unit can be identified, and specifically, step 101 may include the following sub-steps:
substep 1011, receiving an original byte code stream of the video data;
in the embodiment of the present invention, the original byte code stream may be a hexadecimal byte code stream, for example, the following byte code streams are the hexadecimal original byte code stream:
00 00 00 01 2C 00 10 32 20 6E 75 6D 20 30 00 80 00 00 00 01 26 05 1A DC……
the above is merely an example of the original byte code stream in hexadecimal, and certainly, the original byte code stream in other binary systems may also be the original byte code stream in other binary systems, for example, the original byte code stream in binary system may also be converted from binary system to hexadecimal system when the embodiment of the present invention is implemented, and the binary system of the original byte code stream in the embodiment of the present invention is not limited herein.
Substep 1012, detecting whether the original byte code stream contains the start code;
in order to enable a decoder to conveniently detect the boundary of the network abstraction layer unit, and sequentially take out the network abstraction layer unit for decoding, the h.264 adds a start code in front of each network abstraction layer unit: "00000001" or "000001", on some types of media, for the convenience of addressing, the byte code stream is required to be aligned in length, or is an integer multiple of a certain constant, so that a few bytes of "0" are added before the start code for padding, for example, the byte code stream is required to be 4 bytes long, and a byte of "00" is added before the byte code "000001".
In the embodiment of the invention, whether the initial code is contained in the original byte code stream or not can be detected, whether the received original byte code stream contains '000001' or not can be detected, if the received original byte code stream contains '000001', the network abstraction layer unit is detected, otherwise, whether the network abstraction layer unit contains '00000001' or not is continuously detected, and if the received original byte code stream contains '00000001', the network abstraction layer unit is detected, so that the cyclic detection is performed in sequence until the original byte code stream is ended. Specifically, the detection may be performed cyclically one byte by one byte, for example, when the bytes "00" and "00" are detected in sequence, whether the next byte is "01" or not is detected, if yes, the start code "000001" is detected, if no, when all of the consecutive three bytes are detected as "00", whether the next byte is "01" or not is detected, and if yes, the start code "00000001" is detected. Certainly, a method of matching the start code integrally and circularly may also be adopted, for example, the start code "000001" is integrally matched with 3 bytes in the original byte code stream, specifically, the nth byte in the original byte code stream and the first byte and the second byte after the nth byte are taken to form three bytes to match with the start code "000001", after matching is completed, the (N + 1) th byte and the first byte and the second byte after the (N + 1) th byte are taken to form new three bytes to continue matching, so that the length (3 or 4) of the start code is taken as a period, and the byte sections with the word length of the period are taken one by one to match with the start code.
In the embodiment of the invention, the network abstraction layer unit in the original byte code stream can be effectively identified by circularly searching the start code, so that the type of the network abstraction layer unit can be determined subsequently, and whether the network abstraction layer unit is video data or not can be further determined.
And a substep 1013, determining the original byte code stream from the start code to the next start code as a network abstraction layer unit.
Since h.264 adds a start code before each network abstraction layer unit: 00000001 or 000001 as the start of the network abstraction layer unit, when the next start code is detected, it represents that the current network abstraction layer unit is finished, and the next network abstraction layer unit is started, so the original byte code stream from the start code to the next start code can be determined as the network abstraction layer unit.
In the embodiment of the invention, after the original byte code stream of the video data is received, whether the original byte code stream has the start code or not is circularly detected, and if the original byte code stream has the start code, the byte code stream between the two start codes is determined to be a network abstraction layer unit.
in the original byte code stream of the video data, some useless data added by a third party monitoring resource or byte code segments which are generated in an abnormal state and are irrelevant to the video data may be included, and the irrelevant byte code segments also form a network abstraction layer unit. In the h.264 standard, each network abstraction layer unit is provided with a type, so that whether the network abstraction layer unit is video data can be determined by the type of the network abstraction layer unit, the concrete step 102 may include the following sub-steps:
substep 1021, obtaining the type byte code of the network abstraction layer unit;
in h.264, the byte of the first bit after the start code is defined to represent the type of the network abstraction layer unit, and if the start code is "00000001" of the four-bit byte code, the fifth bit is the type byte code, so that the byte code of the specified position of the network abstraction layer unit can be obtained, and the byte code of the specified position is taken as the type byte code.
For example, in the following original byte code stream, 2C, 26 after 00000001 are type byte codes.
00 00 00 01 2C 00 10 32 20 6E 75 6D 20 30 00 80 00 00 00 01 26 05 1A DC……
Thus, when a network abstraction layer unit is identified, the bytecode at the specified location can be obtained as the type bytecode of the network abstraction layer unit.
Substep 1022, determining whether the type bytecode is a preset bytecode;
in practical application, the video is composed of a plurality of still images, so for a video with little change, when encoding, a complete image frame a may be encoded first, and the following image frame B only encodes the difference with the image frame a, so that the size of the image frame B is only a part of the complete image frame a, and if the change of the image frame C following the image frame B is not great, the image frame C may be encoded in the form of the image frame B, so that the loop continues, the video is called a sequence (the sequence is a piece of data with the same characteristics), when a certain image and the preceding image have great change and cannot be generated by referring to the preceding image frame, the previous sequence is ended, the next sequence is started, that is, a complete image frame a1 is regenerated, the following image frame is generated by referring to the complete image frame a1, only the content of the difference with the complete image frame a1 is written, in h.264, a complete image frame is defined as an I-frame and the remaining image frames as P-frames, and in order to enable accurate decoding by a decoder, a parameter set is defined, which is a set of rarely changed data providing decoding information, including a sequence parameter set acting on a series of consecutive coded images and a picture parameter set acting on one or more individual images in a coded video sequence.
In h.264, the values of the sequence parameter set, the picture parameter set, the I frame, and the P frame are defined as follows:
0x67 Sequence Parameter Set (SPS)
0x68 Picture Parameter Set (PPS)
0x65 frame I (IDR)
0x61 frame P (non-IDR Slice)
Therefore, the preset bytecodes can be set to 0x67, 0x68, 0x65, and 0x61, after the type bytecode of the network abstraction layer unit is obtained, it can be determined whether the type bytecode is one of the preset bytecodes, if so, the substep 1023 is executed, otherwise, the procedure jumps out, and the type of the next network abstraction layer unit is continuously determined.
Of course, the values of the sequence parameter set, the picture parameter set, the I frame, and the P frame may also be decimal values, for example:
sequence Parameter Set (SPS)
Image parameter set (PPS)
I frame (IDR)
P frame (non-IDR Slice)
The above values 7, 8, 5, and 1 are obtained by hexadecimal conversion of 0x67, 0x68, 0x65, and 0x61 into decimal, and may be represented by other binary systems, such as binary systems, for example.
Sub-step 1023 of determining that the type of said network abstraction layer unit is a preset type.
When the type bytecode of the network abstraction layer unit is a preset bytecode, for example, the type bytecode of the network abstraction layer unit is one of 0x67, 0x68, 0x65, and 0x61, it is determined that the type of the network abstraction layer unit is the preset type, that is, the network abstraction layer unit is one of a sequence parameter set, a picture parameter set, an I frame, and a P frame, which is a network abstraction layer unit related to video data. And if the data is not the preset type, the data indicates that the network abstraction layer unit is redundant or abnormal.
In the embodiment of the invention, after the network abstraction layer unit is identified, the type byte code of the network abstraction layer unit is obtained, the type of the network abstraction layer unit is determined through the type byte code, and the byte code stream of video data and the byte code stream of non-video data can be determined from the original byte code stream, so that the byte code stream of the non-video data is removed.
103, when the type of the network abstraction layer unit is determined to be a preset type, extracting the network abstraction layer unit;
and when the type of the network abstraction layer unit is determined to be a preset type, extracting the network abstraction layer unit and storing the network abstraction layer unit into a cache.
In the embodiment of the present invention, the preset types are a sequence parameter set, a picture parameter set, an I frame, and a P frame related to a video, and thus the extracted network abstraction layer unit is necessarily video data.
And 104, recombining the extracted network abstraction layer units to obtain a target byte code stream.
In practical applications, the method may be to reassemble a frame of data after extracting the network abstraction layer unit of the frame of data, and the specific step 104 may include the following sub-steps:
substep 1041, determining the sequence of each network abstraction layer unit in the original byte code stream;
substep 1042, sorting the extracted network abstraction layer units according to the sequence;
and a substep 1043 of recombining the sequenced network abstraction layer units to obtain a target byte code stream.
In the embodiment of the invention, the order extracted by each network abstraction layer unit can be used as the sequence, and then the target byte code stream can be obtained by rearranging after sequencing according to the sequence.
The network abstraction layer units combined into the target byte code stream are all video data, so that redundant byte code stream fragments irrelevant to the video data do not exist in the target byte code stream, and the quality of the video, the fault-tolerant capability of a playing terminal decoder and the decoding efficiency can be improved.
And 105, sending the target byte code stream to a video network server through a video network, wherein the video network server is used for sending the target byte code stream to a video network playing terminal.
In a preferred embodiment of the present invention, step 105 comprises the following sub-steps:
substep 1051, packaging the target byte code stream to obtain a video data packet;
in the embodiment of the invention, after the target byte code stream is combined into one frame, the target byte code stream needs to be packaged for data transmission. For example, PS encapsulation of h.264 video data. In the target byte code stream, the sequence parameter set and the picture parameter set usually precede the I frame, so the sequence parameter set, the picture parameter set and the network abstraction layer unit of the I frame can be encapsulated into a PS packet, which includes a PS packet header and a PES packet header, and for the P frame, the PS packet header and the PES packet header can be directly added to encapsulate into a PS packet.
Substep 1052 sending the video data packet to the video networking server over the video networking server's assigned data communication link.
In practical application, the video data can be collected, processed and packaged at the monitoring terminal of the Ethernet and then sent to the video networking server, or the video networking terminal can be collected, processed and packaged and then sent to the video networking server.
The video network is a network with centralized control function, comprising a main control server and a lower level network device, the lower level network device comprises a terminal, one of the core concepts of the video network is that a table is configured by a downlink communication link which is notified by the main control server to a switching device and is used for the current service, and then the transmission of data packets is carried out based on the configured table, namely, the communication method in the video network comprises the following steps:
the video network server configures a downlink data communication link of the current service:
and transmitting the data packet of the current service sent by the source terminal (such as an Ethernet terminal or a video network terminal) to the target terminal (such as a video network server) according to the downlink data communication link.
In the embodiment of the present invention, configuring the downlink data communication link of the current service includes: informing the switching equipment related to the downlink data communication link of the current service to allocate a table;
further, transmitting according to the downlink data communication link includes: the configured table is consulted, and the switching equipment transmits the received data packet through the corresponding port.
In particular to the embodiment of the present invention, before the ethernet terminal or the video networking terminal sends the video data packet to the video networking service, in the process of connecting with the video networking, the video networking server allocates a data communication link between the ethernet terminal or the video networking terminal and the video networking server to the ethernet terminal or the video networking terminal according to the address of the ethernet terminal or the video networking terminal, the data communication link information includes a device (such as an ethernet gateway or a switch) and a port involved in the transmission process, so that the video data packet after being encapsulated can be sent to the video networking server according to the data communication link information, in particular, taking the ethernet terminal as an example, the video data packet is transmitted to the ethernet gateway connected with the video networking terminal according to the ethernet protocol in the ethernet network, after the ethernet gateway is subjected to protocol conversion, according to the data communication link information, and transmitting the video data packet to next equipment according to the designated port until the video data packet reaches the video networking server, transmitting the video data packet to a video networking terminal of the on-demand request after the video networking server receives the video data packet, and decoding and playing the video data packet by the video networking terminal.
In the embodiment of the invention, redundant byte code segments in the original byte code stream of the video data are removed and recombined into the target byte code stream, the target byte code stream is sent to the video networking server after being packaged, and the target byte code stream is sent to the video networking terminal for decoding and playing by the video networking server, for example, a set top box and the like for decoding, so that the fault-tolerant capability and the decoding efficiency of the set top box are improved, and the playing quality of the video is improved.
To better illustrate the embodiments of the present invention, the following illustrates the embodiments of the present invention as an example:
referring to fig. 2, a flow chart of an example of video data processing according to the present invention is shown, where the video data processing flow includes:
s1: receiving a hexadecimal original byte code stream of H.264 video data;
s2: searching 000001 in the original byte code stream, and executing S3 if the 000001 is found; otherwise, executing S4;
s3: acquiring a fifth byte code (if the start code is 000001, one byte 00 is supplemented previously);
s4: searching 00000001 in the original byte code stream, if the original byte code stream is searched, executing S3, otherwise, returning to S1;
s5: and judging whether the value of the fifth byte code is equal to 5, 7, 8 or 1, if so, executing S6, and if not, executing S7.
S6, combining into a target byte code stream;
and S7, jumping out.
In this example, a hexadecimal raw byte stream is received, for example:
00 00 00 01 2C 00 10 32 20 6E 75 6D 20 30 00 80 00 00 00 01 26 05 1A DC 36 31 31 46 52 41 4D 45
firstly searching '000001' in the original byte code stream, searching '00000001' if the '000001' is not searched, judging whether the value of decimal system is 5 or 7 or 8 or 1 if the '000001' or '00000001' is existed, converting the '2C' of hexadecimal system into decimal system, extracting the original byte code stream from the '000001' or '00000001' to the next '000001' or '00000001' if the value of decimal system is 5 or 7 or 8 or 1, and re-synthesizing the target byte code stream, thus removing redundant byte code segments in the original byte code stream (the value of one byte after '000001' or '00000001' is not 5 or 7 or 8 or 1) and ensuring that the target byte code stream is all video data.
In the embodiment of the invention, after an original byte code stream of video data is received, a network abstraction layer unit is identified from the original byte code stream, and whether the type of the network abstraction layer unit is a preset type is determined; when the type of the network abstraction layer unit is a preset type, the network abstraction layer unit is extracted, then the extracted network abstraction layer unit is recombined to obtain a target byte code stream, and the target byte code stream is sent to a video network playing terminal.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 3, a block diagram of an embodiment of a video data processing apparatus according to the present invention is shown, the apparatus is applied to a video network, the video network includes a video network server and a video network playing terminal, the apparatus includes:
the device comprises an identification module 201, a processing module and a processing module, wherein the identification module is used for identifying a network abstraction layer unit from an original byte code stream of video data when the original byte code stream is received;
a preset type determining module 202, configured to determine whether the type of the network abstraction layer unit is a preset type;
the extracting module 203 is configured to extract the network abstraction layer unit when it is determined that the type of the network abstraction layer unit is a preset type;
the target byte code stream combination module 204 is used for recombining the extracted network abstraction layer units to obtain a target byte code stream;
a sending module 205, configured to send the target byte code stream to a video networking server through a video networking, where the video networking server is configured to send the target byte code stream to a video networking play terminal.
In a preferred embodiment of the present invention, the network abstraction layer unit includes a start code, and the identification module 201 includes:
the receiving submodule is used for receiving an original byte code stream of the video data;
the detection submodule is used for detecting whether the original byte code stream contains the start code or not;
and the determining submodule is used for determining the original byte code stream from the start code to the next start code as a network abstraction layer unit.
In a preferred embodiment of the present invention, the preset type determining module 202 includes:
a type byte code obtaining submodule, configured to obtain a type byte code of the network abstraction layer unit;
the preset byte code judging submodule is used for judging whether the type byte code is a preset byte code or not;
and the preset type determining submodule is used for determining that the type of the network abstraction layer unit is a preset type.
The type bytecode obtaining submodule includes:
a specified bytecode acquiring unit, configured to acquire a bytecode at a specified location of the network abstraction layer unit;
a type bytecode determining unit, configured to use the bytecode at the specified location as a type bytecode.
In a preferred embodiment of the present invention, the target byte-stream combining module 204 includes:
the order determination submodule is used for determining the order of each network abstraction layer unit in the original byte code stream;
the sequencing submodule is used for sequencing the extracted network abstraction layer units according to the sequence;
and the combining submodule is used for recombining the sequenced network abstraction layer units to obtain the target byte code stream.
In a preferred embodiment of the present invention, the sending module 205 includes:
the encapsulation submodule is used for encapsulating the target byte code stream to obtain a video data packet;
and the sending submodule is used for sending the video data packet to the video networking server through a data communication link distributed by the video networking server.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The method and apparatus for processing video data provided by the present invention are described in detail above, and the principle and the implementation of the present invention are explained herein by applying specific examples, and the description of the above embodiments is only used to help understand the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (8)
1. A method for processing video data is applied to a video network, wherein the video network comprises a video network server and a video network playing terminal, and the method comprises the following steps:
when an original byte code stream of video data is received, identifying a network abstraction layer unit from the original byte code stream;
determining whether the type of the network abstraction layer unit is a preset type;
when the type of the network abstraction layer unit is determined to be a preset type, extracting the network abstraction layer unit;
wherein the step of extracting the network abstraction layer unit comprises: determining byte code streams of video data and non-video data, removing the byte code streams of the non-video data, and acquiring the network abstraction layer unit;
recombining the extracted network abstraction layer units to obtain a target byte code stream;
the step of recombining the extracted network abstraction layer units to obtain the target byte code stream comprises the following steps: determining the sequence of each network abstraction layer unit in the original byte code stream; sequencing the extracted network abstraction layer units according to the sequence; recombining the sequenced network abstraction layer units to obtain a target byte code stream;
sending the target byte code stream to a video network server through a video network, wherein the video network server is used for sending the target byte code stream to a video network playing terminal; wherein, the step of sending the target byte code stream to a video network server through a video network comprises the following steps: packaging the target byte code stream to obtain a video data packet; and sending the video data packet to the video networking server through a data communication link distributed by the video networking server.
2. The method of claim 1, wherein the network abstraction layer unit includes a start code, and wherein identifying the network abstraction layer unit from a raw byte stream of the video data when the raw byte stream is received comprises:
receiving an original byte code stream of video data;
detecting whether the original byte code stream contains the start code or not;
and if so, determining the original byte code stream from the start code to the next start code as a network abstraction layer unit.
3. The method of claim 1, wherein the step of determining whether the type of the network abstraction layer unit is a preset type comprises:
acquiring the type byte code of the network abstraction layer unit;
judging whether the type byte code is a preset byte code or not;
and if so, determining that the type of the network abstraction layer unit is a preset type.
4. The method of claim 3, wherein the step of obtaining the type bytecode of the network abstraction layer unit comprises:
acquiring byte codes of the designated positions of the network abstraction layer units;
and taking the byte code of the specified position as a type byte code.
5. A video data processing device is applied to a video network, wherein the video network comprises a video network server and a video network playing terminal, and the device comprises:
the device comprises an identification module, a storage module and a processing module, wherein the identification module is used for identifying a network abstraction layer unit from an original byte code stream of video data when the original byte code stream is received;
the preset type determining module is used for determining whether the type of the network abstraction layer unit is a preset type;
the extraction module is used for extracting the network abstraction layer unit when the type of the network abstraction layer unit is determined to be a preset type;
wherein, the extraction module includes: a network abstraction layer unit obtaining unit, configured to determine a byte code stream of video data and a byte code stream of non-video data, remove the byte code stream of the non-video data, and obtain the network abstraction layer unit;
the target byte code stream combination module is used for recombining the extracted network abstraction layer units to obtain a target byte code stream;
wherein, the target byte code stream combination module comprises: the order determination submodule is used for determining the order of each network abstraction layer unit in the original byte code stream; the sequencing submodule is used for sequencing the extracted network abstraction layer units according to the sequence; the combining submodule is used for recombining the sequenced network abstraction layer units to obtain a target byte code stream;
the sending module is used for sending the target byte code stream to a video network server through a video network, and the video network server is used for sending the target byte code stream to a video network playing terminal; wherein the sending module comprises: the encapsulation submodule is used for encapsulating the target byte code stream to obtain a video data packet; and the sending submodule is used for sending the video data packet to the video networking server through a data communication link distributed by the video networking server.
6. The apparatus of claim 5, wherein the network abstraction layer unit comprises a start code, and wherein the identifying module comprises:
the receiving submodule is used for receiving an original byte code stream of the video data;
the detection submodule is used for detecting whether the original byte code stream contains the start code or not;
and the determining submodule is used for determining the original byte code stream from the start code to the next start code as a network abstraction layer unit.
7. The apparatus of claim 5, wherein the preset type determining module comprises:
a type byte code obtaining submodule, configured to obtain a type byte code of the network abstraction layer unit;
the preset byte code judging submodule is used for judging whether the type byte code is a preset byte code or not;
and the preset type determining submodule is used for determining that the type of the network abstraction layer unit is a preset type.
8. The apparatus of claim 7, wherein the type bytecode acquisition submodule comprises:
a specified bytecode acquiring unit, configured to acquire a bytecode at a specified location of the network abstraction layer unit;
a type bytecode determining unit, configured to use the bytecode at the specified location as a type bytecode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710071682.9A CN108419041B (en) | 2017-02-09 | 2017-02-09 | Video data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710071682.9A CN108419041B (en) | 2017-02-09 | 2017-02-09 | Video data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108419041A CN108419041A (en) | 2018-08-17 |
| CN108419041B true CN108419041B (en) | 2021-07-30 |
Family
ID=63125075
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710071682.9A Active CN108419041B (en) | 2017-02-09 | 2017-02-09 | Video data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108419041B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109660595B (en) * | 2018-11-08 | 2021-08-13 | 视联动力信息技术股份有限公司 | Remote operation method and device for real-time street view |
| CN109982020A (en) * | 2019-02-26 | 2019-07-05 | 南京邮电大学 | A kind of storage of video and search method |
| CN110149497A (en) * | 2019-04-09 | 2019-08-20 | 视联动力信息技术股份有限公司 | A kind of view networked data transmission method, apparatus, system and readable storage medium storing program for executing |
| CN114339408A (en) * | 2021-11-26 | 2022-04-12 | 惠州华阳通用电子有限公司 | Video decoding method |
| CN114466225A (en) * | 2022-02-10 | 2022-05-10 | 北京沃东天骏信息技术有限公司 | Video data playback method and device, electronic device and readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101325717A (en) * | 2008-07-11 | 2008-12-17 | 清华大学 | A H.264/SVC stream recombination method suitable for OFDM protection |
| CN102868939A (en) * | 2012-09-10 | 2013-01-09 | 杭州电子科技大学 | Method for synchronizing audio/video data in real-time video monitoring system |
| CN104796765A (en) * | 2015-04-23 | 2015-07-22 | 天脉聚源（北京）教育科技有限公司 | Method and device for extracting SPS (standard positioning services) and PPS (precise positioning services) from H264 frames |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2519745B (en) * | 2013-10-22 | 2018-04-18 | Canon Kk | Method of processing disordered frame portion data units |
-
2017
- 2017-02-09 CN CN201710071682.9A patent/CN108419041B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101325717A (en) * | 2008-07-11 | 2008-12-17 | 清华大学 | A H.264/SVC stream recombination method suitable for OFDM protection |
| CN102868939A (en) * | 2012-09-10 | 2013-01-09 | 杭州电子科技大学 | Method for synchronizing audio/video data in real-time video monitoring system |
| CN104796765A (en) * | 2015-04-23 | 2015-07-22 | 天脉聚源（北京）教育科技有限公司 | Method and device for extracting SPS (standard positioning services) and PPS (precise positioning services) from H264 frames |
Non-Patent Citations (2)
| Title |
|---|
| 刘路.基于TI Davinci平台的高清网络数字摄像机软件设计与实现.《中国优秀硕士学位论文全文数据库 信息科技辑》.2016, * |
| 基于TI Davinci平台的高清网络数字摄像机软件设计与实现;刘路;《中国优秀硕士学位论文全文数据库 信息科技辑》;20160315;第47-53页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108419041A (en) | 2018-08-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108419041B (en) | Video data processing method and device | |
| JP7091421B2 (en) | Transmitter and receiver | |
| JP6961778B2 (en) | Transmission method, reception method, transmitter and receiver | |
| KR101863410B1 (en) | Method and apparatus for transmitting/receiving hybrid media content in a multimedia system | |
| CN108989854B (en) | Playlist error labeling for delivery and rendering of streaming media | |
| US11082340B2 (en) | Transmitting apparatus, transmitting method, and receiving apparatus | |
| CA2936164C (en) | Communication apparatus, communication data generation method, and communication data processing method | |
| CN104253996A (en) | Video data sending and receiving methods, video data sending and receiving devices and video data transmission system | |
| WO2014183478A1 (en) | Video encoding method and apparatus | |
| CN104079975A (en) | Image processing device, image processing method, and computer program | |
| US9936266B2 (en) | Video encoding method and apparatus | |
| JP2005123907A (en) | Data reconstruction device | |
| KR102392888B1 (en) | Method and Apparatus for Improving Packet Loss Recovery | |
| CN105916011A (en) | Video real-time playing method and device | |
| US10986218B2 (en) | Broadcast system with a watermark payload | |
| JP6511470B2 (en) | Method and apparatus for packet transmission and reception in communication system | |
| AU2020407270A1 (en) | Video coding in relation to subpictures | |
| US7839925B2 (en) | Apparatus for receiving packet stream | |
| US9258623B2 (en) | Method and device for quality assessment of encrypted streaming media flows | |
| JP4391412B2 (en) | Dynamic multiplexing method of digital stream | |
| CN116896642A (en) | Video encryption method, device, equipment and storage medium | |
| JP6197708B2 (en) | Moving picture transmission system, moving picture encoding apparatus, moving picture decoding apparatus, moving picture encoding computer program, and moving picture decoding computer program | |
| CN114513669A (en) | Video coding and video playing method, device and system | |
| CN106341589B (en) | Digital image processing method, device and system | |
| JP7472345B2 (en) | Transmission method, reception method, transmission device, and reception device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 100000 Dongcheng District, Beijing, Qinglong Hutong 1, 1103 house of Ge Hua building. Applicant after: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd. Address before: A1103-1113, Gehua building, Dongcheng District, Beijing Applicant before: BEIJING VISIONVERA INTERNATIONAL INFORMATION TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: 33rd Floor, No.1 Huasheng Road, Yuzhong District, Chongqing 400013 Patentee after: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd. Country or region after: China Address before: 100000 Dongcheng District, Beijing, Qinglong Hutong 1, 1103 house of Ge Hua building. Patentee before: VISIONVERA INFORMATION TECHNOLOGY Co.,Ltd. Country or region before: China |
|
| CP03 | Change of name, title or address |