CN102301730B - Method, device and system for transmitting and processing multichannel AV - Google Patents
Method, device and system for transmitting and processing multichannel AV Download PDFInfo
- Publication number
- CN102301730B CN102301730B CN201180001226.8A CN201180001226A CN102301730B CN 102301730 B CN102301730 B CN 102301730B CN 201180001226 A CN201180001226 A CN 201180001226A CN 102301730 B CN102301730 B CN 102301730B
- Authority
- CN
- China
- Prior art keywords
- code stream
- audio
- video
- road
- stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 238000012545 processing Methods 0.000 title claims abstract description 46
- 239000002131 composite material Substances 0.000 claims abstract description 98
- 230000005540 biological transmission Effects 0.000 claims description 47
- 230000008569 process Effects 0.000 claims description 30
- 238000003672 processing method Methods 0.000 claims description 16
- 238000005538 encapsulation Methods 0.000 claims description 11
- 230000001360 synchronised effect Effects 0.000 claims description 10
- 238000000605 extraction Methods 0.000 claims description 9
- 150000001875 compounds Chemical class 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 239000000470 constituent Substances 0.000 claims description 6
- 238000005194 fractionation Methods 0.000 claims description 5
- 230000014759 maintenance of location Effects 0.000 claims description 3
- 230000008901 benefit Effects 0.000 abstract description 4
- 238000012544 monitoring process Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005111 flow chemistry technique Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2365—Multiplexing of several video streams
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention discloses a method, a device and a system for transmitting and processing multichannel AV (Audio/Video). The method comprises the steps of: respectively obtaining multichannel AV code stream; in a merging processing link, merging the each channel AV code stream into at least one channel composite code stream, wherein the each channel AV code stream merged in the composite code stream is correspondingly provided with a code stream identification used for identifying the AV code stream belonged to; and transmitting the composite code stream to an AV receiving terminal based on a network transport protocol for indicating the AV receiving terminal to divide the composite code stream into the each channel AV code stream according to the code stream identification. The method of the present invention integrates the multichannel AV code stream into the at least one channel composite code stream so as to reduce number of the AV code stream, thus when the code stream is transmitted by the network, the network channel is no need to be occupied independently, and the phenomenon that some channels are busy and some channels are free will not occur, thereby fully taking advantage of network resource and raising transmiting effciency.
Description
Technical field
The embodiment of the present invention relates to data processing technique, relates in particular to a kind of multichannel audio-video frequency transmission and processing method, Apparatus and system.
Background technology
Along with the development of stream media technology, multichannel audio-video frequency technology is used widely.In field of video monitoring, people, by Multipath Video Monitoring System, unify safety monitoring to compass of competency especially.Along with the development of integrated degree, the way of video is more and more, and coding/decoding capability, net biography ability and whole system performance have all been proposed to challenge; And along with increasing of way, Multi-path synchronous is play also becomes current a great problem.
Prior art is when realizing Multi-path synchronous broadcasting, common method Shi Jiangge road audio frequency and video are processed separately separately, from data acquisition, coding, Internet Transmission, again to decoding and output, all to control alone, the synchronous processing of just playing at output stage is done a splicing and is exported on a display for many pictures when output.This scheme makes each passage have good independence, controls simple.Some passages are out of order does not affect the normal operation of other passages, and the audio-video code stream that separate, stored is recorded can be play for other universal player easily.
But in realizing process of the present invention, inventor finds that prior art at least exists following defect: Internet Transmission need to take a plurality of passages and transmit independently each road audio-video code stream, waste Internet resources.
Summary of the invention
The embodiment of the present invention provides a kind of multichannel audio-video frequency transmission and processing method, Apparatus and system, with the utilization of optimized network transfer resource.
The embodiment of the present invention provides a kind of multichannel audio-video frequency transmission method, comprising:
Obtain respectively multichannel audio-video frequency code stream;
On merging processing links ，Jiang Ge road, audio-video code stream is incorporated in the composite bit stream of at least one road, wherein, is incorporated in composite bit stream Zhong Mei road audio-video code stream correspondence and is provided with the code stream identification for audio-video code stream under identifying;
Host-host protocol Network Based transmits described composite bit stream to audio frequency and video receiving terminal, to indicate described audio frequency and video receiving terminal according to described code stream identification, described composite bit stream to be split and becomes each road audio-video code stream.
The embodiment of the present invention also provides a kind of multichannel audio-video frequency processing method, comprising:
Host-host protocol Network Based receives at least one road composite bit stream of audio frequency and video transmitting terminal transmission;
In deconsolidation process link, according to the code stream identification arranging corresponding to every road audio-video code stream, described composite bit stream is split and becomes each road audio-video code stream;
To splitting Hou Ge road audio-video code stream, process respectively.
The embodiment of the present invention also provides a kind of multichannel audio-video frequency transmitting device, comprising:
Code stream acquisition module, for obtaining respectively multichannel audio-video frequency code stream;
Code stream merges module, for being incorporated at least one road composite bit stream in merging processing links ，Jiang Ge road audio-video code stream, wherein, being incorporated in composite bit stream Zhong Mei road audio-video code stream correspondence and being provided with the code stream identification for audio-video code stream under identifying;
Bit stream module, transmits described composite bit stream for host-host protocol Network Based to audio frequency and video receiving terminal, to indicate described audio frequency and video receiving terminal according to described code stream identification, described composite bit stream to be split and becomes each road audio-video code stream.
The embodiment of the present invention also provides a kind of multichannel audio-video frequency processing unit, comprising:
Code stream receiver module, receives for host-host protocol Network Based at least one road composite bit stream that audio frequency and video transmitting terminal transmits;
Code stream splits module, in deconsolidation process link, according to the code stream identification arranging corresponding to every road audio-video code stream, described composite bit stream is split and becomes each road audio-video code stream;
Code stream processing module, for processing respectively splitting Hou Ge road audio-video code stream.
The embodiment of the present invention also provides a kind of multichannel audio-video frequency treatment system, comprising: the multichannel audio-video frequency transmitting device that any embodiment of the present invention provides and multichannel audio-video frequency processing unit.
Multichannel audio-video frequency transmission provided by the invention and processing method, Apparatus and system, solved the problem of remote playing multichannel audio-video frequency, by multichannel audio-video frequency code stream being integrated into at least one road composite bit stream, reduced the quantity of audio-video code stream, therefore when by Internet Transmission code stream, without independently taking network channel, there is some channel busy phenomenon of some passage free time, thereby can utilize fully Internet resources, improve efficiency of transmission.
Accompanying drawing explanation
The flow chart of the multichannel audio-video frequency transmission method that Fig. 1 provides for the embodiment of the present invention one;
The flow chart of the multichannel audio-video frequency transmission method that Fig. 2 provides for the embodiment of the present invention two;
Fig. 3 A carries out the schematic diagram of data message merging in the embodiment of the present invention two;
Fig. 3 B is the structural representation of data message in the embodiment of the present invention two;
Fig. 3 C is the structural representation of data message frame head in the embodiment of the present invention two;
The flow chart of the multichannel audio-video frequency processing method that Fig. 4 provides for the embodiment of the present invention three;
The flow chart of the multichannel audio-video frequency processing method that Fig. 5 provides for the embodiment of the present invention four;
The flow chart of the multichannel audio-video frequency processing method that Fig. 6 provides for the embodiment of the present invention five;
Fig. 7 is the FB(flow block) that in the embodiment of the present invention five, multichannel audio-video frequency is processed;
The structural representation of the multichannel audio-video frequency transmitting device that Fig. 8 provides for the embodiment of the present invention six;
The structural representation of the multichannel audio-video frequency transmitting device that Fig. 9 provides for the embodiment of the present invention seven.
Embodiment
For making object, technical scheme and the advantage of the embodiment of the present invention clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
Embodiment mono-
The flow chart of the multichannel audio-video frequency transmission method that Fig. 1 provides for the embodiment of the present invention one.The method of the present embodiment is applicable in the broadcasting application of multichannel audio-video frequency code stream, is particularly useful for multichannel audio-video frequency code stream need to be by Internet Transmission time, by audio frequency and video, sends distolateral performed method, specifically can carry out following steps:
The mode that above-mentioned steps middle pitch video sending end is obtained audio-video code stream can be directly to obtain from camera head, can be also to receive audio-video code stream, or transfer audio-video code stream from the data block of storage, and the form of specifically obtaining is not limit.
In step 120, be incorporated in composite bit stream Zhong Mei road audio-video code stream correspondence and be provided with the code stream identification for audio-video code stream under identifying.Because audio-video code stream may arrange as required a plurality of processing links before by Internet Transmission, such as shooting collections, digital-to-analogue (AD) conversion, coding, buffer memory and message encapsulation link etc., so merging processing links can be one of them or several link.Code stream identification corresponding to the audio-video code stream setting of every road can be included in composite bit stream, also can be independent of composite bit stream, can play and distinguish composite bit stream Zhong Ge road audio-video code stream.
In above-mentioned steps, the applied network transmission protocol of transmission composite bit stream can be existing variety of protocol.
The technical scheme of the present embodiment is by being integrated into multichannel audio-video frequency code stream at least one road composite bit stream, particularly preferably be integrated into a road composite bit stream, when transmitting by network, avoided the lack of uniformity that network channel is taken, there will not be some channel busy and the situation of some passage free time, thereby use that can Optimizing Network Resources, improve data transmission efficiency.The technical scheme of the present embodiment, can also elevator system performance, when being integrated into a small amount of composite bit stream, having reduced system and between multichannel audio-video frequency code stream, has called the load of processing resource and increasing.Meanwhile, this technical scheme is owing to adopting a less or even composite bit stream transmission tone video code flow, thereby makes Internet Transmission synchronous, solves the multichannel audio-video frequency problem of synchronous output during transmission process alone.
Embodiment bis-
The flow chart of the multichannel audio-video frequency transmission method that Fig. 2 provides for the embodiment of the present invention two.The present embodiment can be take above-described embodiment as basis, the operation that Dui Jiangge road audio-video code stream is incorporated in the composite bit stream of at least one road is optimized, can be specifically that audio frequency and video transmitting terminal is arranged on code stream identification correspondence in each unit data piece of each road audio-video code stream, and constituent parts data block is merged and becomes at least one road composite bit stream.
Conventionally, audio-video code stream is comprised of a plurality of unit data pieces, and according to the difference of processing links, the form of expression of the unit data piece of each processing links has difference.The present embodiment can add code stream identification in each unit data piece, thereby can split each unit data piece at audio frequency and video receiving terminal, then manages throughout link again and combines.The present embodiment provides a preferred version, specifically select message encapsulation link as merging processing links, the handled unit data piece of message encapsulation link is data message, code stream identification correspondence is arranged in each unit data piece of each road audio-video code stream, and constituent parts data block is merged and to become at least one road composite bit stream and can comprise the steps:
The channel number correspondence of step 210, audio frequency and video transmitting terminal Jiang Ge road audio-video code stream is arranged in the frame head of each data message of each road audio-video code stream;
In actual applications, each data message typically comprises a frame head, wherein comprises the information of some fields.The technical scheme of the present embodiment utilizes this point, takies a field in the frame head of data message, carries the channel number that can identify each road audio-video code stream.For some audio frequency and video transmitting terminals, its conventionally may be corresponding set the audio-video code stream harvester of quantity, can receive the audio-video code stream of several passages, therefore can pass through each road audio-video code stream of the unique differentiation of channel number.Or, at common audio frequency and video transmitting terminal, also can identify each road audio-video code stream by modes such as order unique number.
Fig. 3 A carries out the schematic diagram of data message merging in the embodiment of the present invention two, as shown in Figure 3A, suppose You Si road audio-video code stream, and it forms the data message of frame code stream form after encoding by encoder.When carrying out message encapsulation, conventionally can, for data message adds frame head file, after the data message of ，Wei tetra-tunnel audio-video code stream adds frame head separately as shown in Figure 3A, in buffer memory, form a whole composite bit stream.Each data message in composite bit stream, can be described as again code stream, and first via audio-video code stream comprises " code stream 1, code stream 1 ', code stream 1 " as shown in Figure 3A ... ", the second tunnel, the similar code stream comprising separately of Third Road He tetra-tunnel audio-video code stream.Four tunnel audio-video code stream are compound to be become composite bit stream ，Qie Ge road, a road audio-video code stream putting in order in composite bit stream and not to limit, and can merge according to the sequencing obtaining.
Each data message includes frame head and code stream frame data, and frame head is mainly conveniently from composite bit stream, to parse each code stream frame, and its structure as shown in Figure 3 B, preferably can comprise frame type sign, frame length and private information etc.Wherein frame type sign is not only used for representing the original position of a frame, but also represents the type that this frame is concrete.Frame length can follow for representative the length of effective code stream frame data below closely.Private information can carry warning message in supervisory control system, in the fields such as Set Top Box, can carry programme information etc.The byte that channel number can be used as certain field also can be used as the independent byte in frame head.
For example, channel number can be used as a byte in frame type sign, and as shown in Figure 3 C, frame type sign comprises four bytes, is respectively audio/video frames sign, frame type, concrete frame format and channel number.As the frame type of frame of video is designated " Vxxx ".First byte " V " represents frame of video sign; Second byte representation video type, gets " H " and represents H264 video, and " M " represents MPEG4 video; The 3rd the concrete form of byte representation video, gets " 0 " and represents video I frame, and " 1 " represents video P frame; The 4th byte representation channel number, value represents the 0th passage, is 1 expression the 1st passage for " 0 ".Such as the H 264 video I frames of the 15th passage, be " VH 0E ".The frame type of audio frame is designated " Axxx ".First byte " A " represents audio frame sign; Second byte representation audio types, gets " A " and represents AMR, gets " G " and represents G series audio frequency, gets " P " and represents PCM, also can carry out corresponding expansion according to application; The 3rd the concrete frame format of byte representation, it is with second byte concrete audio format of representative of arranging in pairs or groups, and it is got " 6 " and represents G 726 audio frequency, gets " A " and represents adpcm audio; The 4th byte representation channel number.Such as the 10th channel audio form is G711, be " AG1A ".
Certainly, in frame head, the content of placing is not limited, but the overall principle is requirement provide distinguish frame boundaries sign, the information of frame type is provided, for terminal parses, use.
The technical scheme of the present embodiment has utilized existing audio-video code stream before Internet Transmission, to carry out the processing links of message encapsulation, in frame head, carry code stream identification and distinguish each road audio-video code stream, both realized the effect that code stream merges, reduced again the change to existing code flow processing method as far as possible, be adapted to apply.
On the basis of the various embodiments described above, audio-video code stream can comprise a plurality of required links in the processing procedure of transmitting terminal, and the operation of typically obtaining respectively multichannel audio-video frequency code stream in audio frequency and video transmitting terminal can comprise: from each camera head, gather respectively multichannel audio-video frequency code stream; The multichannel audio-video frequency code stream collecting is carried out respectively to digital-to-analogue conversion and coding, to obtain multichannel audio-video frequency code stream.In practical application, be not limited to this.
The multichannel audio-video frequency transmission method that the embodiment of the present invention provides has many advantages, such as having optimized network transmission resource and system call resource etc.In addition ，Dui Ge road audio-video code stream and composite bit stream can carry out other processing.For example, after Jiang Ge road audio-video code stream is incorporated in the composite bit stream of at least one road, can also store respectively each road audio-video code stream, and/or storage of complex code stream.Be equivalent to audio frequency and video to carry out video record operation.Separately the audio-video code stream of record can independent play-out, and the composite bit stream of unified storage also can split broadcasting subsequently in resolver.
Embodiment tri-
The flow chart of the multichannel audio-video frequency processing method that Fig. 4 provides for the embodiment of the present invention three, the present embodiment preferably coordinates execution with multichannel audio-video frequency transmission method provided by the invention, and specifically can be received and be brought in execution by audio frequency and video, and the method comprises the steps:
The technical scheme of the present embodiment is carried out deconsolidation process to the composite bit stream through Internet Transmission, specifically according to code stream identification, split, code stream identification can be carried in composite bit stream, also can be independent of composite bit stream transmission, as long as Neng Jiangge road audio-video code stream splits parsing.
The technical scheme of the present embodiment is by being integrated into the multichannel audio-video frequency code stream of at least one road composite bit stream, when transmitting by network, avoided the lack of uniformity that network channel is taken, there will not be some channel busy and the situation of some passage free time, thereby use that can Optimizing Network Resources, improve data transmission efficiency.The technical scheme of the present embodiment, can also elevator system performance, when processing on a small quantity even a composite bit stream, has reduced system and between multichannel audio-video frequency code stream, has called the load of processing resource and increasing.Meanwhile, this technical scheme is owing to adopting a less or even composite bit stream transmission tone video code flow, thereby makes Internet Transmission synchronous, solves the multichannel audio-video frequency problem of synchronous output during transmission process alone.
Embodiment tetra-
The flow chart of the multichannel audio-video frequency processing method that Fig. 5 provides for the embodiment of the present invention four, the present embodiment has specifically been optimized the operation that splits composite bit stream, according to the code stream identification arranging corresponding to every road audio-video code stream, the operation that composite bit stream fractionation is become to each road audio-video code stream can be carried out following steps: from composite bit stream, extract constituent parts data block; The code stream identification arranging corresponding to every road audio-video code stream according to carrying in each unit data piece, merges the unit data piece of extraction to become each road audio-video code stream.
The present embodiment can add code stream identification in each unit data piece, thereby audio frequency and video receiving terminal can split each unit data piece, then in subsequent treatment link, carries out the combination of each road audio-video code stream again.The present embodiment provides a preferred version, specifically select packet parsing link as deconsolidation process link, the handled unit data piece of packet parsing link is data message,, according to the code stream identification arranging corresponding to every road audio-video code stream carrying in each unit data piece, the unit data piece merging of extraction is become to each road audio-video code stream can be comprised the steps:
Step 510, audio frequency and video receiving terminal are identified the channel number arranging corresponding to every road audio-video code stream carrying in each data message frame head;
Step 520, audio frequency and video receiving terminal merge the data message of extraction to become each road audio-video code stream according to channel number.
In actual applications, each data message typically comprises a frame head, wherein comprises the information of some fields.The technical scheme of the present embodiment utilizes this point, takies a field in the frame head of data message, carries the channel number that can identify each road audio-video code stream.Certainly, can identify the code stream identification of distinguishing each road audio-video code stream and be not limited to channel number.
The technical scheme of the present embodiment has utilized existing audio-video code stream after Internet Transmission, to carry out packet parsing, it is the processing links of message decapsulation, with the code stream identification carrying in frame head, distinguish each road audio-video code stream, both realized the effect that code stream splits, reduced again the change to existing code flow processing method as far as possible, be adapted to apply.
On the basis of the various embodiments described above, the performed operation that fractionation Hou Ge road audio-video code stream is processed respectively of receiving terminal can be refined as: to splitting Hou Ge road audio-video code stream, decode respectively and caching process; And caching process Ge road audio-video code stream is carried out to picture splicing, in same display, play.Certainly the processing links in practical application is not limited to this.
The multichannel audio-video frequency processing method that various embodiments of the present invention provide, Dui Ge road audio-video code stream is processed independently, also can unify composite bit stream to process.For example, host-host protocol Network Based can also be stored the composite bit stream receiving after receiving at least one road composite bit stream of audio frequency and video transmitting terminal transmission.Be equivalent to composite bit stream to carry out video record, when needs are play, split again.
Embodiment five
The flow chart of the multichannel audio-video frequency processing method that Fig. 6 provides for the embodiment of the present invention five, the present embodiment specifically provides the whole processing procedure of multichannel audio-video frequency code stream, as shown in Figure 7, for the FB(flow block) that multichannel audio-video frequency in the embodiment of the present invention five is processed, multichannel audio-video frequency processing method comprises the steps: typically
Each camera head in step 610, audio frequency and video transmitting terminal gathers respectively multichannel audio-video frequency code stream;
Camera head as shown in Figure 7, can be camera, also can broadly be interpreted as storing the video disc of audio-video code stream, or other can provide the device of audio-video code stream.
Step 620, audio frequency and video transmitting terminal carry out respectively digital-to-analogue conversion and coding to the multichannel audio-video frequency code stream collecting, to obtain multichannel audio-video frequency code stream;
In above-mentioned steps 620, specifically can adopt a plurality of AD converter Dui Ge road audio-video code stream to carry out digital-to-analogue conversion, then adopt a plurality of encoders respectively Dui Ge road audio-video code stream carry out, form the frame code stream formed by data message.
The channel number correspondence of step 630, audio frequency and video transmitting terminal Jiang Ge road audio-video code stream is arranged in the frame head of each data message of each road audio-video code stream, more unified sending in buffer memory stored;
Buffer unit shown in Fig. 7 can complete the operation of above-mentioned steps 630, not only adds frame head but also carry out buffer memory, and in buffer memory, reality has just formed tactic composite bit stream.Data message is carried out to buffer memory can, according to the priority receiving, be stored with the queue of first-in first-out.
Step 640, audio frequency and video transmitting terminal extract each data message from buffer memory, are encapsulated in the compound message flow at least one road, are preferably encapsulated in a compound message flow in road;
Step 650, audio frequency and video transmitting terminal host-host protocol Network Based transmit this composite bit stream to audio frequency and video receiving terminal;
The channel number arranging corresponding to every road audio-video code stream carrying in each data message frame head in step 660, audio frequency and video receiving terminal identification composite bit stream;
Step 670, audio frequency and video receiving terminal merge the data message of extraction to become each road audio-video code stream according to channel number;
In above-mentioned steps 660 and step 670, the data message that specifically network can be received carries out buffer memory, then in resolution unit, carries out packet parsing operation.While resolving composite bit stream, first byte-by-byte first searches frame type sign, then basis frame data length below, read frame data below, according to the frame information parsing, such as channel number, the concrete form of audio frequency and video etc., the decoder that this code stream can the be sent into respective channel demonstration of decoding.
Step 680, audio frequency and video receiving terminal are decoded respectively and caching process to splitting Hou Ge road audio-video code stream;
In above-mentioned steps 680, can from resolution unit, obtain respectively multichannel audio-video frequency code stream by a plurality of decoding units, independently decode, then buffer memory.Can time of implementation Synchronization Control in the process of buffer memory, so that the picture retention time of follow-up play is synchronous.
Step 690, audio frequency and video receiving terminal carry out picture splicing by caching process Ge road audio-video code stream, in same display, play.
The technical scheme of the present embodiment, the technical scheme that in fact provides a plurality of codecs, single buffer memory to splice, this technical scheme is more applicable for general single channel video and audio coding technology.Multiway images sequence generates video code flow separately by encoder respectively, and multichannel code stream adds that the special identifier of passage is sent in public buffer memory afterwards separately, forms the composite bit stream of multichannel.Video recording storage can be based on this composite bit stream video recording, the video recording of the code stream that also can encode out based on single channel.Network sends and processes based on this composite bit stream, and the network terminal receives data and sends into buffer memory, by resolution unit, parses each road video code flow, sends into respectively decoder separately, solves image sequence; After picture splicing, just send display to show.
Embodiment six
The structural representation of the multichannel audio-video frequency transmitting device that Fig. 8 provides for the embodiment of the present invention six, this device specifically can be integrated in audio frequency and video transmitting terminal, specifically can comprise that code stream acquisition module 810, code stream merge module 820 and bit stream module 830.Wherein, code stream acquisition module 810 is for obtaining respectively multichannel audio-video frequency code stream; Code stream merges module 820 for being incorporated at least one road composite bit stream in merging processing links ，Jiang Ge road audio-video code stream, wherein, is incorporated in composite bit stream Zhong Mei road audio-video code stream correspondence and is provided with the code stream identification for audio-video code stream under identifying; Bit stream module 830 is transmitted described composite bit stream for host-host protocol Network Based to audio frequency and video receiving terminal, to indicate audio frequency and video receiving terminal according to code stream identification, composite bit stream to be split and becomes each road audio-video code stream.
Preferably select message encapsulation link as merging processing links, code stream merging module 820 can comprise: frame head adding device 821 and message encapsulation unit 822.Wherein, frame head adding device 821 is arranged on the frame head of each data message of each road audio-video code stream for the channel number correspondence of Jiang Ge road audio-video code stream; Message encapsulation unit 822 is for being encapsulated in each data message the compound message flow at least one road.
The technical scheme of the present embodiment can be carried out any embodiment of the present invention multichannel audio-video frequency transmission method is provided, and there is corresponding functional module, by multichannel audio-video frequency code stream being integrated into at least one road composite bit stream, particularly preferably be integrated into a road composite bit stream, when transmitting by network, avoided lack of uniformity that network channel is taken, there will not be some channel busy and the situation of some passage free time, thereby use that can Optimizing Network Resources, improve data transmission efficiency.The technical scheme of the present embodiment, can also elevator system performance, when being integrated into a small amount of composite bit stream, having reduced system and between multichannel audio-video frequency code stream, has called the load of processing resource and increasing.
Embodiment seven
The structural representation of the multichannel audio-video frequency transmitting device that Fig. 9 provides for the embodiment of the present invention seven, this device specifically can be integrated in audio frequency and video receiving terminal, specifically can comprise that code stream receiver module 910, code stream split module 920 and code stream processing module 930.Wherein, code stream receiver module 910 receives at least one road composite bit stream of audio frequency and video transmitting terminal transmission for host-host protocol Network Based; Code stream splits module 920 in deconsolidation process link, according to the code stream identification arranging corresponding to every road audio-video code stream, composite bit stream is split and becomes each road audio-video code stream; Code stream processing module 930 is for processing respectively splitting Hou Ge road audio-video code stream.
Preferably select packet parsing link as deconsolidation process link, code stream fractionation module 920 preferably includes: frame head recognition unit 921 and code stream merge cells 922.Wherein, the channel number arranging corresponding to every road audio-video code stream that frame head recognition unit 921 carries for identifying each data message frame head; Code stream merge cells 922 is for merging the data message of extraction to become each road audio-video code stream according to described channel number.
The technical scheme of the present embodiment can be carried out any embodiment of the present invention multichannel audio-video frequency processing method is provided, and has corresponding functional module.The technical scheme of the present embodiment is by being integrated into the multichannel audio-video frequency code stream of at least one road composite bit stream, when transmitting by network, avoided the lack of uniformity that network channel is taken, there will not be some channel busy and the situation of some passage free time, thereby use that can Optimizing Network Resources, improve data transmission efficiency.The technical scheme of the present embodiment, can also elevator system performance, when processing on a small quantity even a composite bit stream, has reduced system and between multichannel audio-video frequency code stream, has called the load of processing resource and increasing.
The embodiment of the present invention also provides a kind of multichannel audio-video frequency treatment system, comprises multichannel audio-video frequency transmitting device and multichannel audio-video frequency processing unit that any embodiment of the present invention provides.
The technical scheme of various embodiments of the present invention has solved the problem of remote playing multichannel audio-video frequency, by multichannel audio-video frequency code stream being integrated into at least one road composite bit stream, particularly preferably be integrated into a road composite bit stream, thereby there is following advantage: on the one hand, the technical scheme of the embodiment of the present invention has reduced the quantity of audio-video code stream by integration, therefore when by Internet Transmission code stream, without independently taking network channel, there is some channel busy phenomenon of some passage free time, thereby can utilize fully Internet resources, improve efficiency of transmission; On the other hand, the processing links of audio-video code stream is more, such as digital-to-analogue conversion, encoding and decoding etc., when audio-video code stream reaches tens tunnels even during tens tunnels, the technical scheme of the embodiment of the present invention can not increase the load increasing when system is managed link dispatch deal resource throughout too much, can more easily realize the balanced use of processing resource; Again on the one hand, the technical scheme of the embodiment of the present invention is transmitted composite bit stream by unification, the equalization data transmission rate of can trying one's best, the data that are transferred to after the data wait that minimizing is first transferred to and the phenomenon of playout-delay.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can complete by the relevant hardware of program command, aforesaid program can be stored in a computer read/write memory medium, this program, when carrying out, is carried out the step that comprises said method embodiment; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CDs.
Finally it should be noted that: above embodiment only, in order to technical scheme of the present invention to be described, is not intended to limit; Although the present invention is had been described in detail with reference to previous embodiment, those of ordinary skill in the art is to be understood that: its technical scheme that still can record aforementioned each embodiment is modified, or part technical characterictic is wherein equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution depart from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (8)
1. a multichannel audio-video frequency transmission method, is characterized in that, comprising:
Obtain respectively multichannel audio-video frequency code stream;
On merging processing links ，Jiang Ge road, audio-video code stream is incorporated in the composite bit stream of at least one road, wherein, is incorporated in composite bit stream Zhong Mei road audio-video code stream correspondence and is provided with the code stream identification for audio-video code stream under identifying;
Host-host protocol Network Based transmits described composite bit stream to audio frequency and video receiving terminal, to indicate described audio frequency and video receiving terminal according to described code stream identification, described composite bit stream to be split and becomes each road audio-video code stream;
Wherein ，Jiang Ge road audio-video code stream is incorporated at least one road composite bit stream and comprises:
Described code stream identification correspondence is arranged in each unit data piece of each road audio-video code stream, and constituent parts data block is merged and becomes at least one road composite bit stream;
Described merging processing links is message encapsulation link, described code stream identification correspondence is arranged in each unit data piece of each road audio-video code stream, and constituent parts data block is merged and becomes at least one road composite bit stream and comprise:
The channel number correspondence of Jiang Ge road audio-video code stream is arranged in the frame head of each data message of each road audio-video code stream, unified sending in buffer memory stored again, wherein, described frame head comprises frame type sign, frame length and private information, described channel number is as a byte in described frame type sign, frame length or private information, or is the independent byte in described frame head;
From buffer memory, extract each data message, each data message is encapsulated in the compound message flow at least one road.
2. multichannel audio-video frequency transmission method according to claim 1, is characterized in that, obtains respectively multichannel audio-video frequency code stream and comprises:
From each camera head, gather respectively multichannel audio-video frequency code stream;
The multichannel audio-video frequency code stream collecting is carried out respectively to digital-to-analogue conversion and coding, to obtain multichannel audio-video frequency code stream.
3. multichannel audio-video frequency transmission method according to claim 1, after it is characterized in that ，Jiang Ge road audio-video code stream is incorporated in the composite bit stream of at least one road, also comprises: store respectively described each road audio-video code stream, and/or store described composite bit stream.
4. a multichannel audio-video frequency processing method, is characterized in that, comprising:
Host-host protocol Network Based receives at least one road composite bit stream of audio frequency and video transmitting terminal transmission;
In deconsolidation process link, according to the code stream identification arranging corresponding to every road audio-video code stream, described composite bit stream is split and becomes each road audio-video code stream;
To splitting Hou Ge road audio-video code stream, process respectively;
Wherein, the code stream identification that described basis arranges corresponding to every road audio-video code stream, becomes each road audio-video code stream by described composite bit stream fractionation and comprises:
From described composite bit stream, extract constituent parts data block;
The code stream identification arranging corresponding to every road audio-video code stream according to carrying in each unit data piece, merges the unit data piece of extraction to become each road audio-video code stream;
Described deconsolidation process link is packet parsing link, according to the code stream identification arranging corresponding to every road audio-video code stream carrying in each unit data piece, the unit data piece merging of extraction is become to each road audio-video code stream and comprise:
Identify the channel number arranging corresponding to every road audio-video code stream carrying in each data message frame head, wherein, described frame head comprises frame type sign, frame length and private information, described channel number is as a byte in described frame type sign, frame length or private information, or is the independent byte in described frame head;
According to described channel number, the data message of extraction is merged and becomes each road audio-video code stream;
Describedly to splitting Hou Ge road audio-video code stream, process and comprise respectively:
To splitting Hou Ge road audio-video code stream, decode respectively and caching process, time of implementation Synchronization Control in the process of caching process, so that the picture retention time of follow-up play is synchronous;
And caching process Ge road audio-video code stream is carried out to picture splicing, in same display, play.
5. multichannel audio-video frequency processing method according to claim 4, is characterized in that, host-host protocol Network Based also comprises after receiving at least one road composite bit stream of audio frequency and video transmitting terminal transmission:
The described composite bit stream receiving is stored.
6. a multichannel audio-video frequency transmitting device, is characterized in that, comprising:
Code stream acquisition module, for obtaining respectively multichannel audio-video frequency code stream;
Code stream merges module, for being incorporated at least one road composite bit stream in merging processing links ，Jiang Ge road audio-video code stream, wherein, being incorporated in composite bit stream Zhong Mei road audio-video code stream correspondence and being provided with the code stream identification for audio-video code stream under identifying;
Bit stream module, transmits described composite bit stream for host-host protocol Network Based to audio frequency and video receiving terminal, to indicate described audio frequency and video receiving terminal according to described code stream identification, described composite bit stream to be split and becomes each road audio-video code stream;
Wherein, described merging processing links is message encapsulation link, and described code stream merging module comprises:
Frame head adding device, for the channel number correspondence of Jiang Ge road audio-video code stream, be arranged on the frame head of each data message of each road audio-video code stream, unified sending in buffer memory stored again, wherein, described frame head comprises frame type sign, frame length and private information, described channel number is as a byte in described frame type sign, frame length or private information, or is the independent byte in described frame head;
Message encapsulation unit, for extract each data message from buffer memory, is encapsulated in each data message in the compound message flow at least one road.
7. a multichannel audio-video frequency processing unit, is characterized in that, comprising:
Code stream receiver module, receives for host-host protocol Network Based at least one road composite bit stream that audio frequency and video transmitting terminal transmits;
Code stream splits module, in deconsolidation process link, according to the code stream identification arranging corresponding to every road audio-video code stream, described composite bit stream is split and becomes each road audio-video code stream;
Code stream processing module, for processing respectively splitting Hou Ge road audio-video code stream;
Wherein, described deconsolidation process link is packet parsing link, and described code stream fractionation module comprises:
Frame head recognition unit, the channel number arranging corresponding to every road audio-video code stream carrying for identifying each data message frame head, wherein, described frame head comprises frame type sign, frame length and private information, described channel number is as a byte in described frame type sign, frame length or private information, or is the independent byte in described frame head;
Code stream merge cells, for merging the data message of extraction to become each road audio-video code stream according to described channel number;
Described code stream processing module, specifically for decoding respectively and caching process to splitting Hou Ge road audio-video code stream, time of implementation Synchronization Control in the process of caching process, so that the picture retention time of follow-up play is synchronous; And caching process Ge road audio-video code stream is carried out to picture splicing, in same display, play.
8. a multichannel audio-video frequency treatment system, is characterized in that, comprising: multichannel audio-video frequency transmitting device claimed in claim 6 and multichannel audio-video frequency processing unit claimed in claim 7.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2011/077259 WO2012106898A1 (en) | 2011-07-18 | 2011-07-18 | Method, device and system for transmitting and processing multi-channel audio-video |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102301730A CN102301730A (en) | 2011-12-28 |
| CN102301730B true CN102301730B (en) | 2014-02-19 |
Family
ID=45360541
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180001226.8A Active CN102301730B (en) | 2011-07-18 | 2011-07-18 | Method, device and system for transmitting and processing multichannel AV |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102301730B (en) |
| WO (1) | WO2012106898A1 (en) |
Families Citing this family (41)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103199865B (en) * | 2012-01-10 | 2016-06-15 | 武汉凯默电气有限公司 | A kind of light adaptive serial port decoding circuit |
| CN102682741B (en) * | 2012-05-30 | 2014-12-03 | 华为技术有限公司 | Multi-display control system and implementation method of multi-display control system |
| CN102739777B (en) * | 2012-06-01 | 2015-04-01 | 苏州阔地网络科技有限公司 | Data stream disconnection recovering method and system |
| CN103514225B (en) * | 2012-06-27 | 2016-12-21 | 浙江大华技术股份有限公司 | The multichannel multiplexing method of a kind of data source and device thereof |
| CN103517027B (en) * | 2012-06-29 | 2017-05-24 | 联想(北京)有限公司 | Video data processing method and electronic equipment |
| CN103581609B (en) * | 2012-07-23 | 2018-09-28 | 中兴通讯股份有限公司 | A kind of method for processing video frequency and device, system |
| CN102801969A (en) * | 2012-07-25 | 2012-11-28 | 华为技术有限公司 | Method, device and system of processing multimedia data |
| CN103856784B (en) * | 2012-12-03 | 2019-02-05 | 联想(北京)有限公司 | Data sending, receiving method and electronic equipment |
| CN103179435B (en) * | 2013-02-27 | 2016-09-28 | 北京视博数字电视科技有限公司 | A kind of multi-path video data multiplexing method and device |
| CN103686047A (en) * | 2013-12-18 | 2014-03-26 | 电子科技大学 | A multi-channel video data transmission method |
| CN104703051B (en) * | 2014-01-06 | 2018-06-05 | 杭州海康威视数字技术股份有限公司 | Code stream sending method and device |
| CN105227242A (en) * | 2014-06-17 | 2016-01-06 | 中兴通讯股份有限公司 | Opto-electronic receiver, launching technique, device, optoelectronic transceiver method, module, equipment |
| CN105847825A (en) | 2015-01-16 | 2016-08-10 | 杭州海康威视数字技术股份有限公司 | Encoding, index storage and access methods for video encoding code stream and corresponding apparatus |
| CN104734992B (en) * | 2015-03-30 | 2018-04-20 | 华为技术有限公司 | A kind of service data transmission method and device |
| CN105979289A (en) * | 2015-12-03 | 2016-09-28 | 乐视致新电子科技（天津）有限公司 | Video generation and play method and device |
| CN105451067A (en) * | 2015-12-04 | 2016-03-30 | 珠海全志科技股份有限公司 | Audio and video data transmission method and device |
| CN105898381A (en) * | 2015-12-15 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Content transmission method, content play method, content server and intelligent equipment |
| CN105681682B (en) * | 2016-01-19 | 2019-06-14 | 广东威创视讯科技股份有限公司 | Video data transmission method and system |
| CN106028137A (en) * | 2016-06-22 | 2016-10-12 | 北京小米移动软件有限公司 | Live streaming processing method and apparatus |
| CN106341619A (en) * | 2016-09-27 | 2017-01-18 | 北京乐景科技有限公司 | Video data synchronous transmission method, device and system |
| CN106331650A (en) * | 2016-09-27 | 2017-01-11 | 北京乐景科技有限公司 | Video data transmission method and apparatus |
| CN106791902A (en) * | 2016-12-23 | 2017-05-31 | 北京多视角文化传播有限公司 | To the audio-video switching method and its cut bank of mobile internet device |
| CN106961571B (en) * | 2017-03-07 | 2020-09-04 | 深圳市广和通无线通信软件有限公司 | Method and system for simultaneously receiving multiple paths of image data |
| CN107645647A (en) * | 2017-09-21 | 2018-01-30 | 京信通信系统（中国）有限公司 | A kind of multichannel audio-video frequency transmission method and device |
| CN107888567B (en) | 2017-10-23 | 2020-08-04 | 浙江大华技术股份有限公司 | Method and device for transmitting composite multimedia signal |
| CN109922330B (en) * | 2017-12-13 | 2021-11-16 | 北京传送科技有限公司 | Data sending method, data receiving method and device |
| CN109618110A (en) * | 2018-12-24 | 2019-04-12 | 大陆汽车车身电子系统（芜湖）有限公司 | Multi-channel video Transmission system |
| CN111372035A (en) * | 2018-12-25 | 2020-07-03 | 杭州海康威视数字技术股份有限公司 | Multimedia data processing method and device, electronic equipment and readable storage medium |
| CN110049341B (en) * | 2019-03-08 | 2022-02-18 | 视联动力信息技术股份有限公司 | Video processing method and device |
| CN110349584A (en) * | 2019-07-31 | 2019-10-18 | 北京声智科技有限公司 | A kind of audio data transmission method, device and speech recognition system |
| WO2021232376A1 (en) * | 2020-05-21 | 2021-11-25 | 华为技术有限公司 | Audio data transmission method, and related device |
| CN111698386B (en) * | 2020-05-26 | 2021-07-09 | 中国科学院上海微系统与信息技术研究所 | Multi-channel image data synchronous transmitting device, receiving device and transmission system |
| CN112383701A (en) * | 2020-10-14 | 2021-02-19 | 深圳海翼智新科技有限公司 | Control method and system for image acquisition equipment and hardware controller |
| CN112492348A (en) * | 2020-10-20 | 2021-03-12 | 广州视源电子科技股份有限公司 | Multi-code stream processing and output method, equipment and storage medium |
| CN114520925A (en) * | 2020-11-19 | 2022-05-20 | 西安诺瓦星云科技股份有限公司 | Video stream processing method, device, system and cloud server system |
| CN112839240B (en) * | 2020-12-31 | 2022-03-22 | 福州大学 | A method and system for bandwidth detection based on video stream |
| CN113068008B (en) * | 2021-03-24 | 2022-09-27 | 苏州科达科技股份有限公司 | Decoding method, encoding method, code stream transmission method, electronic equipment and system |
| CN113840166A (en) * | 2021-08-31 | 2021-12-24 | 南京巨鲨显示科技有限公司 | A method and system for mixing and synchronizing multi-channel streaming media audio and video |
| CN114222166B (en) * | 2021-09-29 | 2024-02-13 | 重庆创通联达智能技术有限公司 | Multi-channel video code stream real-time processing and on-screen playing method and related system |
| CN115802074B (en) * | 2022-11-10 | 2024-03-29 | 中国联合网络通信集团有限公司 | A multi-channel video transmission method, device, equipment and medium |
| CN116886912B (en) * | 2022-12-06 | 2024-02-13 | 广州开得联软件技术有限公司 | Multipath video coding method, device, equipment and storage medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006067124A (en) * | 2004-08-25 | 2006-03-09 | Nec Corp | Method and device for switching image encoded data, system, and program |
| CN100496129C (en) * | 2007-06-05 | 2009-06-03 | 南京大学 | H.264-based multi-channel video transcoding and multiplexing method |
| CN201226562Y (en) * | 2008-03-27 | 2009-04-22 | 北京汉邦高科数字技术有限公司 | Multipath video playback apparatus for embedded digital picture-recording equipment |
| KR20100121384A (en) * | 2009-05-08 | 2010-11-17 | 삼성전자주식회사 | System and method for providing service related to telephone to a plurality of devices using upnp in the home network |
| CN101662637A (en) * | 2009-09-25 | 2010-03-03 | 深圳创维数字技术股份有限公司 | Method for playing all packaged programs in transmission code stream and set-top box |
| CN101977305A (en) * | 2010-10-27 | 2011-02-16 | 北京中星微电子有限公司 | Video processing method, device and system |
-
2011
- 2011-07-18 WO PCT/CN2011/077259 patent/WO2012106898A1/en active Application Filing
- 2011-07-18 CN CN201180001226.8A patent/CN102301730B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN102301730A (en) | 2011-12-28 |
| WO2012106898A1 (en) | 2012-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102301730B (en) | Method, device and system for transmitting and processing multichannel AV | |
| CN1157069C (en) | Video decoding device for synchronously decoding and displaying in units of pictures | |
| JPH09139937A (en) | Video stream converter | |
| CN1179870A (en) | Method and device for encoding, transferring and decoding non-PCM bitstream between digital versatile disc device and multi-channel reproduction apparatus | |
| CN100433173C (en) | After-recording apparatus | |
| CN102801979A (en) | Multi-channel video hybrid coding method and device | |
| CN102364945A (en) | Multi-picture image decoding display method and video monitoring terminal | |
| CN106603564A (en) | Unlimited high-resolution image and video playing methods and systems | |
| CN112788431A (en) | Video playing method, device, system, medium and browser based on HTML5 | |
| CN108322811A (en) | A kind of synchronous method in piano video teaching and system | |
| CN103475900A (en) | Method and device for packaging mobile phone television service video frame and front-end system | |
| CN109040818B (en) | Audio and video synchronization method, storage medium, electronic equipment and system during live broadcasting | |
| CN108122558A (en) | A kind of LATM AAC audio streams turn appearance implementation method and device in real time | |
| KR101595136B1 (en) | Transporting vibrokinetic signals in a digital cinema environment | |
| CN101951507A (en) | Large screen IP (Internet Protocol) video stream access equipment and implementation method thereof | |
| CN114363648A (en) | Method, equipment and storage medium for audio and video alignment in mixed flow process of live broadcast system | |
| CN111372035A (en) | Multimedia data processing method and device, electronic equipment and readable storage medium | |
| CN1848939B (en) | Information management system, information management apparatus and information management method | |
| CN104902192A (en) | Transmission method and equipment for multipath signals | |
| CN113055680A (en) | Distributed transcoding method | |
| CN1829324A (en) | Signal processing device and stream processing method | |
| CN101202876A (en) | Method for implementing synchronization of audio and picture by using audio frequency and video frequency composite channel in DVR | |
| JP3589913B2 (en) | Digital signal receiving device, digital signal processing device, and program recording medium | |
| JP2001045060A (en) | Signal processor, transmission method, transmission medium and method for managing data stream | |
| JPH1166754A (en) | Multi-channel data recording medium and transmission recording and reproducing apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |