CN104768026A - Multi-channel audio and video transcoding device - Google Patents
Multi-channel audio and video transcoding device Download PDFInfo
- Publication number
- CN104768026A CN104768026A CN201510183900.9A CN201510183900A CN104768026A CN 104768026 A CN104768026 A CN 104768026A CN 201510183900 A CN201510183900 A CN 201510183900A CN 104768026 A CN104768026 A CN 104768026A
- Authority
- CN
- China
- Prior art keywords
- module
- information
- audio
- video
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003908 quality control method Methods 0.000 claims abstract description 49
- 230000005540 biological transmission Effects 0.000 claims abstract description 34
- 238000000034 method Methods 0.000 claims description 46
- 230000008569 process Effects 0.000 claims description 36
- 230000000694 effects Effects 0.000 claims description 23
- 238000003860 storage Methods 0.000 claims description 22
- 238000004458 analytical method Methods 0.000 claims description 18
- 230000008447 perception Effects 0.000 claims description 18
- 210000001503 joint Anatomy 0.000 claims description 4
- 238000004088 simulation Methods 0.000 claims description 4
- 238000013519 translation Methods 0.000 claims description 4
- 238000007726 management method Methods 0.000 description 59
- 230000000875 corresponding effect Effects 0.000 description 37
- 230000006870 function Effects 0.000 description 29
- 238000012546 transfer Methods 0.000 description 17
- 238000006243 chemical reaction Methods 0.000 description 13
- 230000011664 signaling Effects 0.000 description 12
- 238000005538 encapsulation Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 10
- 230000003750 conditioning effect Effects 0.000 description 10
- 230000010354 integration Effects 0.000 description 10
- 238000004364 calculation method Methods 0.000 description 8
- 238000012827 research and development Methods 0.000 description 7
- 230000001276 controlling effect Effects 0.000 description 6
- 238000000605 extraction Methods 0.000 description 6
- 230000007704 transition Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000002596 correlated effect Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 208000019901 Anxiety disease Diseases 0.000 description 1
- 241001074085 Scophthalmus aquosus Species 0.000 description 1
- 238000012896 Statistical algorithm Methods 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000003466 anti-cipated effect Effects 0.000 description 1
- 230000036506 anxiety Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000000275 quality assurance Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 239000012536 storage buffer Substances 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000005641 tunneling Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a multi-channel audio and video transcoding device. The multi-channel audio and video transcoding device is characterized in that a foreground webpage setting module receives operation initialization configuration instructions and transcoding related instructions; a management configuration module generates decoding instructions or encoding instructions according to the received initialization configuration instructions and transcoding related instructions; quality adjustment instructions transmitted by an audio and video quality control module are received; an audio and video decoding module receives the decoding instructions and audio and video data for decoding; decoding quality information is collected; the audio and video encoding module receives the encoding instructions and decoding data for encoding; encoding complexity and encoder resource consumption information is collected; the audio and video quality control module generates audio and video quality adjustment instructions and transmits the audio and video quality adjustment instructions to the management configuration module according to received network transmission quality perceiving information, the decoding quality information and the encoding complexity and encoder resource consumption information. By the adoption of the transcoding device, many-to-many transcoding can be achieved, and quality control can be performed on input audio and video information.
Description
Technical field
The present invention relates to audio/video communication field, particularly a kind of multichannel audio frequency and video transcoding device.
Background technology
Along with the fast development of Internet network, multimedia communication service has occupied very consequence in daily life and work, and along with the progressively expansion of network size, the quality requirement of user to audio/video communication business also greatly improves.At present, the transcoding mode for audio/video communication system and video monitoring system middle pitch video communication service can be divided into two large classes, and a class is direct encapsulation transition mode; One class is attached most importance to new explanation/code conversion mode.Producer's brand of the terminal of existing outside audio frequency and video source device is a lot, and there is the terminal equipment with producer's different model; The terminal of existing most of outside audio frequency and video source device all adopts video encoding standard H.264 to carry out Image Coding, but some old-fashioned outside audio frequency and video source device only supports H.263 standard or other old-fashioned audio/video encoding standard, and therefore various video coding standard will exist over a period to come simultaneously.In addition, each producer has Different Strategies when processing image I frame, P frame and B frame, under normal circumstances, the terminal of outside audio frequency and video source device can be encoded the video code flow of output two different images quality simultaneously, so need to be decoded by the function call of distinct methods in decoding end.Therefore, when when needing the transcoding carrying out multi-to-multi, at present in disclosed transcoding technology scheme, all by the stacking realization of multiple stage transcoding device according to specific demand mostly, wherein, every platform equipment all needs specific setting or research and development, and the R&D cycle will be caused so long, high cost, disposes the problems such as complicated.And on transcoded quality, all mostly carry out after independence decodes for the terminal of different outside audio frequency and video source devices, require that coding exports satisfactory code stream according to the code capacity collection of recipient again, which only requires to carry out audio-visual quality relevant treatment for output information, and the network transmission quality state between the terminal not considering outside audio frequency and video source device, and the integration capability such as the encoding and decoding resource use of transcoder, namely the audio/video information of existing multi-to-multi transcoding mode to input can not carry out the quality control of the overall situation, can not the coding requirement of terminal of the outside audio frequency and video source device of dynamic conditioning, be difficult to the practical application request meeting high-performance real-time transcoding.
Summary of the invention
Embodiments provide a kind of multichannel audio frequency and video transcoding device, without the need to arranging multiple stage transcoding device, there will not be the R&D cycle long, high cost, dispose the problems such as complicated, network transmission quality state between the terminal that simultaneously take into account outside audio frequency and video source device when transcoding, and the integration capability such as the encoding and decoding resource use of transcoder, the quality control of the overall situation can be carried out to the audio/video information of input, can the transcoding requirement of terminal of the outside audio frequency and video source device of dynamic conditioning, meet the practical application request of high-performance real-time transcoding, this multichannel audio frequency and video transcoding device comprises: foreground Web page arranges module, management configuration module, audio/video decoding module, audio/video coding module and audio-visual quality control module,
Described foreground Web page arranges module, for providing management and control service interface, and receives the operation initial configuration command information and transcoding relevant command information that user inputted by management and control service interface, and is sent to management configuration module;
Described management configuration module, for receiving described foreground Web page, the operation initial configuration command information and transcoding relevant command information that module sends is set, corresponding decodes commands information and coded command information is generated according to operation initial configuration command information and transcoding relevant command information, receive the audio-visual quality adjustment order that audio-visual quality control module sends, generate corresponding decodes commands information or coded command information according to audio-visual quality adjustment order; And decodes commands information is sent to audio/video decoding module, coded command information is sent to audio/video coding module;
Described audio/video decoding module, for receiving the decodes commands information that described management configuration module is sent, with the audio, video data that external source device sends, carry out the decoding process of audio, video data, and decoded data is sent to audio/video coding module or ext nal network element; Collect decoding quality information, and be sent to audio-visual quality control module;
Described audio/video coding module, for receiving the coded command information that described management configuration module is sent, and the decoded data that described audio/video decoding module sends, carry out the coded treatment of audio, video data, coded message is sent to corresponding ext nal network element; Collect encoder complexity and coder resource consumption information, and be sent to audio-visual quality control module;
Described audio-visual quality control module, for receiving network transmission quality perception information, the encoder complexity of the decoding quality information that described audio/video decoding module sends and the transmission of described audio/video coding module and coder resource consumption information, generate corresponding audio-visual quality adjustment order according to network transmission quality perception information, decoding quality information and coding quality information, and be sent to management configuration module.
In one embodiment, described operation initial configuration command information comprises: the unique identification GUID of the external source device list of required service, external source device, the information importance hierarchical definition of external source device, producer OCX ID definition, channel label, transcoding capabilities collection scope, the definition of external transcoding type, the definition of terminal initial data, the definition of access network primary data, control information, transcoding require one of them or multiple.
In one embodiment, described transcoding relevant command information comprises unique identification GUID and the definition of external transcoding type of external source device.
In one embodiment, described decoding quality information to comprise in code stream frame bandwidth statistics, code stream information source company-information, code stream image dimension information, code stream frame rate information, code stream whether judging that information, present frame first P frame judges information containing image B frame information, present frame I frame, macro block traversal range information with decode complexity information one of them or multiple.
In one embodiment, described encoder complexity and coder resource consumption information comprise coding host processor resources occupation proportion, the single-level memory resource occupation ratio of coding primary processor, the second-level storage resource occupation ratio of coding primary processor, encoding stream export in occupied bandwidth statistics, encoding stream image dimension information, encoding stream frame per second information, encoding stream whether contain image B frame information, coding complexity information one of them or multiple.
In one embodiment, described management configuration module comprises decoding capability collection control module, channel management module, decoding or code capacity administration module, code capacity collection control module;
Described decoding capability collection control module, for carrying out decoding link setup and source coding work; Decoding activities mission requirements just at the decoding activities mission requirements of the decode channel of all channels of run mode, and is sent to audio/video decoding module by process;
Described channel management module, arranges the operation initial configuration command information of module transmission for integrating and store described foreground Web page; The transcoding phase command information of module transmission is set according to described foreground Web page, improves transcoding channel command, transcoding channel command is sent to relative decoding capability set control module;
Described decoding or code capacity administration module, for the treatment of coding or decoding capability multidate information record just at all channels of run mode;
Described code capacity collection control module, for the source coding data of receipt decoding capability set control module, coded command information just in the coded command information of the encoding channel of all channels of run mode, and is sent to audio/video coding module by process.
In one embodiment, described audio/video decoding module comprises special decoding configuration module, returns control information collection module, starts decoder module, decoded state information summarizing module, encoder to connection module and video wall output module;
Described special decoding configuration module, for the treatment of the decodes commands information that management configuration module is sent, and distributes corresponding decode channel detail, and enables corresponding producer OCX decoder module;
Described time control information collection module, create for returning control information instancesization, dynamic collection audio-visual quality returns control information;
Described startup decoder module, for the real-time decoding of the foundation of decode channel, the reception of audio frequency and video Channel message and audio frequency and video message;
Described decoded state information summarizing module, for carrying out back gathering of control information, reports audio-visual quality control module by summary information;
Described encoder is to connection module, and for when transcoding type is flow forwarding mode, initiatively link setup audio/video coding module, carries out the activity of transcoding information butt joint;
Described video wall output module, for according to the requirement of output simulation mouth, sends into display translation port by decoded data.
In one embodiment, described audio/video coding module comprises coding parameter configuration receiver module, sets up encoding target numbering module, correlative coding container module, encoding state information summarizing module, stream memory module and flow forwarding module;
Described coding parameter configuration receiver module, for setting up encoding channel list;
Describedly set up encoding target numbering module, for recognition coding parameter request, enable correlative coding object instance;
Described correlative coding container module, for receiving the audio frequency and video message data corresponding to be encoded that audio/video decoding module is sent, and carries out transcoding message data coding according to the coding negotiation parameter of coding parameter configuration required by receiver module;
Described encoding state information summarizing module, for supervising and record coding state information, gathering encoding state information, and summary information is reported audio-visual quality control module;
Described stream memory module, for storing message after coding;
Described flow forwarding module, the stream distributing data for stream memory module being stored carries out stream information and forwards output.
In one embodiment, described audio-visual quality control module comprises information storage module, analyzes judge module, notification module, startup configuration module and expiry notification module;
Described information storage module, for storing summary information, and is sent to analysis judge module by summary information;
Described analysis judge module, unlocks for internal signal amount, carries out summary information analysis in real time and obtains corresponding audio-visual quality adjustment order, and corresponding audio-visual quality adjustment order is sent to notification module;
Described notification module, for receiving the corresponding audio-visual quality adjustment order that described analysis judge module sends, and is sent to startup configuration module by corresponding audio-visual quality adjustment order;
Described startup configuration module, for being sent to management configuration module by corresponding audio-visual quality adjustment order;
Described expiry notification module, for according to management configuration module order request, deal with data stores return-to-zero.
In embodiments of the present invention, a kind of multichannel audio frequency and video transcoding device and method are proposed, wherein, multichannel audio frequency and video transcoding device comprises foreground Web page and arranges module, management configuration module, audio/video decoding module, audio/video coding module and audio-visual quality control module, adopt apparatus of the present invention just can carry out multipair multimode audio frequency and video transcoding, do not need to realize by multiple stage transcoding device is stacking, avoid occurring that the R&D cycle is long, high cost, disposes the problems such as complicated; Simultaneously, have employed audio-visual quality control module, make when carrying out audio frequency and video transcoding, Internet Transmission state between the terminal can considering outside audio frequency and video source device, and the integration capability such as the encoding and decoding resource use of transcoder, the quality control of the overall situation can be carried out to the audio/video information of input, can the coding requirement of terminal of the outside audio frequency and video source device of dynamic conditioning, meet the practical application request of high-performance real-time transcoding.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, forms a application's part, does not form limitation of the invention.In the accompanying drawings:
Fig. 1 is a kind of multichannel audio frequency and video transcoding device networking schematic diagram that the embodiment of the present invention provides;
Fig. 2 is the structural representation of a kind of multichannel audio frequency and video transcoding device module that the embodiment of the present invention provides;
Fig. 3 is a kind of multichannel audio frequency and video transcoding device state transition graph that the embodiment of the present invention provides;
Fig. 4 is the specific works flow process figure of the analysis judge module in a kind of audio-visual quality control module of providing of the embodiment of the present invention.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly understand, below in conjunction with execution mode and accompanying drawing, the present invention is described in further details.At this, exemplary embodiment of the present invention and illustrating for explaining the present invention, but not as a limitation of the invention.
In the transcoding technology scheme of existing multi-to-multi, be all according to specific demand by the stacking realization of multiple stage transcoding device mostly, wherein, every platform equipment all needs specific setting or research and development, like this R&D cycle will be caused long, high cost, dispose the problems such as complicated; And, network transmission quality state between the terminal not considering outside audio frequency and video source device, and the integration capability such as the encoding and decoding resource use of transcoder, the quality data collection of the overall situation, analysis can not be carried out, and then the terminal coding requirement of the outside audio frequency and video source device of dynamic conditioning, be difficult to the practical application request meeting high-performance real-time transcoding.If design a kind of multi-to-multi transcoding device, multiple transcoding channel is set wherein to complete the transcoding of multi-to-multi, and does not need to complete by multiple stage transcoding device is stacking; Meanwhile, the Internet Transmission state between the terminal that take into account outside audio frequency and video source device, and the integration capability such as the encoding and decoding resource use of transcoder, just can solve problems of the prior art.Based on this, the present invention proposes a kind of multichannel audio frequency and video transcoding device.
Fig. 1 is multichannel audio frequency and video transcoding device networking schematic diagram of the present invention.As shown in Figure 1, described multichannel audio frequency and video transcoding device and correlated source equipment, sink device of being correlated with comprise outside audio frequency and video source device 11, multichannel audio frequency and video transcoding device 12, ext nal network element 13.
Wherein, outside audio frequency and video source device 11 (being called for short external source device) comprising: audio frequency and video source device and the IP network 115 such as IP Camera IPC111, DVR DVR112, alarm host machine 113, general audio-video signal camera 114 of each producer.Outside audio frequency and video source device all by the unified access of IP network 115 multichannel audio frequency and video transcoding device of the present invention, and as the information source data input device of audio, video data message of the present invention.
Ext nal network element 13 comprises: video wall 131, streaming server
1132, streaming server
n133 grades export receiving equipment and IP network 134.All ext nal network element all can be unified to access multichannel audio frequency and video transcoding device of the present invention, and as the stay of two nights data output apparatus of audio, video data message of the present invention.
Be described in detail to the bite rate control of each several part and audio/video information transcoding transfer process below.
Fig. 2 is the structural representation of multichannel audio frequency and video transcoding device of the present invention, comprises outside audio frequency and video source device 21 (being called for short external source device) in the figure, multichannel audio frequency and video transcoding device 20, and ext nal network element 22.
Wherein, outside audio frequency and video source device 21 comprises the audio frequency and video message sink coding equipment of all kinds of producer, by the IP network access multichannel audio frequency and video transcoding device 20 of zones of different.When needs audio/video information transcoding, multichannel audio frequency and video transcoding device 20, meeting active according to initial network parameter and coding/decoding negotiation parameter, carries out the foundation of audio-video code stream channel with outside audio frequency and video source device 21.And according to the dynamic audio-visual quality adjustment demand that multichannel audio frequency and video transcoding device 20 is made, by initial information source producer configured list information, send corresponding audio-visual quality and consult adjustment order to outside audio frequency and video source device 21.
Wherein, ext nal network element 22 comprises video wall display system or the image stitcher of all kinds of producer, or normal stream publishing point equipment.Ext nal network element 22 can pass through physics display interface, or the IP network of zones of different, access multichannel audio frequency and video transcoding device 20.When needs audio/video information is transcoded onto video wall display system or image stitcher, multichannel audio frequency and video transcoding device 20 can according to interface standards mandate, directly from the decoder module multichannel audio frequency and video transcoding device 20, direct output image display information shows to the display physical interface of ext nal network element 22.When needs audio/video information is transcoded onto normal stream publishing point equipment, multichannel audio frequency and video transcoding device 20 can issue requirement according to normal stream, directly from the coding module multichannel audio frequency and video transcoding device 20, output image coding message carries out the transmission of audio/video coding information to the normal stream publishing point equipment of ext nal network element 22.
Wherein, multichannel audio frequency and video transcoding device 20 comprises as lower module: foreground Web communication control module 201, management configuration module 200, audio/video decoding module 202, audio-visual quality control module 203, audio/video coding module 204.
Foreground Web communication control module 201, for providing management and control service interface, and receives the operation initial configuration command information and transcoding relevant command information that user inputted by management and control service interface, and is sent to management configuration module 200.
Management configuration module 200, for receiving foreground Web page, the operation initial configuration command information and transcoding relevant command information that module 201 sends is set, corresponding decoding activities mission requirements and encoding activities mission requirements is generated according to operation initial configuration command information and transcoding relevant command information, and decoding activities mission requirements is sent to audio/video decoding module, encoding activities mission requirements is sent to audio/video coding module; Receive the audio-visual quality adjustment order that audio-visual quality control module sends, generate corresponding decodes commands information or coded command information according to audio-visual quality adjustment order.
Audio/video decoding module 202, for the decodes commands information that receiving management configuration module 200 is sent, with the audio, video data that external source device sends, carry out the decoding process of audio, video data, and decoded data is sent to audio/video coding module 204 or ext nal network element 22; Collect decoding quality information, and be sent to audio-visual quality control module 203.
Audio/video coding module 204, for receiving the transcoding task that described management configuration module 200 is sent, and the decoded data that described audio/video decoding module 202 sends, carry out the coded treatment of audio, video data, coded message is sent to corresponding ext nal network element; Collect encoder complexity and coder resource consumption information, and be sent to audio-visual quality control module 203.
Audio-visual quality control module 203, for receiving network transmission quality perception information, the encoder complexity of the decoding quality information that described audio/video decoding module 202 sends and the transmission of described audio/video coding module 204 and coder resource consumption information, generate corresponding audio-visual quality adjustment order according to network transmission quality perception information, decoding quality information and encoder complexity and coder resource consumption information, and be sent to management configuration module 200.
In the present invention, signalling path data format between each functional module adopts XML (eXtensible MarkupLanguage, extend markup language) language realization, XML language has the specialty characteristicses such as exploitation is simple and easy, standard universal, all the time by the extensive use of compunication industry, it is also the most effective data representation means in Generation Internet simultaneously.So, by XML language being introduced in the middle of each module signalling interworking mechanism of the present invention, can numerous for producer's brand, production year is for the terminal of different outside audio frequency and video source devices, by the support added XML unified at signaling interface place, can specification and unified numerous off-gauge privately owned signaling, and then allow multichannel audio frequency and video transcoding device of the present invention realize the terminal interface order by each outside audio frequency and video source device and the signaling adaptation based on the unified message form of XML, thus it is mutual to achieve at the communications signaling protocols analyzing the unified XML format between each functional module in the middle of multichannel audio frequency and video transcoding device based on Information Statistics, like this by the function expansibility of resolution system to a great extent, and it is compatible to the exploitation of the terminal of the outside audio frequency and video source device of different manufacturers.
In the present invention, the data encapsulation of carrying out XML universal standard signaling has; Arrange in module in foreground Web page, need the data encapsulation of operation initial configuration command information and transcoding relevant command information being carried out XML universal standard signaling; In management configuration module, need the data encapsulation of decodes commands information or coded command information being carried out XML universal standard signaling; In audio/video decoding module, need the data encapsulation of decoded data and decoding quality information being carried out XML universal standard signaling; In audio/video coding module, need the data encapsulation of encoder complexity and coder resource consumption information being carried out XML universal standard signaling; In audio-visual quality control module, need the data encapsulation of audio-visual quality adjustment order being carried out XML universal standard signaling.
During concrete enforcement, the method using multichannel audio frequency and video transcoding device of the present invention to carry out multichannel audio frequency and video transcoding comprises two kinds of situations: the first: when not considering encoding and decoding quality planning and encoding and decoding Mass adjust-ment, the method using multichannel audio frequency and video transcoding device of the present invention to carry out multichannel audio frequency and video transcoding comprises:
Module is set by foreground Web page management and control service interface is provided, and receive the operation initial configuration command information and transcoding relevant command information that user inputted by management and control service interface, and be sent to management configuration module;
Receive described foreground Web page by management configuration module and the operation initial configuration command information and transcoding relevant command information that module sends is set, corresponding decodes commands information and coded command information is generated according to operation initial configuration command information and transcoding relevant command information, and decodes commands information is sent to audio/video decoding module, coded command information is sent to audio/video coding module;
The decodes commands information that described management configuration module sends is received by audio/video decoding module, the decoding OCX engine of corresponding external source device is loaded according to decodes commands information, obtain the audio, video data that external source device sends, carry out the decoding process of audio, video data, and decoded data is sent to audio/video coding module or ext nal network element;
Receive by audio/video coding module the coded command information that described management configuration module sends and (list of outside stay of two nights end points can be comprised, each passage transcoding configuration management requirement, the information such as coding pass consultation parameter requirement), carry out coding plug-in unit example respectively for each transcoding passage to create in good time, coding output channel is set up, when after the decoded data receiving the transmission of audio/video decoding module, the establishment carrying out passage middle pitch video protocols is required according to coding pipeline consultation parameter, intercommunication or directed storage, carry out the coded treatment of audio, video data, coded message is sent to corresponding ext nal network element.
The second: when needs consider encoding and decoding quality planning and encoding and decoding Mass adjust-ment, also need to comprise in this multi-channel video code-transferring method:
In decode procedure, by audio/video decoding module collection decoding quality information, and be sent to audio-visual quality control module;
In an encoding process, received by audio/video coding module and collect encoder complexity and coder resource consumption information, and be sent to audio-visual quality control module;
Network transmission quality perception information is received by audio-visual quality control module, the encoder complexity of the decoding quality information that audio/video decoding module sends and the transmission of audio/video coding module and coder resource consumption information, (coding quality of outside audio frequency and video source device consults requirement to generate corresponding audio-visual quality adjustment order according to network transmission quality perception information, decoding quality information and encoder complexity and coder resource consumption information, and coding output quality is consulted to require), and be sent to management configuration module;
The audio-visual quality adjustment order of audio-visual quality control module transmission is received by management configuration module, corresponding decodes commands information or coded command information is generated according to audio-visual quality adjustment order, decodes commands information with Mass adjust-ment is sent to audio/video decoding module, the coded command information with Mass adjust-ment is sent to audio/video coding module.Meanwhile, need, according to the current set threshold decision in apparatus of the present invention, start or adjust each encoding and decoding associated components detailed process parameter, realizing the functional objective of multichannel audio frequency and video high-quality conversion.
Audio-visual quality information is being carried out in omnibearing statistical analysis process, not only current network transmission quality perception information, decoding quality information and encoder complexity and the coder resource consumption information of receiving is made and laterally cut decision-making judgement, but also longitudinal direction brill decision-making judgement is carried out to the data in a period of time, avoid the Mass adjust-ment decision-making erroneous judgement because network burst mass defect causes.In addition, after sending necessary controlling of quality order to management configuration module, also need the I frame carrying out decode channel quality information to start to differentiate, and during this period, in a period of time that careful controlling of quality order sends as far as possible, make other controlling of quality decision-making too continually.By actual environment application note, by above method, adapted to the network adaptability of dynamic conditioning audio-visual quality to a great extent, and the too high audio-visual quality that causes of the frequency that largely avoided controlling of quality order is repaired curve and can not be restrained and problem that audio-visual quality is dispersed.
Below each module in multichannel audio frequency and video transcoding device 20 is described in detail.
Management configuration module 200 is specifically described.
Management configuration module 200 comprises submodule: decoding capability collection control module 2001, channel management module 2002, solution/code capacity administration module 2003, code capacity collection control module 2004.
Decoding capability collection control module 2001 has two major functions, first function is specifically decode link setup and source coding work, if be indicated as being the stream way of output in transcoding type definition, then issue correlative coding capability set control module 2004 simultaneously and start specific coding pipeline, and the source coding data of wait-receiving mode decoding capability collection control module 2001.Second function is responsible for process to be just issued to audio/video decoding module 202 in the concrete decoding activities task of the decode channel of all channels of run mode.
The function of described channel management module 2002 is responsible for process to run initial configuration order, command context integrated, and stored by MAP mode, so that later stage traversal is searched.And according to the unique identification GUID of source device in order and the definition of external transcoding type, improve transcoding channel command, send relative decoding capability set control module 2001.
The function of described solution or code capacity administration module 2003 is fast data store query facilities of management configuration module 200, and responsible process is just at the coding/decoding ability dynamically recording of all channels of run mode.
The function of described code capacity collection control module 2004 is responsible for process just in the specific coding active task of the encoding channel of all channels of run mode, and be issued to audio/video coding module 204.
Below audio/video decoding module 202 is specifically described.
Audio/video decoding module 202 comprises submodule: special decoding configuration module 2021, return control information collection module 2022, start that decoder module 2023, decoded state information gather 2024, encoder is to connection module 2025, video wall output module 2026.
The function of described special decoding configuration module 2021 is responsible for the concrete decodes commands information (i.e. decoding task Operations Requirements) processing management configuration module 200 and send, and carry out the transcoding channel detail (decode channel is detailed) of distributing correspondence, and enable corresponding producer OCX decoder module.
The function of described time control information collection module 2022 is responsible for back control information instancesization to create, and prepares dynamic collection audio-visual quality and return control information.
The function of described startup decoder module 2023 is the foundation of responsible decode channel, the reception of audio frequency and video Channel message, the real-time decoding of audio frequency and video message.
The function of described decoded state information summarizing module 2024 is responsible for carrying out back gathering of control information, and timing 1 second summary information (decoding quality information) is reported audio-visual quality control module 203.
The function of described encoder to connection module 2025 is responsible for when flow forwarding mode, and initiatively link setup audio/video coding module 204, carries out the activity of transcoding information butt joint.
The function of described video wall output module 2026 is responsible for, according to the requirement of output simulation mouth, showing data (decoded data) and sending into various types of display translation port.
During concrete enforcement, the decoding quality information gathered can be the following information: whether judge that the first P frame of information, present frame judges information, macro block traversal range information and decoding complexity information etc. containing image B frame information, present frame I frame in code stream frame bandwidth statistics, code stream information source company-information, code stream image dimension information, code stream frame rate information, code stream.
Below audio-visual quality control module 203 is specifically described.
Audio-visual quality control module 203 comprises submodule: information storage module 2031, analysis judge module 2032, notification module 2033, startup configuration module 2034, expiry notification module 2035.
The function of described information storage module 2031 is responsible for carrying out the summary information storage of MAP form, carries out summary information analysis use for analysis judge module 2032.
The function of described analysis judge module 2032 is that responsible internal signal amount unlocks, and carries out summary information analysis in real time.
The function of described notification module 2033 is responsible for corresponding adjustment decision-making being carried out in good time being sent to start configuration module 2034.
The function of described startup configuration module 2034 is responsible for relevant audio-visual quality adjustment order to be sent to management configuration module 200
The function of described expiry notification module 2035 is responsible for according to management configuration module 200 order request, and deal with data stores return-to-zero, so that the next transcoding cycle normally carries out.
Below audio/video coding module 204 is specifically described.
In addition to functions described above, audio/video coding module 204 also comprises following function: the link command that need issue according to management configuration module, and process coding pipeline Link State, carry out the activity of link re-establishment chain, and link tears chain activity open in good time.
During concrete enforcement, audio/video coding module 204 comprises submodule: coding parameter configuration receiver module 2041, set up encoding target numbering module 2042, correlative coding container module 2043, encoding state information summarizing module 2044, flow memory module 2045, flow forwarding module 2046.
The function of described coding parameter configuration receiver module 2041 is responsible for setting up transcoding channel list (encoding channel list), then enable correlative coding object instance by setting up encoding target numbering module 2042.
The described function setting up encoding target numbering module 2042 is responsible recognition coding parameter request, enables correlative coding object instance.
The function of described correlative coding container module 2043 is responsible for receiving audio/video decoding module 202 to send corresponding audio frequency and video message data (decoded data) to be encoded, and carry out transcoding message data coding according to the coding negotiation parameter of coding parameter configuration required by receiver module 2041.
The function of described encoding state information summarizing module 2044 is responsible for supervising in real time and record coding state information, and will record summary information (encoder complexity and coder resource consumption information) and be sent to audio-visual quality control module 203.
The function of described stream memory module 2045 is responsible for message after coding to store, and carries out stream information forward output for flow forwarding module 2046.
The function of described flow forwarding module 2046 is responsible for that the stream distributing data that stream memory module 2045 stores is carried out stream information to forward output.
During concrete enforcement, the encoder complexity gathered and coder resource consumption information can be the following information: whether the single-level memory resource occupation ratio of coding host processor resources occupation proportion, coding primary processor, the second-level storage resource occupation ratio of coding primary processor, encoding stream export in occupied bandwidth statistics, encoding stream image dimension information, encoding stream frame per second information, encoding stream containing image B frame information, coding complexity information etc.
Lower mask body introduction carries out the detailed process of audio frequency and video transcoding by multichannel audio frequency and video transcoding device of the present invention.
Foreground Web communication control module 201 sends 2 large class orders to management configuration module 200: run initial configuration order, transcoding related command.
Wherein, run the concrete numerical value content of initial configuration order to comprise: the unique identification GUID of the external source device list of required service, external source device, the information importance hierarchical definition of external source device, producer OCX ID definition, the definition of channel label, capability set scope, external transcoding type, the definition of terminal initial data, the definition of access network primary data, control information, transcoding requirement.
Transcoding related command is that transcoding starts, transcoding terminates.Specific instructions numerical value content comprises: the unique identification GUID of source device, external transcoding type define.
When management configuration module 200 receives the operation initial configuration command information and transcoding relevant command information that foreground Web communication control module 201 sends, carry out associative operation by for the different content running initial configuration command information and transcoding relevant command information.Initial configuration command context, when processing operation initial configuration order, is integrated, and is stored by MAP mode by the channel management module 2002 in management configuration module 200, so that later stage traversal is searched.Channel management module 2002 is when processing transcoding related command, then according to unique identification GUID and the definition of external transcoding type of the source device in transcoding related command, improve transcoding channel command, be issued to relative decoding capability set control module 2001 specifically to decode link setup and source coding work, if be indicated as being the stream way of output in transcoding type definition, then transcoding channel command is issued to correlative coding capability set control module 2004 simultaneously and starts specific coding channel, and the source coding data of wait-receiving mode decoding capability collection control module 2001.Solution in management configuration module 200/code capacity administration module 2003 is responsible for process just at the coding/decoding ability dynamically recording of all channels of run mode.Decoding capability collection control module 2001 in management configuration module 200 is responsible for process and is just issued to audio/video decoding module 202 in the concrete decoding activities task (decodes commands information) of the decode channel of all channels of run mode.Code capacity collection control module 2004 in management configuration module 200 is responsible for process and is just issued to audio/video coding module 204 in the specific coding active task (coded command information) of the encoding channel of all channels of run mode.
When audio/video decoding module 202 receives decodes commands information (the decoding task Operations Requirements) of management configuration module 200, first decodes commands is imported into special decoding configuration module 2021, distribute corresponding decode channel detailed, and prepare to enable corresponding producer OCX decoder module according to company-information.Next step will carry out back the establishment of control information instancesization by returning control information collection module 2022, prepare dynamic collection audio-visual quality and return control information.After previous work completes, by carrying out the operation of decoder module by starting decoder module 2023, comprising: the real-time decoding of the foundation of decode channel, the reception of audio frequency and video Channel message, audio frequency and video message.In the process, by the key technology data in Real-time Collection decode procedure, and key technology data are committed to decoded state information summarizing module 2024 and carry out gathering of information, and timing 1 second summary information (decoding quality information) is reported audio-visual quality control module 203.If transcoding type is flow forwarding mode, then need decoded data to be sent to encoder to connection module 2025, and by encoder to connection module 2025 initiatively link setup audio/video coding module 204, carry out the activity of transcoding information butt joint.If transcoding type is video wall, then need decoded data to be sent to video wall output module 2026, display data, according to the requirement of output simulation mouth, are sent into various types of display translation port by video wall output module 2026.In addition, in decode procedure, supervised in real time and carrying recorded decoding network state information by decoded state information summarizing module 2024, and record summary information is sent to audio-visual quality control module 203, supplied when dynamic conditioning picture quality as statistics foundation.
When audio/video coding module 204 receives the coded command information that management configuration module 200 issues, receiver module 2041 will be configured by coding parameter and set up transcoding channel list (encoding channel list), enabling correlative coding object instance by setting up encoding target numbering module 2042 again, then sending corresponding audio frequency and video message data to be encoded by correlative coding container module 2043 stand by tone Video decoding module 202.When receiving after audio/video decoding module 202 sends corresponding audio frequency and video message data to be encoded, correlative coding container module 2043 carries out transcoding message data coding work by according to the coding negotiation parameter required by coding parameter configuration receiver module 2041.Packet storage after coding result is encoded by stream memory module 2045 according to encoding target numbering module 2042 defined implementation requirements, and after being encoded by flow forwarding module 2046, message carries out forwarding output.In addition, in an encoding process, supervised in real time and record coding state information by encoding state information summarizing module 2044, and summary information (encoder complexity and coder resource consumption information) will be recorded send to audio-visual quality control module 203, supply dynamic conditioning picture quality as statistics foundation.
After audio-visual quality control module 203 receives the decoding quality information (decoding network state statistical information) and the encoder complexity sent of audio/video coding module 204 and coder resource consumption information (coded message performance takies statistics) that audio/video decoding module 202 sends, first the summary information storage of MAP form is carried out by information storage module 2031, then analyze judge module 2032 and by internal signal amount unlocking manner, summary information analysis will be carried out in real time.Summary information comprises: decoding quality information, network transmission quality perception data, encoder complexity and coder resource consumption information (transcoding device encoding and decoding performance tracking perception data), and according to exclusive modeling statistical algorithm, judge whether to need to carry out the adjustment of audio frequency and video channel quality parameter.If make corresponding adjustment decision-making, then can be informed by notification module 2033 and start configuration module 2034, relevant audio-visual quality adjustment order is sent to management configuration module 200, after management configuration module 200 receives adjustable strategies, can unifies to carry out order integration and order issues.Expiry notification module 2035 is responsible for deal with data according to management configuration module 200 order request and is stored return-to-zero, so that the next transcoding cycle normally carries out.
Fig. 3 is multichannel audio frequency and video transcoding device state transition graph of the present invention.Zero represents transcoding device state; represents transcoding device State Transferring trigger condition; ◇ represents transcoding device state adjustment threshold decision situation in this condition.
Comprise the whole show state of device at multichannel audio frequency and video transcoding device state transition graph of the present invention: idle waiting task 301, transcoding unified management 302, audio frequency and video transcoding 303, transcoding export 304, network quality information collects storage 305, encoder performance information stores 306, in real time transfer capability gather and analyzes 307, dynamically audio-visual quality adjust 308.
Comprise State Transferring trigger condition at multichannel audio frequency and video transcoding device state transition graph of the present invention: receive forwarding task 310, start solutions/encoding example 311, transcoding result exports 312, network foundation information extraction 313, basis of coding information extraction 314, network quality problem data 315, coding performance problems data 316, collect information integration result of calculation 317, mass parameter adjustment result 318, need to adjust quality notification 319, transcoding task terminates 320.
Transcoding device state adjustment threshold decision situation is in this condition comprised: judge adjustment threshold value 321 at multichannel audio frequency and video transcoding device state transition graph of the present invention.
The state of multichannel audio frequency and video transcoding device of the present invention is changed from idle waiting task 301 state,
Multichannel audio frequency and video transcoding device state is in idle waiting state 301, when being submitted to by the user interface mode of web mode by multichannel audio frequency and video transcoding device controllers or multichannel audio frequency and video transcoding device controllers is met by the command condition that plan target mode is submitted to before, to meet and receive forwarding task 310 State Transferring trigger condition, now the state of multichannel audio frequency and video transcoding device transfers transcoding unified management 302 to.
Now multichannel audio frequency and video transcoding device will consult requirement according to transcoding initial configuration information and transcoding, start solution/encoding example, if separating encoding example starts successfully, then meet and start solution/encoding example 311 State Transferring trigger condition, now the state of conversion equipment transfers audio frequency and video transcoding 303 to.
Audio frequency and video transcoding 303 activity comprises audio/video decoding and audio/video coding function, this activity not only will export target difference according to transcoding, corresponding audio-video signal is sent to analog display device or to normal stream distributing device, export 312 State Transferring trigger conditions when meeting transcoding result, now the state of multichannel audio frequency and video transcoding device transfers transcoding output 304 to.
In addition, in audio frequency and video transcoding 303 activity, topmost task also needs in the middle of solution coding overall process, real-time collection decoding quality information and encoder complexity and coder resource consumption information, and when meeting network foundation information extraction 313 State Transferring trigger condition, now the state of conversion equipment transfers network quality information collection storage 305 to.And when meeting basis of coding information extraction 314 State Transferring trigger condition, now the state of conversion equipment transfers encoder performance information storage 306 to.
When network quality information collects storage 305 state, be responsible for the network quality statistical information in collection, storage certain time length, and gather as real-time transfer capability and data format desired by analyzing, make corresponding forward data and arrange, and the extraction that risk data carries out being correlated with is shown.When meeting network quality problem data 315 State Transferring trigger condition, now the state of conversion equipment transfers real-time transfer capability to and gathers and analyze 307.
When encoder performance information stores 306 state, be responsible for the encoder performance quality statistic information in collection, storage certain time length, and information format is anticipated the data format desired by gathering for real-time transfer capability and analyzing, complete corresponding forward data to arrange, and the extraction that risk data carries out being correlated with is shown.When meeting coding performance problems data 316 State Transferring trigger condition, now the state of conversion equipment can transfer real-time transfer capability too to and gathers and analyze 307.
When real-time transfer capability gathers and analyzes 307 state, will network quality information collect the movable and encoder performance information of storage 305 store 306 movablely to arrange, network quality information after the pre-process extracted and encoder performance information unification carry out transverse direction and cut data analysis and longitudinally bore data analysis, and find wherein whether have exception, when satisfied collection information integration result of calculation 317 State Transferring trigger condition, now the state of conversion equipment transfers dynamic audio-visual quality adjustment 308 to.
Adjust in 308 active states at dynamic audio-visual quality, by according to finding the collection information integration result of calculation made about network quality information and encoder performance information, carry out the mass balance point of the overall view overall situation, and make corresponding audio-visual quality dynamic optimization strategy.And make the corresponding command request report, when meeting mass parameter adjustment result 318 State Transferring trigger condition, now the state of conversion equipment transfers adjustment threshold decision situation judgement adjustment threshold value 321 to.
In judgement adjustment threshold value 321, according to the audio-visual quality dynamic adjusted threshold threshold value using customer satisfaction evaluation to collect in conversion equipment running, adjust for dynamic audio-visual quality the threshold value judgement activity that the 308 audio-visual quality dynamic optimization strategies made carry out necessary adjustment.When adjusting quality notification 319 State Transferring trigger condition when satisfying the demand, now the state of conversion equipment transfers transcoding unified management 302 to.Carry out next stage audio frequency and video conversion overall process.
In addition, when in audio frequency and video transcoding 303 activity, when judging that meeting transcoding task terminates 320 State Transferring trigger condition, now the state of conversion equipment rotates back into idle waiting task 301.System mode is zero to the free time and is in wait task translate phase.
Due to audio, video data input and with flow the way of output export all need to pass through network, can often face due to various network reason, there is the situation of network bandwidth fluctuation, if the fluctuating range of bandwidth makes the audio, video data of some transcoding channel itself cannot normal transmission, the audio-visual quality of this transcoding channel will be caused to decline, often there is choppy voice, there is stagnant stopping in video, or there is mosaic, even completely fuzzy not identifiable situation, at this time just require that multichannel audio frequency and video transcoding device of the present invention is on the basis based on Information Statistics parser, carry out image synthesis quality assurance, and corresponding controlling of quality process is made to the unusual fluctuations of the network bandwidth, above-mentioned process activity mainly needs the analysis judge module in audio-visual quality control module to process.
Fig. 4 is the specific works flow process figure of the analysis judge module in a kind of audio-visual quality control module of providing of the embodiment of the present invention.As shown in Figure 4, the data analyzing process in judge module 2032 comprise decoding quality information, encoder complexity and coder resource consumption information and network transmission quality data.The encoding and decoding resource perception assembly 400 that decoding quality information and encoder complexity and coder resource consumption information are monitored in 40 by quality state receives, and network transmission quality data (transmission of network 42 produces) monitor network quality perception component 401 perception in 40 by quality state.Then, data after perception can be input to threshold values and judge in 402 by encoding and decoding resource perception assembly 400 and network quality perception component 401, judge that 402 judge to produce judged result through threshold values, judged result is transferred to the decision controller 410 in Rate Control 41, decision controller 410 is according to the Internet Transmission control decision strategy preset, and current each transcoding channel quality condition, making a policy property of audio-video code stream input code flow is adjusted, and audio-video code stream output code flow is adjusted accordingly, adjustment information sends to stream encapsulation 411 and bit rate controller 412, to realize bandwidth self-adaption adjustment.
Concrete, threshold values judges 402 workmanship conducts: according to decoding quality information, encoder complexity and coder resource consumption information, with network transmission quality perception information, and by default audio-visual quality dynamic adjusted threshold threshold values in transcoding device of the present invention, carry out overall audio-visual quality decision-making.Concrete threshold values judges to comprise: according to the application importance index of this transcoding channel, makes quality control necessity and differentiates; According to the relation between information source end network statistics characteristic and current information source coding negotiation parameter, make coding negotiation parameter adjustment necessity and possibility differentiation; If quality is due to coding primary processor and associated storage buffer occupancy is too high causes, then can run the application importance of transcoding channel according to each self-channel at other, make and integrate quality control requirements and differentiate.
The specific works of bit rate controller 412 is the high low values according to encoder quantization parameter, carries out concrete audio/video coding work.Image Coding controls image encoded bandwidth and relationship between quality according to quantization parameter QP.Compress more severe after the larger Image Coding of QP, the overall occupied bandwidth of data volume namely after output image coding is lower, and image sharpness can reduce simultaneously.Audio coding adopts fixed-bandwidth coded system, is consulted by audio protocols capability set at present, the suitable audio protocols of switching at runtime if desired, solves audio quality and bandwidth relationship problem,
The specific works of stream encapsulation 411 is: according to the requirement of network message encapsulation format, and according to encapsulation of data protocol requirement after each own coding of audio frequency and video, is encapsulated into by coded data in the middle of RTP message, and by tunneling, indicates each RTP message attribute.
Above-mentioned all component all belongs to analyzes judge module 2032.
The process of use apparatus of the present invention dynamic conditioning audio-visual quality is: when the mass parameter associated change such as fluctuation and codec hardware inadequate resource occur to network quality bandwidth systems axiol-ogy, can according to the quality tabulate statistics data in a period of time, for user's transcoding channel application importance ranking, carry out the process reducing frame per second or adjustment image resolution ratio, meanwhile need the continuity ensureing sound.The mechanism of adjustment video frame rate change is: when detecting that the network bandwidth consults lower than transcoding device prospective quality the network bandwidth required, then video frame rate is reduced to 1/2 of original frame per second.Such as: when former setting video frame rate is 20 frames/second, systems axiol-ogy is inadequate to bandwidth, and now system can notify that corresponding audio frequency and video information source end makes video frame rate adjustment, and frame per second reduces to 10 frames/second, now as detection bandwidth is still inadequate, then continuing to reduce frame per second is 5 frames/second.When system discovery bandwidth has showed abundant, frame per second can raise by warning tone video source end by system, such as, but the speed raised necessarily keeps slowly increasing progressively state, can first bring up to 11 frames/second, 12 frames/second from 10 frames/second ... until near the value being stabilized in a suitable networks bandwidth.When codec hardware inadequate resource, the mode that multichannel audio frequency and video transcoding device employing of the present invention does relevant treatment for B frame information saves coder resource, such as: close B frame coding and enable mode, make this channel only there is I frame, P frame coded message, greatly will save bandwidth like this and save Decoder Time complexity.Can adopt in addition, abandon the mode of B frame decoding, by peculiar algorithm, diplomaticly abandon B frame decoding process, more decoder resources is used for the decode procedure of I frame and P frame.In addition, if when network bandwidth deficiency, have and judge that the coded system that information source side adopts is MJPEG moving picture encoding mode, then enforcement capabilities negotiation mode is passed through to this channel, make it carry out more reasonably Image Coding strategy, export I frame and P frame coded image data.In whole controlling of quality process, for audio coding channel, multichannel audio frequency and video transcoding device of the present invention adopts enforcement capabilities collection to consult, optionally activate G.728, the G.729 low bandwidth voice coding modes such as voice, can not only greatly reduce speech coding bandwidth like this, and in low bandwidth situation, voice quality can be ensured to a greater extent.In time there is fluctuation or codec hardware resource anxiety in network, after audio-video code stream dynamic conditioning, although the video effect of some channel can decrease, but still it is continuous, clear to meet sound, and image is without flower screen, stagnant audio frequency and video of stopping overall encoding and decoding practical function target.
Compared with prior art, channel audio frequency and video transcoding device of the present invention has the following advantages:
(1) multi-to-multi, multichannel, eurypalynous audio frequency and video transcoding can be carried out by multichannel audio frequency and video transcoding device of the present invention, do not need to realize by multiple stage transcoding device is stacking, avoid occurring that the R&D cycle is long, high cost, dispose the problems such as complicated;
(2) have employed audio-visual quality control module, make when carrying out audio frequency and video transcoding, Internet Transmission state between the terminal can considering outside audio frequency and video source device, and the integration capability such as the encoding and decoding resource use of transcoder, the quality control of the overall situation can be carried out to the audio/video information of input, can the coding requirement of terminal of the outside audio frequency and video source device of dynamic conditioning, meet the practical application request of high-performance real-time transcoding.
Obviously, those skilled in the art should be understood that, each module of the above-mentioned embodiment of the present invention or each step can realize with general calculation element, they can concentrate on single calculation element, or be distributed on network that multiple calculation element forms, alternatively, they can realize with the executable program code of calculation element, thus, they can be stored and be performed by calculation element in the storage device, and in some cases, step shown or described by can performing with the order be different from herein, or they are made into each integrated circuit modules respectively, or the multiple module in them or step are made into single integrated circuit module to realize.Like this, the embodiment of the present invention is not restricted to any specific hardware and software combination.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the embodiment of the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (9)
1. a multichannel audio frequency and video transcoding device, is characterized in that, comprising: foreground Web page arranges module, management configuration module, audio/video decoding module, audio/video coding module and audio-visual quality control module;
Described foreground Web page arranges module, for providing management and control service interface, and receives the operation initial configuration command information and transcoding relevant command information that user inputted by management and control service interface, and is sent to management configuration module;
Described management configuration module, for receiving described foreground Web page, the operation initial configuration command information and transcoding relevant command information that module sends is set, corresponding decodes commands information or coded command information is generated according to operation initial configuration command information and transcoding relevant command information, receive the audio-visual quality adjustment order that audio-visual quality control module sends, generate corresponding decodes commands information or coded command information according to audio-visual quality adjustment order; Decodes commands information is sent to audio/video decoding module, or coded command information is sent to audio/video coding module;
Described audio/video decoding module, for receiving the decodes commands information that described management configuration module is sent, with the audio, video data that external source device sends, carry out the decoding process of audio, video data, and decoded data is sent to audio/video coding module or ext nal network element; Collect decoding quality information, and be sent to audio-visual quality control module;
Described audio/video coding module, for receiving the coded command information that described management configuration module is sent, and the decoded data that described audio/video decoding module sends, carry out the coded treatment of audio, video data, coded message is sent to corresponding ext nal network element; Collect encoder complexity and coder resource consumption information, and be sent to audio-visual quality control module;
Described audio-visual quality control module, for receiving network transmission quality perception information, the encoder complexity of the decoding quality information that described audio/video decoding module sends and the transmission of described audio/video coding module and coder resource consumption information, generate corresponding audio-visual quality adjustment order according to network transmission quality perception information, decoding quality information and encoder complexity and coder resource consumption information, and be sent to management configuration module.
2. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterized in that, described operation initial configuration command information comprises: the unique identification GUID of the external source device list of required service, external source device, the information importance hierarchical definition of external source device, producer OCX ID definition, channel label, transcoding capabilities collection scope, the definition of external transcoding type, the definition of terminal initial data, the definition of access network primary data, control information, transcoding require one of them or multiple.
3. multichannel audio frequency and video transcoding device as claimed in claim 1, is characterized in that, described transcoding relevant command information comprises unique identification GUID and the definition of external transcoding type of external source device.
4. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterized in that, described decoding quality information to comprise in code stream frame bandwidth statistics, code stream information source company-information, code stream image dimension information, code stream frame rate information, code stream whether judging that information, present frame first P frame judges information containing image B frame information, present frame I frame, macro block traversal range information with decode complexity information one of them or multiple.
5. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterized in that, described encoder complexity and coder resource consumption information comprise coding host processor resources occupation proportion, the single-level memory resource occupation ratio of coding primary processor, the second-level storage resource occupation ratio of coding primary processor, encoding stream export in occupied bandwidth statistics, encoding stream image dimension information, encoding stream frame per second information, encoding stream whether contain image B frame information, coding complexity information one of them or multiple.
6. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterized in that, described management configuration module comprises decoding capability collection control module, channel management module, decoding or code capacity administration module, code capacity collection control module;
Described decoding capability collection control module, for carrying out decoding link setup and source coding work; Decoding activities mission requirements just at the decoding activities mission requirements of the decode channel of all channels of run mode, and is sent to audio/video decoding module by process;
Described channel management module, arranges the operation initial configuration command information of module transmission for integrating and store described foreground Web page; The transcoding phase command information of module transmission is set according to described foreground Web page, improves transcoding channel command, transcoding channel command is sent to relative decoding capability set control module;
Described decoding or code capacity administration module, for the treatment of coding or decoding capability multidate information record just at all channels of run mode;
Described code capacity collection control module, for the source coding data of receipt decoding capability set control module, coded command information just in the coded command information of the encoding channel of all channels of run mode, and is sent to audio/video coding module by process.
7. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterized in that, described audio/video decoding module comprises special decoding configuration module, returns control information collection module, starts decoder module, decoded state information summarizing module, encoder to connection module and video wall output module;
Described special decoding configuration module, for the treatment of the decodes commands information that management configuration module is sent, and distributes corresponding decode channel detail, and enables corresponding producer OCX decoder module;
Described time control information collection module, create for returning control information instancesization, dynamic collection audio-visual quality returns control information;
Described startup decoder module, for the real-time decoding of the foundation of decode channel, the reception of audio frequency and video Channel message and audio frequency and video message;
Described decoded state information summarizing module, for carrying out back gathering of control information, reports audio-visual quality control module by summary information;
Described encoder is to connection module, and for when transcoding type is flow forwarding mode, initiatively link setup audio/video coding module, carries out the activity of transcoding information butt joint;
Described video wall output module, for according to the requirement of output simulation mouth, sends into display translation port by decoded data.
8. multichannel audio frequency and video transcoding device as claimed in claim 1, it is characterized in that, described audio/video coding module comprises coding parameter configuration receiver module, sets up encoding target numbering module, correlative coding container module, encoding state information summarizing module, stream memory module and flow forwarding module;
Described coding parameter configuration receiver module, for setting up encoding channel list;
Describedly set up encoding target numbering module, for recognition coding parameter request, enable correlative coding object instance;
Described correlative coding container module, for receiving the audio frequency and video message data corresponding to be encoded that audio/video decoding module is sent, and carries out transcoding message data coding according to the coding negotiation parameter of coding parameter configuration required by receiver module;
Described encoding state information summarizing module, for supervising and record coding state information, gathering encoding state information, and summary information is reported audio-visual quality control module;
Described stream memory module, for storing message after coding;
Described flow forwarding module, the stream distributing data for stream memory module being stored carries out stream information and forwards output.
9. multichannel audio frequency and video transcoding device as claimed in claim 1, is characterized in that, described audio-visual quality control module comprises information storage module, analyzes judge module, notification module, startup configuration module and expiry notification module;
Described information storage module, for storing summary information, and is sent to analysis judge module by summary information;
Described analysis judge module, unlocks for internal signal amount, carries out summary information analysis in real time and obtains corresponding audio-visual quality adjustment order, and corresponding audio-visual quality adjustment order is sent to notification module;
Described notification module, for receiving the corresponding audio-visual quality adjustment order that described analysis judge module sends, and is sent to startup configuration module by corresponding audio-visual quality adjustment order;
Described startup configuration module, for being sent to management configuration module by corresponding audio-visual quality adjustment order;
Described expiry notification module, for according to management configuration module order request, deal with data stores return-to-zero.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510183900.9A CN104768026B (en) | 2015-04-17 | 2015-04-17 | A kind of multichannel audio frequency and video transcoding device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510183900.9A CN104768026B (en) | 2015-04-17 | 2015-04-17 | A kind of multichannel audio frequency and video transcoding device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104768026A true CN104768026A (en) | 2015-07-08 |
| CN104768026B CN104768026B (en) | 2018-01-30 |
Family
ID=53649580
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510183900.9A Active CN104768026B (en) | 2015-04-17 | 2015-04-17 | A kind of multichannel audio frequency and video transcoding device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104768026B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105072507A (en) * | 2015-07-24 | 2015-11-18 | 南京信通科技有限责任公司 | Method and system for transmitting multimedia data |
| CN105657542A (en) * | 2016-03-31 | 2016-06-08 | 深圳市茁壮网络股份有限公司 | Mosaic business management platform and mosaic business management system |
| CN106888400A (en) * | 2015-12-15 | 2017-06-23 | 中国电信股份有限公司 | A kind of method and system for realizing transcoding task scheduling |
| CN107566671A (en) * | 2017-10-12 | 2018-01-09 | 携程旅游信息技术（上海）有限公司 | Network voice communication method and its system, storage medium, electronic equipment |
| WO2018165869A1 (en) * | 2017-03-14 | 2018-09-20 | 深圳中兴力维技术有限公司 | Video surveillance system, client, signaling exchange server, and control method |
| CN111541941A (en) * | 2020-05-07 | 2020-08-14 | 杭州趣维科技有限公司 | Method for accelerating coding of multiple encoders at mobile terminal |
| CN111934823A (en) * | 2020-08-12 | 2020-11-13 | 中国联合网络通信集团有限公司 | Data transmission method, radio access network equipment and user plane functional entity |
| CN112311802A (en) * | 2020-11-05 | 2021-02-02 | 维沃移动通信有限公司 | Information transmission method and information transmission device |
| CN112511768A (en) * | 2020-11-27 | 2021-03-16 | 上海网达软件股份有限公司 | Multi-picture synthesis method, device, equipment and storage medium |
| WO2021139418A1 (en) * | 2020-01-09 | 2021-07-15 | 西安万像电子科技有限公司 | Image processing apparatus, remote device, and communication system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1668109A (en) * | 2004-03-10 | 2005-09-14 | 浙江大学 | Adaptive video transcoding gateway with multiple conversion functions |
| JP2009089156A (en) * | 2007-10-01 | 2009-04-23 | Yamaha Corp | Distribution system and method |
| CN101873482A (en) * | 2010-07-02 | 2010-10-27 | 上海交通大学 | Real-time streaming media cluster transcoding system |
| CN102523435A (en) * | 2012-01-01 | 2012-06-27 | 洛阳普天通信科技有限公司 | Mobile high-definition video surveillance method and apparatus based on 3G network |
-
2015
- 2015-04-17 CN CN201510183900.9A patent/CN104768026B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1668109A (en) * | 2004-03-10 | 2005-09-14 | 浙江大学 | Adaptive video transcoding gateway with multiple conversion functions |
| JP2009089156A (en) * | 2007-10-01 | 2009-04-23 | Yamaha Corp | Distribution system and method |
| CN101873482A (en) * | 2010-07-02 | 2010-10-27 | 上海交通大学 | Real-time streaming media cluster transcoding system |
| CN102523435A (en) * | 2012-01-01 | 2012-06-27 | 洛阳普天通信科技有限公司 | Mobile high-definition video surveillance method and apparatus based on 3G network |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105072507B (en) * | 2015-07-24 | 2019-01-25 | 南京信通科技有限责任公司 | A kind of transmission method and system of multi-medium data |
| CN105072507A (en) * | 2015-07-24 | 2015-11-18 | 南京信通科技有限责任公司 | Method and system for transmitting multimedia data |
| CN106888400A (en) * | 2015-12-15 | 2017-06-23 | 中国电信股份有限公司 | A kind of method and system for realizing transcoding task scheduling |
| CN106888400B (en) * | 2015-12-15 | 2019-05-10 | 中国电信股份有限公司 | A kind of method and system for realizing transcoding task schedule |
| CN105657542A (en) * | 2016-03-31 | 2016-06-08 | 深圳市茁壮网络股份有限公司 | Mosaic business management platform and mosaic business management system |
| CN105657542B (en) * | 2016-03-31 | 2018-10-19 | 深圳市茁壮网络股份有限公司 | A kind of mosaic service management platform and system |
| WO2018165869A1 (en) * | 2017-03-14 | 2018-09-20 | 深圳中兴力维技术有限公司 | Video surveillance system, client, signaling exchange server, and control method |
| CN107566671A (en) * | 2017-10-12 | 2018-01-09 | 携程旅游信息技术（上海）有限公司 | Network voice communication method and its system, storage medium, electronic equipment |
| CN107566671B (en) * | 2017-10-12 | 2020-09-25 | 上海华客信息科技有限公司 | Network voice communication method and system, storage medium and electronic equipment |
| WO2021139418A1 (en) * | 2020-01-09 | 2021-07-15 | 西安万像电子科技有限公司 | Image processing apparatus, remote device, and communication system |
| CN111541941A (en) * | 2020-05-07 | 2020-08-14 | 杭州趣维科技有限公司 | Method for accelerating coding of multiple encoders at mobile terminal |
| CN111541941B (en) * | 2020-05-07 | 2021-10-29 | 杭州小影创新科技股份有限公司 | Method for accelerating coding of multiple encoders at mobile terminal |
| CN111934823A (en) * | 2020-08-12 | 2020-11-13 | 中国联合网络通信集团有限公司 | Data transmission method, radio access network equipment and user plane functional entity |
| CN111934823B (en) * | 2020-08-12 | 2022-08-02 | 中国联合网络通信集团有限公司 | Data transmission method, radio access network equipment and user plane functional entity |
| CN112311802A (en) * | 2020-11-05 | 2021-02-02 | 维沃移动通信有限公司 | Information transmission method and information transmission device |
| CN112311802B (en) * | 2020-11-05 | 2023-10-27 | 维沃移动通信有限公司 | Information transmission method and information transmission device |
| CN112511768A (en) * | 2020-11-27 | 2021-03-16 | 上海网达软件股份有限公司 | Multi-picture synthesis method, device, equipment and storage medium |
| CN112511768B (en) * | 2020-11-27 | 2024-01-02 | 上海网达软件股份有限公司 | Multi-picture synthesis method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104768026B (en) | 2018-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104768026A (en) | Multi-channel audio and video transcoding device | |
| CN100502369C (en) | A digital home network media format transcoding device and method | |
| CN103067749B (en) | IPTV service quality monitoring method, device and video server | |
| KR20000075421A (en) | System for network transcoding of multimedia data flow | |
| CN101917612A (en) | Streaming media video coding method and device | |
| CN106993190B (en) | Software-hardware synergism coding method and system | |
| CN103533305B (en) | A kind of plugin-free universal video monitoring of B/S frameworks | |
| CN101389020A (en) | Method for extending decoding capability of stream media playing device | |
| CN102215381A (en) | Integrating device and method for integrating digital video monitoring systems | |
| CN102625082A (en) | A video surveillance system | |
| CN115701709A (en) | Video encoding method, device, computer readable medium and electronic equipment | |
| CN107529023A (en) | It is a kind of that there is signal mutually for the matrix device and output intent of function | |
| CN205647835U (en) | Video transcoding system under cloud environment | |
| CN116709037A (en) | 5G camera-based method for transmitting monitoring key data of weather and rain | |
| CN109587438A (en) | A kind of differentiation video content services method towards intelligent video monitoring | |
| CN114827542B (en) | Multi-channel video code stream capture method, system, equipment and medium | |
| CN112866713B (en) | Transcoding all-in-one machine system and transcoding method | |
| CN102694845A (en) | Tri-network converged mobile phone anti-theft monitoring system | |
| CN106534889B (en) | A Real-time Streaming Media Multiplex Forwarding Method Based on Ring Buffer | |
| CN107979568A (en) | A kind of video surveillance applications system | |
| CN110392267A (en) | A kind of low cost mining production scene automation centralized monitoring method | |
| CN105187951B (en) | A kind of RTMP flow medium live system Reverse Turning Control method and its system | |
| CN115442340A (en) | Method and system for realizing multi-standard video access | |
| CN111818337A (en) | Method and system for compatible monitoring of multiple video monitoring devices | |
| Huh et al. | Ultra-high resolution video distributed transcoding system using memory-based high-speed data distribution method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |