Adaptive multimedia distribution player method in a kind of terminal applies agreement
Technical field
The present invention relates to Play Technique for Multimedia field in the terminal applies agreement, adaptive multimedia distribution player method in particularly a kind of terminal applies agreement can use application program on the terminal applies server by terminal applies protocol network terminal.Use this adaptive multi-medium play method network terminal to be distributed to this locality and to finish by consulting the multimedia code stream in the playing process to be resolved, look audio decoder and Synchronization Control with application server.Adopt terminal applies agreement of the present invention can obviously reduce the network application server load, improve the bandwidth usage efficient of multimedia application in the terminal applies agreement, greatly improve network terminal multimedia quality.
Background technology
Along with developing rapidly of network infrastructure and internet, personal computer is rapidly to the network computer transition.Use the various application on the network computer accesses network to become the important way that people obtain information and various network services.Carry out multimedia by the terminal applies agreement and in the terminal applies agreement, critical role is arranged.But in traditional terminal applies agreement multimedia is not carried out special disposal, just simply it is realized by remote display protocol as a kind of common graphical interfaces.The traditional approach major defect has: the one, multimedia broadcast is needed a large amount of network bandwidth resources, and the 2nd, the audio sync of looking in the multimedia is controlled difficulty, and the 3rd, the application server load is very heavy when the user increases.Multimedia adaptive distribution player method of the present invention can be applied on the diverse network terminal, comprises PC and NC (network computer) etc., has well solved above-mentioned three problems.
Summary of the invention
The object of the present invention is to provide the self-adapting distribution method of multimedia in a kind of terminal applies agreement.When the user carried out multimedia, the network terminal and application server were consulted earlier in the terminal applies agreement, and the content of negotiation comprises network terminal disposal ability, server load condition and spendable network bandwidth situation.Wherein network terminal disposal ability mainly comprises multimedia code stream analytic ability, video decoding capability, audio decoder ability and looks the audio sync ability.Through consultation the code stream analyzing in the multimedia process, video decode, audio decoder, look audio sync and just can on the network terminal or application server, carry out respectively according to terminal processing capacity, server load condition and network bandwidth situation.When video decoding process carried out on the network terminal, the control of Play Control window was still undertaken by application server, and local video is decoded to user transparent.
For achieving the above object, the multimedia adaptive player method in the terminal applies agreement comprises step:
● earlier the terminal multi-media ability to play is held consultation when the network terminal is connected with application server and distribute according to negotiation result and implement, wherein playing process comprises multimedia code stream parsing, video decode, audio decoder and Synchronization Control;
● consult when terminal and server connect, to carry out, at first send local ability support information to multimedia by terminal, comprising code stream analyzing, video decode, audio decoder ability etc., by server it is checked then and adjust, and to terminal transmission confirmation, after negotiations process was finished, the application server and the network terminal were according to collaborative multimedia code stream parsing, video decode, audio decoder and the Synchronization Control process of finishing playing process of negotiation result;
● during multimedia, the negotiation information of server basis and terminal adaptive to the terminal transmission encoding code stream or decodedly look, voice data;
● the multimedia of terminal this locality control window is controlled by application server, and looking wherein, audio decoder both can also can carry out in terminal at server;
● the control of Play Control window is undertaken by application server all the time in the playing process.
The present invention solves between the application server and the network terminal multimedia is held consultation, regulates, adjusted and the enforcement that distributes, rather than simple Synchronization Control.
Description of drawings
The present invention is described in further detail below in conjunction with accompanying drawing and negotiation instance:
Fig. 1 is an adaptive multi-medium play method process schematic diagram in the terminal applies agreement of the present invention;
Fig. 2 is that application server of the present invention is looked, audio decoder and Synchronization Control figure;
Fig. 3 is that application server of the present invention carries out video decode, and the network terminal carries out audio decoder figure;
Fig. 4 is the network terminal of the present invention when carrying out video decode, Play Control window control information flow process schematic diagram;
Fig. 5 is that application server of the present invention carries out broadcast window control and audio decoder, and the network terminal carries out video decode figure;
Fig. 6 is that application server of the present invention carries out broadcast window control, and the network terminal is looked, audio decoder and Synchronization Control figure;
Fig. 7 is that application server of the present invention carries out broadcast window control, and the network terminal carries out that multimedia code stream is resolved and looked, audio decoder figure.
Among Fig. 1, at first terminal use's login, terminal to server sends the media play ability information then, and server consults to confirm playing process after receiving information.When the terminal use began multimedia, each process of playing according to negotiation result is distributed in terminal or server carries out
Among Fig. 2, wherein the left side is the empty screen on the application server, and the right side is the local screen of terminal.Server is finished following function:
1, multimedia window control
2, look, audio code stream resolves
3, look, audio decoder
4, transmit decoded look, voice data
5, Synchronization Control
Terminal is just by remote display protocol display graphics interface and output audio.
Among Fig. 3, its basic process is with shown in Figure 2 identical, but audio decoder carries out on terminal.
Among Fig. 4, the detailed description of face as follows of its control information flow process.
Among Fig. 5, the difference that server capability is compared with Fig. 2 is that video decoding process carries out in terminal, so server is a coding video frequency data to terminal transmission.
Among Fig. 6, the function that server is finished is as follows:
1, multimedia window control
2, multimedia video, audio stream are resolved
3, transmit coding video frequency data and coding audio data
Terminal is finished and is looked, audio decoder and Synchronization Control.
Among Fig. 7, server only carries out following function:
1, multimedia window control
2, analyze video format
3, transmit original multimedia code stream to the network terminal
Terminal is actual to be a complete video player, finishes multimedia code stream and resolves, and looks, audio decoder and Synchronization Control.
Embodiment
Concrete enforcement of the present invention is held consultation to the terminal multi-media ability to play when network terminal user connects with network application server as shown in Figure 1.In negotiations process, the network terminal provides the information of local ability to play multi-media for server, comprising to analytic ability, video decoding capability, the audio decoder ability of multimedia code stream and the ability of looking audio sync.The above-mentioned information that network application server provides according to terminal, again in conjunction with server self current loading condition and network bandwidth resources situation, decide multimedia code stream parsing, video decode, audio decoder in the multimedia process, look audio sync like where collaborative carrying out on application server and the terminal, and send confirmation to terminal.
The present invention does the self adaptation adjustment to the terminal multi-media playing process.According to multimedia code stream parsing, video decode, audio decoder and look the execution that distributes of audio sync process on the application server or the network terminal, actual playing process can have five kinds of modes, and it corresponds respectively to Fig. 2, Fig. 3, Fig. 5, Fig. 6 and Fig. 7.This five kinds of situations are described respectively below.
Fig. 2 on application server, carry out code stream analysis, look, the schematic diagram of audio decoder and Synchronization Control.Playing program on the application server outputs to decoded video data in the empty window on the application server, video data outputs on terminal use's screen by remote display protocol together with the Play Control window again then, and decoded voice data then outputs on the network terminal by the voice data passage.The Synchronization Control of playing process is carried out at the application server end.This kind situation is adapted to the simple network terminal of function.
Fig. 3 is similar with Fig. 2, and the audio decoder process of the main distinction in playing process finished at the network terminal, and the data of transmitting by voice-grade channel are coding audio data.Synchronization Control is undertaken by application server in this broadcast mode.
Broadcast window control information schematic diagram when Fig. 4 carries out on the network terminal for video decoding process.When the terminal use adjusts broadcast window (these information comprise beginning, time-out, adjust the window's position and size etc.), control information shown among Fig. 41 earlier and the positional information on the local screen combine, the remote display protocol that passes through shown in 2 is delivered to the empty window of server with user's control among Fig. 4 for another example, control information is delivered to the playing program on the server shown among Fig. 43, playing program is adjusted the broadcast interface in the empty window system shown among Fig. 44 again.Video data in the broadcast window produces on terminal, playing program on the server must continue to send control information back on the terminal video decoding process again, shown among Fig. 45, video decoding process on the terminal is according to this control information then, decoded video data is write in the broadcast window zone corresponding in the long-range window system on the local screen, shown among Fig. 46.By above-mentioned steps, though window control in the playing process and video decode carry out on server and terminal respectively, this process is transparent to the terminal use, and whole window control is still undertaken by application server fully.
The playing process schematic diagram that Fig. 5 carries out in terminal for video decoding process.The control information of this situation window as shown in Figure 4.Concrete playing process is as follows, and following function is mainly finished in the broadcast on the application server: broadcast window control, multimedia code stream parsing, audio decoder, voice data transmission, video data encoder transmission and Synchronization Control etc.Broadcast window among Fig. 5 in the empty window of application program is light shade, and expression practical video data do not output to herein.Video decoding process among Fig. 5 on the terminal writes the video data that decodes in the broadcast window corresponding the long-range window system on the local screen according to the window information that obtains from server.Synchronization Control in the playing process shown in Figure 5 is still carried out on server, and this mainly is because audio decoder is finished on server.
Fig. 6 and Fig. 7 and Fig. 5 are similar substantially, and video decoding process all is to finish in terminal.Fig. 6 represents that video and audio decoder process all finish at the network terminal, but multimedia code stream resolves and still carry out at server because look, audio decoder is all in terminal, therefore can look, the Synchronization Control of audio frequency moves to terminal.The difference of decode procedure shown in Figure 7 and Fig. 6 is that the resolving of multimedia code stream also carries out in terminal, as if the playing program on the server only need that multimedia code stream is sent to terminal and get final product, but in fact, therefore need on server, solve information relevant in the multimedia code stream with video because the playing program on the server need be controlled broadcast window.