CN102055949B - Recording method, device and system of multimedia conference and rewinding method and device - Google Patents

Abstract

The embodiment of the invention provides a recording method, a device and a system of a multimedia conference. The recording method of the multimedia conference comprises the following steps of performing combined recording treatment to the data (at least video data, audio-frequency data or image data) of a multi-channel media stream in the multimedia conference. Since the combined recording treatment to the multi-channel media stream in the multimedia conference can be realized as per a recording strategy, the comprehensive situation of the multimedia conference can be shown better, and the recording strategy can be arranged flexibly.

Description

Recorded broadcast method, the Apparatus and system of multimedia conferencing, playback method and device

Technical field

The present invention relates to communication technical field, relate in particular to a kind of multimedia conferencing method for recording, playback method, recorded broadcast device and recording and broadcasting system.

Background technology

At present, the recorded broadcast mode of multimedia conferencing is generally following form:

A kind of terminal realizes that the mode of recorded broadcast is: integrated recording and broadcasting system in traditional television terminal, during holding multimedia conferencing, enable the recording function of television terminal, record and store the data of the Media Stream such as local audio, video of television terminal, perhaps record and store the data of the Media Stream such as far-end audio, video of other television terminals that television terminal receives, after multimedia conferencing finishes, by television terminal the data content of the Media Stream recorded is playbacked and to check.

The another kind of recorded broadcast mode of using detection type recorded broadcast server is: with the terminal in detection type recorded broadcast server and the multimedia conferencing, multipoint control unit MCU (Multipoint Control Unit, multipoint control unit) etc. insert in same network, during holding multimedia conferencing, detection type recorded broadcast server grasps the communication data packet on the network, go out the data of the Media Stream that needs record then according to the leaching information extraction that arranges, as audio frequency, video data, carry out stored record afterwards, multimedia conferencing playbacks the data of checking the Media Stream of storing after finishing again.

In realizing process of the present invention, the inventor finds that there are the following problems at least in the prior art:

First kind of recorded broadcast mode, owing to just by television terminal the data of itself or the single channel Media Stream that receives are recorded separately and storage separately, can not carry out some combinations to the data of Media Streams such as multichannel voice frequency, video and record processing, as, image formats such as many pictures, picture-in-picture.

Second kind of recorded broadcast mode because detection type recorded broadcast server grasps the communication data packet on the network, extracts audio frequency, the independent recording and storing of video data then, can't carry out some combinations to the data of Media Streams such as multichannel voice frequency, video too and record processing.

Summary of the invention

Embodiments of the invention provide a kind of multimedia conferencing method for recording, playback method, record device, playback device, recorded broadcast device and recording and broadcasting system, realize the combination of multichannel IMS conference medium stream in the multimedia conferencing is recorded.

The embodiment of the invention provides a kind of method for recording of multimedia conferencing, comprising:

Acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, and described IMS conference medium stream is at least video media stream or audio medium stream;

According to the media record strategy described multichannel IMS conference medium stream is made up and to record processing.

Corresponding, the embodiment of the invention is provided for realizing the record device of a kind of multimedia conferencing of said method, comprising:

Receiver module is used for receiving according to the meeting level and records the multichannel IMS conference medium that will the record stream that strategy is determined, described IMS conference medium stream is at least video media stream or audio medium stream;

Record processing module, record processing for according to the media record strategy described multichannel IMS conference medium stream being made up.

Corresponding, the embodiment of the invention also provides a kind of method that playbacks of multimedia conferencing, comprising:

Reception carries the request that playbacks of media identification, and described media identification is used for the identification medium file;

Obtain corresponding media file according to described media identification, playbacking, described media file is for making up multichannel IMS conference medium stream in the multimedia conferencing and record processing and obtained according to recording strategy.

Corresponding, the embodiment of the invention is provided for also realizing that a kind of multimedia meeting of said method playbacks device, comprising:

Playback the request receiver module, be used for receiving the request that playbacks that carries media identification, described media identification is used for the identification medium file;

Playback module, be used for obtaining corresponding media file according to described media identification, to playback, described media file is recorded the processing acquisition according to recording tactful multichannel IMS conference medium stream in the multimedia conferencing is made up, and the described strategy of recording comprises that the meeting level is recorded strategy and media-level is recorded strategy.

The embodiment of the invention also provides a kind of recorded broadcast device of multimedia conferencing, comprises above-mentioned record device or the above-mentioned device that playbacks.

Based on recorded broadcast method, the device of the multimedia conferencing that provides with the invention described above embodiment, the embodiment of the invention provides a kind of method for recording of multimedia conferencing, comprising:

Acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, and described IMS conference medium stream is at least video media stream or audio medium stream;

According to the meeting-place under the described IMS conference medium stream, to store described multichannel IMS conference medium stream and distribute association identification, described association identification is used for the IMS conference medium stream in related each meeting-place.

Corresponding, the embodiment of the invention is provided for realizing the record device of a kind of multimedia conferencing of said method, comprising:

Receiver module, the multichannel IMS conference medium that is used for each meeting-place of acquisition multimedia conferencing flows, and described IMS conference medium stream is at least video media stream or audio medium stream;

The association identification distribution module is used for according to the meeting-place under the described IMS conference medium stream, stores described multichannel IMS conference medium stream and distributes association identification, and described association identification is used for the IMS conference medium stream in related each meeting-place.

The embodiment of the invention also provides a kind of method that playbacks of multimedia conferencing, comprising:

Reception carries the request that playbacks of association identification, obtains the multichannel IMS conference medium stream of described association identification correspondence, and described association identification is used for the IMS conference medium stream in related each meeting-place, and described IMS conference medium stream is at least video media stream or audio medium stream;

According to the media record strategy described multichannel IMS conference medium stream is made up and to record processing.

Corresponding, the embodiment of the invention also be provided for realizing said method a kind of multimedia conferencing playback device, comprising:

Playback the request receiver module, be used for receiving the request that playbacks that carries association identification, obtain the multichannel IMS conference medium stream of described association identification correspondence, described association identification is used for the IMS conference medium stream in related each meeting-place, and described IMS conference medium stream is at least video media stream or audio medium stream;

Playback processing module, record processing for according to the media record strategy described multichannel IMS conference medium stream being made up.

The embodiment of the invention also provides a kind of recorded broadcast device of multimedia conferencing, comprises above-mentioned record device or the above-mentioned device that playbacks.

The technical scheme that is provided by the embodiment of the invention described above as can be seen, owing to can record processing according to recording tactful multichannel IMS conference medium stream in the multimedia conferencing is made up, so the comprehensive condition of reaction multimedia conferencing that can be preferable, and, record and arrange flexibly tactfully.

Description of drawings

In order to be illustrated more clearly in the technical scheme of the embodiment of the invention, the accompanying drawing of required use is done to introduce simply in will describing embodiment below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.

Fig. 1 is the schematic flow sheet of the method for recording of embodiment of the invention multimedia conferencing;

Fig. 2 is the structural representation one of the record device of embodiment of the invention multimedia conferencing;

Fig. 3 is the structural representation two of the record device of embodiment of the invention multimedia conferencing;

Fig. 4 is the schematic flow sheet of the method that playbacks of embodiment of the invention multimedia conferencing;

Fig. 5 is the structural representation that playbacks device one of embodiment of the invention multimedia conferencing;

Fig. 6 is the structural representation that playbacks device two of embodiment of the invention multimedia conferencing;

Fig. 7 is the schematic flow sheet of the method for recording of embodiment of the invention multimedia conferencing;

Fig. 8 is the structural representation one of the record device of embodiment of the invention multimedia conferencing;

Fig. 9 is the structural representation two of the record device of embodiment of the invention multimedia conferencing;

Figure 10 is the schematic flow sheet of the method that playbacks of embodiment of the invention multimedia conferencing;

Figure 11 is the structural representation that playbacks device one of embodiment of the invention multimedia conferencing;

Figure 12 is the structural representation that playbacks device two of embodiment of the invention multimedia conferencing;

Figure 13 is the structural representation one of the recorded broadcast method of embodiment of the invention multimedia conferencing;

Figure 14 is the structural representation two of the recorded broadcast method of embodiment of the invention multimedia conferencing;

Figure 15 is the true system schematic of embodiment of the invention net;

Figure 16 is the concrete application flow schematic diagram of the recorded broadcast method of embodiment of the invention multimedia conferencing;

Figure 17 is the concrete application flow schematic diagram of the recorded broadcast method of embodiment of the invention multimedia conferencing;

Figure 18 is the structural representation three of the recording and broadcasting system of embodiment of the invention multimedia conferencing;

Figure 19 is the concrete application flow schematic diagram of the recorded broadcast method of embodiment of the invention multimedia conferencing;

Figure 20 is the structural representation four of the recording and broadcasting system of embodiment of the invention multimedia conferencing;

Figure 21 is the concrete application flow schematic diagram of the recorded broadcast method of embodiment of the invention multimedia conferencing.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.

Can't make up the defective of recording to multichannel IMS conference medium stream (Media Stream such as audio medium stream, video media stream, picture Media Stream etc.) in the multimedia conferencing based on prior art, what the embodiment of the invention provided a kind of multimedia conferencing records, playbacks method, device, recorded broadcast device and recording and broadcasting system, can make up multichannel IMS conference medium stream in the multimedia conferencing and to record processing according to recording strategy, and can the multichannel IMS conference medium stream that processing is recorded in combination be playbacked.

Here, multichannel IMS conference medium stream in the multimedia conferencing can be the multichannel local media stream in a meeting meeting-place, or multichannel distant end media stream, can also be multichannel local media stream or the multichannel distant end media stream in a plurality of meetings meeting-place, multichannel can be understood as and is at least 2 the tunnel, does not give unnecessary details at this.Can also know that a meeting meeting-place can comprise more than one conference terminal.As, in the true system of net shown in Figure 12, a meeting meeting-place comprises 3 conference terminals, the true system of IMS conference of single net meeting-place just exists 3 road local video Media Streams, 3 road local audio Media Streams and 3 great distances to look closely Media Stream, 3 great distance end audio medium streams frequently, namely has 6 tunnel video media stream and 6 road audio medium streams.

The method of recording, playbacking of a kind of multimedia conferencing that the embodiment of the invention provides, device, recorded broadcast device and recording and broadcasting system, multichannel IMS conference medium stream in the multimedia conferencing made up record processing, it is main as the multi-channel video Media Stream is synthesized one or more many pictures, one or more picture-in-picture, or image style such as one or more widescreen image, etc.; As the multichannel voice frequency Media Stream being synthesized recording modes such as SCVF single channel voice frequency, multichannel voice frequency or multichannel audio, etc.Like this, the data of the Media Stream recorded of combination can be reacted the comprehensive condition of multimedia conferencing better, can also playback by data to Media Stream easily, obtain the comprehensive condition of multimedia conferencing.

Embodiment one

As shown in Figure 1, the embodiment of the invention provides a kind of method for recording of multimedia conferencing, comprising:

Step 11: obtain to record the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, described IMS conference medium stream is at least video media stream or audio medium stream;

Step 12: according to the media record strategy described multichannel IMS conference medium stream is made up and to record processing.

Optionally, the executive agent of the method for recording of multimedia conferencing can be the recorded broadcast server, referring to shown in Figure 13, the recorded broadcast server is connected with multipoint control unit (multipoint control unit MCU), when multipoint control unit MCU is connected with at least one conference terminal, acquisition is recorded the step 11 that the definite multichannel IMS conference medium that will record of strategy flows according to the meeting level, specifically can comprise:

The meeting level is recorded strategy send to multipoint control unit MCU, described meeting level is recorded strategy and comprised: the meeting-place recording mode is switched in acoustic control, or the broadcast site recording mode, or the Chair site recording mode, or specific meeting-place recording mode;

Receive described multipoint control unit MCU and record strategy according to described meeting level, the multichannel IMS conference medium stream that will record at least one definite meeting-place, described meeting-place comprises at least one conference terminal.

Particularly, the meeting-place recording mode is switched in acoustic control, refers to the size according to each meeting-place sound in the meeting, the data of the Media Stream of the conference terminal in the maximum meeting-place of sound in the recorded meeting; The broadcast site recording mode refers to be broadcasted in the recorded meeting data of Media Stream of the conference terminal in meeting-place; The Chair site recording mode refers to the data of the Media Stream of the conference terminal of Chair site in the recorded meeting; Specific meeting-place recording mode refers to record the data of Media Stream of the conference terminal in selected single or multiple meeting-place.

The meeting level is recorded strategy and is mainly used in determining that those Media Streams in which meeting-place need be recorded.The meeting level is recorded strategy and is included but not limited to above-mentioned example policy.

Perhaps, optionally, referring to shown in Figure 14, the recorded broadcast server is connected with at least one conference terminal, the conference terminal that is connected with the recorded broadcast server is connected with multipoint control unit MCU again, when multipoint control unit MCU also is connected with other not with at least one conference terminal that the recorded broadcast server is connected, obtain to record according to the meeting level step 11 of the multichannel IMS conference medium that will the record stream that strategy determines, specifically can comprise:

The meeting level is recorded strategy send to conference terminal, described meeting-place comprises at least one conference terminal, described meeting level is recorded strategy and is comprised: specific meeting-place recording mode, or specific meeting-place local media stream recording mode, or specific meeting-place distant end media stream recording mode;

Receive described conference terminal and record the multichannel IMS conference medium that will the record stream that strategy is determined according to described meeting level.

Because that the recorded broadcast server connects is conference terminal rather than multipoint control unit MCU, the recorded broadcast server is only to obtain the media stream data on the connected conference terminal, so, some meeting level is recorded strategy and can't be used, as: meeting-place recording mode, broadcast site recording mode are switched in acoustic control.

Particularly, specific meeting-place recording mode refers to record the data of Media Stream of the conference terminal in selected single or multiple meeting-place; Specific meeting-place local media stream recording mode refers to record the data of local media stream of the conference terminal in selected single or multiple meeting-place; Specific meeting-place distant end media stream recording mode refers to record the data of the distant end media stream that the conference terminal in selected single or multiple meeting-place receives.

Optionally, according to the media record strategy described multichannel IMS conference medium stream is made up the step 12 of recording processing, specifically can comprise:

Video media recording mode according to the media record strategy, described multi-channel video Media Stream is synthesized one or more Multipicture, or one or more video picture-in-picture, or one or more widescreen video, described video media recording mode comprises: the video record way arranges pattern, or the Multipicture recording mode, or video picture-in-picture recording mode, or widescreen video media record pattern;

Audio frequency media recording mode according to the media record strategy, described multichannel voice frequency Media Stream is synthesized audio frequency mono channel, or the audio frequency multichannel, described audio frequency media recording mode comprises: the audio recording way arranges pattern, or audio frequency mono channel recording mode, or audio frequency multichannel recording mode.

Media-level is recorded strategy and is mainly used in determining the multichannel IMS conference medium is flowed the mode that synthetic recording is handled.Media-level is recorded strategy and is included but not limited to above-mentioned example policy.

Particularly, the video record way arranges, and refers to record the output multi-channel video; The Multipicture recording mode refers to and the synthetic single channel of multi-channel video media groups or the many pictures of multichannel can be recorded; Video picture-in-picture recording mode refers to and the synthetic single channel of multi-channel video media groups or multichannel picture-in-picture can be recorded; Widescreen video media record pattern refers to the synthetic single channel of multi-channel video media groups or multichannel widescreen video image are recorded.The video media recording mode includes but not limited to above-mentioned example recording mode.And the use capable of being combined of above-mentioned video media recording mode is recorded the multi-channel video Media Stream that strategy is determined by the meeting level in the meeting of combination record multimedia, can better react the comprehensive condition of multimedia conferencing.

The audio recording way arranges, and refers to record the output multichannel voice frequency; The audio frequency mono channel recording mode refers to and can become monophonic audio to record the multichannel voice frequency medium in the meeting (meeting-place sound, background music etc.) audio mixing that the audio mixing way can arrange; Audio frequency multichannel recording mode refers to and the multichannel voice frequency medium audio mixing in the meeting can be become multichannel voice frequency, records according to the multichannel audio medium then.The audio frequency media recording mode includes but not limited to above-mentioned example recording mode.And the also use capable of being combined of above-mentioned audio frequency media recording mode is recorded the multichannel voice frequency medium that strategy is determined by the meeting level in the meeting of combination record multimedia, can better react the comprehensive condition of multimedia conferencing.

Optionally, the method for recording of the multimedia conferencing of the embodiment of the invention can arrange the multiple different strategy of recording simultaneously, realizes the data of the Media Stream in the meeting are recorded.As, 2 kinds of different meeting levels are set record strategy, determine 2 groups of Media Streams that constituted by multi-channel video Media Stream and audio medium stream respectively, the Media Stream that wherein one group of multi-channel video Media Stream and audio medium stream are constituted, adopting a kind of video media recording mode and audio frequency media recording mode to make up records, Media Stream to another group multi-channel video Media Stream and audio medium stream formation, adopt another kind of video media recording mode and audio frequency media recording mode to make up and record, can more fully react the comprehensive condition of multimedia conferencing.

Optionally, in the method for recording of the multimedia conferencing of the embodiment of the invention, record parameter if be provided with, as record duration, record capacity, format, record in code check, the compression protocol one or more, step 12, specifically can also be, according to the media record strategy and record parameter and described multichannel IMS conference medium stream is made up record processing.As the video media recording mode of recording strategy according to media-level when video media stream is recorded, record parameter and comprise and record code check, format, frame per second, the compression protocol that can adopt after data are synthetic etc.And for example the audio frequency media recording mode of recording strategy according to media-level is when recording audio medium stream, records parameter and comprises and record code check, record frequency range, the compression protocol that can adopt after data are synthetic etc.As the compression protocol that video media stream is adopted can be: H.263, H.264, MPEG2, MPEG4 etc., to the compression protocol of audio medium stream can be: G.711, G.722, G.729, ACC etc., do not give unnecessary details at this.

Optionally, in the method for recording of the multimedia conferencing of the embodiment of the invention, the recorded broadcast server is connected with multipoint control unit MCU in the scene, multipoint control unit MCU is connected with at least one conference terminal, multipoint control unit MCU can send video media stream and the time synchronization information of audio medium stream, medium indication information and the meeting indication information of IMS conference medium stream to the recorded broadcast server.

Particularly, obtain to record according to the meeting level step 11 of the multichannel IMS conference medium that will the record stream that strategy determines, can also comprise: the time synchronization information that obtains video media stream and audio medium stream in the described multichannel IMS conference medium stream.At this moment, according to the media record strategy described multichannel IMS conference medium stream is made up the step 12 of recording processing, can also comprise: according to the time synchronization information of described video media stream and audio medium stream, be media file with the data of the described video media stream after synthetic and the data multiplexing and encoding of audio medium stream; Store described media file, and for described media file media identification is set, described media identification is used for the described media file of sign.

Media file can adopt comparatively general forms such as MPEG media file format, is conducive to the storage of media file, and occurs looking the nonsynchronous problem of audio frequency easily when avoiding playbacking, and has improved to playback quality.And, by the media file for storage corresponding media identification is set, can find the media data that need playback quickly and easily by media identification like this.

The medium indication information can comprise at least: whether media data type, media data be compressed, in the media compression agreement, data bit rate, medium bandwidth one or more, etc.By the medium indication information, can judge whether the multichannel IMS conference medium stream decoding to receiving.As, the media data of different types is distributed to different media decoder, media decoder such as Video Decoder, audio decoder, picture decoder, etc.

The meeting indication information comprises at least: meeting begins, meeting adjourned, in the affiliation of meeting-place defection, meeting-place one or more, etc.According to the meeting indication information, can record combination and carry out different processing.As, during the indication information that receives that meeting adjourned, illustrate that active conference finishes, so the recorded broadcast of active conference is handled and can be finished; For another example, when receiving the meeting-place defection in the meeting, a lot of processing policies can be arranged, the simplest strategy is exactly to stop recording defection meeting-place media data, can certainly use other a meeting-place to replace the defection meeting-place, certainly when being many pictures, the form of recording can dynamically change many pictures pattern (as: changing to three-picture from four pictures), etc.

Optionally, in the method for recording of the multimedia conferencing of the embodiment of the invention, the recorded broadcast server is connected with at least one conference terminal in another scene, the conference terminal that is connected with the recorded broadcast server is connected with multipoint control unit MCU again, and multipoint control unit MCU also is connected with other at least one conference terminals that is not connected with the recorded broadcast server.The conference terminal that is connected with multipoint control unit MCU can send the video media stream of IMS conference medium stream and the time synchronization information of audio medium stream to the recorded broadcast server, medium indication information and meeting indication information, in like manner, time synchronization information, the concrete application of medium indication information and meeting indication information, can understand with reference to above-mentioned scene, not give unnecessary details at this.

Optionally, the method for recording of the multimedia conferencing of the embodiment of the invention can also comprise the data of the Media Stream after synthetic are carried out corresponding compressed encoding that this process is not necessary, and compressed encoding mainly is in order to reduce the data volume of Media Stream.

Optionally, obtain to record in the step 11 of the multichannel IMS conference medium that will the record stream that strategy determines according to the meeting level, the meeting level can also be recorded strategy and media-level and record strategy and all send to multipoint control unit MCU or described conference terminal, unrestricted.

For " net is true " system, as shown in figure 15, each meeting-place arranges more than one conference terminal, as 3 conference terminals, 3 high-definition cameras and 3 high-clear displays, in the use, in 3 high-clear displays, can show man-size distal view picture, and epigraph is continuous in the horizontal direction, makes the participant of each side face the on-the-spot experience of having a meeting, carry out face-to-face exchange together just like body.

Above-mentioned multimedia conferencing record, playback method, can also comprise, conference terminal compositing terminal group (shown in the frame of broken lines among Figure 13,14) with same meeting-place, and media-level can be set record strategy, as with the local video of each terminal in the set of terminal combination many pictures of local video or local widescreen image, the far-end video of each terminal in the set of terminal is combined into far-end Multipicture or far-end widescreen image.

The technical scheme that is provided by the invention described above embodiment is appreciated that the method for recording of above-mentioned multimedia conferencing, can arrange flexibly and record strategy, makes the data of the Media Stream that combination is recorded better react the comprehensive condition of multimedia conferencing.

Embodiment two

The method for recording of the multimedia conferencing that provides referring to above-described embodiment one, as shown in Figure 2, the embodiment of the invention provides a kind of record device that can realize the multimedia conferencing of above-mentioned method for recording, comprising:

Receiver module 21 is used for receiving according to the meeting level and records the multichannel IMS conference medium that will the record stream that strategy is determined, described IMS conference medium stream is at least video media stream or audio medium stream.

Record processing module 22, record processing for according to the media record strategy described multichannel IMS conference medium stream being made up.

As shown in Figure 3, optional, receiver module 21 can comprise:

Strategy sending module 211, be used for that the meeting level is recorded strategy and send to multipoint control unit MCU, described meeting level is recorded strategy and comprised: the meeting-place recording mode is switched in acoustic control, or the broadcast site recording mode, or Chair site recording mode, or specific meeting-place recording mode.

Media Stream receiver module 212 is used for receiving described multipoint control unit MCU and records strategy according to described meeting level, the multichannel IMS conference medium stream that will record at least one definite meeting-place, and described meeting-place comprises at least one conference terminal.

Can also be that optional, receiver module 21 can comprise:

Strategy sending module 211, be used for that the meeting level is recorded strategy and send to conference terminal, described meeting-place comprises at least one conference terminal, described meeting level is recorded strategy and is comprised: specific meeting-place recording mode, or specific meeting-place local media stream recording mode, or specific meeting-place distant end media stream recording mode.

Media Stream receiver module 212 is used for receiving described conference terminal and records the multichannel IMS conference medium that will the record stream that strategy is determined according to described meeting level.

Optionally, record processing module 22, comprising:

Video record processing module 221, be used for the video media recording mode according to described media record strategy, described multi-channel video Media Stream is synthesized one or more Multipicture, or one or more video picture-in-picture, or one or more widescreen video, described video media recording mode comprises: the video record way arranges pattern, or the Multipicture recording mode, or video picture-in-picture recording mode, or widescreen video media record pattern.

Audio recording processing module 222, be used for the audio frequency media recording mode according to described media record strategy, described multichannel voice frequency Media Stream is synthesized audio frequency mono channel, or audio frequency multichannel, described audio frequency media recording mode comprises: the audio recording way arranges pattern, or audio frequency mono channel recording mode, or audio frequency multichannel recording mode.

Optionally, receiver module 21 can also comprise:

Time synchronization information receiver module 213 is used for receiving the time synchronization information that described multichannel IMS conference medium flows video media stream and audio medium stream.

At this moment, record processing module 22, can also comprise:

Media file generation module 223 is used for the time synchronization information according to described video media stream and audio medium stream, is media file with the data of the described video media stream after synthetic and the data multiplexing and encoding of audio medium stream.

Memory module 224 is used for the described media file of storage, and for described media file media identification is set, and described media identification is used for the described media file of sign.

The record device of the multimedia conferencing that the embodiment of the invention provides and concrete composition module can be understood with reference to the multimedia conferencing method for recording that above-described embodiment one provides, and do not give unnecessary details at this.

The technical scheme that is provided by the invention described above embodiment as can be seen, the record device of above-mentioned multimedia conferencing can arrange flexibly and record strategy, makes the data of the Media Stream that combination is recorded better react the comprehensive condition of multimedia conferencing.

Embodiment three

The method for recording of the multimedia conferencing that provides corresponding to the embodiment of the invention one, as shown in Figure 4, the embodiment of the invention provides a kind of method that playbacks of multimedia conferencing, comprising:

Step 41: receive the request that playbacks that carries media identification, described media identification is used for the identification medium file.

Step 42: obtain corresponding media file according to described media identification, playbacking, described media file is for making up multichannel IMS conference medium stream in the multimedia conferencing and record processing and obtained according to recording strategy.

The executive agent of the method that playbacks of embodiment of the invention multimedia conferencing can be the recorded broadcast server.

The method that playbacks of embodiment of the invention multimedia conferencing can also comprise: the reception of recorded broadcast server carries playbacking before the request of media identification, and media identification is sent to multipoint control unit MCU or conference terminal.Like this, in the step 41, the recorded broadcast server can receive the request that playbacks that carries media identification from multipoint control unit MCU or conference terminal, in the step 42, the recorded broadcast server obtains corresponding media file according to described media identification, and multipoint control unit MCU or conference terminal obtain media file from the recorded broadcast server and playback.

To playbacking of media file, as to the media file demultiplexing, if the compressed mistake of media file will decompress when playbacking, the recorded broadcast server can carry out adaptation processing (as resolution decreasing, fall frame per second etc.) to the widescreen image of recording, and does not give unnecessary details at this.

Referring to shown in Figure 13, in the scene of the embodiment of the invention, the recorded broadcast server is connected with multipoint control unit MCU, and multipoint control unit MCU is connected with at least one conference terminal.The recorded broadcast server according to the media record strategy to multichannel IMS conference medium stream make up record processing after, for media file arranges media identification, described media identification is used for the described media file of sign.The recorded broadcast server sends to multipoint control unit MCU with the media identification corresponding with media file.When needs playback, multipoint control unit MCU sends and carries the request that playbacks of media identification to the recorded broadcast server, the recorded broadcast server obtains the media file of media identification correspondence from the media file that it is recorded, if the recorded broadcast server self has the output equipment of looking audio frequency media, then the recorded broadcast server can self be finished playbacking media file.Perhaps, the recorded broadcast server can send to media file multipoint control unit MCU, and MCU playbacks by multipoint control unit.

Perhaps, the conference terminal that is connected with multipoint control unit MCU can be transmitted the request that playbacks that carries media identification by multipoint control unit MCU and give the recorded broadcast server, the recorded broadcast server obtains the media file of media identification correspondence from the media file that it is recorded, the recorded broadcast server can send to conference terminal by multipoint control unit MCU with media file, is playbacked by conference terminal.

Referring to shown in Figure 14, in another scene of the embodiment of the invention, the recorded broadcast server is connected with at least one conference terminal, the conference terminal that is connected with the recorded broadcast server is connected with multipoint control unit MCU again, and multipoint control unit MCU also is connected with other at least one conference terminals that is not connected with the recorded broadcast server.The process that specific implementation playbacks can be with reference to a last scene, and realization playbacks media file, does not do and gives unnecessary details.

Optionally, in another scene of the embodiment of the invention, for " net true " system as shown in figure 15, when the video media stream of widescreen image is playbacked:

If the terminal with corresponding number playbacks, then the recorded broadcast server can decompress to widescreen image media stream and recover the widescreen image, and then be partitioned into the image of each terminal correspondence, these images are encoded to generate the code stream of each terminal image, each terminal that these code streams is sent to correspondence in the true set of terminal of net playbacks, the state when recording to reproduce fully.

If when playbacking with single terminal, the decoding capability of single terminal might not reach the ability of decoding widescreen image, so when playbacking, then the recorded broadcast server can carry out adaptation processing (as resolution decreasing, fall frame per second etc.) to the widescreen image of recording, with the media formats that becomes single terminal to support the widescreen image transitions.

Therefore, the method that playbacks of above-mentioned realization multimedia conferencing, can obtain corresponding media file by media identification playbacks with realization, and media file is by making up to record to the data of multipath media stream in the multimedia conferencing and obtained according to recording strategy, and the media file that playbacks can better react the comprehensive condition of multimedia conferencing.

Embodiment four

As shown in Figure 5, the method that playbacks of the multimedia conferencing that provides corresponding to embodiment three, the embodiment of the invention provides a kind of device that playbacks of multimedia conferencing, comprising:

Playback request receiver module 51, be used for receiving the request that playbacks that carries media identification, described media identification is used for the identification medium file.

Playback module 52, be used for obtaining corresponding media file according to described media identification, to playback, described media file is recorded the processing acquisition according to recording tactful multichannel IMS conference medium stream in the multimedia conferencing is made up, and the described strategy of recording comprises that the meeting level is recorded strategy and media-level is recorded strategy.

As shown in Figure 6, optional, multimedia conferencing playback device, can also comprise:

Media identification sending module 53 is used for sending media identification to multipoint control unit MCU or conference terminal.

The multimedia conferencing that the embodiment of the invention provides playback device and concrete composition module, can playback method with reference to the multimedia conferencing that above-described embodiment three provides and understand, do not give unnecessary details at this.

Embodiment five

Method for recording, the device of the multimedia conferencing that provides corresponding to above-described embodiment one to four, playback method, device, the embodiment of the invention provides a kind of recorded broadcast device of multimedia conferencing, comprising: the record device of multimedia conferencing and/or multimedia conferencing playback device.The recorded broadcast device of multimedia conferencing can be the recorded broadcast server.

Further, the recorded broadcast device of embodiment of the invention multimedia conferencing can also comprise:

Input-output apparatus is used for input and records strategy and record parameter, and the data of exporting the Media Stream that playbacks.Record strategy and comprise that the meeting level is recorded strategy and media-level is recorded strategy.

Therefore the recorded broadcast device of embodiment of the invention multimedia conferencing can arrange flexibly and record strategy, and according to recording the data that strategy makes up the Media Stream of recording, better reacts the comprehensive condition of multimedia conferencing.

Embodiment six

As shown in Figure 7, the embodiment of the invention provides a kind of method for recording of multimedia conferencing, comprising:

Step 71, acquisition are recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, and described IMS conference medium stream is at least video media stream or audio medium stream.

Step 72, according to the meeting-place under the described IMS conference medium stream, store described multichannel IMS conference medium stream and distribute association identification, described association identification is used for the IMS conference medium stream in related each meeting-place.

Optionally, the executive agent of the method for recording of multimedia conferencing can be the recorded broadcast server, and referring to shown in Figure 13, the recorded broadcast server is connected with multipoint control unit MCU, and multipoint control unit MCU is connected with at least one conference terminal.Described acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, specifically comprises:

The meeting level is recorded strategy send to multipoint control unit MCU, described meeting level is recorded strategy and comprised: the meeting-place recording mode is switched in acoustic control, or the broadcast site recording mode, or the Chair site recording mode, or specific meeting-place recording mode;

Receive described MCU and record strategy according to described meeting level, the multichannel IMS conference medium stream that will record at least one definite meeting-place, described meeting-place comprises at least one conference terminal.

Perhaps, referring to shown in Figure 14, the recorded broadcast server is connected with at least one conference terminal, and the conference terminal that is connected with the recorded broadcast server is connected with multipoint control unit MCU again, and multipoint control unit MCU also is connected with other at least one conference terminals that is not connected with the recorded broadcast server.Described acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, specifically comprises:

The meeting level is recorded strategy send to conference terminal, described meeting-place comprises at least one conference terminal, described meeting level is recorded strategy and is comprised: specific meeting-place recording mode, or specific meeting-place local media stream recording mode, or specific meeting-place distant end media stream recording mode;

Receive described conference terminal and record the multichannel IMS conference medium that will the record stream that strategy is determined according to described meeting level.

Optionally, according to the meeting-place under the described IMS conference medium stream, store the step 72 of described multichannel IMS conference medium stream and distribution association identification, specifically that is to say, can create a file for every kind of medium in each meeting-place according to the type of described multichannel IMS conference medium stream, also can flow affiliated meeting-place according to described multichannel IMS conference medium, for creating a file in each meeting-place, also can file of whole conference creation.No matter the sort of stored record mode all is related association identification of meeting-place record of record.

Optionally, the method for recording of the multimedia conferencing of the embodiment of the invention can also comprise: the time synchronization information that obtains video media stream and audio medium stream in the described multichannel IMS conference medium stream.

Like this, time synchronization information according to described video media stream and audio medium stream, can realize that with the data of described video media stream and the data multiplexing and encoding of audio medium stream be media file, occur looking the nonsynchronous problem of audio frequency when being conducive to avoid playbacking easily, raising playbacks quality.

Optionally, the method for recording of the multimedia conferencing of the embodiment of the invention can also comprise: the control command that obtains and store each meeting-place in the multimedia conferencing.

Like this, in the time of will playbacking, can playback the image of in conference process, seeing in the meeting-place and the sound of hearing, playback the control command of this meeting-place in meeting simultaneously, accomplish the complete reproduction to this meeting-place.

The technical scheme that is provided by the invention described above embodiment as can be seen, the method for recording of above-mentioned multimedia conferencing can arrange flexibly and record strategy, makes the data of the Media Stream that combination is recorded better react the comprehensive condition of multimedia conferencing.

Embodiment eight

The method for recording of the multimedia conferencing that provides referring to above-described embodiment seven, as shown in Figure 8, the embodiment of the invention provides a kind of record device that can realize the multimedia conferencing of above-mentioned method for recording, comprising:

Receiver module 81 is used for obtaining to record the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, and described IMS conference medium stream is at least video media stream or audio medium stream.

Association identification distribution module 82 is used for according to the meeting-place under the described IMS conference medium stream, stores described multichannel IMS conference medium stream and distributes association identification, and described association identification is used for the IMS conference medium stream in related each meeting-place.

As shown in Figure 9, optionally, if the executive agent of the method for recording of multimedia conferencing can be the recorded broadcast server, the recorded broadcast server is connected with multipoint control unit MCU, multipoint control unit MCU is connected with at least one conference terminal, and perhaps, the recorded broadcast server is connected with at least one conference terminal, the conference terminal that is connected with the recorded broadcast server is connected with multipoint control unit MCU again, and multipoint control unit MCU also is connected with other at least one conference terminals that is not connected with the recorded broadcast server.

The record device of the embodiment of the invention can also comprise: synchronizing information acquisition module 83 is used for obtaining the time synchronization information that described multichannel IMS conference medium flows video media stream and audio medium stream.

The record device of the embodiment of the invention can also comprise: control command acquisition module 84, and for the control command that obtains and store each meeting-place of multimedia conferencing.

The record device of the multimedia conferencing that the embodiment of the invention provides and concrete composition module can be understood with reference to the multimedia conferencing method for recording that above-described embodiment seven provides, and do not give unnecessary details at this.

The technical scheme that is provided by the invention described above embodiment is appreciated that the record device of above-mentioned multimedia conferencing, can arrange flexibly and record strategy, makes the data of the Media Stream that combination is recorded better react the comprehensive condition of multimedia conferencing.

Embodiment nine

The method for recording of the multimedia conferencing that provides corresponding to the embodiment of the invention seven, as shown in figure 10, the embodiment of the invention provides a kind of method that playbacks of multimedia conferencing, comprising:

Step 101, reception carry the request that playbacks of association identification, obtain the multichannel IMS conference medium stream of described association identification correspondence, and described association identification is used for the IMS conference medium stream in related each meeting-place, and described IMS conference medium stream is at least video media stream or audio medium stream.

Step 102, according to the media record strategy described multichannel IMS conference medium stream is made up and to record processing.

Media-level is recorded strategy and is comprised video media recording mode and audio frequency media recording mode, described video media recording mode comprises: the video record way arranges pattern, or Multipicture recording mode, or video picture-in-picture recording mode, or widescreen video media record pattern, described audio frequency media recording mode comprises: the audio recording way arranges pattern, or the audio frequency mono channel recording mode, or audio frequency multichannel recording mode.

Optionally, according to the media record strategy described multichannel IMS conference medium stream is made up the step 102 of recording processing, can comprise:

According to the video media recording mode of described media record strategy, described multi-channel video Media Stream is synthesized one or more Multipicture, or one or more video picture-in-picture, or one or more widescreen video;

According to the audio frequency media recording mode of described media record strategy, described multichannel voice frequency Media Stream is synthesized audio frequency mono channel, or the audio frequency multichannel.

The method that playbacks of the multimedia conferencing of the embodiment of the invention can also comprise:

Obtain the time synchronization information of video media stream and audio medium stream in the described multichannel IMS conference medium stream;

According to the time synchronization information of described video media stream and audio medium stream, be media file with the data of the described video media stream after synthetic and the data multiplexing and encoding of audio medium stream.

Media file can adopt comparatively general forms such as MPEG media file format, occurs looking the nonsynchronous problem of audio frequency when avoiding playbacking easily, improves to playback quality.

The executive agent that the embodiment of the invention playbacks method can be the recorded broadcast server.

Under scene of the embodiment of the invention, referring to shown in Figure 13, be connected with multipoint control unit MCU as the recorded broadcast server, multipoint control unit MCU is connected with at least one conference terminal.

Multipoint control unit MCU can send carry association identification the request that playbacks to the recorded broadcast server, the recorded broadcast server obtains corresponding multichannel IMS conference medium stream according to association identification, the recorded broadcast server sends to multipoint control unit MCU with described multichannel IMS conference medium stream, multipoint control unit MCU records tactful described multichannel IMS conference medium stream is made up according to media-level and records processing, and playbacks.

Perhaps, conference terminal sends and carries the request that playbacks of association identification to multipoint control unit MCU, the recorded broadcast server receives the request of playbacking by multipoint control unit MCU, the recorded broadcast server obtains corresponding multichannel IMS conference medium stream according to association identification, the recorded broadcast server sends to multipoint control unit MCU with described multichannel IMS conference medium stream, multipoint control unit MCU records tactful described multichannel IMS conference medium stream is made up according to media-level and records processing, the Media Stream that multipoint control unit MCU records combination after the processing sends to conference terminal, is playbacked by conference terminal.

When if the recorded broadcast server also directly is connected with player or conference terminal, player or conference terminal can send carry association identification the request that playbacks to the recorded broadcast server, the recorded broadcast server obtains corresponding multichannel IMS conference medium stream according to association identification, the recorded broadcast server sends to multipoint control unit MCU with described multichannel IMS conference medium stream, multipoint control unit MCU records tactful described multichannel IMS conference medium stream is made up according to media-level and records processing, the Media Stream that multipoint control unit MCU records combination after the processing by the recorded broadcast server sends to player or conference terminal, is playbacked by player or conference terminal.

Under another scene of the embodiment of the invention, referring to shown in Figure 13, the recorded broadcast server is connected with at least one conference terminal, the conference terminal that is connected with the recorded broadcast server is connected with multipoint control unit MCU again, and multipoint control unit MCU also is connected with other at least one conference terminals that is not connected with the recorded broadcast server.

The conference terminal that is connected with the recorded broadcast server sends and carries the request that playbacks of association identification to the recorded broadcast server, the recorded broadcast server obtains corresponding multichannel IMS conference medium stream according to association identification, the recorded broadcast server is recorded tactful described multichannel IMS conference medium stream is made up according to media-level and is recorded processing, and playbacks.

Perhaps, the conference terminal that is connected with the recorded broadcast server sends and carries the request that playbacks of association identification to the recorded broadcast server, the recorded broadcast server obtains corresponding multichannel IMS conference medium stream according to association identification, the recorded broadcast server sends the multichannel IMS conference medium and flows the conference terminal that is connected to the recorded broadcast server, the conference terminal that is connected with the recorded broadcast server is recorded tactful described multichannel IMS conference medium stream is made up according to media-level and is recorded processing, and playbacks.

When if the recorded broadcast server also directly is connected with player or conference terminal, player or conference terminal can be realized the function as the above-mentioned conference terminal that is connected with the recorded broadcast server, as record according to media-level strategy to as described in multichannel IMS conference medium stream make up and record processing, and playback.

The method that playbacks of the multimedia conferencing of the embodiment of the invention playbacks in the process, as the interface that can provide by the recorded broadcast server, perhaps expansion plugin, send suspend, change reproduction time, the request that stops.The recorded broadcast server can be handled request, redefine the time point (determining the code stream time point: can calculate timestamp in the code stream according to reproduction time) of each meeting-place broadcast code flow in the meeting, with request with confirmed that the code stream of time point issues multipoint control unit MCU.Multipoint control unit MCU wait is received after the recorded broadcast server has been reaffirmed the code stream of time point and is just continued to handle.

The method that playbacks of the multimedia conferencing of the embodiment of the invention can also comprise:

Playback the image of in conference process, seeing in the meeting-place and the sound of hearing, playback the control command of this meeting-place and meeting simultaneously, accomplish the complete reproduction to this meeting-place.

The method that playbacks of the multimedia conferencing of the embodiment of the invention can also comprise:

In playbacking process, the interface that can provide by the recorded broadcast server, perhaps expansion plugin, realize specifying the virtual affiliation in meeting-place, many pictures be set, many pictures poll, switch the program request meeting-place, quiet close sound, long-range present screen switching etc. can the control operation.

To specifying the virtual affiliation operation in meeting-place, with this appointment meeting-place of the playback image of seeing in conference process and the sound of hearing, the control command in this meeting-place of playback is simultaneously accomplished the complete reproduction to this meeting-place.

To many screen operations are set, the meeting-place of appointment is combined into the picture span mode of appointment, send to program request person.

To many pictures polling operation, the meeting-place of appointment regularly is combined into the picture span mode of appointment in turn, send to program request person.

To switching the operation of program request meeting-place, the program request meeting field picture harmony sound of appointment is sent to program request person.

The quiet sound that closes is operated, with specifying the sound in meeting-place to reject, made program request person can't hear this meeting-place sound, mask a riot of sound meeting-place.

To switching the long-range meeting-place screen operator that presents, will specify the image of screen to send to program request person.

Therefore the method that playbacks of above-mentioned realization multimedia conferencing can obtain corresponding multipath media stream by association identification, and combination is recorded and playbacked to multipath media stream, better reacts the comprehensive condition of multimedia conferencing.

Embodiment ten

As shown in figure 11, the method that playbacks of the multimedia conferencing that provides corresponding to embodiment seven, the embodiment of the invention provides a kind of device that playbacks of multimedia conferencing, comprising:

Playback request receiver module 111, be used for receiving the request that playbacks that carries association identification, obtain the multichannel IMS conference medium stream of described association identification correspondence, described association identification is used for the IMS conference medium stream in related each meeting-place, and described IMS conference medium stream is at least video media stream or audio medium stream.

Playback processing module 112, record processing for according to the media record strategy described multichannel IMS conference medium stream being made up.

As shown in figure 12, optional, playback processing module 112, can comprise:

Video record processing module 1121, be used for the video media recording mode according to described media record strategy, described multi-channel video Media Stream is synthesized one or more Multipicture, or one or more video picture-in-picture, or one or more widescreen video, described media-level is recorded strategy and is comprised video media recording mode and audio frequency media recording mode, described video media recording mode comprises: the video record way arranges pattern, or Multipicture recording mode, or video picture-in-picture recording mode, or widescreen video media record pattern.

Audio recording processing module 1122 is used for the audio frequency media recording mode according to described media record strategy, and described multichannel voice frequency Media Stream is synthesized audio frequency mono channel, or the audio frequency multichannel.Described audio frequency media recording mode comprises: the audio recording way arranges pattern, or the audio frequency mono channel recording mode, or audio frequency multichannel recording mode.

The embodiment of the invention playback device, can also comprise:

Synchronizing information acquisition module 113 is used for obtaining the time synchronization information that described multichannel IMS conference medium flows video media stream and audio medium stream.

Media file generation module 114 is used for the time synchronization information according to described video media stream and audio medium stream, is media file with the data of the described video media stream after synthetic and the data multiplexing and encoding of audio medium stream.

The embodiment of the invention playback device, can also comprise:

Control command playbacks module 115, is used for playbacking according to the meeting level recording the control command that strategy is determined.

The multimedia conferencing that the embodiment of the invention provides playback device and concrete composition module, can playback method with reference to the multimedia conferencing that above-described embodiment nine provides and understand, do not give unnecessary details at this.

The technical scheme that is provided by the invention described above embodiment is appreciated that, above-mentioned multimedia conferencing playback device, can obtain corresponding multipath media stream by association identification, combination is recorded and is playbacked to multipath media stream, better reacts the comprehensive condition of multimedia conferencing.

Embodiment 11

Method for recording, the device of the multimedia conferencing that provides corresponding to above-described embodiment seven to ten, playback method, device, the embodiment of the invention provides a kind of recorded broadcast device of multimedia conferencing, comprising: the record device of multimedia conferencing and/or multimedia conferencing playback device.The recorded broadcast device of multimedia conferencing can be the recorded broadcast server.

Further, the recorded broadcast device of the embodiment of the invention can also comprise:

Input-output apparatus is used for input and records strategy, records parameter, and the program request interface is provided.

Record strategy and comprise that media-level records strategy.The program request interface provide send to suspend, change reproduction time, the request that stops, provide and specify the virtual affiliation in meeting-place, many pictures are set, many pictures poll, switch the program request meeting-place, quiet close sound, long-range present screen switching etc. can the control operation.

Therefore the recorded broadcast device of the invention described above embodiment can arrange flexibly and record strategy, and according to recording the data that strategy makes up the Media Stream of recording, better reacts the comprehensive condition of multimedia conferencing.

Embodiment 12

Method for recording, the device of the multimedia conferencing that provides corresponding to above-described embodiment one to four, playback method, device, the embodiment of the invention provides a kind of recording and broadcasting system of multimedia conferencing, comprises the recorded broadcast device of multimedia conferencing, multipoint control unit MCU and conference terminal.As shown in figure 13, the recorded broadcast server is connected with multipoint control unit MCU, and multipoint control unit MCU is connected with at least one conference terminal.Recorded broadcast device 100, the multipoint control unit (multipoint control unit MCU) 200 that is connected with recorded broadcast device 100, and at least one conference terminal 300 that is connected with multipoint control unit MCU200.The recorded broadcast device of multimedia conferencing can be the recorded broadcast server.

Optionally, a plurality of conference terminals 300 link to each other by first communication network with multipoint control unit 200, and multipoint control unit 200 is finished data mutual of 300 Media Streams of a plurality of conference terminals.Simultaneously, recorded broadcast device 100 links to each other with multipoint control unit 200 by the second communication network, and set up connection, this connect to be used for recorded broadcast device 100 and 200 of multipoint control units carry out the data of Media Stream and information (as meeting indication information, medium indication information etc.) alternately, recorded broadcast device 100 can carry out synthetic recording to the data of the multipath media stream on the multipoint control unit 200.

Attention: second communication network and first communication network can be same kind of communication network, and as all being Ethernet, second communication network and first communication network also can be different communication networks.A plurality of conference terminals 300, multipoint control unit 200 and recorded broadcast device 100 also can be arranged on a communication network, as Ethernet.

When recorded broadcast device 100 during as separate equipment, can have the input equipment of oneself, be used for the input of information, as: keyboard, touch-screen, mouse, remote controller etc.; The output equipment that also can have oneself is used for the output demonstration of information, as: liquid crystal display screen, display etc.Certainly, when recorded broadcast device during as separate equipment, can there be oneself independently input-output apparatus, at this moment yet, it can share the input-output apparatus of multipoint control unit 200 turnkey console, by multipoint control unit 200 turnkey console the recorded broadcast device is carried out indirect control.

The user can record strategy and record parameter by the input equipment setting of recorded broadcast device 100.Multipoint control unit 200 receives the meeting level of recorded broadcast device 100 transmissions and records strategy, multipoint control unit 200 is recorded strategy according to the meeting level and is determined that the multichannel IMS conference medium that will record flows, multipoint control unit 200 sends the multichannel IMS conference medium that will record and flows to recorded broadcast device 100, recorded broadcast device 100 is recorded strategy according to media-level the data of multichannel IMS conference medium stream is synthesized, and obtains media file.Recorded broadcast device 100 store media files also arrange corresponding media identification.

Multipoint control unit 200 sends and carries the request that playbacks of media identification to recorded broadcast device 100, recorded broadcast device 100 obtains corresponding media file according to media identification, recorded broadcast device 100 is realized playbacking, perhaps, recorded broadcast device 100 sends to multipoint control unit 200 with media file, and multipoint control unit 200 is realized playbacking.

Recorded broadcast device 100 can become one with multipoint control unit 200 or independent the setting.

In another scene of the embodiment of the invention, when meeting constitutes " net is true " system eventually, there is more than one conference terminal in each meeting-place, as shown in figure 15,3 conference terminals, 3 high-definition cameras and 3 high-clear displays, the conference terminal compositing terminal group (as shown in Figure 15 shown in the frame of broken lines) in same meeting-place.The difference of this scene and above-mentioned two scenes is that set of terminal has replaced conference terminal, and recorded broadcast device 100 can independently arrange, also can with set of terminal in conference terminal become one.The recorded broadcast process of this scene can be understood with reference to scene, does not give unnecessary details at this.

Embodiment 13

Method for recording, the device of the multimedia conferencing that provides corresponding to above-described embodiment one to four, playback method, device, the embodiment of the invention provides a kind of recording and broadcasting system of multimedia conferencing, comprises the recorded broadcast device of multimedia conferencing, multipoint control unit MCU and conference terminal.As shown in figure 14, the recording and broadcasting system of multimedia conferencing comprises that multipoint control unit (multipoint control unit MCU) 200, multipoint control unit 200 that recorded broadcast device 100, at least one conference terminal 300 that is connected with recorded broadcast device 100, at least one conference terminal 300 that is connected with recorded broadcast device 100 connect also are connected with at least one conference terminal 300:

Optionally, a plurality of conference terminals 300 link to each other by first communication network with multipoint control unit 200, and multipoint control unit 200 is finished data mutual of 300 Media Streams of a plurality of conference terminals.Simultaneously, recorded broadcast device 100 links to each other with at least one conference terminal 300 by the second communication network, and recorded broadcast device 100 can make up the data of the multipath media stream at least one conference terminal 300 that is attached thereto and record.Attention: second communication network and first communication network can be same kind of communication network, as all being Ethernet; Second communication network and first communication network also can be different communication networks.A plurality of conference terminals 300, multipoint control unit 200 and recorded broadcast device 100 also can be arranged on a communication network, as Ethernet.When recorded broadcast device 100 during as separate equipment, can have the input equipment of oneself, be used for the input of information, as: keyboard, touch-screen, mouse, remote controller etc.; The output equipment that also can have oneself is used for the output demonstration of information, as: liquid crystal display screen, display etc.Certainly, when recorded broadcast device during as separate equipment, can there be oneself independently input-output apparatus, at this moment yet, it can share the input-output apparatus of multipoint control unit 200 turnkey console, by multipoint control unit 200 turnkey console the recorded broadcast device is carried out indirect control.

The user can record strategy and record parameter by the input equipment setting of recorded broadcast device 100.

Because 100 in recorded broadcast device is connected with part conference terminal 300, and the recorded broadcast device is just to the record of conference process, so recorded broadcast device 100 flows to record the multichannel IMS conference medium of connected conference terminal 300 in conference process only.Like this, recorded broadcast device 100 sends to connected conference terminal 300, and the meeting level that can be suitable for is recorded strategy and comprised: specific meeting-place recording mode, or specific meeting-place local media stream recording mode, or specific meeting-place distant end media stream recording mode.

The conference terminal 300 that is connected with recorded broadcast device 100 receives the meeting level of recorded broadcast device 100 transmissions and records strategy, conference terminal 300 is recorded strategy according to the meeting level and is determined that the multichannel IMS conference medium that will record flows, conference terminal 300 sends the multichannel IMS conference medium that will record and flows to recorded broadcast device 100, recorded broadcast device 100 is recorded strategy according to media-level the data of multichannel IMS conference medium stream is synthesized, and obtains media file.Recorded broadcast device 100 store media files also arrange corresponding media identification.

Conference terminal 300 sends and carries the request that playbacks of media identification to recorded broadcast device 100, recorded broadcast device 100 obtains corresponding media file according to media identification, recorded broadcast device 100 is realized playbacking, perhaps, recorded broadcast device 100 sends to conference terminal 300 with media file, and conference terminal 300 is realized playbacking.

Recorded broadcast device 100 can become one with conference terminal 300 or independent the setting.

In another scene of the embodiment of the invention, when meeting constitutes " net is true " system eventually, there is more than one conference terminal in each meeting-place, as shown in figure 15,3 conference terminals, 3 high-definition cameras and 3 high-clear displays, the conference terminal compositing terminal group (as shown in Figure 15 shown in the frame of broken lines) in same meeting-place.The difference of this scene and above-mentioned two scenes is that set of terminal has replaced conference terminal, and recorded broadcast device 100 can independently arrange, also can with set of terminal in conference terminal become one.The recorded broadcast process of this scene can be understood with reference to above-mentioned scene, does not give unnecessary details at this.

Embodiment 1

Recording, playback method as shown in figure 16 with what the recording and broadcasting system of multimedia conferencing shown in Figure 13 illustrated multimedia conferencing, at first is the recording process of multimedia conferencing:

1601, the recorded broadcast device is recorded strategy with the meeting level and is sent to multipoint control unit.

The recorded broadcast device is recorded strategy " the meeting-place recording mode is switched in acoustic control " with the meeting level and is sent to multipoint control unit MCU.The Media Stream that " the meeting-place recording mode is switched in acoustic control " expression need be recorded is the Media Stream in the maximum meeting-place of volume.

Also can be that if multipoint control unit MCU has set in advance the meeting level and records strategy, then the recorded broadcast device does not need to send the meeting level and records strategy to multipoint control unit MCU.

1602, multipoint control unit MCU records the definite multichannel IMS conference medium stream that will record of strategy according to the meeting level.

Multipoint control unit MCU receives the meeting level for " the meeting-place recording mode is switched in acoustic control " of recorded broadcast device transmission and records strategy, multipoint control unit MCU can regularly detect the size of each meeting-place volume in the meeting, determines the data of the Media Stream in the maximum meeting-place of volume are sent to the recorded broadcast device to record.

1603, multipoint control unit MCU sends the multichannel IMS conference medium that will record and flows to the recorded broadcast device.

The data that the IMS conference medium that multipoint control unit MCU transmits to the recorded broadcast device flows, can use the individual data interface channel to transmit the data of all types of IMS conference medium streams, also can use a plurality of data interface channels to transmit the data that dissimilar IMS conference mediums flows, the data of dissimilar IMS conference medium stream such as video, voice data.

And multipoint control unit MCU can send video media stream and the time synchronization information of audio medium stream, medium indication information and the meeting indication information of IMS conference medium stream simultaneously to the recorded broadcast device.

1604, the recorded broadcast device is recorded strategy according to media-level the data of the multichannel IMS conference medium stream that receives is synthesized.

The media-level of recorded broadcast device is recorded strategy, as video record strategy " many pictures ", audio recording strategy " multichannel pattern ".The recorded broadcast device will be synthetic according to the data of the multipath media stream in the maximum meeting-place of sound in the meeting of " the meeting-place recording mode is switched in acoustic control " acquisition according to " many pictures ", " multichannel pattern ".As, local video Media Stream and far-end video media stream are recorded as many pictures, local audio Media Stream and far-end audio recording medium stream are recorded as multichannel audio, as local voice L channel, far-end speech R channel etc.

Record parameter (as recording duration etc.) if the recorded broadcast device also comprises, then finish synthesizing multichannel IMS conference medium stream according to recording the parameter cooperation.

If multipoint control unit MCU has the video media stream of IMS conference medium stream and the time synchronization information of audio medium stream to the transmission of recorded broadcast device, when medium indication information and meeting indication information, specifically can be:

The recorded broadcast device receives the medium indication information that sends from multipoint control unit, judges whether the data of multipath media stream are decoded.Whether the recorded broadcast device decodes to the data of the multipath media stream that receives, depends on whether the data of the Media Stream that receives are compressed, when the data of the Media Stream that receives do not have can directly synthesize when compressed.

The data of the Media Stream after the recorded broadcast device will synthesize are carried out corresponding compressed encoding.The data of the Media Stream after the recorded broadcast device will synthesize are carried out corresponding compressed encoding, are not necessary, and compressed encoding mainly is in order to reduce the data volume of Media Stream.

The recorded broadcast device is according to time synchronization information, and the data multiplexing and encoding of the Media Stream after synthetic is become one or more media file, and media file format can adopt the MPEG media file format, conveniently stores and playbacks.The data multiplexing and encoding of Media Stream after the compression is become media file, not necessarily, also can be directly with the data of the Media Stream after the compression with its time synchronizing information separately separate, stored in memory device.

If the recorded broadcast device receives the meeting indication information that multipoint control unit sends, as, during the indication information that receives that meeting adjourned, illustrating that active conference finishes, can finish recording of active conference so.

1605, the recorded broadcast device gets up media file storage, and the corresponding media identification of configuration.

The media file storage that the recorded broadcast device can obtain multiplexing and encoding is with in the device or equipment of memory function at hard disk, USB flash disk, SD card, tape etc., and can dispose corresponding media identification, when being convenient to playback, finds corresponding media file according to media identification.

Then be the process that playbacks of multimedia conferencing:

1606, the recorded broadcast device sends to multipoint control unit MCU with media identification.

The recorded broadcast device sends to multipoint control unit MCU with media identification.

Can know that multipoint control unit MCU also can send to media identification each conference terminal, does not do and gives unnecessary details.

1607, multipoint control unit sends the request that playbacks to the recorded broadcast device.

Multipoint control unit MCU sends to the recorded broadcast device and playbacks request, and described playbacking carries media identification in the request.

Notice that each conference terminal also can send the request of playbacking, will playback request by multipoint control unit and be transmitted to the recorded broadcast device.

1608, the recorded broadcast device obtains corresponding media file according to playbacking request.

The recorded broadcast device receives the request of playbacking, and according to playbacking the media identification that request is carried, reads the media file of the correspondence of storage.

If the recorded broadcast device self has the output equipment of looking audio frequency media, can self finish demultiplexing, decoding to media file by the recorded broadcast device, playback then.The recorded broadcast device also can carry out the data of the Media Stream behind the demultiplexing adaptation processing of medium, sends to multipoint control unit MCU.Carry out the adaptation processing of medium, be mainly used to the media compression type that the media compression type conversion can be supported for multipoint control unit MCU.

1609, the recorded broadcast device sends to multipoint control unit MCU with the data of Media Stream.

The recorded broadcast device sends to multipoint control unit MCU with the data of Media Stream, and the data of Media Stream are the data of adaptation processing.

1610, multipoint control unit MCU playbacks.

Multipoint control unit MCU receives the data of the Media Stream of recorded broadcast device transmission, playbacks after the decoding.Perhaps, multipoint control unit MCU also can send to conference terminal with the data of Media Stream, by playbacking after the conference terminal decoding.

In addition, the data-interface (as: USB interface) that can also provide by the recorded broadcast device is with the media file copy or send on other the equipment (as: PC) and play.

Therefore, in multimedia conferencing, multimedia conferencing may relate to more than one meeting-place, each meeting-place arranges a conference terminal usually, like this, above-mentioned multimedia conferencing record, playback method, can make up the data of multipath media stream in the multimedia conferencing and record processing, satisfy the different tactful requirements of recording.

And for " net is true " system, as shown in figure 15, each meeting-place arranges more than one conference terminal, as 3 conference terminals, 3 high-definition cameras and 3 high-clear displays, in the use, in 3 high-clear displays, can show man-size distal view picture, and epigraph is continuous in the horizontal direction, makes the participant of each side face the on-the-spot experience of having a meeting, carry out face-to-face exchange together just like body.

Above-mentioned multimedia conferencing record, playback method, can also comprise, conference terminal compositing terminal group (shown in the frame of broken lines among Figure 15) with same meeting-place, and media-level can be set record strategy, as with the local video of each terminal in the set of terminal combination many pictures of local video or local widescreen image, the far-end video of each terminal in the set of terminal is combined into far-end Multipicture or far-end widescreen image.So, local video image is not staggered in the far-end video image, to the identification of local video image and far-end video image, clearly shows the comprehensive condition in meeting-place when being convenient to playback.Certainly, also local media and the distant end media of each terminal in the set of terminal can be carried out recording of combination in any, not do and give unnecessary details.

Embodiment 2

Recording, playback method with what the recording and broadcasting system of multimedia conferencing shown in Figure 14 illustrated multimedia conferencing, as shown in figure 17, at first is the recording process of multimedia conferencing:

1701, the recorded broadcast device is recorded strategy with the meeting level and is sent to conference terminal.

The recorded broadcast device is recorded strategy " specific meeting-place recording mode " with the meeting level and is sent to the conference terminal that is attached thereto.

In like manner, if the conference terminal that links to each other with the recorded broadcast device has set in advance the meeting level and recorded strategy, then the recorded broadcast device does not need to send the meeting level and records tactful in the conference terminal that is attached thereto.

1702, conference terminal is recorded the definite multichannel IMS conference medium stream that will record of strategy according to the meeting level.

The conference terminal that links to each other with the recorded broadcast device receives record tactful " the specific meeting-place recording mode " of recorded broadcast device transmission, determines whether self is the specific meeting-place of recording in the strategy.If the conference terminal that links to each other with the recorded broadcast device is determined certainly as the specific meeting-place of recording in the strategy, confirm that then the Media Stream on it is the multichannel IMS conference medium stream that will record, the conference terminal that links to each other with the recorded broadcast device sends to the recorded broadcast device with the Media Stream on it.

1703, conference terminal will send the multichannel IMS conference medium that will record and flow to the recorded broadcast device.

The data that the multichannel IMS conference medium that the conference terminal that links to each other with the recorded broadcast device transmits to the recorded broadcast device flows, can use the individual data interface channel to transmit the data of all types of IMS conference medium streams, also can use a plurality of data interface channels to transmit the data that dissimilar IMS conference mediums flows, the data of dissimilar IMS conference medium stream such as video, voice data.

And the conference terminal that links to each other with the recorded broadcast device can be simultaneously to recorded broadcast device transmitting time synchronizing information, medium indication information and meeting indication information.

1704, the recorded broadcast device is recorded strategy according to media-level the data of the multichannel IMS conference medium that receives stream is synthesized.

The media-level of recorded broadcast device is recorded strategy, as video record strategy " picture-in-picture ", audio recording strategy " multichannel pattern ".The recorded broadcast device is according to " picture-in-picture ", " multichannel pattern ", and the data of multipath media stream are synthetic.As, local video Media Stream and far-end video media stream are recorded as picture-in-picture, local audio Media Stream and far-end audio recording medium stream are recorded as multichannel audio, as local voice L channel, far-end speech R channel etc.

Record parameter (as recording duration etc.) if the recorded broadcast device also comprises, then finish synthesizing multichannel IMS conference medium stream according to recording the parameter cooperation.

If the conference terminal that links to each other with the recorded broadcast device has the video media stream of IMS conference medium stream and the time synchronization information of audio medium stream to the transmission of recorded broadcast device, when medium indication information and meeting indication information, specifically can be:

The recorded broadcast device receives the medium indication information that conference terminal sends, and judges whether the data of multipath media stream are decoded.Whether the recorded broadcast device decodes to the data of the multipath media stream that receives, depends on whether the data of the Media Stream that receives are compressed, when the data of the Media Stream that receives do not have can directly synthesize when compressed.

The data of the Media Stream after the recorded broadcast device will synthesize are carried out corresponding compressed encoding.The data of the Media Stream after the recorded broadcast device will synthesize are carried out corresponding compressed encoding, are not necessary, and compressed encoding mainly is in order to reduce the data volume of Media Stream.

The recorded broadcast device becomes one or more media file according to time synchronization information with the media stream data multiplexing and encoding after synthetic.The data multiplexing and encoding of Media Stream after the compression is become media file, neither be necessary, also can be directly with the data of the Media Stream after the compression with its time synchronizing information separately separate, stored in memory device.

If the recorded broadcast device receives the meeting indication information that conference terminal sends, as, during the indication information that receives that meeting adjourned, illustrating that active conference finishes, can finish recording of active conference so.

1705, the recorded broadcast device gets up media file storage, and the corresponding media identification of configuration.

The media file storage that the recorded broadcast device can obtain multiplexing and encoding, and can dispose corresponding media identification, when being convenient to playback, find corresponding media file according to media identification.

Then be the process that playbacks of multimedia conferencing:

1706, the recorded broadcast device sends to conference terminal with media identification.

The recorded broadcast device sends to media identification at least one conference terminal that is attached thereto.

Can know that the conference terminal that links to each other with the recorded broadcast device also can send to other conference terminals with media identification by multipoint control unit MCU, does not do and gives unnecessary details.

1707, conference terminal sends the request that playbacks to the recorded broadcast device.

At least one conference terminal that links to each other with the recorded broadcast device sends to the recorded broadcast device and playbacks request, and described playbacking carried media identification in the request.

Can know that the conference terminal that multipoint control unit MCU and other do not link to each other with the recorded broadcast device also can send the request of playbacking, and does not do and gives unnecessary details.

1708, the recorded broadcast device obtains corresponding media file according to playbacking request.

The recorded broadcast device receives the request of playbacking, and according to playbacking the media identification that request is carried, reads the media file corresponding with media identification of storage.

Note, if the recorded broadcast device self has the output equipment of looking audio frequency media, can self finish demultiplexing, decoding to media file by the recorded broadcast device, playback then.

If the recorded broadcast device is ignored the output equipment of audio frequency media, the recorded broadcast device can carry out the data of the Media Stream behind the demultiplexing adaptation processing of medium, sends at least one conference terminal that links to each other with the recorded broadcast device.

Notice that carry out the adaptation processing of medium, being mainly used to the media compression type conversion is the media compression type that conference terminal can be supported.

1709, the recorded broadcast device sends to conference terminal with the data of Media Stream.

The recorded broadcast device sends at least one conference terminal that links to each other with the recorded broadcast device with the data of Media Stream, and the data of Media Stream are the data of adaptation processing.

1710, conference terminal playbacks.

At least one conference terminal that links to each other with the recorded broadcast device receives adaptive media file, to the media file decoding, playbacks then.

At least one conference terminal that links to each other with the recorded broadcast device also can send to the data of Media Stream multipoint control unit MCU, multipoint control unit MCU sends to the conference terminal that other do not link to each other with the recorded broadcast device with the data of Media Stream, by playbacking after multipoint control unit MCU or other the conference terminal decodings that does not link to each other with the recorded broadcast device.

In addition, the also data-interface (as: USB interface) that can provide by the recorded broadcast device is with the media file copy or send on other the equipment (as: PC) and play.

In multimedia conferencing, multimedia conferencing may relate to more than one meeting-place, and each meeting-place arranges a conference terminal usually, like this, above-mentioned multimedia conferencing record, playback method, can make up the data of multipath media stream and record processing, satisfy the different tactful requirements of recording.

Equally for " net is true " system, as shown in figure 15, each meeting-place arranges more than one conference terminal, as 3 conference terminals, 3 high-definition cameras and 3 high-clear displays, in the use, in 3 high-clear displays, can show man-size distal view picture, and epigraph is continuous in the horizontal direction, makes the participant of each side face the on-the-spot experience of having a meeting, carry out face-to-face exchange together just like body.

Above-mentioned multimedia conferencing record, playback method, can also comprise, conference terminal compositing terminal group (shown in the frame of broken lines among Figure 15) with same meeting-place, and media-level can be set record strategy, as with the local video of each terminal in the set of terminal combination many pictures of local video or local widescreen image, the far-end video of each terminal in the set of terminal is combined into far-end Multipicture or far-end widescreen image.So, local image is not staggered in the distal view picture, to the identification of local image and distal view picture, clearly shows the comprehensive condition in meeting-place when being convenient to playback.Certainly, the recording and storing that local media and the distant end media of each terminal in the set of terminal can be carried out combination in any is not done and is given unnecessary details yet.

Embodiment 3

Record, playback method referring to what recording and broadcasting system shown in Figure 180 illustrated multimedia conferencing, in recording and broadcasting system, the recorded broadcast device is connected with multipoint control unit MCU, and multipoint control unit MCU is connected with at least one conference terminal.The recorded broadcast server can also directly be connected with player or conference terminal, and player or conference terminal do not participate in a conference, and it can be used as program request person.

As shown in figure 19, at first be the recording process of multimedia conferencing:

1901, the multichannel IMS conference medium in each meeting-place stream in the meeting of recorded broadcast device recording.

The recorded broadcast device is recorded strategy according to the meeting level and is determined that the multichannel IMS conference medium that will record flows, and the recorded broadcast device also records described multichannel IMS conference medium stream.

1902, the recorded broadcast device is multichannel IMS conference medium flow distribution association identification.

The recorded broadcast device is stored described multichannel IMS conference medium stream and is distributed association identification according to the meeting-place under the described IMS conference medium stream, and described association identification is used for the IMS conference medium stream in related each meeting-place.As, a file is created in each meeting-place, 1.avi, 2.avi, 3.avi, the related 1.avi of association identification conf1,2.avi, 3.avi.

Then be the process that playbacks of multimedia conferencing:

1903, player sends and carries the request that playbacks of association identification to the recorded broadcast device.

Player can be with stream protocols such as RTSP by recorded broadcast mounted point International Broadcasting Convention conf1, as H323/SIP method of calling program request conf1.

1904, the recorded broadcast device sends to multipoint control unit MCU with the multichannel IMS conference medium stream of association identification correspondence.

The recorded broadcast device obtains corresponding multichannel IMS conference medium stream 1.avi according to conf1, and 2.avi, 3.avi send to multipoint control unit MCU.

1905, the multichannel IMS conference medium of multipoint control unit MCU stream makes up and records processing.

Multipoint control unit MCU records strategy to multichannel IMS conference medium stream 1.avi according to media-level, and 2.avi, 3.avi make up and record processing.As synthetic many pictures, long-rangely present that screen splicing, sound mix, main flow and auxilliary stream merge, the time is held in the stack meeting, carry out processing such as duration.

1906, the Media Stream that will record after the processing of multipoint control unit MCU sends to the recorded broadcast device.

1907, the recorded broadcast device sends the Media Stream record after the processing to player.

1908, player is recorded the Media Stream after the processing.

The player basis is recorded the Media Stream after the processing, realizes playbacking.

Can know that multipoint control unit MCU also can directly issue the player of program request with the Media Stream after handling, and does not need to transmit through the recorded broadcast device.

What can replace is, in 1903 player can send carry association identification the request that playbacks to multipoint control unit MCU.At this moment, multipoint control unit MCU need transmit the request of playbacking to the recorded broadcast device.Then, 1904, the recorded broadcast device sends to multipoint control unit MCU with the multichannel IMS conference medium stream of association identification correspondence.1905, the multichannel IMS conference medium of multipoint control unit MCU stream makes up and records processing.At this moment, 1906, the Media Stream recorded after the processing of multipoint control unit MCU sends to player.The player basis is recorded the Media Stream after the processing, realizes playbacking.

In the above-described embodiment, multipoint control unit MCU and recorded broadcast device can have a plurality of, and a multipoint control unit MCU can connect a plurality of recorded broadcast devices, and a recorded broadcast device can connect a plurality of multipoint control unit MCU.Multipoint control unit MCU and recorded broadcast equipment also can be integrated into an equipment.

Embodiment 4

Record, playback method with what the recording and broadcasting system of multimedia conferencing shown in Figure 20 illustrated multimedia conferencing.In the recording and broadcasting system, the recorded broadcast server is connected with at least one conference terminal, and the conference terminal that is connected with the recorded broadcast server is connected with multipoint control unit MCU again, and multipoint control unit MCU also is connected with other at least one conference terminals that is not connected with the recorded broadcast server.The recorded broadcast server can also directly connect player or conference terminal, and player or conference terminal do not participate in a conference, and it can be used as program request person.

As shown in figure 21, at first be the recording process of multimedia conferencing:

2101, the multichannel IMS conference medium in each meeting-place stream in the meeting of recorded broadcast device recording.

The recorded broadcast device is recorded strategy according to the meeting level and is determined that the multichannel IMS conference medium that will record flows, and the recorded broadcast device also records described multichannel IMS conference medium stream.

2102, the recorded broadcast device is multichannel IMS conference medium flow distribution association identification.

The recorded broadcast device is stored described multichannel IMS conference medium stream and is distributed association identification according to the meeting-place under the described IMS conference medium stream, and described association identification is used for the IMS conference medium stream in related each meeting-place.As, a file is created in each meeting-place, 1.avi, 2.avi, 3.avi, the related 1.avi of association identification conf1,2.avi, 3.avi.

Then be the process that playbacks of multimedia conferencing:

2103, conference terminal sends and carries the request that playbacks of association identification to the recorded broadcast device.

The conference terminal player that is connected with the recorded broadcast server can be with stream protocols such as RTSP by recorded broadcast mounted point International Broadcasting Convention conf1, as H323/SIP method of calling program request conf1.

2104, the recorded broadcast device makes up multichannel IMS conference medium stream and records processing.

The recorded broadcast device is recorded strategy to multichannel IMS conference medium stream 1.avi according to media-level, and 2.avi, 3.avi make up and record processing.As synthetic many pictures, long-rangely present that screen splicing, sound mix, main flow and auxilliary stream merge, the time is held in the stack meeting, carry out processing such as duration.

2105, the Media Stream that will record after the processing of recorded broadcast device sends to conference terminal.

The Media Stream that the recorded broadcast device will be recorded after the processing sends to the conference terminal that is connected with the recorded broadcast server.

2106, conference terminal playbacks the Media Stream of recording after the processing.

The conference terminal that is connected with the recorded broadcast server is realized playbacking.

Conference terminal can replace with player.

What can replace is, the recorded broadcast device can send the multichannel IMS conference medium to conference terminal in 2104.At this moment, conference terminal makes up multichannel IMS conference medium stream and records processing, realizes playbacking.

One of ordinary skill in the art will appreciate that all or part of flow process that realizes in above-described embodiment method, be to instruct relevant hardware to finish by computer program, described program can be stored in the computer read/write memory medium, this program can comprise the flow process as the embodiment of above-mentioned each side method when carrying out.Wherein, described storage medium can be magnetic disc, CD, read-only storage memory body (Read-Only Memory, ROM) or at random store memory body (Random Access Memory, RAM) etc.

The above; only for the preferable embodiment of the present invention, but protection scope of the present invention is not limited thereto, and anyly is familiar with those skilled in the art in the technical scope that the present invention discloses; the variation that can expect easily or replacement all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of claim.

Claims (38)

1. the method for recording of a multimedia conferencing is characterized in that, comprising:

Acquisition is recorded the many groups multichannel IMS conference medium that will record stream that strategy is determined according to multiple meeting level, every group of corresponding a kind of described meeting level of described multichannel IMS conference medium stream recorded strategy, described IMS conference medium stream is at least video media stream or audio medium stream, and described meeting level is recorded the multichannel IMS conference medium stream that strategy is used for the definite meeting-place that will record;

Record tactful described many group multichannel IMS conference medium flow points are not made up according to media-level and record processing, described media-level is recorded strategy and is used for definite mode that multichannel IMS conference medium stream synthetic recording is handled.

2. the method for recording of multimedia conferencing according to claim 1 is characterized in that, described acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, specifically comprises:

The meeting level is recorded strategy send to multipoint control unit MCU, described meeting level is recorded strategy and comprised: the meeting-place recording mode is switched in acoustic control, or the broadcast site recording mode, or the Chair site recording mode, or specific meeting-place recording mode;

Receive described multipoint control unit MCU and record strategy according to described meeting level, the multichannel IMS conference medium stream that will record at least one definite meeting-place, described meeting-place comprises at least one conference terminal.

3. the method for recording of multimedia conferencing according to claim 1 is characterized in that, described acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, specifically comprises:

The meeting level is recorded strategy send to conference terminal, described meeting-place comprises at least one conference terminal, described meeting level is recorded strategy and is comprised: specific meeting-place recording mode, or specific meeting-place local media stream recording mode, or specific meeting-place distant end media stream recording mode;

Receive described conference terminal and record the multichannel IMS conference medium that will the record stream that strategy is determined according to described meeting level.

4. according to the method for recording of claim 2 or 3 described multimedia conferencings, it is characterized in that, record tactful described multichannel IMS conference medium stream is made up according to media-level and record processing, specifically comprise:

Record the video media recording mode of strategy according to media-level, described multi-channel video Media Stream is synthesized one or more Multipicture, or one or more video picture-in-picture, or one or more widescreen video, described video media recording mode comprises: the video record way arranges pattern, or the Multipicture recording mode, or video picture-in-picture recording mode, or widescreen video media record pattern;

Record the audio frequency media recording mode of strategy according to media-level, described multichannel voice frequency Media Stream is synthesized audio frequency mono channel, or the audio frequency multichannel, described audio frequency media recording mode comprises: the audio recording way arranges pattern, or audio frequency mono channel recording mode, or audio frequency multichannel recording mode.

5. the method for recording of multimedia conferencing according to claim 4 is characterized in that, described acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, also comprises:

Obtain the time synchronization information of video media stream and audio medium stream in the described multichannel IMS conference medium stream.

6. the method for recording of multimedia conferencing according to claim 5 is characterized in that, describedly records strategy according to media-level and described multichannel IMS conference medium stream made up records processing, also comprises:

According to the time synchronization information of described video media stream and audio medium stream, be media file with the data of the described video media stream after synthetic and the data multiplexing and encoding of audio medium stream;

Store described media file, and for described media file media identification is set, described media identification is used for the described media file of sign.

7. the record device of a multimedia conferencing is characterized in that, comprising:

Receiver module, be used for receiving according to multiple meeting level and record the many groups multichannel IMS conference medium that will record stream that strategy is determined, every group of corresponding a kind of described meeting level of described multichannel IMS conference medium stream recorded strategy, described IMS conference medium stream is at least video media stream or audio medium stream, and described meeting level is recorded the multichannel IMS conference medium stream that strategy is used for the definite meeting-place that will record;

Record processing module, be used for recording tactful described many group multichannel IMS conference medium flow points are not made up according to media-level and record processing, described media-level is recorded strategy and is used for definite mode that multichannel IMS conference medium stream synthetic recording is handled.

8. the record device of multimedia conferencing according to claim 7 is characterized in that, described receiver module comprises:

The strategy sending module is used for that the meeting level is recorded strategy and sends to multipoint control unit MCU, and described meeting level is recorded strategy and comprised: the meeting-place recording mode is switched in acoustic control, or the broadcast site recording mode, or the Chair site recording mode, or specific meeting-place recording mode;

The Media Stream receiver module is used for receiving described multipoint control unit MCU and records strategy according to described meeting level, the multichannel IMS conference medium stream that will record at least one definite meeting-place, and described meeting-place comprises at least one conference terminal.

9. the record device of multimedia conferencing according to claim 7 is characterized in that, described receiver module comprises:

The strategy sending module, be used for that the meeting level is recorded strategy and send to conference terminal, described meeting-place comprises at least one conference terminal, and described meeting level is recorded strategy and comprised: specific meeting-place recording mode, or specific meeting-place local media stream recording mode, or specific meeting-place distant end media stream recording mode;

The Media Stream receiver module is used for receiving described conference terminal and records the multichannel IMS conference medium that will the record stream that strategy is determined according to described meeting level.

10. according to Claim 8 or the record device of 9 described multimedia conferencings, it is characterized in that the described processing module of recording comprises:

The video record processing module, be used for recording according to described media-level the video media recording mode of strategy, described multi-channel video Media Stream is synthesized one or more Multipicture, or one or more video picture-in-picture, or one or more widescreen video, described video media recording mode comprises: the video record way arranges pattern, or the Multipicture recording mode, or video picture-in-picture recording mode, or widescreen video media record pattern;

The audio recording processing module, be used for recording according to described media-level the audio frequency media recording mode of strategy, described multichannel voice frequency Media Stream is synthesized audio frequency mono channel, or audio frequency multichannel, described audio frequency media recording mode comprises: the audio recording way arranges pattern, or audio frequency mono channel recording mode, or audio frequency multichannel recording mode.

11. the record device of multimedia conferencing according to claim 10 is characterized in that, described receiver module also comprises:

The time synchronization information receiver module is used for receiving the time synchronization information that described multichannel IMS conference medium flows video media stream and audio medium stream.

12. the record device of multimedia conferencing according to claim 11 is characterized in that, the described processing module of recording also comprises:

The media file generation module is used for the time synchronization information according to described video media stream and audio medium stream, is media file with the data of the described video media stream after synthetic and the data multiplexing and encoding of audio medium stream;

Memory module is used for the described media file of storage, and for described media file media identification is set, and described media identification is used for the described media file of sign.

13. the method that playbacks of a multimedia conferencing is characterized in that, comprising:

Reception carries the request that playbacks of media identification, and described media identification is used for the identification medium file;

Obtain corresponding media file according to described media identification, to playback, described media file makes up to record to handle to multichannel IMS conference medium stream in the multimedia conferencing by the method for recording according to arbitrary described multimedia conferencing among the claim 1-6 and is obtained.

14. the method that playbacks of multimedia conferencing according to claim 13 is characterized in that, described method also comprises: reception carries playbacking before the request of media identification, and media identification is sent to multipoint control unit MCU or conference terminal.

15. a multimedia conferencing playback device, it is characterized in that, comprising:

Playback the request receiver module, be used for receiving the request that playbacks that carries media identification, described media identification is used for the identification medium file;

Playback module, be used for obtaining corresponding media file according to described media identification, playbacking, described media file makes up to record to handle to multichannel IMS conference medium stream in the multimedia conferencing according to the method for recording of arbitrary described multimedia conferencing among the claim 1-6 and obtains.

16. multimedia conferencing according to claim 15 playback device, it is characterized in that, also comprise:

The media identification sending module is used for sending media identification to multipoint control unit MCU or conference terminal.

17. the recorded broadcast device of a multimedia conferencing is characterized in that, comprises as arbitrary described record device among the claim 7-12.

18. the recorded broadcast device of a multimedia conferencing is characterized in that, comprises as claim 15 or the 16 described devices that playback.

19. the method for recording of a multimedia conferencing is characterized in that, comprising:

Acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, and described IMS conference medium stream is at least video media stream or audio medium stream, and described meeting level is recorded strategy for the multichannel IMS conference medium stream in the meeting-place of determining to record;

According to the meeting-place under the described IMS conference medium stream, to store described multichannel IMS conference medium stream and distribute association identification, described association identification is used for the IMS conference medium stream in related each meeting-place;

Described according to the meeting-place under the described IMS conference medium stream, store described multichannel IMS conference medium stream and distribute association identification to comprise: according to the type of described multichannel IMS conference medium stream, for every kind of medium in each meeting-place are created a file; Perhaps, according to the meeting-place under the described multichannel IMS conference medium stream, for creating a file or file of whole conference creation in each meeting-place.

20. the method for recording of multimedia conferencing according to claim 19 is characterized in that, described acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, specifically comprises:

The meeting level is recorded strategy send to multipoint control unit MCU, described meeting level is recorded strategy and comprised: the meeting-place recording mode is switched in acoustic control, or the broadcast site recording mode, or the Chair site recording mode, or specific meeting-place recording mode;

Receive described multipoint control unit MCU and record the multichannel IMS conference medium stream that will record at least one definite meeting-place of strategy according to described meeting level, described meeting-place comprises at least one conference terminal.

21. the method for recording of multimedia conferencing according to claim 19 is characterized in that, described acquisition is recorded the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, specifically comprises:

The meeting level is recorded strategy send to conference terminal, described meeting-place comprises at least one conference terminal, described meeting level is recorded strategy and is comprised: specific meeting-place recording mode, or specific meeting-place local media stream recording mode, or specific meeting-place distant end media stream recording mode;

Receive described conference terminal and record the multichannel IMS conference medium that will the record stream that strategy is determined according to described meeting level.

22. the method for recording of multimedia conferencing according to claim 19 is characterized in that, described method also comprises: the time synchronization information that obtains video media stream and audio medium stream in the described multichannel IMS conference medium stream.

23. the method for recording of multimedia conferencing according to claim 19 is characterized in that, described method also comprises: the control command that obtains each meeting-place in the multimedia conferencing.

24. the record device of a multimedia conferencing is characterized in that, comprising:

Receiver module, be used for obtaining to record the multichannel IMS conference medium that will the record stream that strategy is determined according to the meeting level, described IMS conference medium stream is at least video media stream or audio medium stream, and described meeting level is recorded the multichannel IMS conference medium stream that strategy is used for the definite meeting-place that will record;

The association identification distribution module is used for according to the meeting-place under the described IMS conference medium stream, stores described multichannel IMS conference medium stream and distributes association identification, and described association identification is used for the IMS conference medium stream in related each meeting-place; Described according to the meeting-place under the described IMS conference medium stream, store described multichannel IMS conference medium stream and distribute association identification to comprise: according to the type of described multichannel IMS conference medium stream, for every kind of medium in each meeting-place are created a file; Perhaps, according to the meeting-place under the described multichannel IMS conference medium stream, for creating a file or file of whole conference creation in each meeting-place.

25. the record device of multimedia conferencing according to claim 24 is characterized in that, described receiver module specifically comprises:

The strategy sending module is used for that the meeting level is recorded strategy and sends to multipoint control unit MCU, and described meeting level is recorded strategy and comprised: the meeting-place recording mode is switched in acoustic control, or the broadcast site recording mode, or the Chair site recording mode, or specific meeting-place recording mode;

The Media Stream receiver module is used for receiving described multipoint control unit MCU and records the multichannel IMS conference medium stream that will record at least one definite meeting-place of strategy according to described meeting level, and described meeting-place comprises at least one conference terminal.

26. the record device of multimedia conferencing according to claim 24 is characterized in that, described receiver module specifically comprises:

The strategy sending module, be used for that the meeting level is recorded strategy and send to conference terminal, described meeting-place comprises at least one conference terminal, and described meeting level is recorded strategy and comprised: specific meeting-place recording mode, or specific meeting-place local media stream recording mode, or specific meeting-place distant end media stream recording mode;

The Media Stream receiver module is used for receiving described conference terminal and records strategy according to described meeting level, the definite multichannel IMS conference medium that will record stream.

27. the record device of multimedia conferencing according to claim 24 is characterized in that, described record device also comprises: the synchronizing information acquisition module is used for obtaining the time synchronization information that described multichannel IMS conference medium flows video media stream and audio medium stream.

28. the record device of multimedia conferencing according to claim 24 is characterized in that, described record device also comprises: the control command acquisition module, and for the control command that obtains each meeting-place of multimedia conferencing.

29. the method that playbacks of a multimedia conferencing is characterized in that, comprising:

Reception carries the request that playbacks of association identification, obtains the multichannel IMS conference medium stream of described association identification correspondence, and described association identification is used for the IMS conference medium stream in related each meeting-place, and described IMS conference medium stream is at least video media stream or audio medium stream; The distribution of described association identification comprises: according to the type of described multichannel IMS conference medium stream, for every kind of medium in each meeting-place are created a file; Perhaps, according to the meeting-place under the described multichannel IMS conference medium stream, for creating a file or file of whole conference creation in each meeting-place;

Record tactful described multichannel IMS conference medium stream is made up according to media-level and record processing, described media-level is recorded the mode that strategy is used for determining the multichannel IMS conference medium is flowed the synthetic recording processing.

30. the method that playbacks of multimedia conferencing according to claim 29, it is characterized in that, described media-level is recorded strategy and is comprised video media recording mode and audio frequency media recording mode, described video media recording mode comprises: the video record way arranges pattern, or Multipicture recording mode, or video picture-in-picture recording mode, or widescreen video media record pattern, described audio frequency media recording mode comprises: the audio recording way arranges pattern, or audio frequency mono channel recording mode, or audio frequency multichannel recording mode;

Describedly record strategy according to media-level and described multichannel IMS conference medium stream made up record processing, specifically comprise:

Record tactful video media recording mode according to described media-level, described multi-channel video Media Stream is synthesized one or more Multipicture, or one or more video picture-in-picture, or one or more widescreen video;

Record tactful audio frequency media recording mode according to described media-level, described multichannel voice frequency Media Stream is synthesized audio frequency mono channel, or the audio frequency multichannel.

31. the method that playbacks of multimedia conferencing according to claim 29 is characterized in that, described method also comprises:

Obtain the time synchronization information of video media stream and audio medium stream in the described multichannel IMS conference medium stream;

According to the time synchronization information of described video media stream and audio medium stream, be media file with the data of the described video media stream after synthetic and the data multiplexing and encoding of audio medium stream.

32. the method that playbacks of multimedia conferencing according to claim 29 is characterized in that, described method also comprises: obtain the control command in each meeting-place in the multimedia conferencing, playback described control command.

33. a multimedia conferencing playback device, it is characterized in that, comprising:

Playback the request receiver module, be used for receiving the request that playbacks that carries association identification, obtain the multichannel IMS conference medium stream of described association identification correspondence, described association identification is used for the IMS conference medium stream in related each meeting-place, and described IMS conference medium stream is at least video media stream or audio medium stream; The distribution of described association identification comprises: according to the type of described multichannel IMS conference medium stream, for every kind of medium in each meeting-place are created a file; Perhaps, according to the meeting-place under the described multichannel IMS conference medium stream, for creating a file or file of whole conference creation in each meeting-place;

Playback processing module, be used for recording tactful described multichannel IMS conference medium stream is made up according to media-level and record processing, described media-level is recorded strategy and is used for definite mode with the processing of multichannel IMS conference medium stream synthetic recording.

34. multimedia conferencing according to claim 33 playback device, it is characterized in that the described processing module that playbacks comprises:

The video record processing module, be used for recording according to described media-level the video media recording mode of strategy, described multi-channel video Media Stream is synthesized one or more Multipicture, or one or more video picture-in-picture, or one or more widescreen video, described media-level is recorded strategy and is comprised video media recording mode and audio frequency media recording mode, described video media recording mode comprises: the video record way arranges pattern, or Multipicture recording mode, or video picture-in-picture recording mode, or widescreen video media record pattern;

The audio recording processing module, be used for recording according to described media-level the audio frequency media recording mode of strategy, described multichannel voice frequency Media Stream is synthesized audio frequency mono channel, or audio frequency multichannel, described audio frequency media recording mode comprises: the audio recording way arranges pattern, or audio frequency mono channel recording mode, or audio frequency multichannel recording mode.

35. multimedia conferencing according to claim 33 playback device, it is characterized in that the described device that playbacks also comprises:

The synchronizing information acquisition module is used for obtaining the time synchronization information that described multichannel IMS conference medium flows video media stream and audio medium stream;

The media file generation module is used for the time synchronization information according to described video media stream and audio medium stream, is media file with the data of the described video media stream after synthetic and the data multiplexing and encoding of audio medium stream.

36. multimedia conferencing according to claim 33 playback device, it is characterized in that the described device that playbacks also comprises: control command playbacks module, be used for obtaining the control command in each meeting-place of multimedia conferencing, playback described control command.

37. the recorded broadcast device of a multimedia conferencing is characterized in that, comprises as arbitrary described record device among the claim 24-28.

38. the recorded broadcast device of a multimedia conferencing is characterized in that, comprises as arbitrary described device that playbacks among the claim 33-36.

Images