CN101489090A - Method, apparatus and system for multipath media stream transmission and reception - Google Patents
Method, apparatus and system for multipath media stream transmission and reception Download PDFInfo
- Publication number
- CN101489090A CN101489090A CNA2009100082994A CN200910008299A CN101489090A CN 101489090 A CN101489090 A CN 101489090A CN A2009100082994 A CNA2009100082994 A CN A2009100082994A CN 200910008299 A CN200910008299 A CN 200910008299A CN 101489090 A CN101489090 A CN 101489090A
- Authority
- CN
- China
- Prior art keywords
- media data
- grouping
- data stream
- streams
- description
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a method for transmitting and receiving a multiplex media data stream, a device and a system, and relates to a network technique capable of solving the problem of unable freely combination and output of the multiplex media stream. The transmission method of the multiplex media data stream in a multimedia communication comprises: grouping the untransmitted multiplex media data stream; performing a grouping description to the grouped multiplex media data stream; transmitting the grouped multiplex media data stream and the corresponding grouping description. A receiving treatment method of the multiplex media data stream in the multimedia communication comprises: receiving the multiplex media data stream with the grouping description and the grouping description corresponding to the media data stream; and grouping and outputting the media data stream according to the received multiplex media data stream. The examples of the invention can suit for the multiplex media stream transmission and output in the multimedia communication.
Description
Technical Field
The present invention relates to network technologies, and in particular, to a method, an apparatus, and a system for transmitting and receiving multiple media streams in multimedia communication.
Background
To further enhance the clinical feeling of a conference, in a video conference, it is often necessary to transmit video, audio and data of multiple (or multiple) conferees at a conference room at the same time. The transmission of multiple media streams in a video conference is defined based on ITU-T h.239 standard, multiple media streams can be transmitted between a terminal and the terminal, and between the terminal and an MCU (multipoint control Unit).
Fig. 1 is a schematic diagram illustrating a method for transmitting one of the media streams in a prior art video conference. Two sets of conference television terminals are respectively arranged in the conference place A and the conference place B, and each set of terminal is used by 1 (or 1 group) of participants. Wherein, each set of terminal respectively includes equipment such as camera, microphone, display device and speaker. In addition, the two meeting places A, B are connected to each other through a switch. The terminal 1 of the meeting place A is connected with the terminal 3 of the meeting place B, the terminal 2 of the meeting place A is connected with the terminal 4 of the meeting place B, so that the terminal 1 of the meeting place A presents the sound image and data collected by the terminal 3 of the meeting place B, and the terminal 2 of the meeting place A presents the sound image and data collected by the terminal 4 of the meeting place B. In turn, terminal 3 of site B will present the audio and video and data collected by terminal 1 of site a, and terminal 4 of site B will present the audio and video and data collected by terminal 2 of site a. By the technical scheme, the transmission of the two-way video and audio streams of the two meeting places is realized.
Still another prior art method for generating corresponding audio positions for a video layout includes: the MCU generates a multi-picture video for synthesizing a plurality of endpoint images and sound position information corresponding to the multi-picture layout, and sends a plurality of audio streams, the multi-picture video and the sound position information to the receiving end according to the loudspeaker condition of the receiving end, and the receiving end uses the plurality of audio streams to reproduce according to the position information, so that the positions of the endpoint sounds heard by participants are close to the positions (layout) of the endpoints in the multi-picture. For conference participants, the audio broadcast at the speaker at the far end of the screen may be attenuated, or delayed, compared to the audio broadcast at the speaker at the near end of the display screen. This approach can enhance the clinical feel of the meeting. However, in this scheme, the sound position is determined by the MCU and executed by the terminal, which lacks flexibility and the terminal cannot adjust the sound position autonomously. The prior art can not realize the free combination output of multiple media streams in multimedia communication, and does not consider the transmission and processing of data services.
Disclosure of Invention
The embodiment of the invention provides a method, a device and a system for transmitting and outputting multi-path media streams in multimedia communication, which can solve the problem that the multi-path media streams in the multimedia communication can not be freely combined and output.
The embodiment of the invention adopts the following technical scheme:
a transmission method of multi-path media data stream in multimedia communication includes:
grouping a plurality of media data streams to be transmitted; grouping description is carried out on the grouped multi-path media data stream; and transmitting the grouped multi-path media data stream and the grouping description corresponding to the media data stream.
The embodiment of the invention also provides a receiving and processing method of the multi-path media data stream in the multimedia communication, which comprises the following steps: receiving a multi-path media data stream with packet description; and according to the received packet description of the multi-path media data stream, grouping and outputting the media data stream.
The embodiment of the present invention further provides a device for transmitting multiple media data streams in multimedia communication, including: a grouping unit, which is used for grouping the multi-path media data stream to be transmitted; the grouping description unit is used for carrying out grouping description on the grouped multi-path media data stream; and the data transmission unit is used for transmitting the grouped multi-path media data stream and the grouping description corresponding to the media data stream.
The embodiment of the present invention further provides a device for receiving and processing multiple media data streams in multimedia communication, including: a receiving unit, configured to receive a plurality of media data streams with packet descriptions and packet descriptions corresponding to the media data streams; and the output unit is used for outputting the media data streams in a grouping mode according to the grouping description of the received multi-path media data streams.
An embodiment of the present invention further provides a conference terminal, including:
the sending device is used for acquiring and grouping the multi-path media data streams to be transmitted, grouping and describing the grouped multi-path media data streams, and transmitting the grouped multi-path media data streams and the grouping description corresponding to the media data streams; and/or
And the receiving processing device is used for receiving the multi-path media data stream with the grouping description and the grouping description corresponding to the media data stream, and grouping and outputting the media data stream according to the grouping description of the received multi-path media data stream.
The embodiment of the invention also provides a system for transmitting the multi-path media data stream in the multimedia communication, which comprises the following steps:
the data acquisition device comprises video acquisition equipment, audio acquisition equipment or data acquisition equipment and is used for acquiring the multi-channel media data stream;
the transmission device is used for grouping the multi-path media data streams acquired by the data acquisition device, grouping and describing the grouped multi-path media data streams, and transmitting the grouped multi-path media data streams and the grouping description corresponding to the media data streams;
the receiving processing device is used for receiving the multi-path media data stream with the grouping description and the grouping description corresponding to the media data stream, and grouping and outputting the media data stream according to the grouping description of the received multi-path media data stream;
and the data output device is used for outputting the grouped media data stream through video output equipment, audio output equipment or data output equipment.
The method, the device and the system for transmitting and receiving the multi-path media stream in the multimedia communication can group the multi-path media data, perform grouping description on each group, and send the grouped multimedia data stream and the grouping description; and after receiving the multimedia data stream carrying the packet description and the packet description corresponding to the multimedia data stream, the media data stream is output in packets according to the packet descriptions, thereby realizing the free combination output of multiple paths of media streams.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a diagram illustrating a method for transmitting multiple media streams in a video conference;
FIG. 2 is a flowchart illustrating a method for transmitting multiple media data streams in multimedia communication according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for outputting multiple media data streams in multimedia communication according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a method for transmitting and outputting multiple media data streams in multimedia communication according to an embodiment of the present invention;
FIG. 5 is a flowchart of a method according to a first embodiment of the present invention;
FIG. 6 is a diagram illustrating grouping of multiple media streams at an input according to an embodiment of the present invention;
FIG. 7 is a diagram illustrating grouping of multiple media streams at an output according to an embodiment of the present invention;
FIG. 8 is a diagram illustrating a method for transmitting and outputting multiple media data streams in multimedia communication according to a second embodiment of the present invention;
FIG. 9 is a flowchart of a method for transmitting and outputting multiple media data streams in a multimedia communication according to a third embodiment of the present invention;
FIG. 10 is a diagram illustrating an apparatus for multi-media data stream transmission in multimedia communication according to an embodiment of the present invention;
FIG. 11 is a diagram illustrating an apparatus for receiving and processing multiple media data streams in multimedia communication according to an embodiment of the present invention;
fig. 12 is a system diagram illustrating multi-media data stream transmission in multimedia communication according to an embodiment of the invention.
Detailed Description
The following describes a method, an apparatus and a system for transmitting and receiving multiple media streams in multimedia communication in detail with reference to the accompanying drawings.
It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 2, a method for transmitting multiple media streams in multimedia communication according to an embodiment of the present invention includes:
s201, grouping the multiple media data streams to be transmitted.
The grouping of the multiple media data streams may be implemented by any of the following methods:
grouping according to the position relation among the interfaces of the media data stream, namely dividing the media data streams of the same physical interface or physical interfaces with similar positions into a group; or the images and/or the sounds are grouped by the spatial positions of the audio and/or the videos, namely the camera acquires the spatial position of the image, the microphone acquires the spatial position of the sound, and the videos and/or the audios with consistent or similar spatial positions of the image and/or the sound are used as a group; or picking up multiple sound source positions by using an array microphone to form corresponding independent audio streams, and then grouping the multiple audio streams; or after a panoramic image is acquired through a wide-angle camera, the panoramic image is cut into multiple paths of separated images, and then the multiple paths of video streams are grouped.
S202, grouping and describing the grouped multiple media data streams.
Specifically, the packet description may be carried in a media data stream or a bearer channel corresponding to the media data stream; or carrying the packet description in a control protocol associated with the media data stream; or adding a control message carrying packet description corresponding to the media data in the media data stream, thereby realizing packet description of the grouped multiple paths of media data streams.
S203, transmitting the grouped multi-path media data stream and the grouping description corresponding to the media data stream.
The method for transmitting the multi-path media stream provided by the embodiment of the invention can specify the group characteristics for the transmitted media data stream by grouping the multi-path media data stream and adding the grouping description to the grouped media data stream, and the receiving terminal can perform corresponding output processing according to the grouping description, thereby realizing the free combined transmission of the multi-path media stream at different terminals.
As shown in fig. 3, a method for receiving and processing multiple media streams in multimedia communication according to an embodiment of the present invention includes:
s301, receiving a plurality of paths of media data streams with packet descriptions and the packet descriptions corresponding to the media data streams.
Specifically, the packet description may be carried in a media data stream or a bearer channel corresponding to the media data stream; or carried in a control protocol associated with the media data stream; or in control messages added to the media data stream.
S302, according to the received grouping description of the multi-path media data stream, grouping and outputting the media data stream and the grouping description corresponding to the media data stream.
The method for receiving and processing the multi-path media stream in the multimedia communication of the embodiment of the invention receives the multi-path media data stream with the grouping description and the grouping description corresponding to the media data stream, and then outputs the media data according to the grouping description, thereby realizing the free combination output of the multi-path media stream at different terminals.
The following describes a specific embodiment of the present invention through practical application of transmission and output of multiple media streams in multimedia communication under different scenarios.
Example one
Fig. 4 is a schematic diagram of a multi-media stream transmission and output scenario in the present embodiment. In this embodiment, the conference site a sends multiple media streams, and the conference site B receives multiple media streams. It should be noted that, in practical applications, the conference site a and the conference site B generally include both transmitting and receiving devices, and also include both transmitting and receiving devices on the terminal. For convenience of explanation, the embodiments of the present invention are simplified.
In this embodiment, the conference hall a includes conference participants P1 and P2, the terminals 1, P1 and P2 respectively have a microphone 1, a camera 1 and a data processing device 1 (such as a computer) corresponding thereto, and the conference hall B includes a terminal 2, a plurality of conference participants P3, a display 1 and a speaker 1 respectively located at the position 1, a display 3 and a speaker 3 respectively located at the position 3, and a display 2 located at the position 2. The terminal 1 and the terminal 2 are connected via a network. As shown in fig. 5, the basic process is as follows:
s501, the terminal 1 collects 6 paths of media data and groups the media data. The 6 sets of media data include: data service media 1, data service media 2, video media 1, video media 2, audio media 1, audio media 2.
The grouping may be performed according to the position relationship between the interfaces of the media data streams, that is, the media data streams of the same physical interface or physical interfaces with similar positions are grouped into one group. As shown in fig. 6, dividing the 6 media streams into two groups L1 and L2, where the media data of the L1 group corresponds to the conference participant P1 includes: data service media 1, video media 1, audio media 1; the media stream of the L2 group corresponds to the conference participant P2, and includes: data service media 2, video media 2, audio media 2.
The above is a method for determining grouping by the terminal 1 according to the interface relationship, and data received by the video input, audio input, and data service input interfaces corresponding to the participant P1 are taken as L1 group, and data received by the video input, audio input, and data service input interfaces corresponding to the participant P2 are taken as L2 group. The Video Interface may be a CVBS (Composite Video Broadcast Signal) Interface, an S-Video (Separate Video) Interface, a VGA (Video graphics Array) Interface, a DVI (Digital Video Interface) Interface, or the like. The audio Interface may be a various forms of MIC (media Interface Connector), Line IN (input signal) analog or digital Interface. The data service interface can be a network interface, a USB interface or a VGA interface (data content is converted into video output on a PC), and the data service content comprises files or slide shows. These interfaces may also be physically combined, for example, the video Interface and the audio Interface may be combined into an HDMI (High Definition Multimedia Interface) Interface or an IEEE1394 Interface, and even video, audio, and data services may all be connected through a USB Interface, in which case the video, audio, and data services may also be transmitted through a logical channel.
The invention is not limited in this regard and there may be multiple sets of video, audio, data traffic streams for each packet, for example packet L1 may also have two audio inputs and two video inputs.
The grouping relationship may also be determined by grouping the spatial positions of the audio and/or video, that is, acquiring the spatial position of the image by the camera, acquiring the spatial position of the sound by the microphone, and grouping the video and/or audio with the spatial positions of the image and/or the sound being consistent or close to each other.
The grouping relation can also be determined by picking up multiple sound source positions by using an array microphone to form corresponding independent audio streams and then grouping the multiple audio streams; or after a panoramic image is acquired through a wide-angle camera, the panoramic image is cut into multiple paths of separated images, and then the multiple paths of video streams are grouped. The corresponding video media and audio media are then classified into a group, for example, the video media and audio media may be grouped according to a positional relationship. I.e. the packetized media stream may be constituted by other means and not necessarily obtained directly from the interface.
S502, the terminal 1 compresses and encodes the grouped media data stream.
And S503, grouping and describing the grouped multiple media data streams.
The following three ways are described for grouping multiple media data streams:
the first method is to carry the packet description in the media data stream or the bearer channel corresponding to the media data stream.
For example, the packet description may be carried in an extension header of RTP or in a media data stream. In particular, the group characteristics may be filled in an extension header of RTP or an extension field or a specific field in the media data stream.
For example, the packet description field is filled in an Extension Header (RTP Header Extension) of the RTP, and RTP streams having the same packet description are the same group. Alternatively, the packet description may be identified in the corresponding bearer, for example, a field extension is performed in data (payload) of RTP, and the packet description is added.
In addition, the extension header of RTP can be customized, and the packet description is carried in the customized extension header.
In SIP/SDP communication, the packet description can be carried by marking in RTP.
The second way carries the packet description information in the control protocol associated with the media stream. In particular, the group characteristics may be populated in an extension field in the control protocol.
Taking the h.323 standard as an example, each media stream is assigned a corresponding session ID (sessionid), so that the relevant session can be associated by assigning a packet description to each session ID, for example, in an open logical channel (openlogical channel) message, a packet description field is extended for filling the packet description, as defined below:
OpenLogicalChannel::＝SEQUENCE
{
forwardLogicalChannelNumber LogicalChannelNumber，
forwardLogicalChannelParametersSEQUENCE
{
portNumber INTEGER(0..65535)OPTIONAL，
dataType DataType，
multiplexParameters CHOICE
{
h222LogicalChannelParameters H222LogicalChannelParameters，
h223LogicalChannelParameters H223LogicalChannelParameters，
v76LogicalChannelParameters V76LogicalChannelParameters，
...，
h2250LogicalChannelParameters H2250LogicalChannelParameters，
none NULL --for use with Separate Stack when
--multiplexParameters are not required
--or appropriate
}，
...，
forwardLogicalChannelDependency LogicalChannelNumber OPTIONAL，
--also used to refer to the primary logical channel when using video redundancy
coding
replacementFor LogicalChannelNumber OPTIONAL，
group IDINTEGER(0..65535)OPTIONAL
}，
--Used to specify the reverse channel for bi-directional open request
reverseLogicalChannelParameters SEQUENCE
{
dataType DataType，
multiplex Parameters CHOICE
{
--H.222 parameters are never present in reverse direction
h223LogicalChannelParameters H223LogicalChannelParameters，
v76LogicalChannelParameters V76LogicalChannelParameters，
...，
h2250LogicalChannelParametersH2250LogicalChannelParameters
}OPTIONAL，--Not present for H.222
...，
reverseLogicalChannelDependency LogicalChannelNumber OPTIONAL，
--also used to refer to the primary logical channel when using video redundancy
coding
replacementFor LogicalChannelNumber OPTIONAL
}OPTIONAL，--Not present for uni-directional channel request
...，
separateStack NetworkAccessParameters OPTIONAL，
--for Open responder to establish the stack
encryptionSync EncryptionSync OPTIONAL--used only by Master
}
wherein the groupID is an extended packet description field for filling the packet description.
And the third mode is to add a control message carrying the packet description of the corresponding media data in the media data stream. In particular, a group characteristic is defined in each of said control messages, including in the message body of said control message at least one media stream belonging to the same packet.
For example, a control message is added for informing the peer which media data is the same packet. Assuming that the session logical channel numbers of the video, audio and data service data of the packet L1 are 1, 2 and 3, respectively, a message groupidification is transmitted, where the message includes the logical channel numbers 1, 2 and 3, so that the receiving end determines that the media data of the logical channel numbers 1, 2 and 3 are in the same group according to the message.
When the SIP/SDP protocol is adopted for multimedia communication, the packet description can be carried in a mode of adopting a plurality of sessions (sessions). For example:
v＝0
o＝mhandley 2890844526 2890842807 IN IP4 126.16.64.4
s＝P1
...
m＝audio 49170 RTP/AVP 0
m＝video 51372 RTP/AVP 31
m＝application 32416 udp wb
v＝0
o＝mhandley 2890844526 2890842807 IN IP4 126.16.64.4
s＝P2
...
m＝audio 49171 RTP/AVP 0
m＝video 51373 RTP/AVP 31
m＝application 32417 udp wb
among them, the session P1(S ═ P1) corresponds to the packet L1, and the session P2(S ═ P1) corresponds to the packet L2, and contains audio, video, and application data streams, respectively.
Of course, the grouping can also be illustrated by adding an attribute, for example:
v＝0
m＝audio 49170 RTP/AVP 0
m＝video 51372 RTP/AVP 31
m＝application 32416 udp wb
m＝audio 49171 RTP/AVP 0
m＝video 51373 RTP/AVP 31
m＝application 32417 udp wb
...
g＝49170 51372 32416
g＝49171 51373 32417
media data corresponding to the ports 49170, 51372, and 32416 are divided into one group by the description of g-491705137232416, and media data corresponding to the ports 49171, 51373, and 32417 are divided into another group by g-491715137332417.
In addition, the grouping can also be realized by directly extending the media description and adding grouping descriptions, such as:
v＝0
m＝audio 49170 RTP/AVP 0 group1
m＝video 51372 RTP/AVP 31 group1
m＝application 32416 udp wb group1
m＝audio 49171 RTP/AVP 0 group2
m＝video 51373 RTP/AVP 31 group2
m＝application 32417 udp wb group2
...
in this way, group1 and group2 in the media description are used to describe the group number corresponding to the media stream, and media streams with the same group number are the same group. group1 and group2 may be numeric or character designations.
And S504, the terminal 1 sends the multi-channel media data to the terminal 2.
S505, the terminal 2 receives the media data with the packet description, and performs decoding and decompression processing.
And S506, outputting the media data according to the grouping description.
As shown in fig. 4 and 7, specifically, the following steps are performed: according to the grouping relationship, it is determined to output the video data 1 and the audio data 1 corresponding to the group L1 to the display 1 and the speaker 1 at the position 1, to output the video data 2 and the audio data 2 of the group L2 to the display 3 and the speaker 3 at the position 3, and to output the data service media 1 and the data service media 2 of the groups L1 and L2 to the display 2 at the position 2 as needed.
The embodiment of the invention can also realize that the data service data output interface switches and outputs the acquired data services of a plurality of sending ends, namely, the switching can be carried out according to the requirement. For example, the data service output interface is switched to the data service output of L1 when the conferee P1 at the transmitting end explains the slide, and switched to the data service output of L2 when P2 explains the slide. The video, audio, data service output interfaces here can also be in various forms and combinations as the aforementioned input interfaces.
The embodiment of the invention can also realize the switching of the video data, the audio data or the data service data output by the output interface according to the packet description of the received media data stream. For example, the terminal 2 may further automatically control to switch the output contents of the video output 1 and the video output 2 interfaces to the video of the packet L1 and to switch the audio output 1 and the audio output 2 to the audio of the output packet L1 when the conferee P1 explains the slideshow according to the packet description, so that the conferees at the meeting place B can see the image of P1 at the same time on the respective displays and hear the sound of P1 on the respective speakers. Further, at the same time, the receiving end may notify the transmitting end to pause the audio and video acquisition of L2 group or pause the transmission of the audio and video of L2 group, so as to reduce the occupation of bandwidth.
The network connecting terminal 1 and terminal 2 can be a circuit domain network (e.g. E1/SDH/ISDN) or a packet network (e.g. IP network), and the communication protocol can be H.320/H.323/H.324/SIP, etc.
In the above embodiment, the video media 1, the audio media 1 and the data service media 1 are divided into 1 group, which is a common application case, but the actual grouping can be very flexible, for example, the video media 2 is taken as 1 group, and the audio media 2 and the video media 1 are taken as 1 group.
Through the steps, the embodiment of the invention realizes the transmission and output of the multi-path media data by grouping, so that the receiving end can freely combine and output the multi-path media stream, and the transmission and control of the data service corresponding to the video and audio are also realized. The embodiment of the invention also realizes the use of a single terminal in one meeting place, thereby solving the problem of overhigh cost caused by the use of a plurality of terminals in the prior art.
Example two
On the basis of the first embodiment, the method for transmitting and outputting the multiple media data streams in this embodiment may also be processed by an intermediate device (for example, a conference control device, which may specifically be a multipoint control unit MCU).
After receiving the media data stream carrying the packet description and the corresponding packet description, the MCU obtains the packet description of each path of media data, and can re-determine the packet relationship of each path of media data stream according to the output requirement. In this embodiment, the grouping relationship of the media data streams may be forwarded by the MCU, so as to change the grouping relationship between the media data streams, or regenerate the grouping relationship of multiple media data streams.
As shown in fig. 8, the video media stream and the audio media stream sent by the terminal 1 and the data service media stream sent by the terminal 3 are combined into a new group L at the MCU and then sent to the terminal 2. The specific combination is not limited to the above-described embodiments.
It can be understood that: in the video conference, the conference control device mainly completes the main media stream control, so that the corresponding media streams (audio media stream, video media stream and data media stream) can be combined together flexibly according to the requests of some conference terminals by adopting the mode, and the requirements of users can be met in a diversified manner.
The embodiment of the invention realizes the transmission and output of the multi-path media stream by grouping, so that the receiving end can freely combine and output the multi-path media stream, and the transmission and control of the data service media stream corresponding to the video and audio are also realized.
Implementation III
The present embodiment is a method for a terminal 2 to output multiple media streams based on implementing a transmission of multiple media data streams in one embodiment, and specifically includes the following steps:
s901, arranging a plurality of loudspeakers in a meeting place B;
s902, the terminal 2 acquires spatial position information of each display in the meeting place B;
s903, video data 1 in the received packet L1 is output through the display 1 at position 1, and video data 2 in the packet L2 is output through the display 3 at position 3.
S904, the received audio data 1 of the packet L1 is output through at least one speaker in the conference room B, so that the spatial position feeling thereof is the same as or similar to that of the display 1 at the position 1.
S905, the received audio data 2 of the packet L2 is output through at least one speaker in the conference hall B, so that the spatial position sense is the same as or similar to that of the display 3 at the position 3.
The above steps S904 and S905 are not limited to the above order, and step S905 may precede step S904.
The embodiment can realize that the sound heard by the participants is the same as or similar to the corresponding video position in a multi-conference place, thereby better realizing the reality of the conference television.
The embodiment of the invention also provides a device for transmitting the multi-path media stream, which can solve the problem that the multi-path media stream can only be transmitted between specific terminals.
As shown in fig. 10, the apparatus for transmitting multiple media data streams in multimedia communication according to an embodiment of the present invention includes:
a grouping unit 101, configured to group multiple media data streams to be transmitted;
a packet description unit 102, configured to perform packet description on the grouped multiple media data streams;
and a data transmission unit 103 configured to transmit the grouped multiple media data streams and the packet description corresponding to the media data streams.
Further, in a preferred embodiment of the present invention, the grouping unit 101 may group the media data streams by any one of the following methods: grouping according to the position relation among the interfaces of the media data stream, namely dividing the media data streams of the same physical interface or physical interfaces with similar positions into a group; or the images and/or the sounds are grouped by the spatial positions of the audio and/or the videos, namely the camera acquires the spatial position of the image, the microphone acquires the spatial position of the sound, and the videos and/or the audios with consistent or similar spatial positions of the image and/or the sound are used as a group; or picking up multiple sound source positions by using an array microphone to form corresponding independent audio streams, and then grouping the multiple audio streams; or after a panoramic image is acquired through a wide-angle camera, the panoramic image is cut into multiple paths of separated images, and then the multiple paths of video streams are grouped.
The packet description unit 102 may perform packet description on the grouped media data stream in any one of the following manners: carrying the packet description in the media data stream or a bearer channel corresponding to the media data stream; or carrying the packet description in a control protocol associated with the media data stream; or adding a control message carrying a packet description corresponding to the media data in the media data stream.
In this embodiment, the media data stream may specifically be one or more of the following: audio stream, video stream, data stream.
The device for transmitting the multi-path media data stream in the multimedia communication of the embodiment of the invention groups the multi-path media data through the grouping unit, and the grouping description unit performs grouping description on the multimedia data stream, thereby realizing the transmission of the multi-path media stream through one terminal, enabling a receiving terminal to output each media data according to the corresponding grouping description, and realizing the free combination transmission of the multi-path media data at different terminals.
The invention also provides a device for receiving and processing the multi-path media data stream in the multimedia communication, which can solve the problem that the multi-path media stream can not be freely combined and output.
As shown in fig. 11, the apparatus for receiving and processing multiple media data streams in multimedia communication according to the embodiment of the present invention includes a receiving unit 111 and an output unit 112.
The receiving unit 111 is configured to receive a plurality of media data streams with packet descriptions and packet descriptions corresponding to the media data streams. Wherein, the packet description can be carried in the media data stream or the bearer channel corresponding to the media data stream; or carried in a control protocol associated with the media data stream; or in control messages added to the media data stream.
An output unit 112, configured to output the media data stream in a packet according to the packet description of the received multiple media data streams.
Further, the apparatus may further include: and the switching unit is used for switching the media data stream output by the output unit according to the packet description of the media data stream received by the receiving unit. The apparatus may further include a suspending unit for suspending acquisition or transmission of media data streams of groups other than the specified group when all of the output ports are switched to the media data streams of the specified group.
The device for receiving and processing the multi-path media data stream in the multimedia communication can output the media data stream in a grouping way according to the grouping description when receiving the multi-path media data stream with the grouping description and the grouping description corresponding to the media data stream, thereby realizing that the multi-path media stream can be freely output at different terminals. In addition, the switching unit can also switch the transmission of the media data of a specific group, and the suspending unit can suspend the collection or transmission of the media data of certain groups, so that the network pressure is relieved.
The device for transmitting the multiple media streams in the multimedia communication and the device for receiving and processing provided by the embodiments of the present invention can realize the free combination output of the multiple media streams in the multimedia communication by referring to the first, second, and third method embodiments.
The embodiment of the invention also provides a conference terminal which comprises a sending device and a receiving processing device.
The sending device is used for acquiring and grouping a plurality of paths of media data streams to be transmitted, grouping and describing the grouped plurality of paths of media data streams, and transmitting the grouped plurality of paths of media data streams and grouping and describing corresponding to the media data streams; and/or
The receiving and processing device is used for receiving the multi-path media data stream with the grouping description and the grouping description corresponding to the media data stream, and grouping and outputting the media data stream according to the grouping description of the received multi-path media data stream.
It is preferable that one conference terminal has both the transmission device and the reception processing device.
On the basis of the above scheme, the transmitting apparatus further includes:
the grouping unit is used for grouping the multi-path media data streams to be transmitted, and comprises the steps of grouping according to the position relation among the interfaces of the media data streams, or grouping through the spatial position of audio and/or video, or utilizing an array microphone to pick up the positions of a plurality of paths of sound sources to form corresponding independent audio streams, and then grouping the multi-path audio streams; or after a panoramic image is acquired through a wide-angle camera, the panoramic image is cut into multiple paths of separated images, and then the multiple paths of video streams are grouped;
the grouping description unit is used for carrying out grouping description on the grouped multi-path media data stream; carrying packet description in a media data stream or a bearer channel corresponding to the media data stream; or carrying the packet description in a control protocol associated with the media data stream; or adding a control message carrying packet description corresponding to the media data in the media data stream;
and the data transmission unit is used for transmitting the grouped multi-path media data stream and the grouping description corresponding to the media data stream.
The conference terminal of the embodiment of the invention can realize the grouping of the multimedia data stream to be sent and the carrying of the grouping description, thereby being capable of carrying out grouping sending on the multi-path media data stream, and outputting each media data stream according to the grouping description after receiving the multimedia data stream sent by the grouping and the corresponding grouping description, thereby realizing the free combination and output of the multi-path media data.
The embodiment of the invention also provides a system for transmitting the multi-path media streams in the multimedia communication, which can solve the problem that the multi-path media streams cannot be freely combined and output.
This embodiment can be explained in connection with the embodiment of fig. 4. As shown in fig. 12, the system for transmitting multiple media streams in multimedia communication according to the embodiment of the present invention includes: data acquisition means 121, transmission means 122, reception processing means 123, and data output means 124. Wherein,
the data acquiring device 121 includes a video acquiring device, an audio acquiring device or a data acquiring device, and is configured to acquire multiple media data streams.
The transmission device 122 is configured to group the multiple media data streams acquired by the data acquisition device, perform group description on the grouped multiple media data streams, and transmit the grouped multiple media data streams and the group description corresponding to the media data streams.
The receiving processing device 123 is configured to receive a plurality of media data streams with packet descriptions and packet descriptions corresponding to the media data streams, and output the media data streams in packets according to the received packet descriptions of the plurality of media data streams.
The data output device 124 is configured to output the grouped media data stream through a video output device, an audio output device, or a data output device.
On the basis of the above scheme, the transmission device may further include:
the grouping unit is used for grouping the multi-path media data streams to be transmitted, and comprises the steps of grouping according to the position relation among the interfaces of the media data streams, or grouping through the spatial position of audio and/or video, or utilizing an array microphone to pick up the positions of a plurality of paths of sound sources to form corresponding independent audio streams, and then grouping the multi-path audio streams; or after a panoramic image is acquired through a wide-angle camera, the panoramic image is cut into multiple paths of separated images, and then the multiple paths of video streams are grouped;
the grouping description unit is used for carrying out grouping description on the grouped multi-path media data stream; carrying packet description in a media data stream or a bearer channel corresponding to the media data stream; or carrying the packet description in a control protocol associated with the media data stream; or adding a control message carrying packet description corresponding to the media data in the media data stream;
and the data transmission unit is used for transmitting the grouped multi-path media data stream and the grouping description corresponding to the media data stream.
In a preferred embodiment of the present invention, the system may further include:
and the conference control equipment is used for changing the grouping relation by forwarding the grouping relation of the media data streams or grouping a plurality of paths of media data streams of different meeting places. The conference control device may be an MCU.
In the system for transmitting multiple media streams in multimedia communication provided by the embodiment of the present invention, multiple media data are grouped by a transmission device, grouped description is performed on the grouped multiple media data streams, and the media data with the grouped description and the corresponding grouped description are sent, and after receiving the multiple media data and the grouped description, an output device outputs the media data according to the grouped description, so that free combination output of the multiple media streams can be realized; the optimized MCU in the system can also change the grouping relation of the media data or change the grouping relation by forwarding the grouping relation of the media data stream, thereby realizing the free combination output of multi-path media streams.
The system for transmitting multiple media streams in multimedia communication provided by the embodiment of the present invention can refer to the first, second, and third method embodiments, and implement processing of transmission, reception, and output of multiple media streams in multimedia communication.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (21)
1. A method for multi-media data streaming in multimedia communications, comprising:
grouping a plurality of media data streams to be transmitted;
grouping description is carried out on the grouped multi-path media data stream;
and transmitting the grouped multi-path media data stream and the grouping description corresponding to the media data stream.
2. The method of claim 1, wherein the grouping the multiple media data streams is specifically:
grouping according to the position relation among the interfaces of the media data stream, namely dividing the media data streams of the same physical interface or physical interfaces with similar positions into a group; or
Grouping the audio and/or video spatial positions, namely acquiring the spatial positions of images through a camera, acquiring the spatial positions of sounds through a microphone, and taking the video and/or audio with consistent or similar spatial positions of the images and/or sound positions as a group; or
Picking up multiple sound source positions by using an array microphone, forming corresponding independent audio streams, and grouping the multiple audio streams; or
After a panoramic image is acquired through a wide-angle camera, the panoramic image is cut into multiple paths of separated images, and then the multiple paths of video streams are grouped.
3. The method according to claim 1 or 2, wherein the packet description of the grouped multiple media data streams comprises:
carrying packet description in the media data stream or a bearer channel corresponding to the media data stream; or
Carrying a packet description in a control protocol associated with the media data stream; or
And adding a control message carrying a packet description corresponding to the media data in the media data stream.
4. The method of claim 1 or 2, wherein the grouping of the multiple media data streams to be transmitted comprises:
the conference control equipment changes the grouping relation by forwarding the grouping relation of the multi-path media data stream; or
And grouping the multiple media data streams of different meeting places by the meeting control equipment.
5. A method as claimed in claim 1 or 2, wherein the media data stream is specifically one or more of: audio stream, video stream, data stream.
6. A method for receiving and processing multiple media data streams in multimedia communication, comprising:
receiving a plurality of paths of media data streams with packet descriptions and the packet descriptions corresponding to the media data streams;
and according to the received packet description of the multi-path media data stream, grouping and outputting the media data stream.
7. The method of claim 6, wherein packetizing the media data stream based on the packet description of the received multiplexed media data stream comprises:
outputting the received video data to a corresponding video output interface according to the packet description of the received media data stream; and/or
Outputting the received audio data to a corresponding audio data interface; and/or
And outputting the received data service data to a corresponding data service data output interface.
8. The method of claim 7, wherein outputting the received data traffic data to a corresponding data traffic data output interface comprises:
and the data service data output interface switches and outputs the received data service data of the plurality of sending ends.
9. The method of claim 6, wherein packetizing the media data stream based on the packet description of the received multiplexed media data stream comprises:
and outputting video data to corresponding display equipment according to the packet description of the received multi-path media data stream, acquiring spatial position information of the display equipment, and outputting audio data related to the video data by using at least one loudspeaker equipment, so that the spatial position of the output audio is the same as or similar to that of the display equipment.
10. The method of claim 6, further comprising:
and switching the video data, the audio data or the data service data output by the output interface according to the received packet description of the media data stream.
11. An apparatus for multiple media data stream transmission in multimedia communication, comprising:
a grouping unit, which is used for grouping the multi-path media data stream to be transmitted;
the grouping description unit is used for carrying out grouping description on the grouped multi-path media data stream;
and the data transmission unit is used for transmitting the grouped multi-path media data stream and the grouping description corresponding to the media data stream.
12. The apparatus according to claim 11, wherein the grouping unit groups the multiple media data streams to be transmitted by any one of:
grouping according to the position relation among the interfaces of the media data stream, namely dividing the media data streams of the same physical interface or physical interfaces with similar positions into a group; or
Grouping the audio and/or video spatial positions, namely acquiring the spatial positions of images through a camera, acquiring the spatial positions of sounds through a microphone, and taking the video and/or audio with consistent or similar spatial positions of the images and/or sound positions as a group; or
Picking up multiple sound source positions by using an array microphone, forming corresponding independent audio streams, and grouping the multiple audio streams; or
After a panoramic image is acquired through a wide-angle camera, the panoramic image is cut into multiple paths of separated images, and then the multiple paths of video streams are grouped.
13. The apparatus according to claim 11, wherein the grouping description unit performs grouping description on the grouped multiple media data streams by any one of:
carrying packet description in the media data stream or a bearer channel corresponding to the media data stream; or
Carrying a packet description in a control protocol associated with the media data stream; or
And adding a control message carrying a packet description corresponding to the media data in the media data stream.
14. The apparatus according to any one of claims 11 to 13,
the media data stream is specifically one or more of the following: audio stream, video stream, data stream.
15. An apparatus for receiving and processing multiple media data streams in multimedia communication, comprising:
a receiving unit, configured to receive a plurality of media data streams with packet descriptions and packet descriptions corresponding to the media data streams;
and the output unit is used for outputting the media data streams in a grouping mode according to the grouping description of the received multi-path media data streams.
16. The apparatus of claim 15, further comprising:
and the switching unit is used for switching the media data stream output by the output unit according to the packet description of the media data stream received by the receiving unit.
17. A conference terminal, comprising:
the sending device is used for acquiring and grouping the multi-path media data streams to be transmitted, grouping and describing the grouped multi-path media data streams, and transmitting the grouped multi-path media data streams and the grouping description corresponding to the media data streams; and/or
And the receiving processing device is used for receiving the multi-path media data stream with the grouping description and the grouping description corresponding to the media data stream, and grouping and outputting the media data stream according to the grouping description of the received multi-path media data stream.
18. The conference terminal according to claim 17, wherein said transmission means comprises:
the grouping unit is used for grouping the multi-path media data streams to be transmitted, and comprises the steps of grouping according to the position relation among the interfaces of the media data streams, or grouping through the spatial position of audio and/or video, or utilizing an array microphone to pick up the positions of a plurality of paths of sound sources to form corresponding independent audio streams, and then grouping the multi-path audio streams; or after a panoramic image is acquired through a wide-angle camera, the panoramic image is cut into multiple paths of separated images, and then the multiple paths of video streams are grouped;
the grouping description unit is used for carrying out grouping description on the grouped multi-path media data stream; carrying packet description in a media data stream or a bearer channel corresponding to the media data stream; or carrying the packet description in a control protocol associated with the media data stream; or adding a control message carrying packet description corresponding to the media data in the media data stream;
and the data transmission unit is used for transmitting the grouped multi-path media data stream and the grouping description corresponding to the media data stream.
19. A system for multiple media data streams transmission in multimedia communications, comprising:
the data acquisition device comprises video acquisition equipment, audio acquisition equipment or data acquisition equipment and is used for acquiring the multi-channel media data stream;
the transmission device is used for grouping the multi-path media data streams acquired by the data acquisition device, grouping and describing the grouped multi-path media data streams, and transmitting the grouped multi-path media data streams and the grouping description corresponding to the media data streams;
the receiving processing device is used for receiving the multi-path media data stream with the grouping description and the grouping description corresponding to the media data stream, and grouping and outputting the media data stream according to the grouping description of the received multi-path media data stream;
and the data output device is used for outputting the grouped media data stream through video output equipment, audio output equipment or data output equipment.
20. The system of claim 19, wherein the transmission means comprises:
the grouping unit is used for grouping the multi-path media data streams to be transmitted, and comprises the steps of grouping according to the position relation among the interfaces of the media data streams, or grouping through the spatial position of audio and/or video, or utilizing an array microphone to pick up the positions of a plurality of paths of sound sources to form corresponding independent audio streams, and then grouping the multi-path audio streams; or after a panoramic image is acquired through a wide-angle camera, the panoramic image is cut into multiple paths of separated images, and then the multiple paths of video streams are grouped;
the grouping description unit is used for carrying out grouping description on the grouped multi-path media data stream; carrying packet description in a media data stream or a bearer channel corresponding to the media data stream; or carrying the packet description in a control protocol associated with the media data stream; or adding a control message carrying packet description corresponding to the media data in the media data stream;
and the data transmission unit is used for transmitting the grouped multi-path media data stream and the grouping description corresponding to the media data stream.
21. The system of claim 19 or 20, further comprising:
and the conference control equipment is used for changing the grouping relation by forwarding the grouping relation of the media data streams or grouping a plurality of paths of media data streams of different meeting places.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910008299.4A CN101489090B (en) | 2009-02-20 | 2009-02-20 | Method, apparatus and system for multipath media stream transmission and reception |
| PCT/CN2010/070180 WO2010094213A1 (en) | 2009-02-20 | 2010-01-14 | Method, apparatus and system for transmitting and receiving multiplex media data stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910008299.4A CN101489090B (en) | 2009-02-20 | 2009-02-20 | Method, apparatus and system for multipath media stream transmission and reception |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101489090A true CN101489090A (en) | 2009-07-22 |
| CN101489090B CN101489090B (en) | 2014-01-08 |
Family
ID=40891737
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910008299.4A Active CN101489090B (en) | 2009-02-20 | 2009-02-20 | Method, apparatus and system for multipath media stream transmission and reception |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN101489090B (en) |
| WO (1) | WO2010094213A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010094213A1 (en) * | 2009-02-20 | 2010-08-26 | 华为终端有限公司 | Method, apparatus and system for transmitting and receiving multiplex media data stream |
| WO2016150320A1 (en) * | 2015-03-25 | 2016-09-29 | 中兴通讯股份有限公司 | Method and device for sending audio |
| WO2019170037A1 (en) * | 2018-03-05 | 2019-09-12 | 集思谱（北京）科技有限公司 | Multimedia information distribution method and system combining individual units |
| CN110349584A (en) * | 2019-07-31 | 2019-10-18 | 北京声智科技有限公司 | A kind of audio data transmission method, device and speech recognition system |
| CN113542688A (en) * | 2021-07-14 | 2021-10-22 | 杭州海康威视数字技术股份有限公司 | Audio and video monitoring method, device, equipment, storage medium and system |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115314666A (en) * | 2022-08-08 | 2022-11-08 | 深圳明弘电子科技有限公司 | A kind of video conference data collaboration method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1128921A (en) * | 1995-02-09 | 1996-08-14 | 三菱电机株式会社 | Multimedia Information Processing System |
| US5548346A (en) * | 1993-11-05 | 1996-08-20 | Hitachi, Ltd. | Apparatus for integrally controlling audio and video signals in real time and multi-site communication control method |
| CN1466385A (en) * | 2002-06-19 | 2004-01-07 | 华为技术有限公司 | Real time receiving and sxtorage method for video signal conference stream medium |
| CN1929593A (en) * | 2005-09-07 | 2007-03-14 | 宝利通公司 | Spatially correlated audio in multipoint videoconferencing |
| JP2007072739A (en) * | 2005-09-07 | 2007-03-22 | Hitachi Communication Technologies Ltd | Multipoint conference system, multipoint conference device and client terminal |
| CN101217658A (en) * | 2008-01-09 | 2008-07-09 | 杭州华三通信技术有限公司 | A media transmission method, system and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101489090B (en) * | 2009-02-20 | 2014-01-08 | 华为终端有限公司 | Method, apparatus and system for multipath media stream transmission and reception |
-
2009
- 2009-02-20 CN CN200910008299.4A patent/CN101489090B/en active Active
-
2010
- 2010-01-14 WO PCT/CN2010/070180 patent/WO2010094213A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5548346A (en) * | 1993-11-05 | 1996-08-20 | Hitachi, Ltd. | Apparatus for integrally controlling audio and video signals in real time and multi-site communication control method |
| CN1128921A (en) * | 1995-02-09 | 1996-08-14 | 三菱电机株式会社 | Multimedia Information Processing System |
| CN1466385A (en) * | 2002-06-19 | 2004-01-07 | 华为技术有限公司 | Real time receiving and sxtorage method for video signal conference stream medium |
| CN1929593A (en) * | 2005-09-07 | 2007-03-14 | 宝利通公司 | Spatially correlated audio in multipoint videoconferencing |
| JP2007072739A (en) * | 2005-09-07 | 2007-03-22 | Hitachi Communication Technologies Ltd | Multipoint conference system, multipoint conference device and client terminal |
| CN101217658A (en) * | 2008-01-09 | 2008-07-09 | 杭州华三通信技术有限公司 | A media transmission method, system and device |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010094213A1 (en) * | 2009-02-20 | 2010-08-26 | 华为终端有限公司 | Method, apparatus and system for transmitting and receiving multiplex media data stream |
| WO2016150320A1 (en) * | 2015-03-25 | 2016-09-29 | 中兴通讯股份有限公司 | Method and device for sending audio |
| CN106162038A (en) * | 2015-03-25 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of audio frequency sending method and device |
| WO2019170037A1 (en) * | 2018-03-05 | 2019-09-12 | 集思谱（北京）科技有限公司 | Multimedia information distribution method and system combining individual units |
| CN110349584A (en) * | 2019-07-31 | 2019-10-18 | 北京声智科技有限公司 | A kind of audio data transmission method, device and speech recognition system |
| CN113542688A (en) * | 2021-07-14 | 2021-10-22 | 杭州海康威视数字技术股份有限公司 | Audio and video monitoring method, device, equipment, storage medium and system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2010094213A1 (en) | 2010-08-26 |
| CN101489090B (en) | 2014-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101081803B1 (en) | Method and system for conducting continuous presence conferences | |
| US8237765B2 (en) | Video conferencing device which performs multi-way conferencing | |
| JP3676979B2 (en) | High-speed video transmission via telephone line | |
| CN100579196C (en) | Device, network appliance and method for video and audio signal transmission | |
| US8385234B2 (en) | Media stream setup in a group communication system | |
| US9344475B2 (en) | Media transmission method and system based on telepresence | |
| US8024486B2 (en) | Converting data from a first network format to non-network format and from the non-network format to a second network format | |
| CN103051864B (en) | Mobile video session method | |
| CN110392047A (en) | Data transmission method, device and equipment | |
| CN102655584A (en) | Media data transmitting and playing method and system in tele-presence technology | |
| CN101370114A (en) | Video and audio processing method, multi-point control unit and video conference system | |
| WO2011140812A1 (en) | Multi-picture synthesis method and system, and media processing device | |
| US9961303B2 (en) | Video conference virtual endpoints | |
| CN101489090A (en) | Method, apparatus and system for multipath media stream transmission and reception | |
| EP3127326A1 (en) | System and method for a hybrid topology media conferencing system | |
| US7180535B2 (en) | Method, hub system and terminal equipment for videoconferencing | |
| AU2013227926B2 (en) | Electronic conference system, bandwidth management method and storage medium in which bandwidth management program is stored | |
| CN102025973B (en) | Video synthesizing method and video synthesizing system | |
| CN101141615B (en) | External implementing method of session television terminal supporting double currents | |
| WO2013001276A1 (en) | Apparatuses, methods and computing software products for operating real-time multiparty multimedia communications | |
| CN102957893B (en) | For the method and system switched between the video flowing in continuous presence conferences | |
| JP2823571B2 (en) | Distributed multipoint teleconferencing equipment | |
| JP2002111663A (en) | Electronic conferencing system and information distribution method in the system | |
| EP1286547A1 (en) | Broadband media distribution system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Su Honghong Inventor after: Wang Zhaoxiang Inventor before: Su Honghong |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: SU HONGHONG TO: SU HONGHONG WANG ZHAOXIANG |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518129 Building 2, B District, Bantian HUAWEI base, Longgang District, Shenzhen, Guangdong. Patentee after: Huawei terminal (Shenzhen) Co.,Ltd. Address before: 518129 Building 2, B District, Bantian HUAWEI base, Longgang District, Shenzhen, Guangdong. Patentee before: HUAWEI DEVICE Co.,Ltd. |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20181218 Address after: 523808 Southern Factory Building (Phase I) Project B2 Production Plant-5, New Town Avenue, Songshan Lake High-tech Industrial Development Zone, Dongguan City, Guangdong Province Patentee after: HUAWEI DEVICE Co.,Ltd. Address before: 518129 Building 2, B District, Bantian HUAWEI base, Longgang District, Shenzhen, Guangdong. Patentee before: Huawei terminal (Shenzhen) Co.,Ltd. |
|
| TR01 | Transfer of patent right |