CN112511782B - Video conference method, first terminal, MCU, system and storage medium - Google Patents

Abstract

The present invention provides a video conferencing method, a first terminal, an MCU, a system and a storage medium. The method obtains network quality parameters during a video conference, adjusts the encoding and decoding capabilities according to the network quality parameters, encodes and decodes media files using the adjusted encoding and decoding capabilities, and sends the encoded and decoded media stream and the network quality parameters to the MCU; further, the MCU receives the media stream and the network quality parameters from the first terminal, adjusts the encoding and decoding capabilities according to the network quality parameters, encodes and decodes the media stream to be sent using the adjusted encoding and decoding capabilities, wherein the media stream to be sent comes from other participating terminals except the first terminal, and then sends the encoded and decoded media stream to the first terminal; the first terminal receives the media stream from the MCU; the problem in the prior art that some terminals have unsmooth video images or poor effects due to network reasons during a conference, and the user experience is poor.

Description

Video conference method, first terminal, MCU, system and storage medium

Technical Field

The present invention relates to the field of audio and video technology, and more specifically, to a video conferencing method, a first terminal, a multipoint control unit (MCU), a system and a storage medium.

Background technique

With the rapid development of IP network and multimedia communication technology, video conferencing system has been widely used in modern enterprises. Video conferencing system refers to the use of TV equipment and video conferencing terminals to call multiple user terminals distributed in different places into the same conference through MCU.

In real-world applications, there are more and more small-scale meetings and self-service meetings, and terminals and MCUs from various manufacturers often need to be held. At present, in traditional conference television systems, a common scenario is that due to network reasons, some terminals experience choppy or poor video images during meetings, which greatly reduces user experience satisfaction.

Summary of the invention

The video conferencing method, first terminal, MCU, system and storage medium provided in the embodiments of the present invention mainly solve the technical problem that in the prior art, due to network reasons, some terminals experience unsmooth video images or poor effects during a conference, resulting in poor user experience.

To solve the above technical problems, an embodiment of the present invention provides a video conferencing method, which is applied to a first terminal and includes:

Obtain network quality parameters during video conferencing;

Adjusting the encoding and decoding capability according to the network quality parameter;

Encode and decode the media file using the adjusted encoding and decoding capability;

Send the encoded and decoded media stream and network quality parameters to the multipoint control unit MCU;

Receive a media stream from the MCU.

To solve the above technical problems, an embodiment of the present invention provides a video conferencing method, which is applied to a multipoint control unit MCU, including:

receiving a media stream and a network quality parameter from a first terminal during a video conference;

Adjusting the encoding and decoding capability according to the network quality parameter;

Using the adjusted encoding and decoding capability to encode and decode a media stream to be sent, where the media stream to be sent comes from other participating terminals except the first terminal;

The encoded and decoded media stream is sent to the first terminal.

In order to solve the above technical problems, an embodiment of the present invention provides a video conferencing method, in which a first terminal obtains a network quality parameter during a video conference, adjusts the codec capability according to the network quality parameter, encodes and decodes a media file using the adjusted codec capability, and sends the encoded and decoded media stream and the network quality parameter to a multipoint control unit MCU;

During the video conference, the MCU receives a media stream and a network quality parameter from the first terminal, adjusts the codec capability according to the network quality parameter, uses the adjusted codec capability to encode and decode the media stream to be sent, the media stream to be sent comes from other participating terminals except the first terminal, and sends the encoded and decoded media stream to the first terminal;

The first terminal receives a media stream from the MCU.

To solve the above technical problem, an embodiment of the present invention further provides a first terminal, which includes: a first acquisition module, a first adjustment module, a first encoding and decoding module, a first sending module and a first receiving module;

The first acquisition module is used to obtain network quality parameters during the video conference;

The first adjustment module is used to adjust the encoding and decoding capability according to the network quality parameter;

The first encoding and decoding module is used to encode and decode the media file using the adjusted encoding and decoding capability;

The first sending module is used to send the encoded and decoded media stream and network quality parameters to the multipoint control unit MCU;

The first receiving module is used to receive the media stream from the MCU.

To solve the above technical problems, an embodiment of the present invention further provides a multipoint control unit MCU, the MCU comprising: a second receiving module, a second adjusting module, a second encoding and decoding module and a second sending module;

The second receiving module is used to receive the media stream and network quality parameters from the first terminal during the video conference;

The second adjustment module is used to adjust the encoding and decoding capability according to the network quality parameter;

The second encoding and decoding module is used to encode and decode the to-be-sent media stream using the adjusted encoding and decoding capability, where the to-be-sent media stream comes from other participating terminals except the first terminal;

The second sending module is used to send the encoded and decoded media stream to the first terminal.

To solve the above technical problem, an embodiment of the present invention further provides a system, the system comprising a multipoint control unit MCU and at least two first terminals;

During the video conference, the first terminal is used to obtain network quality parameters, adjust the codec capability according to the network quality parameters, encode and decode the media file using the adjusted codec capability, and send the encoded and decoded media stream and the network quality parameters to the MCU;

During the video conference, the MCU receives the media stream and the network quality parameter from the first terminal, adjusts the codec capability according to the network quality parameter, encodes and decodes the media stream to be sent using the adjusted codec capability, the media stream to be sent comes from other participating terminals except the first terminal, and sends the encoded and decoded media stream to the first terminal;

The first terminal is also used to receive a media stream from the MCU.

To solve the above technical problem, an embodiment of the present invention provides a storage medium, wherein the storage medium stores one or more first computer programs, and the one or more first computer programs can be executed by one or more processors to implement the steps of the first terminal corresponding to the video conference method as described above;

or,

The storage medium stores one or more second computer programs, and the one or more second computer programs can be executed by one or more processors to implement the steps of the MCU corresponding video conferencing method as described above.

The beneficial effects of the present invention are:

The video conferencing method, first terminal, MCU, system and storage medium provided by the embodiment of the present invention obtain network quality parameters at the first terminal during the video conference, and then adjust the codec capability according to the network quality parameters, use the adjusted codec capability to encode and decode the media file, and send the encoded and decoded media stream and network quality parameters to the multipoint control unit MCU; further, the MCU receives the media stream and network quality parameters from the first terminal, adjusts the codec capability according to the network quality parameters, and uses the adjusted codec capability to encode and decode the media stream to be sent, wherein the media stream to be sent comes from other participating terminals other than the first terminal, and then sends the encoded and decoded media stream to the first terminal; further, the first terminal receives the media stream from the MCU; solves the problem in the prior art that some terminals have unsmooth video images or poor effects due to network reasons during the conference, and the user experience is poor. That is, the video conferencing method, first terminal, MCU, system and storage medium provided by the embodiment of the present invention realize the dynamic adjustment of the codec capability in combination with the current network quality parameters during the video conference, which greatly improves the effect of the video conference image, and thus improves the user experience satisfaction.

Other features and corresponding beneficial effects of the present invention are described in the latter part of the specification, and it should be understood that at least part of the beneficial effects become obvious from the description in the specification of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be further described below with reference to the accompanying drawings and embodiments, in which:

FIG1 is a schematic diagram of a basic flow chart of a terminal-side video conferencing method provided in Embodiment 1 of the present invention;

FIG. 2 is a second basic flow diagram of the terminal-side video conferencing method provided in Embodiment 1 of the present invention;

FIG3 is a schematic diagram of a basic flow chart of a video conferencing method on the MCU side provided in Embodiment 1 of the present invention;

FIG4 is a second basic flow diagram of the MCU-side video conferencing method provided in Embodiment 1 of the present invention;

FIG5 is a schematic diagram of the basic flow of a video conferencing method provided by Embodiment 3 of the present invention;

FIG6 is a schematic diagram of the basic flow of a terminal-side video conferencing method provided in Embodiment 4 of the present invention;

FIG7 is a schematic diagram of the basic flow of the MCU-side video conferencing method provided in Embodiment 4 of the present invention;

FIG8 is a schematic diagram of the basic flow of the MCU-side video conferencing method provided in Embodiment 5 of the present invention;

FIG9 is a schematic diagram of the structure of a first terminal provided in Embodiment 6 of the present invention;

FIG10 is a schematic diagram of the structure of an MCU provided in Embodiment 6 of the present invention;

FIG. 11 is a schematic diagram of the structure of a system provided in Embodiment 7 of the present invention.

Detailed ways

In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the embodiments of the present invention are further described in detail below through specific implementation methods combined with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention and are not used to limit the present invention.

Embodiment 1:

In order to solve the problem in the prior art that due to network reasons, some terminals experience unsmooth video images or poor effects, resulting in poor user experience during a meeting, a video conferencing method is provided in an embodiment of the present invention. During the video conferencing process, the first terminal obtains network quality parameters, and then adjusts the encoding and decoding capabilities according to the network quality parameters, encodes and decodes the media files using the adjusted encoding and decoding capabilities, and sends the encoded and decoded media streams and network quality parameters to the multi-point control unit MCU; please refer to Figure 1, as shown in Figure 1 is a basic flow chart of the video conferencing method provided by this embodiment.

S101: Acquire network quality parameters during a video conference.

Optionally, in this embodiment, before obtaining the network quality parameter during the video conference, at least the following steps are also included, as shown in FIG2 :

S201: Send first video codec protocol information to the MCU, where the first video codec protocol information includes various video codec protocols supported by the first terminal.

First, the first terminal in this embodiment supports at least one video codec protocol; for example, the first terminal supports two video codec protocols, namely N and K. At this time, the first terminal sends the first video codec protocol information to the MCU side, where the first video codec protocol information includes N and K.

S202: Receive second video codec protocol information from the MCU, where the second video codec protocol information includes a video codec protocol with the highest priority supported by the first terminal.

Then, the MCU will evaluate the video codec protocols supported by the first terminal, determine a video codec protocol with the best video conferencing quality for the first terminal, determine its priority as the highest, add it to the second video codec protocol information and send it to the first terminal; for example, continuing the above example, further, the MCU side determines that the video codec protocol N has the highest priority, that is, the second video codec protocol information includes N, and further, the second video codec protocol information is sent to the first terminal, so that the first terminal receives the second video codec protocol information from the MCU.

S203: Join the conference using the video codec protocol with the highest priority.

Finally, the first terminal joins the conference using the video codec protocol with the highest priority supported by the first terminal included in the second video codec protocol information; for example, still following the above example, further, the first terminal joins the conference using video codec protocol N.

Optionally, in this embodiment, joining the conference using the video codec protocol with the highest priority includes at least the following two methods:

Method 1: Join the conference by actively calling the MCU.

It should be understood that the first terminal can actively call the MCU to join the conference through the calling number or interactive voice and video response (IVVR), etc. In actual applications, it can be flexibly adjusted according to the specific application scenario.

Method 2: Actively add users to the conference through MCU.

It should also be understood that the first terminal may also passively join the conference, that is, the conference administrator actively adds the first terminal through the MCU, and the first terminal joins the conference at this time.

Optionally, the network quality parameters in this embodiment include but are not limited to packet loss rate, network jitter, and network delay. Optionally, the network quality parameters include any one or any combination of packet loss rate, network jitter, and network delay.

S102: Adjust the encoding and decoding capability according to the network quality parameter.

Optionally, in this embodiment, the encoding and decoding capability is adjusted according to the network quality parameter, including at least the following two cases:

In case 1, when the corresponding value of the network quality parameter is within the preset first threshold range, it is determined that the current network condition is at the first level, and the transmission rate of the current codec is adjusted.

It should be understood that adjusting the transmission rate of the current codec includes: reducing the transmission rate of the codec or increasing the transmission rate of the codec.

For a better understanding, here is a specific example:

For example, suppose the preset first threshold range is [A1, A2], and the network quality parameter is the packet loss rate. When the terminal obtains a corresponding value of the packet loss rate within the first threshold range [A1, A2] after forward error correction (FEC) or packet loss strategy compensation, it is determined that the current network situation is at the first level, and the transmission rate of the current codec is adjusted; specifically, suppose the corresponding value of the previous packet loss rate is a1, and the packet loss rate this time is a2, wherein a1 and a2 are both within [A1, A2]. When a1>a2, the transmission rate of the current codec should be increased, and when a2>a1, the transmission rate of the current codec should be reduced.

It is worth noting that what is listed here is just a specific example. In actual applications, it is necessary to make flexible adjustments according to the specific application scenarios. At the same time, the preset first threshold and the reduced or increased transmission rate value are flexibly set by the developer based on experiments or experience.

In case 2, when the corresponding value of the network quality parameter is within the preset second threshold range, it is determined that the current network condition is at the second level, and the resolution and/or frame rate of the current codec is adjusted.

It should be understood that adjusting the resolution and/or frame rate of the current codec includes: reducing the resolution and/or frame rate of the codec, or increasing the resolution and/or frame rate of the codec.

For a better understanding, here is a specific example:

For example, assume that the preset second threshold range is [A3, A4], and assume that the network quality parameter is the packet loss rate. When the terminal obtains a corresponding value of the packet loss rate within the second threshold range [A3, A4] after forward error correction (FEC) or packet loss strategy compensation, it is determined that the current network situation is at the second level, and the resolution and/or frame rate of the current codec are adjusted; specifically, assume that the corresponding value of the previous packet loss rate is a3, and the packet loss rate this time is a4, where a3 and a4 are both within [A3, A4]. When a3>a4, the resolution and/or frame rate of the current codec should be increased, and when a4>a3, the resolution and/or frame rate of the current codec should be reduced.

It is worth noting that what is listed here is just a specific example. In actual applications, it is necessary to make flexible adjustments according to the specific application scenarios. At the same time, the preset second threshold and the reduced or increased resolution and/or frame rate value are flexibly set by the developer based on experiments or experience.

It should be noted that the maximum value of the preset first threshold range is smaller than the minimum value of the preset second threshold range. For example, taking the above example, the size relationship of A1, A2, A3, and A4 is A1<A2<A3<A4.

S103: Encode and decode the media file using the adjusted encoding and decoding capability.

It should be understood that after the codec capability is adjusted, the media file is further encoded and decoded using the adjusted codec capability.

S104: Send the encoded and decoded media stream and network quality parameters to the multipoint control unit MCU.

It should be understood that, further, the encoded and decoded media stream and the acquired network quality parameters are sent to the MCU.

S105: receiving a media stream from the MCU.

It should also be understood that the first terminal also receives the media stream sent from the MCU.

In order to solve the problem in the prior art that due to network reasons, some terminals experience unsmooth video images or poor effects, resulting in poor user experience during a meeting, a video conferencing method is provided in an embodiment of the present invention. During the video conferencing process, the MCU receives a media stream and a network quality parameter from a first terminal, adjusts the encoding and decoding capability according to the network quality parameter, and uses the adjusted encoding and decoding capability to encode and decode the media stream to be sent, wherein the media stream to be sent comes from other participating terminals except the first terminal, and the encoded and decoded media stream is sent to the first terminal; please refer to Figure 3, as Figure 3 is a schematic diagram of the basic flow of the video conferencing method provided by this embodiment.

S301: receiving a media stream and a network quality parameter from a first terminal during a video conference.

Optionally, the MCU in this embodiment is compatible with at least two video codec protocols. Therefore, in this embodiment, before receiving the media stream and the network quality parameter from the first terminal during the video conference, at least the following steps are also included, as shown in FIG. 4:

S401: Receive first video codec protocol information from a first terminal, where the first video codec protocol information includes various video codec protocols supported by the first terminal.

First, the first terminal in this embodiment supports at least one video codec protocol; for example, the first terminal supports two video codec protocols, namely N and K. At this time, the first terminal sends the first video codec protocol information to the MCU, where the first video codec protocol information includes N and K. At this point, the MCU receives the first video codec protocol information from the first terminal side.

S402: Prioritize each video codec protocol, wherein a video codec protocol with better video conference quality has a higher priority, and determine second video codec protocol information, where the second video codec protocol information includes the highest priority video codec protocol supported by the first terminal.

Then, the MCU will evaluate the video codec protocols supported by the first terminal side, determine a video codec protocol with the best video conferencing quality for the first terminal, set its priority as the highest, add it to the second video codec protocol information and send it to the first terminal; for example, continuing with the above example, further, the MCU determines that the video codec protocol N has the highest priority, that is, the second video codec protocol information includes N.

S403: Send the second video encoding and decoding protocol information to the first terminal.

Finally, the MCU sends the second video codec protocol information corresponding to the highest priority video codec protocol supported by the first terminal to the first terminal side; for example, still following the above example, further, the MCU sends the second video codec protocol information to the first terminal.

Optionally, the network quality parameters in this embodiment include but are not limited to packet loss rate, network jitter, and network delay. Optionally, the network quality parameters include any one or any combination of packet loss rate, network jitter, and network delay.

S302: Adjust the encoding and decoding capability according to the network quality parameter.

Optionally, in this embodiment, the encoding and decoding capability is adjusted according to the network quality parameter, including at least the following two cases:

In case 1, when the corresponding value of the network quality parameter is within the preset third threshold range, it is determined that the current network condition is at the third level, and the transmission rate of the current codec is adjusted.

It should be understood that adjusting the transmission rate of the current codec includes: reducing the transmission rate of the codec or increasing the transmission rate of the codec.

For a better understanding, here is a specific example:

For example, assume that the preset third threshold range is [B1, B2], and assume that the network quality parameter is the packet loss rate. When the terminal obtains a corresponding value of the packet loss rate within the third threshold range [B1, B2] after forward error correction (ForwBrd Error Correction, FEC) or packet loss strategy compensation and other strategies, it is determined that the current network situation is at the third level, and the transmission rate of the current codec is adjusted; specifically, assume that the corresponding value of the previous packet loss rate is b1, and the packet loss rate this time is b2, where b1 and b2 are both within [B1, B2]. When b1>b2, the transmission rate of the current codec should be increased, and when b2>b1, the transmission rate of the current codec should be reduced.

It is worth noting that what is listed here is just a specific example. In actual applications, it is necessary to make flexible adjustments according to the specific application scenarios. At the same time, the preset third threshold and the reduced or increased transmission rate value are flexibly set by the developer based on experiments or experience.

In case 2, when the corresponding value of the network quality parameter is within the preset fourth threshold range, it is determined that the current network condition is at the fourth level, and the resolution and/or frame rate of the current codec is adjusted.

It should be understood that adjusting the resolution and/or frame rate of the current codec includes: reducing the resolution and/or frame rate of the codec, or increasing the resolution and/or frame rate of the codec.

For a better understanding, here is a specific example:

For example, assume that the preset fourth threshold range is [B3, B4], and assume that the network quality parameter is the packet loss rate. When the terminal obtains a corresponding value of the packet loss rate within the fourth threshold range [B3, B4] after forward error correction (ForwBrd Error Correction, FEC) or packet loss strategy compensation and other strategies, it is determined that the current network situation is at the fourth level, and the resolution and/or frame rate of the current codec are adjusted; specifically, assume that the corresponding value of the previous packet loss rate is b3, and the packet loss rate this time is b4, where b3 and b4 are both within [B3, B4]. When B3>B4, the resolution and/or frame rate of the current codec should be increased, and when B4>B3, the resolution and/or frame rate of the current codec should be reduced.

It is worth noting that what is listed here is just a specific example. In actual applications, it is necessary to make flexible adjustments according to the specific application scenarios. At the same time, the fourth threshold and the reduced or increased resolution and/or frame rate values are preset and flexibly set by the developer based on experiments or experience.

It should be noted that the maximum value of the preset third threshold range is smaller than the minimum value of the preset fourth threshold range. For example, taking the above example, the size relationship of B1, B2, B3, and B4 is B1<B2<B3<B4.

It should also be noted that the preset first threshold range may be equal to or different from the preset third threshold range, and the preset second threshold range may be equal to or different from the preset fourth threshold range. In actual applications, flexible adjustments can be made according to specific application scenarios.

Optionally, in this embodiment, after reducing the transmission rate of the codec, or reducing the resolution and/or frame rate of the codec, it also includes: releasing redundant codec resources for use in other video conferences.

Optionally, in this embodiment, before increasing the transmission rate of the codec, or increasing the resolution and/or frame rate of the codec, the method further includes: acquiring codec resources.

S303: Encode and decode the media stream to be sent by using the adjusted encoding and decoding capability, where the media stream to be sent comes from other participating terminals except the first terminal.

It should be understood that after the codec capability is adjusted, the adjusted codec capability is further used to encode and decode the media stream to be sent, wherein the media stream to be sent comes from other participating terminals except the first terminal.

S304: Send the encoded and decoded media stream to the first terminal.

It should be understood that, further, the encoded and decoded media stream is sent to the first terminal.

The video conferencing method provided by the embodiment of the present invention obtains network quality parameters at the first terminal during the video conferencing process, and then adjusts the encoding and decoding capabilities according to the network quality parameters, uses the adjusted encoding and decoding capabilities to encode and decode media files, and sends the encoded and decoded media streams and network quality parameters to the multi-point control unit MCU; further, the MCU receives the media stream and network quality parameters from the first terminal, adjusts the encoding and decoding capabilities according to the network quality parameters, and uses the adjusted encoding and decoding capabilities to encode and decode the media stream to be sent, wherein the media stream to be sent comes from other participating terminals except the first terminal, and then sends the encoded and decoded media stream to the first terminal; further, the first terminal receives the media stream from the MCU; the problem in the prior art that some terminals have unsmooth video images or poor effects due to network reasons during the conference, and the user experience is poor; it realizes the dynamic adjustment of the encoding and decoding capabilities in combination with the current network quality parameters during the video conferencing process, which greatly improves the effect of the video conferencing image, thereby improving the user experience satisfaction.

At the same time, in the video conferencing method provided by the embodiment of the present invention, the MCU is compatible with at least two video codec protocols, that is, it is compatible with the video codec protocols supported by terminals of various manufacturers, thereby avoiding the cumbersome operation that the existing MCU only supports a single video codec protocol and needs to configure the video codec protocol before entering the meeting; and the MCU ensures that each terminal can enter the meeting with its optimal capability, further improving the effect of the video conferencing image, thereby further improving the user experience satisfaction.

Embodiment 2:

In order to solve the problem in the prior art that in a conference, due to network reasons, some terminals experience choppy or poor video images and poor user experience, a video conferencing method is provided in an embodiment of the present invention.

Step 1: During the video conference, the first terminal obtains the network quality parameters, adjusts the codec capability according to the network quality parameters, encodes and decodes the media file using the adjusted codec capability, and sends the encoded and decoded media stream and the network quality parameters to the multipoint control unit MCU;

Step 2: During the video conference, the MCU receives the media stream and the network quality parameter from the first terminal, adjusts the codec capability according to the network quality parameter, and uses the adjusted codec capability to encode and decode the media stream to be sent. The media stream to be sent comes from other participating terminals except the first terminal, and the encoded and decoded media stream is sent to the first terminal;

Step 3: The first terminal receives the media stream from the MCU.

It is worth noting that in order to avoid redundant description, all examples in the first embodiment are not fully described in this embodiment. It should be clear that all examples in the first embodiment are applicable to this embodiment.

The video conferencing method provided in the embodiment of the present invention solves the problem in the prior art that due to network reasons, some terminals experience jerky or poor video images and poor user experience during a conference; it realizes dynamic adjustment of the encoding and decoding capabilities in combination with the current network quality parameters during the video conference, greatly improves the effect of the video conferencing image, and thereby improves the user experience satisfaction.

Embodiment three:

Based on the above embodiments, the embodiment of the present invention provides a specific video conferencing method process, as shown in FIG5 , which is a basic flow chart of the video conferencing method provided by this embodiment.

S501: The first terminal sends first video codec protocol information to the MCU, where the first video codec protocol information includes various video codec protocols supported by the first terminal.

S502: The MCU receives the first video codec protocol information from the first terminal, prioritizes each video codec protocol, wherein a video codec protocol with better corresponding video conferencing quality has a higher priority, and determines the second video codec protocol information, wherein the second video codec protocol information includes the highest priority video codec protocol supported by the first terminal.

S503: Send the second video encoding and decoding protocol information to the first terminal.

S504: The first terminal joins the conference using the video codec protocol with the highest priority.

S505: The first terminal obtains network quality parameters during the video conference.

S506: The first terminal adjusts the encoding and decoding capability according to the network quality parameter.

S507: The first terminal encodes and decodes the media file using the adjusted encoding and decoding capability.

S508: The first terminal sends the encoded and decoded media stream and the network quality parameter to the MCU.

S509: The MCU receives the media stream and the network quality parameter from the first terminal, and adjusts the encoding and decoding capability according to the network quality parameter.

S510: The MCU uses the adjusted encoding and decoding capability to encode and decode the media stream to be sent, where the media stream to be sent comes from other participating terminals except the first terminal.

S511: The MCU sends the encoded and decoded media stream to the first terminal.

The video conferencing method provided by the embodiment of the present invention realizes the interaction of the optimal capabilities of each terminal in the video conferencing. At the same time, each terminal in the video conferencing can select a more suitable encoding and decoding capability according to the real-time situation of the network, thereby ensuring the quality of the video conferencing and improving the user's video conferencing experience.

Embodiment 4:

The embodiment of the present invention provides a specific video conferencing method process based on the above embodiment.

First, the terminal side is taken as an example to illustrate "adjusting the encoding and decoding capability according to the network quality parameter", as shown in FIG6 .

S601: Obtaining a packet loss rate during a video conference.

S602: Determine whether the packet loss rate is within a preset first threshold range;

If yes, execute S603; if no, execute S604.

S603: Determine that the current network condition is at the first level, and adjust the transmission rate of the current codec.

S604: Determine whether the packet loss rate is within a preset second threshold range;

If yes, execute S605, if no, end this process.

S605: Determine that the current network condition is at the second level, determine that the current network condition is at the second level, and adjust the resolution and/or frame rate of the current codec.

Next, the MCU side is taken as an example to explain "adjusting the encoding and decoding capability according to the network quality parameters", as shown in FIG7 .

S701: Obtaining a packet loss rate during a video conference.

S702: Determine whether the packet loss rate is within a preset third threshold range;

If yes, execute S703; if no, execute S704.

S703: Determine that the current network condition is at the third level, and adjust the transmission rate of the current codec.

S704: Determine whether the packet loss rate is within a preset fourth threshold range;

If yes, execute S705, if no, end this process.

S705: Determine that the current network condition is at the fourth level, determine that the current network condition is at the fourth level, and adjust the resolution and/or frame rate of the current codec.

The video conferencing method provided by the embodiment of the present invention enables each terminal in the video conferencing to select a more suitable encoding and decoding capability, such as transmission rate, resolution, and frame rate, according to the real-time network situation, thereby ensuring the quality of the video conferencing and improving the user's video conferencing experience.

Embodiment five:

The embodiment of the present invention provides a specific video conferencing method process based on the above embodiment.

The following is an example of "adjusting the encoding and decoding capability according to the network quality parameters" using the MCU side as shown in FIG8.

S801: Obtaining a packet loss rate during a video conference.

S802: Determine whether the packet loss rate is within a preset third threshold range;

If yes, execute S803; if no, execute S808.

S803: Determine whether the current codec transmission rate needs to be reduced;

If yes, execute S804; if no, execute S806.

S804: Reduce the transmission rate of the current codec.

S805: Release excess codec resources for use in other video conferences.

S806: Acquire codec resources.

S807: Increase the transmission rate of the current codec.

S808: Determine whether the packet loss rate is within a preset fourth threshold range;

If yes, execute S809, if no, end this process.

S809: Determine whether the resolution and/or frame rate of the current codec needs to be reduced;

If yes, execute S910; if no, execute S912.

S810: Reduce the resolution and/or frame rate of the current codec.

S811: Release excess codec resources for use in other video conferences.

S812: Acquire codec resources.

S813: Increase the resolution and/or frame rate of the current codec.

The video conferencing method provided by the embodiment of the present invention can effectively release codec resources when the network deteriorates so as to make the codec resources available for other video conferences, thereby effectively ensuring efficient use of conference codec resources.

Embodiment six:

In order to solve the problem in the prior art that some terminals have unsmooth video images or poor effects and poor user experience due to network reasons in a conference, a first terminal is provided in an embodiment of the present invention. As shown in FIG9 , the first terminal includes a first acquisition module 901, a first adjustment module 902, a first encoding and decoding module 903, a first sending module 904 and a first receiving module 905; wherein,

The first acquisition module 901 is used to obtain network quality parameters during the video conference;

The first adjustment module 902 is used to adjust the encoding and decoding capability according to the network quality parameter;

The first codec module 903 is used to encode and decode the media file using the adjusted codec capability;

The first sending module 904 is used to send the encoded and decoded media stream and network quality parameters to the multipoint control unit MCU;

The first receiving module 905 is used to receive the media stream from the MCU.

Optionally, the first sending module 904 is further configured to send first video codec protocol information to the MCU before acquiring the network quality parameter during the video conference, wherein the first video codec protocol information includes various video codec protocols supported by the first terminal.

Optionally, the first receiving module 905 is also used to receive second video codec protocol information from the MCU, wherein the second video codec protocol information includes the highest priority video codec protocol supported by the first terminal. Further, the first terminal joins the meeting with the highest priority video codec protocol.

Optionally, the first adjustment module 902 adjusts the encoding and decoding capability according to the network quality parameter, including at least the following two situations:

In case 1, when the corresponding value of the network quality parameter is within the preset first threshold range, it is determined that the current network condition is at the first level, and the transmission rate of the current codec is adjusted.

It should be understood that adjusting the transmission rate of the current codec includes: reducing the transmission rate of the codec or increasing the transmission rate of the codec.

In case 2, when the corresponding value of the network quality parameter is within the preset second threshold range, it is determined that the current network condition is at the second level, and the resolution and/or frame rate of the current codec is adjusted.

It should be understood that adjusting the resolution and/or frame rate of the current codec includes: reducing the resolution and/or frame rate of the codec, or increasing the resolution and/or frame rate of the codec.

In order to solve the problem in the prior art that some terminals have unsmooth video images or poor effects due to network reasons in a conference, resulting in poor user experience, an MCU is provided in an embodiment of the present invention. As shown in FIG10 , the MCU includes a second receiving module 1001, a second adjustment module 1002, a second encoding and decoding module 1003, and a second sending module 1004; wherein,

The second receiving module 1001 is used to receive the media stream and network quality parameters from the first terminal during the video conference;

The second adjustment module 1002 is used to adjust the encoding and decoding capability according to the network quality parameter;

The second encoding and decoding module 1003 is used to encode and decode the to-be-sent media stream using the adjusted encoding and decoding capability, where the to-be-sent media stream comes from other participating terminals except the first terminal;

The second sending module 1004 is used to send the encoded and decoded media stream to the first terminal.

Optionally, the MCU is compatible with at least two video codec protocols, and the second receiving module 1001 is also used to receive first video codec protocol information from the first terminal before receiving the media stream and network quality parameters from the first terminal during the video conference, wherein the first video codec protocol information includes each video codec protocol supported by the first terminal.

Optionally, the MCU also includes a determination module, which is used to prioritize each video codec protocol, wherein the video codec protocol corresponding to the better the video conferencing quality has a higher priority, and determine the second video codec protocol information, wherein the second video codec protocol information includes the highest priority video codec protocol supported by the first terminal. Furthermore, the second sending module 1004 sends the second video codec protocol information to the first terminal.

Optionally, the second adjustment module 1002 adjusts the encoding and decoding capability according to the network quality parameter, including at least the following two situations:

In case 1, when the corresponding value of the network quality parameter is within the preset third threshold range, it is determined that the current network condition is at the third level, and the transmission rate of the current codec is adjusted.

It should be understood that adjusting the transmission rate of the current codec includes: reducing the transmission rate of the codec or increasing the transmission rate of the codec.

In case 2, when the corresponding value of the network quality parameter is within the preset fourth threshold range, it is determined that the current network condition is at the fourth level, and the resolution and/or frame rate of the current codec is adjusted.

It should be understood that adjusting the resolution and/or frame rate of the current codec includes: reducing the resolution and/or frame rate of the codec, or increasing the resolution and/or frame rate of the codec.

Optionally, in this embodiment, after reducing the transmission rate of the codec, or reducing the resolution and/or frame rate of the codec, redundant codec resources are released for use in other video conferences.

Optionally, in this embodiment, before increasing the transmission rate of the codec, or increasing the resolution and/or frame rate of the codec, the codec resources are acquired.

It is worth noting that in order to avoid redundant description, all examples in Embodiments 1 to 5 are not fully described in this embodiment. It should be clear that all examples in Embodiments 1 to 5 are applicable to this embodiment.

The first terminal and MCU provided in the embodiment of the present invention solve the problem in the prior art that, due to network reasons, some terminals have video images that are not smooth or have poor effects, resulting in poor user experience. Therefore, compared with the prior art, the first terminal and MCU provided in the embodiment of the present invention realize dynamic adjustment of the encoding and decoding capabilities in combination with the current network quality parameters during the video conference, which greatly improves the effect of the video conference image, thereby improving the user experience satisfaction.

At the same time, the MCU provided in the embodiment of the present invention is compatible with at least two video codec protocols, that is, compatible with the video codec protocols supported by terminals of various manufacturers, thereby avoiding the cumbersome operation that the existing MCU only supports a single video codec protocol and needs to configure the video codec protocol before entering the meeting; and the MCU ensures that each terminal can enter the meeting with its optimal capability, further improving the effect of the video conference image, thereby further improving the user experience satisfaction.

Embodiment seven:

In order to solve the problem in the prior art that some terminals have unsmooth video images or poor effects and poor user experience due to network reasons during a meeting, a system is provided in an embodiment of the present invention. As shown in FIG11 , the system includes an MCU 1101 as described in Embodiment 6 and at least two first terminals 1102 as described in Embodiment 6; wherein,

During the video conference, the first terminal 1102 is used to obtain network quality parameters, adjust the codec capability according to the network quality parameters, encode and decode the media file using the adjusted codec capability, and send the encoded and decoded media stream and the network quality parameters to the MCU 1101;

During the video conference, MCU1101 receives the media stream and the network quality parameter from the first terminal 1102, adjusts the codec capability according to the network quality parameter, and uses the adjusted codec capability to encode and decode the media stream to be sent. The media stream to be sent comes from other participating terminals except the first terminal 1102 (that is, other first terminals participating in the conference), and sends the encoded and decoded media stream to the first terminal 1102.

The first terminal 1102 is further configured to receive a media stream from the MCU 1101 .

It should be understood that only a process of interaction between a first terminal and an MCU is taken as an example here, and the processes of interaction between other first terminals and the MCU are the same, which will not be repeated here.

At the same time, an embodiment of the present invention also provides a storage medium (i.e., a computer-readable storage medium), wherein the storage medium stores one or more first computer programs, and the one or more first computer programs can be executed by one or more processors to implement the steps of the video conferencing method corresponding to the first terminal as described above; or the storage medium stores one or more second computer programs, and the one or more second computer programs can be executed by one or more processors to implement the steps of the video conferencing method corresponding to the MCU as described above.

The computer-readable storage medium includes volatile or non-volatile, removable or non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules or other data). Computer-readable storage media include, but are not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable read only memory), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory), digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer.

Obviously, it should be understood by those skilled in the art that all or some steps, systems, and functional modules/units in the above disclosed methods can be implemented as software (which can be implemented with program code executable by a computing device), firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component can have multiple functions, or a function or step can be performed by several physical components in cooperation. Some physical components or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, executed by a computing device, and in some cases, the steps shown or described can be performed in a different order than herein, and the computer-readable medium can include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data).

In addition, it is well known to those skilled in the art that communication media generally contain computer readable instructions, data structures, program modules or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery media. Therefore, the present invention is not limited to any specific hardware and software combination.

The above contents are further detailed descriptions of the embodiments of the present invention in combination with specific implementation methods, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as falling within the protection scope of the present invention.

Claims (13)

1. A video conferencing method, applied to a first terminal, comprising: Obtain network quality parameters during video conferencing; Adjusting the encoding and decoding capability according to the network quality parameter; Encode and decode the media file using the adjusted encoding and decoding capability; Send the encoded and decoded media stream and network quality parameters to the multipoint control unit MCU; receiving a media stream from the MCU; the media stream of the MCU is a media stream obtained by the MCU encoding and decoding the media stream to be sent based on its adjusted encoding and decoding capability, and the media stream to be sent comes from other participating terminals except the first terminal; The network quality parameter includes network jitter; Before obtaining the network quality parameter during the video conference, the method further includes: Sending first video codec protocol information to the MCU, where the first video codec protocol information includes various video codec protocols supported by the first terminal; receiving second video codec protocol information from the MCU, where the second video codec protocol information includes a video codec protocol with the highest priority supported by the first terminal; the video codec protocol with the highest priority is a video codec protocol with the best video conferencing quality relative to the first terminal; Join the conference using the video codec protocol with the highest priority. 2. The video conferencing method according to claim 1, wherein the step of adjusting the encoding and decoding capability according to the network quality parameter comprises: When the corresponding value of the network quality parameter is within a preset first threshold range, determining that the current network condition is at the first level, and adjusting the transmission rate of the current codec; When the corresponding value of the network quality parameter is within a preset second threshold range, determining that the current network condition is at the second level, and adjusting the resolution and/or frame rate of the current codec; The maximum value of the preset first threshold range is smaller than the minimum value of the preset second threshold range. 3. The video conferencing method according to claim 1, wherein joining the conference with the video codec protocol with the highest priority comprises: Join the conference by actively calling the MCU; or, Actively add and join the conference through the MCU. 4. The video conferencing method according to any one of claims 1 to 3, characterized in that the network quality parameter includes at least one of a packet loss rate and a network delay. 5. A video conferencing method, applied to a multipoint control unit MCU, comprising: receiving a media stream and a network quality parameter from a first terminal during a video conference, wherein the media stream of the first terminal is a media stream obtained by encoding and decoding a media file by the first terminal based on its adjusted encoding and decoding capability; Adjusting the encoding and decoding capability according to the network quality parameter; Using the adjusted encoding and decoding capability to encode and decode a media stream to be sent, where the media stream to be sent comes from other participating terminals except the first terminal; Sending the encoded and decoded media stream to the first terminal; The network quality parameter includes network jitter; The MCU is compatible with at least two video encoding and decoding protocols; Before receiving the media stream and the network quality parameter from the first terminal during the video conference, the method further includes: Receiving first video codec protocol information from a first terminal, wherein the first video codec protocol information includes various video codec protocols supported by the first terminal; Prioritize each video codec protocol, wherein a video codec protocol with better video conferencing quality has a higher priority, and determine second video codec protocol information, wherein the second video codec protocol information includes a video codec protocol with the highest priority supported by the first terminal; the video codec protocol with the highest priority is a video codec protocol with the best video conferencing quality relative to the first terminal; Send the second video codec protocol information to the first terminal. 6. The video conferencing method according to claim 5, wherein the step of adjusting the encoding and decoding capability according to the network quality parameter comprises: When the corresponding value of the network quality parameter is within a preset third threshold range, determining that the current network condition is at the third level, and adjusting the transmission rate of the current codec; When the corresponding value of the network quality parameter is within a preset fourth threshold range, determining that the current network condition is at the fourth level, and adjusting the resolution and/or frame rate of the current codec; The maximum value of the preset third threshold range is smaller than the minimum value of the preset fourth threshold range. 7. The video conferencing method according to claim 5, wherein the adjusting the transmission rate of the current codec comprises: reducing the transmission rate of the codec or increasing the transmission rate of the codec; The adjusting the resolution and/or frame rate of the current codec includes: reducing the resolution and/or frame rate of the codec, or increasing the resolution and/or frame rate of the codec; After reducing the transmission rate of the codec, or reducing the resolution and/or frame rate of the codec, the method further includes: releasing redundant codec resources for use in other video conferences; Before increasing the transmission rate of the codec, or increasing the resolution and/or frame rate of the codec, the method further includes: acquiring codec resources. 8. The video conferencing method according to any one of claims 5 to 7, characterized in that the network quality parameter includes at least one of a packet loss rate and a network delay. 9. A video conferencing method, comprising: During the video conference, the first terminal obtains the network quality parameter, adjusts the codec capability according to the network quality parameter, encodes and decodes the media file using the adjusted codec capability, and sends the encoded and decoded media stream and the network quality parameter to the multipoint control unit MCU; During the video conference, the MCU receives a media stream and a network quality parameter from the first terminal, adjusts the codec capability according to the network quality parameter, uses the adjusted codec capability to encode and decode the media stream to be sent, the media stream to be sent comes from other participating terminals except the first terminal, and sends the encoded and decoded media stream to the first terminal; The first terminal receives a media stream from the MCU; The network quality parameter includes network jitter; Before obtaining the network quality parameter, the first terminal is further used to: send first video codec protocol information to the MCU, the first video codec protocol information including each video codec protocol supported by the first terminal; receive second video codec protocol information from the MCU, the second video codec protocol information including the highest priority video codec protocol supported by the first terminal; join the conference with the highest priority video codec protocol; The MCU is compatible with at least two video encoding and decoding protocols; Before receiving the media stream and network quality parameters from the first terminal, the MCU is also used to receive first video codec protocol information from the first terminal, the first video codec protocol information including each video codec protocol supported by the first terminal; prioritize each video codec protocol, wherein the video codec protocol corresponding to the better video conference quality has a higher priority, determine second video codec protocol information, the second video codec protocol information includes the highest priority video codec protocol supported by the first terminal; and send the second video codec protocol information to the first terminal. 10. A first terminal, characterized in that the first terminal comprises: a first acquisition module, a first adjustment module, a first encoding and decoding module, a first sending module and a first receiving module; The first acquisition module is used to obtain network quality parameters during the video conference; The first adjustment module is used to adjust the encoding and decoding capability according to the network quality parameter; The first encoding and decoding module is used to encode and decode the media file using the adjusted encoding and decoding capability; The first sending module is used to send the encoded and decoded media stream and network quality parameters to the multipoint control unit MCU; The first receiving module is used to receive a media stream from the MCU; the network quality parameter includes network jitter; the media stream of the MCU is a media stream obtained by the MCU encoding and decoding the media stream to be sent based on its adjusted encoding and decoding capability, and the media stream to be sent comes from other participating terminals except the first terminal; The first sending module is further used to send first video codec protocol information to the MCU before obtaining the network quality parameter during the video conference, wherein the first video codec protocol information includes each video codec protocol supported by the first terminal; The first receiving module is also used to receive second video codec protocol information from the MCU, the second video codec protocol information includes the highest priority video codec protocol supported by the first terminal, and further, the first terminal joins the conference with the highest priority video codec protocol; the highest priority video codec protocol is the video codec protocol with the best video conferencing quality relative to the first terminal. 11. A multipoint control unit MCU, characterized in that the MCU comprises: a second receiving module, a second adjusting module, a second encoding and decoding module and a second sending module; The second receiving module is used to receive a media stream and a network quality parameter from a first terminal during a video conference, where the media stream of the first terminal is a media stream obtained by encoding and decoding a media file by the first terminal based on its adjusted encoding and decoding capability; The second adjustment module is used to adjust the encoding and decoding capability according to the network quality parameter; The second encoding and decoding module is used to encode and decode the to-be-sent media stream using the adjusted encoding and decoding capability, where the to-be-sent media stream comes from other participating terminals except the first terminal; The second sending module is used to send the encoded and decoded media stream to the first terminal; The network quality parameter includes network jitter; The MCU is compatible with at least two video encoding and decoding protocols; The second receiving module is further used to receive first video codec protocol information from the first terminal before receiving the media stream and network quality parameters from the first terminal during the video conference, wherein the first video codec protocol information includes various video codec protocols supported by the first terminal; The MCU also includes a determination module, which is used to prioritize each video codec protocol, wherein the video codec protocol corresponding to the better the video conferencing quality is, the higher the priority is, and the second video codec protocol information is determined, and the second video codec protocol information includes the highest priority video codec protocol supported by the first terminal; the second sending module is also used to send the second video codec protocol information to the first terminal, and the highest priority video codec protocol is the video codec protocol with the best video conferencing quality relative to the first terminal. 12. A video conferencing system, characterized in that the video conferencing system comprises a multipoint control unit MCU and at least two first terminals; During the video conference, the first terminal is used to obtain network quality parameters, adjust the codec capability according to the network quality parameters, encode and decode the media file using the adjusted codec capability, and send the encoded and decoded media stream and the network quality parameters to the MCU; During the video conference, the MCU receives the media stream and the network quality parameter from the first terminal, adjusts the codec capability according to the network quality parameter, encodes and decodes the media stream to be sent using the adjusted codec capability, the media stream to be sent comes from other participating terminals except the first terminal, and sends the encoded and decoded media stream to the first terminal; The first terminal is also used to receive a media stream from the MCU; The network quality parameter includes network jitter; Before obtaining the network quality parameter, the first terminal is further used to: send first video codec protocol information to the MCU, the first video codec protocol information including each video codec protocol supported by the first terminal; receive second video codec protocol information from the MCU, the second video codec protocol information including the highest priority video codec protocol supported by the first terminal; join the conference with the highest priority video codec protocol; The MCU is compatible with at least two video encoding and decoding protocols; Before receiving the media stream and network quality parameters from the first terminal, the MCU is also used to receive first video codec protocol information from the first terminal, the first video codec protocol information including each video codec protocol supported by the first terminal; prioritize each video codec protocol, wherein the video codec protocol corresponding to the better video conference quality has a higher priority, determine second video codec protocol information, the second video codec protocol information includes the highest priority video codec protocol supported by the first terminal; and send the second video codec protocol information to the first terminal. 13. A storage medium, characterized in that the storage medium stores one or more first computer programs, and the one or more first computer programs can be executed by one or more processors to implement the steps of the video conferencing method according to any one of claims 1 to 4; or, The storage medium stores one or more second computer programs, and the one or more second computer programs can be executed by one or more processors to implement the steps of the video conferencing method as described in any one of claims 6 to 8.