CN108574840A - A method and device for evaluating video quality of experience - Google Patents

Abstract

The present application relates to the field of communication technology, and discloses a method and device for evaluating video quality of experience, which are used for a receiving device to evaluate the video service quality of experience from the sending device to the receiving device. The method is as follows: the receiving end device receives the uplink video damage parameter sent by the control network element, and the uplink video damage parameter is used to represent the quality damage degree of the uplink video data sent by the originating device to the control network element; the receiving end device Based on the uplink video impairment parameters and downlink video impairment parameters, evaluate the quality of video experience from the originating device to the receiving end device, wherein the downlink video impairment parameters are used to characterize the The degree of quality damage of the downlink video data of the receiving device.

Description

A method and device for evaluating video quality of experience

technical field

The embodiments of the present application relate to the field of communication technologies, and in particular, to a method and device for evaluating video quality of experience.

Background technique

With the development of communication technology, users' demand for video services is increasing day by day, and improving the quality of video service experience has become the focus of the industry. At present, the industry has proposed some solutions for measuring the quality of experience of video services. By measuring some factors that affect the quality of experience of video services, the quality of video experience can be evaluated. The industry often uses the video mean subjective score (video Mean Opinion Score, vMOS) to represent the video experience quality. Operators improve the video service experience quality by improving the vMOS index.

In the video conferencing application scenario, when there are more than two participating sites, it needs to be controlled through a multipoint control unit (MCU), and all terminals of the participating sites must be connected to the MCU through standard interfaces. The terminals of each participating site perform video mixing or switching through the MCU. In the prior art, the method for evaluating the video experience quality in the video conference system is: integrating a function module for evaluating the video experience quality in the receiving device of the video conference system, and the function module periodically Calculate video quality of experience.

In a video conferencing application scenario with an MCU, at least one uplink video data reaches the MCU through the uplink between the originating device and the MCU. After the MCU performs video mixing or switching, it passes through the downlink between the MCU and the receiving device. Send downlink video data to the receiving device. Since the MCU needs to perform transcoding operations when performing video mixing or switching, and the functional module integrated in the receiving device can only measure the factors that affect the quality of video service experience in the downlink, resulting in the integration of the functional module in the receiving device The evaluated video quality of experience cannot accurately reflect the real video quality of experience from the source device to the sink device.

Contents of the invention

Embodiments of the present application provide a method and device for evaluating video quality of experience, which are used to solve the problem that existing methods cannot accurately evaluate real video experience quality from a source device to a receive device.

The specific technical scheme that the embodiment of the present application provides is as follows:

In the first aspect, a method for evaluating video quality of experience is provided. The receiving device receives the uplink video impairment parameter sent by the control network element, and based on the uplink video impairment parameter and the downlink video impairment parameter, evaluates the video quality from the originating device to all The quality of video experience of the receiving device, wherein the uplink video impairment parameter is used to characterize the degree of quality impairment of the uplink video data sent by the originating device to the control network element, and the downlink video impairment parameter is used to characterize the control network element The degree of quality damage of the downlink video data sent by the network element to the receiving device. In this way, the video impairment parameters of the uplink and downlink can be integrated, and the end-to-end video experience quality from the source device to the receiver device can be correctly evaluated, and the accuracy of video experience quality evaluation in the video communication system can be improved, so as to facilitate timely adjustment In this way, the user's video communication experience is guaranteed.

In a possible design, the uplink video impairment parameters include video quality attenuation factor and uplink transmission delay, and the downlink video impairment parameters include downlink video source quality, interactive experience quality, and downlink transmission delay. delay, wherein the uplink is a transmission link between the originating device and the control network element, and the downlink is a transmission link between the control network element and the receiving device road. The receiving end device may specifically evaluate the quality of video experience from the originating device to the receiving end device through the following method: the receiving end device combines the video source quality of the downlink with the video quality attenuation factor , determine the video source quality from the originating device to the receiving end device, combine the transmission delay of the uplink and the transmission delay of the downlink, determine the video source quality from the originating device to the receiving end The transmission delay of the device, and determine the viewing experience quality according to the determined transmission delay from the originating device to the receiving device, according to the determined video source quality from the originating device to the receiving device, the determined The interactive experience quality and the viewing experience quality are used to determine the video experience quality from the originating device to the receiving device. Optionally, the receiving device may also combine other more uplink video impairment parameters and downlink video impairment parameters to evaluate the video quality of experience from the sending device to the receiving device, the above is just an example .

In a possible design, the video quality attenuation factor conforms to the following formula: Wherein, F is the video quality attenuation factor, the sQuality _c is the video source quality of the uplink, and the sQuality _o is the reference video source when the video source data of the originating device is not damaged by video coding Quality; in a possible implementation manner, the receiving device multiplies the quality of the downlink video source by the video quality attenuation factor, and determines the resulting product as the The video source quality of the device.

In a possible design, the receiving device adds the transmission delay of the uplink to the transmission delay of the downlink, and determines the sum as the The transmission delay of the end device.

In a possible design, the originating device includes a first originating device and a second originating device, the uplink video data includes first uplink video data and second uplink video data, and the control network element is a The lower-level control network element, the lower-level control network element is connected to the upper-level control network element; the receiving device receives the uplink video damage parameter sent by the lower-level control network element, and the uplink video damage parameter is determined by the first uplink video damage parameter parameter and the second uplink video damage parameter, the first uplink video damage parameter is used to characterize the quality damage degree of the first uplink video data sent by the first originating device to the lower-level control network element, the first The second uplink video impairment parameter is used to characterize the degree of quality impairment of the second uplink video data sent by the second originating device to the lower-level control network element via the upper-level control network element. Optionally, at least two upper-level control network elements may be included in the cascade mode, and the above method may also be used. Wherein, each level of control network element obtains the video damage parameters between the current control network element and the previous network element, wherein, the previous network element can be the upper control network element of the current control network element, or can be the same as the current control network element. The terminal connected to the network element, the current control network element synthesizes various video impairment parameters, and sends the integrated video impairment parameters to the next-level control network element or the receiving end device, and finally enables the receiving end device to synthesize the uplink and downlink Video impairment parameters to evaluate the video experience quality from the source device to the receive device.

In the second aspect, a method for evaluating video quality of experience is provided, which controls a network element to receive uplink video data sent by an originating device, acquires an uplink video impairment parameter, and sends the uplink video impairment parameter to a receiving end device for use in the The receiving device evaluates the video quality of experience from the sending device to the receiving device, wherein the uplink video impairment parameter is used to characterize the degree of quality impairment of the uplink video data. In this way, the receiving device can integrate the video impairment parameters of the uplink and downlink, correctly evaluate the end-to-end video quality of experience from the sending device to the receiving device, and improve the accuracy of video quality of experience evaluation in the video communication system. In order to facilitate timely adjustment to ensure the user's video communication experience.

In a possible design, the uplink video impairment parameter includes a video quality attenuation factor and an uplink transmission delay, and the uplink is a transmission link between the originating device and the control network element, so The control network element acquires the video source quality sQuality _c of the uplink and the resolution of the uplink video data, and the control network element determines the resolution of the uplink video data according to the correspondence between the resolution and the reference video source quality The reference video source quality sQuality _o corresponding to the resolution, the reference video source quality represents the quality of the video source data of the originating device without video coding damage, and the control network element calculates the video quality attenuation factor according to the following formula F: The control network element acquires uplink transmission delay according to the uplink video data.

In a possible design, if the number of the originating device is one, the uplink video impairment parameter includes the video quality attenuation factor of the one originating device and the distance between the one originating device and the control network element. A transmission delay of an uplink; and the control network element obtains the video source quality sQuality of the uplink between the one originating device and the control network element according to the uplink video data sent by the one originating device _c , and acquire the resolution of the uplink video data; the control network element determines the reference video source quality sQuality corresponding to the resolution of the uplink video data according to the correspondence between the resolution and the quality of the reference video source _o , the reference video source quality represents the quality of the video source data of the originating device without video coding damage; the control network element calculates the video quality attenuation factor F according to the following formula: The control network element acquires an uplink transmission delay between the one originating device and the control network element according to the uplink video data.

In a possible design, if the number of the originating devices is at least two, the uplink video impairment parameters include: an average value of video quality attenuation factors of at least two channels of uplink video data sent by the at least two originating devices , and a maximum value of transmission delays of at least two uplinks between the at least two originating devices and the control network element. The control network element respectively acquires video source quality of at least two uplinks between the at least two originating devices and the control network element according to the at least two channels of uplink video data sent by the at least two originating devices sQuality _c , and obtain the resolutions of the at least two channels of upstream video data respectively; the control network element determines the corresponding Refer to the video source quality sQuality _o ; the control network element calculates the video quality attenuation factor F of the uplink video data on each path according to the following formula: Obtain at least two F's, calculate the average of said at least two F's The control network element respectively acquires transmission delays of at least two uplinks according to the uplink video data, and determines a maximum value of transmission delays of the at least two uplinks.

In a possible design, the originating device includes a first originating device and a second originating device, the uplink video data includes first uplink video data and second uplink video data, and the control network element is a The lower-level control network element, the lower-level control network element is connected to the upper-level control network element; the lower-level control network element receives the first uplink video data sent by the first originating device, and through the upper-level control network element Receive the second uplink video data sent by the second originating device. The lower-level control network element acquires a first uplink video damage parameter according to the first uplink video data, and the first uplink video damage parameter is used to characterize the quality damage degree of the first uplink video data; and receives the upper-level control The upper-level uplink video damage parameter sent by the network element, the upper-level uplink video damage parameter is used to characterize the quality damage of the upper-level uplink video data from the second originating device to the upper-level control network element; the lower-level control network element is based on The upper-level uplink video damage parameter and the upper-lower uplink video damage parameter are used to calculate the second uplink video damage parameter, and the upper-lower uplink video damage parameter is used to represent the connection between the upper-level control network element and the lower-level control network element The quality damage degree of the upper and lower uplink video data, the second uplink video damage parameter is used to characterize the quality damage degree of the second uplink video data; the lower control network element according to the first uplink video damage parameter and the The second uplink video impairment parameter determines the uplink video impairment parameter.

In a third aspect, an apparatus for evaluating video quality of experience is provided, and the apparatus has a function of implementing the behavior of the receiving end device in the first aspect and any possible implementation manner of the first aspect. The functions described above may be implemented by hardware, or may be implemented by executing corresponding software on the hardware. The hardware or software includes one or more modules corresponding to the above functions.

In a fourth aspect, an apparatus for evaluating video quality of experience is provided, and the apparatus has a function of controlling network element behavior in any possible implementation manner of the above-mentioned second aspect and the second aspect. The functions described above may be implemented by hardware, or may be implemented by executing corresponding software on the hardware. The hardware or software includes one or more modules corresponding to the above functions.

In a fifth aspect, there is provided a device for evaluating video quality of experience, the device comprising a transceiver, a processor, and a memory, the processor and the memory are connected through a bus system, and the processor is used to execute codes in the memory , when the code is executed, the execution causes the processor to execute the method in the first aspect or any possible implementation manner of the first aspect.

According to the sixth aspect, there is provided a device for evaluating the quality of video experience, the device includes a transceiver, a processor, and a memory, the processor and the memory are connected through a bus system, and the processor is used to execute the code in the memory , when the code is executed, the execution causes the processor to execute the second aspect or the method in any possible implementation manner of the second aspect.

A seventh aspect provides a system for evaluating video quality of experience, the system includes the device described in the third aspect or the fifth aspect, and the device described in the fourth aspect or the sixth aspect.

In an eighth aspect, there is provided a computer storage medium for storing a computer program, and the computer program includes a computer program for executing the first aspect, the second aspect, any possible implementation of the first aspect, or any of the second aspects. Instructions for methods in possible implementations.

In a ninth aspect, an embodiment of the present invention provides a computer program product including instructions, which, when run on a computer, cause the computer to execute the methods described in the above aspects.

Description of drawings

FIG. 1 is a schematic diagram of a system architecture for evaluating video quality of experience in an embodiment of the present application;

FIG. 2 is a schematic flow diagram of a method for evaluating video quality of experience in an embodiment of the present application;

FIG. 3 is a schematic diagram of the architecture of the cascade mode in the embodiment of the present application;

FIG. 4 is a schematic diagram of the architecture of the video conferencing system in the embodiment of the present application;

FIG. 5 is a schematic diagram of a method for evaluating video quality of experience in scenario 1 in an embodiment of the present application;

FIG. 6 is a schematic diagram of a method for evaluating video quality of experience in Scenario 2 in an embodiment of the present application;

FIG. 7 is a schematic diagram of a method for evaluating video quality of experience in scenario 3 in the embodiment of the present application;

FIG. 8 is one of the schematic diagrams of the signaling flow and execution method for evaluating the video quality of experience in the embodiment of the present application;

FIG. 9 is the second schematic diagram of the signaling process and execution method for evaluating video quality of experience in the embodiment of the present application;

10 to 13 are schematic structural diagrams of an apparatus for evaluating video quality of experience in an embodiment of the present application.

Detailed ways

Embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.

As shown in FIG. 1 , in this embodiment of the present application, a system 100 for evaluating video quality of experience includes at least a control network element 101 , an originating device 102 , and a receiving device 103 . The originating device 102 sends uplink video data to the control network element 101 through an uplink, and the uplink is a transmission link between the originating device 102 and the control network element 101 . The control network element 101 sends downlink video data to the receiving device 103 through a downlink, and the downlink is a transmission link between the control network element 101 and the receiving device 103 . In the embodiment of the present application, both the control network element 101 and the receiving device 103 are integrated with a module having a video quality of experience evaluation function, and the module can be used to evaluate the video experience quality according to the received video data.

Based on the system 100 for evaluating video quality of experience shown in FIG. 1 , as shown in FIG. 2 , in the embodiment of the present application, the method for evaluating video quality of experience has the following process.

Step 201, the originating device sends uplink video data to the control network element, and the control network element receives the uplink video data sent by the originating device.

Step 202, the control network element acquires the uplink video impairment parameter according to the received uplink video data.

Wherein, the uplink video damage parameter is used to characterize the quality damage degree of uplink video data. Uplink video impairment parameters include video quality attenuation factor and uplink transmission delay.

Step 203, the control network element sends the uplink video impairment parameters to the receiving device, and the receiving device receives the uplink video impairment parameters sent by the control network element.

Step 204, the receiving device evaluates the video experience quality from the sending device to the receiving device based on the uplink video impairment parameter and the downlink video impairment parameter.

Wherein, the downlink video damage parameter is used to characterize the quality damage degree of the downlink video data sent by the control network element to the receiving device. Downlink video impairment parameters include downlink video source quality, interactive experience quality and downlink transmission delay.

Specifically, the video quality attenuation factor conforms to the following formula:

Among them, F is the video quality attenuation factor, sQuality _c is the video source quality of the uplink, and sQuality _o is the reference video source quality when the video source data of the originating device is not damaged by video coding.

In step 201, the control network element obtains the uplink transmission delay according to the uplink video data;

The control network element acquires the uplink video impairment parameters, and specifically needs to acquire the video quality attenuation factor F and the uplink transmission delay in the uplink video impairment parameters. in:

The control network element obtains the video source quality sQuality _c of the uplink and the resolution of the uplink video data, and determines the reference video source quality sQuality corresponding to the resolution of the uplink video data according to the correspondence between the resolution and the quality of the reference video source _o , and then according to the formula Calculate the video quality attenuation factor F.

It should be noted here that the number of originating devices may be one or at least two.

If there is one originating device, the uplink video impairment parameter includes a video quality attenuation factor of the originating device and an uplink transmission delay between the originating device and the control network element. The control network element obtains the uplink transmission delay between a source device and the control network element according to the uplink video data; and the control network element obtains the source device and the control network element based on the uplink video data sent by the source device. between the video source quality sQuality _c of the uplink, and the resolution of the obtained uplink video data. The control network element determines the reference video source quality sQuality _o corresponding to the resolution of the uplink video data according to the correspondence between the resolution and the quality of the reference video source. Control network elements according to the formula Calculate the video quality attenuation factor F.

If the number of originating devices is at least two, the uplink video impairment parameters include: the average value of video quality attenuation factors of at least two channels of uplink video data sent by at least two originating devices, and the distance between at least two originating devices and the control network element The maximum value of the transmission delay of at least two uplinks. According to the uplink video data, the control network element obtains the transmission delays of at least two uplinks respectively, and determines the maximum value of the transmission delays of the at least two uplinks; and the control network element sends the at least two uplinks according to the At least two channels of uplink video data, respectively acquire the video source quality sQuality _c of at least two uplinks between the at least two originating devices and the control network element, and respectively acquire the resolution of at least two channels of uplink video data, and the control network According to the corresponding relationship between the resolution and the quality of the reference video source, determine the reference video source quality sQuality _o corresponding to the resolution of the upstream video data on each channel, and then according to the formula Calculate the video quality attenuation factor F of the upstream video data of each channel, obtain at least two F, and then calculate the average value of at least two F

In step 203, the receiving device specifically evaluates the video quality of experience from the sending device to the receiving device through the following methods S1-S3.

S1. The receiving end device determines the video source quality from the sending end device to the receiving end device by combining the downlink video source quality and the video quality attenuation factor in the uplink video impairment parameter.

Wherein, the receiving device multiplies the downlink video source quality by the video quality attenuation factor F, and determines the obtained product as the video source quality from the sending device to the receiving device.

S2. The receiving device combines the transmission delay of the uplink and the transmission delay of the downlink to determine the transmission delay from the originating device to the receiving device, and according to the determined transmission delay from the originating device to the receiving device Determine the quality of viewing experience.

Wherein, the receiving device adds the transmission delay of the uplink and the transmission delay of the downlink, and determines the sum as the transmission delay from the sending device to the receiving device.

S3. The receiving device determines the video experience quality from the sending device to the receiving device according to the determined video source quality, interactive experience quality and viewing experience quality from the sending device to the receiving device.

In practical applications, if the number of terminals participating in communication in the video communication system is small, each terminal only needs to be connected to one control network element to complete media exchange. However, for the terminals participating in the communication with a large amount of data, especially in the application scenario of multiple conference sites, the control network element in the cascade mode is often required. In a possible implementation manner, the architecture of the cascade mode includes an upper-level control network element and a lower-level control network element. The upper-level control network element is connected to the lower-level control network element, and both the upper-level control network element and the lower-level control network element can be connected to the terminal. The lower-level control network element may execute the method performed by the above-mentioned control network element 101 . Taking any terminal connected to a lower-level control network element as a receiving device as an example, the sending device may include two types: a first sending device and a second sending device. Wherein, the first originating device is any terminal that sends video data connected to the lower-level control network element, and the second originating device is any terminal that sends video data connected to the upper-level control network element. Correspondingly, the uplink video data in the method shown in FIG. 2 may include first uplink video data and second uplink video data. The first uplink video data is received by the receiving device and sent by the first sending device, and the second uplink video data is received by the receiving device and sent by the second sending device. The video data sent by the second originating device received by the upper-level control network element may be called upper-level uplink video data, and the video data sent by the upper-level control network element received by the lower-level control network element may be called upper-level uplink video data.

The upper-level control network element also integrates a module with video experience quality evaluation function, which is used to collect the upper-level uplink video impairment parameters. The degree of quality damage.

Specifically, based on the method for evaluating video quality of experience shown in FIG. 2 , as shown in FIG. 3 , in the foregoing cascade mode, the method for evaluating video quality of experience is as follows.

Step 301, the first originating device sends the first uplink video data to the lower-level control network element, and the lower-level control network element receives the first uplink video data sent by the first originating device; and, the second originating device sends the second uplink video data to the lower-level The control network element, the lower-level control network element receives the second uplink video data sent by the second originating device.

Wherein, the second originating device sends the second uplink video data to the lower control network element through the upper control network element. In practical applications, the second originating device sends upper-level uplink video data to the upper-level control network element, and the upper-level control network element performs video transcoding and mixing operations on the upper-level uplink video data sent by the second originating device, and the video transcoding and mixing data ( It can be referred to as upper-lower-level uplink video data) and sent to the lower-level control network element.

Step 302: The lower-level control network element acquires the first uplink video impairment parameter according to the first uplink video data, and the lower-level control network element receives the upper-level uplink video impairment parameter sent by the upper-level control network element.

Wherein, the first uplink video damage parameter is used to characterize the degree of quality damage of the first uplink video data.

Step 303: The lower-level control network element calculates the second uplink video impairment parameter based on the upper-level uplink video impairment parameter and the upper-lower-level uplink video impairment parameter. Wherein, the upper-lower uplink video impairment parameter is used to represent the quality damage degree of the upper-lower uplink video data from the upper-level control network element to the lower-level control network element, and the second uplink video impairment parameter is used to represent the quality damage degree of the second uplink video data.

Step 304, the lower control network element sends the uplink video impairment parameters to the receiving device, and the receiving device receives the uplink video impairment parameters sent by the lower control network element.

Wherein, the uplink video impairment parameter is determined by the first uplink video impairment parameter and the second uplink video impairment parameter. For example, the uplink video impairment parameters include the above-mentioned first uplink frequency impairment parameter and the above-mentioned second uplink video impairment parameter; for another example, the uplink video impairment parameter is determined by the lower-level control network element according to the above-mentioned first uplink frequency impairment parameter and the above-mentioned second uplink video impairment parameter. Calculated damage parameters.

Step 305: The receiving device evaluates the video experience quality from the sending device to the receiving device based on the uplink video impairment parameter and the downlink video impairment parameter.

For a specific evaluation method, reference may be made to the method for evaluating video experience quality shown in FIG. 2 above, and repeated descriptions will not be repeated.

It should be noted that, in a specific implementation, the video communication system may also include at least two upper-level control network elements, and the above method may also be adopted under such a network architecture. Wherein, each level of control network element obtains the video damage parameters between the current control network element and the previous network element, wherein, the previous network element can be the upper control network element of the current control network element, or can be the same as the current control network element. The terminal connected to the network element, the current control network element synthesizes various video impairment parameters, and sends the integrated video impairment parameters to the next-level control network element or the receiving end device, and finally enables the receiving end device to synthesize the uplink and downlink Video impairment parameters to evaluate the video experience quality from the source device to the receive device.

To sum up, in the method for evaluating video quality of experience provided by the embodiment of this application, the control network element obtains the uplink video impairment parameters and sends them to the receiving device, and the receiving device can comprehensively consider the video impairments of the uplink and downlink Parameters to correctly evaluate the video quality of experience from the source device to the receiver device.

An embodiment of the present application also provides a computer storage medium for storing a computer program, where the computer program includes instructions for executing the method for evaluating video quality of experience as shown in FIG. 2 .

The method for evaluating video quality of experience provided by the embodiments of the present application can be applied to various video communication systems where there are control network elements, and the control network elements can be used to perform video transcoding operations in the video communication system.

The method for evaluating video quality of experience provided by the embodiment of the present application will be further described in detail below in combination with specific application scenarios.

Taking the video conferencing system as an example, as shown in FIG. 4 , in the video conferencing system 400, the terminal 407 establishes a signaling channel and a bearer channel with the network side, and the network side schedules the terminal to access the video conference and perform data transmission. Wherein, the link shown by the solid line in Fig. 4 represents the signaling channel, and the signaling channel is responsible for media negotiation control; the link shown by the dotted line represents the bearer channel, and the bearer channel is responsible for the transmission of the media stream. The chairman terminal 401 is used to schedule video conferences and send control signaling during the video conferences; the conference application server (Application Server, AS) 402 belongs to the network element of the service capability layer, and provides IP multimedia subsystem (IP Multimedia Subsystem, IMS) network-based Multimedia conferencing services, complete the scheduling of voice conferences, data conferences, or video conferences, and provide web interface configuration and management services; Multimedia Resource Function Controller (Multimedia Resource Function Controller, MRFC) 403 controls multimedia resources through the H.248 protocol For media resources on the processor (Multimedia Resource Function Processor, MRFP), MRFC403 parses the session initiation protocol (Session Initiation Protocol, SIP) resource control command from AS402, converts it into a control command for MRFP and generates corresponding billing information; The control unit (Multipoint Control Unit, MCU) 404 is in the position of the core switch on the bearer channel of the media stream. During the video processing process, the MCU 404 decodes the video code stream received from the originating device, adjusts the resolution of the video, and Mix multiple videos, re-encode them and send them to corresponding receiving devices; call control network element 405 performs signaling operations for call session control, manages SIP sessions, and cooperates with other network entities to perform session control, service control and resource allocation The access gateway (ie Access Gateway) 406 provides an analog subscriber line interface, directly encapsulates user data and subscriber line signaling in IP packets, and is used to insert ordinary telephone users into softswitches or IMS networks, which can be used for users Provide services such as telephone service and dial-up Internet service.

In the video conferencing system 400, at least two terminals 407 are included, and one terminal 407 is taken as an example in FIG. 4 . According to the transmission direction of the video data, the terminal 407 can be divided into a sending device and a receiving device. The connection forms of the sending device and the receiving device to the network side conform to the network architecture shown in Figure 4, and the working modes between the sending device and the receiving device and the network side conform to the above description. In the following description, the control network element may be the MCU 404 in FIG. 4. Of course, the control network element may also be other forms of network elements that undertake video transcoding and hybrid functions in the video communication system, for example, a Universal Media Gateway (UMG ), which is not limited in the embodiments of this application.

Taking the method for evaluating video quality of experience applied to the video conferencing system 400 as an example, the method for evaluating video quality of experience will be further introduced in detail below.

In the video conferencing system 400, the control network element is an MCU, and the video conferencing system may have different application scenarios according to the number and layout of the conference sites. The following describes several application scenarios as examples.

First introduce several application scenarios.

scene one,

There are few venues participating in the video conference, and the media exchange between each venue can be completed only through one MCU, that is, the media stream between terminals in each venue only needs to be converted through one MCU. Each venue is divided into primary and secondary.

As shown in Figure 5, assuming that each venue is divided into primary and secondary venues, one main venue and multiple sub-venues, the main venue is the originating device, and each sub-venue is the receiving device. The MCU decodes the video received from Terminal 1 in the main venue, and adjusts the resolution according to the requirements of Terminal 2, Terminal 3, and Terminal 4 in each branch venue. For example, the resolution of the video data sent by Terminal 1 is 1080P. The resolutions of the video data sent to Terminal 2, Terminal 3 and Terminal 4 are adjusted to 360P, 480P and 720P respectively, and the video is compressed and sent to each branch venue through the network. In the embodiment of this application, the MCU obtains the uplink video impairment parameters according to the uplink video data sent by terminal 1, and sends the uplink video impairment parameters to the terminals in each sub-site through control messages, which facilitates terminal 2, terminal 3 and terminal 4 According to the uplink video impairment parameters and respective downlink video impairment parameters, the video quality of experience from terminal 1 to itself is calculated. Wherein, the MCU may periodically send the uplink video impairment parameter to the terminals in each sub-venue, or may not use periodicity, which is not limited in this application.

Scenario 2: There are few venues participating in the video conference, and the media exchange between each venue can be completed only through one MCU, that is, the media stream between terminals in each venue only needs to be converted through one MCU.

As shown in Figure 6, there is no distinction among the venues. The terminals (terminal 1, terminal 2, terminal 3, and terminal 4) in each venue send uplink video data to the MCU, and the MCU sends the received uplink video data of each channel to the MCU. The data is first decoded, the video resolution is adjusted, and then the upstream video data of each channel is combined, the combined video is compressed, and sent to each sub-venue through the network. Each terminal is both an originating device and a receiving device. In the embodiment of the present application, the MCU periodically sends the comprehensive uplink video impairment parameters of the uplink video data of each channel to the terminals in each sub-venue through control messages, so that terminal 1, terminal 2, and terminal 3 and terminal 4 calculate the video quality of experience from the originating device to the receiving device according to the comprehensive uplink video impairment parameters and respective downlink video impairment parameters.

Scenario 3: There are many venues participating in the video conference, and one MCU is not enough to complete the media exchange among the venues. MCU cascading is required to schedule conferences. It is assumed that the MCU cascade mode includes an upper-level MCU and a lower-level MCU.

As shown in FIG. 7 , the upper-level MCU is connected to terminal A1 , terminal A2 , terminal A3 and terminal A4 , and the lower-level MCU is connected to terminal B1 , terminal B2 , terminal B3 and terminal B4 .

In the way of cascading MCUs, each MCU integrates a module with a video experience quality evaluation function. The current MCU obtains video impairment parameters between the current MCU and a previous network element, where the previous network element may be a superior MCU of the current MCU, or may be a terminal connected to the current MCU. Currently, the MCU synthesizes various video impairment parameters, and sends the integrated video impairment parameters to the receiving device. Finally, the receiving device comprehensively evaluates the video experience quality from the sending device to the receiving device according to the received video impairment parameters sent by the MCU and the video impairment parameters detected by itself.

It is assumed that terminal B4 is a receiving device, and other terminals are sending devices. Terminal A1, terminal A2, terminal A3, and terminal A4 respectively send the upper-level uplink video data to the upper-level MCU, and the upper-level MCU obtains the upper-level uplink video impairment parameters according to the upper-level uplink video data sent by these terminals, and stores the upper-level uplink video impairment parameters Send it to the lower-level MCU. The upper-level MCU also sends the upper-lower uplink video data to the lower-level MCU, and the lower-level MCU obtains the upper-lower uplink video impairment parameters according to the upper-lower uplink video data. The lower-level MCU also receives the uplink video data (denoted as the first uplink video data) sent by the terminal B1, the terminal B2 and the terminal B3, and acquires the first uplink video impairment parameter of the first uplink video data. The lower-level MCU acquires the second uplink video impairment parameter according to the upper-level uplink video impairment parameter and the upper-lower-level uplink video impairment parameter. The lower-level MCU sends the first uplink video impairment parameter and the second uplink video impairment parameter to terminal B4; or, the lower-level MCU calculates the uplink video impairment parameter according to the first uplink video impairment parameter and the second uplink video impairment parameter, and sends the calculated The uplink video impairment parameters are sent to terminal B4. Terminal B4, as the receiving device, receives the downlink video data sent by the lower-level MCU, and obtains downlink video damage parameters according to the downlink video data; terminal B4 receives the first uplink video damage parameters, the second uplink video damage parameters and the downlink video damage parameters. parameters to evaluate the video quality of experience from the source device to the receiver device; or, the terminal B4 evaluates the video experience quality from the source device to the receiver device according to the received uplink video impairment parameters and downlink video impairment parameters.

The methods for evaluating video experience quality in scenarios 1, 2, and 3 are further introduced in detail below.

For Scenario 1 and Scenario 2, as shown in FIG. 8 , when evaluating video quality of experience, the signaling process and execution method between network elements are as follows.

Step 801, the conference application server initiates a SIP request to the call control network element, invites the terminal corresponding to the called number, the control network element receives the SIP request sent by the conference application server, and the control network element sends the SIP request to the terminal through the access network element .

It should be noted that the terminal may be the originating device or the receiving device, and both the sending device and the receiving device conform to the description of the relevant access conference process.

The SIP request does not carry a Session Description Protocol (Session Description Protocol, SDP), and the purpose is to let the terminal provide an SDP offer first, and then negotiate media capabilities with the conference port according to the SDP offer. Among them, SDP is a protocol used to describe multimedia session announcement, multimedia session invitation and other forms of multimedia session initiation, and usually includes session information and media information.

Step 802 , the terminal replies 200 OK to the conference application server through the access network element and the call control network element, indicating that the SIP request is answered, and carries the SDP offer in the 200 OK message. The conference application server receives the 200 OK sent by the terminal.

In this embodiment of the present application, an indication is added to the original SDP offer whether to support periodic reporting of video quality of experience. Taking the video quality of experience as vMOS as an example, the instructions shown in Table 1 are added to the SDP offer. The parameter name of this indication is vMOS_report_flag, which indicates whether to support periodic video vMOS reporting. Use TRUE to indicate that video vMOS periodic reporting is supported, and use FALSE to indicate that video vMOS periodic reporting is not supported.

Table 1

parameter name Parameter Description example vMOS_report_flag Whether to support periodic reporting of video vMOS TRUE OR FALSE

Step 803: After receiving the 200 OK response, the conference application server initiates a request to the multimedia resource function controller, and carries an SDP offer in the request, and the multimedia resource function controller receives the request sent by the conference application server.

Step 804: After receiving the request, the multimedia resource function controller sends a command to the MCU instructing the MCU to add the terminal, and the MCU receives the command sent by the multimedia resource function controller.

Step 805, after the MCU receives the command, add the terminal, and allocate media resources for the terminal, and return 200OK to the multimedia resource function controller, which is characterized as the successful allocation of media resources for the terminal, and the multimedia resource function controller receives the 200OK returned by the MCU .

Step 806, the multimedia resource function controller returns 200 OK to the conference application server, and carries the SDP response (ie SDP Answer) in the 200 OK, and the conference application server receives the 200 OK returned by the multimedia resource function controller.

Step 807, the conference application server replies an ACK message to the terminal through the call control network element and the access gateway, and carries the SDP Answer in the ACK message, and the terminal receives the ACK message returned by the conference application server.

After the terminal receives the ACK message, a media stream is established between the MCU and the terminal. The MCU adds the terminal to the interaction of the video conference.

If during the media negotiation process, the terminal corresponding to the originating device supports periodic reporting of video quality of experience, the MCU starts to periodically obtain the uplink video impairment parameters from the originating device to the MCU, and sends them to the receiving device.

The specific process is:

Step 808, the originating device sends uplink video data to the MCU, and the MCU receives the uplink video data sent by the originating device.

Step 809, the MCU determines the uplink video source quality sQuality _c and the uplink video quality attenuation factor.

The MCU analyzes the uplink video data, extracts the video resolution and encoding format of the uplink video data, and periodically counts the parameters such as the bit rate and frame rate of the video, and calculates the uplink video source quality sQuality _c based on these parameters. The method for calculating sQuality _c may adopt any method in the prior art.

Wherein, for Scenario 1, the MCU only needs to obtain the video source quality of the uplink from Terminal 1 to the MCU in the main conference venue. For scenario 2, the MCU needs to obtain the video source quality of each uplink from each terminal 1 , 2 , 3 , and 4 to the MCU.

The MCU will maintain the reference video source quality of a video with different resolutions without video coding damage, assuming it is maintained in the form of a table, as shown in Table 2, CIF, 360P, VGA, 4CIF, 720P and 1080P are the video conferencing system commonly used resolutions. Each resolution corresponds to a reference video source quality, and the MCU queries the corresponding reference video source quality sQuality _o according to the resolution of the uplink video data. According to the formula Computes the video quality attenuation factor.

Table 2

resolution sQuality _o CIF 4.06 360P 4.12 VGA 4.24 4CIF 4.31 720P 4.58 1080P 4.78

For scenario 1, the MCU only needs to calculate the video quality attenuation factor of the uplink from terminal 1 to the MCU in the main conference site. For Scenario 2, the MCU needs to calculate the video quality attenuation factors of each uplink from each terminal 1, terminal 2, terminal 3, and terminal 4 to the MCU, and calculate the average value of the video quality attenuation factors of each uplink F.

Step 810, the MCU detects the uplink transmission delay.

The uplink transmission delay may be a round-trip propagation delay of a control message, for example, the control message is a Real-time Transport Control Protocol (Real-time Transport Control Protocol, RTCP) message. For scenario 1, the uplink transmission delay is the transmission time delay RTT of the uplink link from terminal 1 to the MCU in the main site. For the second scenario, the uplink transmission delay is the maximum value MaxRTT among the uplink transmission delays from the terminal 1, the terminal 2, the terminal 3 and the terminal 4 to the MCU.

It should be noted that the order of step 810 and step 809 may be exchanged, or step 810 may be parallel with step 809 .

Step 811 , the MCU sends the uplink video quality attenuation factor and the uplink transmission delay to the receiving device, and the receiving device receives the uplink video quality attenuation factor and the uplink transmission delay sent by the MCU.

For example, the MCU carries the above parameters in the extended information of the RTCP message sent to the receiving device. The details are shown in Table 3.

table 3

Step 812, the receiving device evaluates the video quality of experience from the sending device to the receiving device.

Specifically, the receiving device calculates the video source quality sQuality of the downlink according to parameters such as video resolution, encoding format, bit rate, frame rate, and screen size of the downlink video data;

The receiving device combines the uplink video quality attenuation factor and the downlink video source quality sQuality to calculate the video source quality sQuality′ from the sending device to the receiving device.

For scenario one, sQuality'=sQuality*F; for scenario two,

The receiving device calculates the interaction quality of experience sInteraction.

The receiving device combines the downlink transmission delay RTTd with the uplink transmission delay to calculate the transmission delay RTTa from the originating device to the receiving device.

For scenario one, RTT _a =RTT _d +RTT; for scenario two, RTT _a =RTT _d +MaxRTT.

The receiving device calculates the viewing experience quality sView according to the RTTa.

The receiving device calculates the video quality of experience from the sending device to the receiving device according to the above-mentioned calculated video quality sQuality', interactive experience quality sInteraction and viewing experience quality sView, for example, calculates vMOS.

For the third scenario, as shown in FIG. 9 , when evaluating the video quality of experience, the signaling process and execution method between network elements are as follows.

In FIG. 9 , the terminal includes an originating device and a receiving device as an example. Both the originating device and the receiving device use the method shown in FIG. 9 to access a video conference. Steps 901 to 907 are similar to steps 801 to 807, and other overlapping points will not be repeated here.

After the media negotiation in steps 901 to 907, the terminal establishes media streams with MCU1 and MCU2. If during the media negotiation process in steps 901 to 907, the terminal corresponding to the originating device supports the reporting of video quality of experience, the upper-level MCU obtains information from the originating device (including terminal A1, terminal A2, terminal A3, and terminal A4) to the upper-level MCU. The upper-level uplink video impairment parameters are sent to the lower-level MCU, and the lower-level MCU obtains the first uplink video impairment parameters from the originating device (including terminal B1, terminal B2, and terminal B3) to the lower-level MCU, and obtains the upper-lower uplink from the upper-level MCU to the lower-level MCU. Video impairment parameters, calculate the second uplink video impairment parameters according to the upstream and downstream uplink video impairment parameters and the received upper-level uplink video impairment parameters, and send the first uplink video impairment parameters and the second uplink video impairment parameters to the receiving end device (ie terminal B4); or, calculate the uplink video impairment parameter according to the first uplink video impairment parameter and the second uplink video impairment parameter, and send the calculated uplink video impairment parameter to the receiving device (ie terminal B4).

The specific process is:

Step 908, MCU1 calculates the average video quality attenuation factor of the upstream uplink of each originating device (including terminal A1, terminal A2, terminal A3, and terminal A4) to MCU1, which is recorded as And, the MCU1 detects the maximum value among the transmission delays of the upper-level uplinks on each path, which is denoted as MaxRTT ₁ .

Among them, calculate The method of MaxRTT ₁ is as described in step 808 to step 811, and will not be repeated here.

Step 909, MCU1 will and MaxRTT ₁ sent to MCU2, MCU2 receives MCU1 sent and MaxRTT ₁ .

Specifically, MCU1 may carry the above parameters in the extended information of the RTCP message, an example is shown in Table 4.

Table 4

Step 910, MCU2 calculates the average video quality attenuation factor between each originating device (including terminal A1, terminal A2, terminal A3, terminal A4, terminal B1, terminal B2 and terminal B3) and MCU2.

Specifically, MCU2 calculates the video quality attenuation factors of each uplink from each originating device (including terminal B1, terminal B2, and terminal B3) to MCU2, which are respectively denoted as F _B1 , F _B2 , and F _B3 , and calculates MCU1 to The video quality attenuation factor of the upstream and downstream uplinks of MCU2 is denoted as F _MCU1 .

Wherein, the step of MCU2 calculating the video quality attenuation factor of each uplink from each originating device (including terminal B1, terminal B2 and terminal B3) to MCU2 can be interchanged with or parallel to the sequence of steps 908 to 909.

MCU2 calculates the video quality attenuation factor between each originating device (including terminal A1, terminal A2, terminal A3 and terminal A4) and MCU2, denoted as F′ _MCU1 . in,

The average video quality attenuation factor between each originating device and MCU2 is recorded as but

Step 911, MCU2 calculates the maximum value of the transmission delay from each originating device (including terminal A1, terminal A2, terminal A3, terminal A4, terminal B1, terminal B2 and terminal B3) to MCU2.

Specifically, MCU2 respectively calculates the transmission delays from MCU1, terminal B1, terminal B2, and terminal B3 to MCU2, which are denoted as RTT _MCU1 , RTT _B1 , RTT _B2 , and RTT _B3 . It should be noted that the steps of MCU2 calculating the transmission delays from MCU1 , terminal B1 , terminal B2 and terminal B3 to MCU2 and the order of steps 908 to 910 can be exchanged or parallelized.

The MCU2 respectively calculates the transmission delays from the terminal A1, the terminal A2, the terminal A3, and the terminal A4 to the MCU2, which is denoted as RTT′ _MCU1 . Among them, RTT′ _MCU1 = RTT _MCU1 + MaxRTT ₁

The maximum value of the transmission delay from each originating device to MCU2 is recorded as MaxRTT ₂ , then MaxRTT ₂ =MAX(RTT′ _MCU1 , RTT _B1 , RTT _B2 , RTT _B3 ), where MAX is calculated by taking the maximum value.

Wherein, there is no order of steps 911 and 910.

Step 912, MCU2 sends to the receiving device (i.e. terminal B4) and MaxRTT ₂ , the receiving device receives the MCU2 sent and MaxRTT ₂ .

Specifically, MCU2 may carry the above parameters in the extended information of the RTCP packet, an example is shown in Table 5.

table 5

Step 913, the receiving device receives the message sent by MCU2 and MaxRTT ₂ , evaluate the video quality of experience from the source device to the receiver device.

It should be noted that scenario 1, scenario 2, and scenario 3 are just examples for the convenience of illustrating the method of the embodiment of the present application. The method of the embodiment of the present application can be applied to various similar application scenarios, for example, there are at least two The MCU cascading scenario of the upper-level MCU.

Based on the same inventive concept as the method for evaluating video quality of experience shown in FIG. 2, as shown in FIG. Execute the method for evaluating video quality of experience shown in FIG. 2 . Wherein, the device 1000 for evaluating video quality of experience includes:

The receiving unit 1001 is configured to receive an uplink video impairment parameter sent by the control network element, where the uplink video impairment parameter is used to represent the degree of quality impairment of the uplink video data sent by the originating device to the control network element;

The processing unit 1002 is configured to evaluate the quality of video experience from the originating device to the device based on the uplink video impairment parameter and the downlink video impairment parameter received by the receiving unit 1001, wherein the downlink video impairment parameter is used to characterize the video quality sent by the control network element to the device The quality damage degree of downlink video data.

Optionally, the uplink video impairment parameters include video quality attenuation factor and uplink transmission delay, and the uplink is the transmission link between the originating device and the control network element; the downlink video impairment parameters include downlink video source quality , interactive experience quality and downlink transmission delay, the downlink is the transmission link between the control network element and the device;

The processing unit 1002 is specifically used for:

Combining the downlink video source quality and video quality attenuation factor to determine the video source quality from the originating device to the device;

Combining the transmission delay of the uplink and the transmission delay of the downlink, determine the transmission delay from the originating device to the device, and determine the quality of viewing experience according to the determined transmission delay from the originating device to the device;

Based on the determined video source quality, interactive experience quality, and viewing experience quality from the originating device to the device, the video quality of experience from the originating device to the device is determined.

The processing unit 1002 is configured to determine the video source quality from the originating device to the device, specifically including:

The downlink video source quality is multiplied by the video quality attenuation factor, and the resulting product is determined as the video source quality from the originating device to the device.

Optionally, the processing unit 1002 is configured to determine a transmission delay from the originating device to the apparatus, specifically including:

The transmission delay of the uplink and the transmission delay of the downlink are added, and the sum obtained is determined as the transmission delay from the originating device to the device.

Optionally, the originating device includes a first originating device and a second originating device, the uplink video data includes first uplink video data and second uplink video data, the control network element is a lower-level control network element in cascade mode, and the lower-level control network The element is connected with the superior control network element;

The receiving unit 1001 is specifically used for:

Receive the uplink video impairment parameter sent by the lower-level control network element. The uplink video impairment parameter is determined by the first uplink video impairment parameter and the second uplink video impairment parameter. The first uplink video impairment parameter is used to represent the The quality damage degree of the first uplink video data of the network element, and the second uplink video damage parameter are used to characterize the quality damage degree of the second uplink video data sent by the second originating device to the lower-level control network element via the upper-level control network element.

Based on the same inventive concept as the method for evaluating video quality of experience shown in FIG. 2, as shown in FIG. The method for evaluating video quality of experience shown in FIG. 2, wherein the apparatus 1100 for evaluating video quality of experience includes:

a receiving unit 1101, configured to receive uplink video data sent by the originating device;

A processing unit 1102, configured to acquire an uplink video damage parameter, where the uplink video damage parameter is used to characterize the degree of quality damage of uplink video data;

The sending unit 1103 is configured to send the uplink video impairment parameters obtained by the processing unit 1102 to the receiving device, so that the receiving device evaluates the video experience quality from the sending device to the receiving device.

Optionally, the uplink video impairment parameter includes a video quality attenuation factor and an uplink transmission delay, and the uplink is a transmission link between the originating device and the device;

The processing unit 1102 is specifically used for:

Obtain the video source quality sQuality _c of the uplink and the resolution of the uplink video data;

According to the correspondence between the resolution and the quality of the reference video source, determine the reference video source quality sQuality _o corresponding to the resolution of the uplink video data. The reference video source quality represents the video source data of the originating device without video coding damage. quality;

Calculate the video quality attenuation factor F according to the following formula:

Acquire the uplink transmission delay according to the uplink video data.

Optionally, if the number of the originating device is one, the uplink video impairment parameter includes a video quality attenuation factor of the originating device and an uplink transmission delay between the originating device and the device; and

The processing unit 1102 is specifically used for:

According to the uplink video data sent by a source device, acquire a video source quality sQuality _c of the uplink between the source device and the device, and acquire the resolution of the uplink video data;

According to the correspondence between the resolution and the quality of the reference video source, determine the reference video source quality sQuality _o corresponding to the resolution of the uplink video data. The reference video source quality represents the video source data of the originating device without video coding damage. quality;

Calculate the video quality attenuation factor F according to the following formula:

Acquiring an uplink transmission delay between the originating device and the device according to the uplink video data;

Optionally, if the number of originating devices is at least two, the uplink video impairment parameters include: the average value of video quality attenuation factors of at least two channels of uplink video data sent by at least two originating devices, and at least two originating devices and devices The maximum value of the transmission delay between at least two uplinks;

The processing unit 1102 is specifically used for:

According to at least two channels of uplink video data sent by at least two originating devices, respectively acquire the video source quality sQuality _c of at least two uplinks between the at least two originating devices and the device, and respectively acquire at least two channels of uplink video data resolution;

According to the corresponding relationship between the resolution and the quality of the reference video source, determine the quality sQuality _o of the reference video source corresponding to the resolution of the upstream video data on each channel;

Calculate the video quality attenuation factor F of the uplink video data of each channel according to the following formula: Get at least two F's, calculate the average of at least two F's

According to the uplink video data, the transmission time delays of the at least two uplinks are obtained respectively, and the maximum value of the transmission time delays of the at least two uplinks is determined.

Optionally, the originating device includes a first originating device and a second originating device, and the uplink video data includes first uplink video data and second uplink video data, and the device is a lower-level control network element in cascade mode, and the lower-level control network element and The upper control network element is connected;

The receiving unit 1101 is specifically configured to: receive the first uplink video data sent by the first originating device;

The sending unit 1103 is specifically configured to: receive the second uplink video data sent by the second originating device through an upper-level control network element;

The processing unit 1102 is specifically configured to: acquire a first uplink video damage parameter according to the first uplink video data, where the first uplink video damage parameter is used to characterize the quality damage degree of the first uplink video data;

The receiving unit 1101 is specifically configured to: receive the upper-level uplink video impairment parameter sent by the upper-level control network element, and the upper-level uplink video impairment parameter is used to represent the quality damage degree of the upper-level uplink video data from the second originating device to the upper-level control network element;

The processing unit 1102 is specifically configured to: calculate a second uplink video impairment parameter based on the upper-level uplink video impairment parameter and the upper-lower-level uplink video impairment parameter. The quality damage degree of the uplink video data, the second uplink video damage parameter is used to characterize the quality damage degree of the second uplink video data; and, the uplink video damage parameter is determined according to the first uplink video damage parameter and the second uplink video damage parameter.

Based on the same inventive concept as the method for evaluating video quality of experience shown in FIG. 2, as shown in FIG. Execute the method shown in FIG. 3 . Wherein, the apparatus 1200 for evaluating video quality of experience includes a transceiver 1201, a processor 1202, a memory 1203 and a bus 1204, the processor 1202 and the memory 1203 are connected through the bus 1204, and the processor 1202 is used to execute the code in the memory 1203, when When the code is executed, the execution causes the processor 1202 to execute the method for evaluating video quality of experience shown in FIG. 2 .

The processor 1202 may be a central processing unit (English: central processing unit, abbreviated: CPU), a network processor (English: network processor, abbreviated: NP) or a combination of CPU and NP.

The processor 1202 may further include a hardware chip. The aforementioned hardware chip may be an application-specific integrated circuit (English: application-specific integrated circuit, abbreviation: ASIC), a programmable logic device (English: programmable logic device, abbreviation: PLD) or a combination thereof. The above-mentioned PLD can be a complex programmable logic device (English: complex programmable logic device, abbreviation: CPLD), field-programmable logic gate array (English: field-programmable gate array, abbreviation: FPGA), general array logic (English: generic array logic , Abbreviation: GAL) or any combination thereof.

The memory 1203 may include a volatile memory (English: volatile memory), such as a random access memory (English: random-access memory, abbreviated: RAM); the memory 1203 may also include a non-volatile memory (English: non-volatile memory ), such as flash memory (English: flash memory), hard disk (English: hard diskdrive, abbreviated: HDD) or solid-state hard disk (English: solid-state drive, abbreviated: SSD); the memory 1203 can also include the memory of the above-mentioned types combination.

Based on the same inventive concept as the method for evaluating video quality of experience shown in FIG. 2, as shown in FIG. Execute the method shown in FIG. 3 . Wherein, the apparatus 1300 for evaluating video quality of experience includes a transceiver 1301, a processor 1302, a memory 1303 and a bus 1304, the processor 1302 and the memory 1303 are connected through the bus 1304, and the processor 1302 is used to execute the code in the memory 1303, when When the code is executed, the execution causes the processor 1302 to execute the method for evaluating video quality of experience shown in FIG. 2 .

The processor 1302 may be a central processing unit (English: central processing unit, abbreviated: CPU), a network processor (English: network processor, abbreviated: NP) or a combination of CPU and NP.

The processor 1302 may further include a hardware chip. The aforementioned hardware chip may be an application-specific integrated circuit (English: application-specific integrated circuit, abbreviation: ASIC), a programmable logic device (English: programmable logic device, abbreviation: PLD) or a combination thereof. The above-mentioned PLD can be a complex programmable logic device (English: complex programmable logic device, abbreviation: CPLD), field-programmable logic gate array (English: field-programmable gate array, abbreviation: FPGA), general array logic (English: generic array logic , Abbreviation: GAL) or any combination thereof.

The memory 1303 may include a volatile memory (English: volatile memory), such as a random access memory (English: random-access memory, abbreviated as RAM); the memory 1303 may also include a non-volatile memory (English: non-volatile memory ), such as flash memory (English: flash memory), hard disk (English: hard diskdrive, abbreviated: HDD) or solid-state hard disk (English: solid-state drive, abbreviated: SSD); the memory 1303 can also include the memory of the above-mentioned types combination.

It should be noted that the devices provided in FIGS. 10-11 can be used to implement the method for evaluating video quality of experience shown in FIG. 2 . In a specific implementation manner, the processing unit 1002 in FIG. 10 may be implemented by the processor 1202 in FIG. 12 , and the receiving unit 1001 may be implemented by the transceiver 1201 in FIG. 12 . The processing unit 1102 in FIG. 11 may be implemented by the processor 1302 in FIG. 13 , and both the receiving unit 1101 and the sending unit 1103 may be implemented by the transceiver 1301 in FIG. 13 .

In the system 100 for evaluating video quality of experience provided in FIG. 1 in the embodiment of the present application, the receiving device 103 may be the device provided in the embodiments corresponding to FIG. 10 and FIG. 12 . The control network element 101 may be the device provided in the embodiments corresponding to FIG. 11 and FIG. 13 . The system for evaluating video quality of experience is used to execute the method in the embodiment corresponding to FIG. 2 .

Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present application is described with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams.

While preferred embodiments of the present application have been described, additional changes and modifications to these embodiments can be made by those skilled in the art once the basic inventive concept is appreciated. Therefore, the appended claims are intended to be construed to cover the preferred embodiment and all changes and modifications which fall within the scope of the application.

Apparently, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. In this way, if the modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and equivalent technologies, the present application also intends to include these modifications and variations.

Claims (20)

1. A method for assessing video quality of experience, comprising:

receiving an uplink video damage parameter sent by a control network element by a receiving end device, wherein the uplink video damage parameter is used for representing the quality damage degree of uplink video data sent to the control network element by a sending end device;

and the receiving end equipment evaluates the video experience quality from the transmitting end equipment to the receiving end equipment based on the uplink video damage parameter and the downlink video damage parameter, wherein the downlink video damage parameter is used for representing the quality damage degree of downlink video data sent to the receiving end equipment by the control network element.

2. The method of claim 1, wherein the uplink video impairment parameters comprise a video quality degradation factor and an uplink transmission delay, the uplink being a transmission link between the originating device and the controlling network element; the downlink video impairment parameter comprises video source quality, interactive experience quality and transmission delay of a downlink, and the downlink is a transmission link between the control network element and the receiving end equipment;

the receiving end device evaluates the quality of experience of the video from the sending end device to the receiving end device based on the uplink video damage parameter and the downlink video damage parameter, and comprises the following steps:

the receiving end device determines the video source quality from the transmitting end device to the receiving end device by combining the video source quality of the downlink with the video quality attenuation factor;

the receiving end device determines the transmission delay from the transmitting end device to the receiving end device by combining the transmission delay of the uplink and the transmission delay of the downlink, and determines the viewing experience quality according to the determined transmission delay from the transmitting end device to the receiving end device;

and the receiving end equipment determines the video experience quality from the transmitting end equipment to the receiving end equipment according to the determined video source quality from the transmitting end equipment to the receiving end equipment, the interaction experience quality and the watching experience quality.

3. The method of claim 2, wherein the video quality degradation factor conforms to the following equation:

wherein F is the video quality attenuation factor, the sQuality_cIs said upstreamVideo source quality of a link, said sQuality_oThe reference video source quality of the video source data of the originating device is obtained when the video source data is not damaged by video coding;

the receiving device determining the video source quality from the originating device to the receiving device in combination with the video source quality of the downlink and the video quality degradation factor, comprising:

the sink device multiplies the video source quality of the downlink by the video quality attenuation factor, and determines the resulting product as the video source quality from the originating device to the sink device.

4. The method of claim 2 or 3, wherein the determining, by the sink device, the transmission delay from the originating device to the sink device in conjunction with the transmission delay of the uplink and the transmission delay of the downlink comprises:

and the receiving end equipment adds the transmission delay of the uplink and the transmission delay of the downlink, and determines the sum as the transmission delay from the transmitting end equipment to the receiving end equipment.

5. The method according to any of claims 1 to 4, wherein the originating device comprises a first originating device and a second originating device, the upstream video data comprises a first upstream video data and a second upstream video data, the control network element is a subordinate control network element in a cascaded mode, and the subordinate control network element is connected to a superior control network element;

the receiving end equipment receives the uplink video damage parameters sent by the control network element, and the method comprises the following steps:

the receiving end equipment receives an uplink video damage parameter sent by the lower control network element, wherein the uplink video damage parameter is determined by a first uplink video damage parameter and a second uplink video damage parameter; the first uplink video impairment parameter is used to represent a quality impairment degree of first uplink video data sent by the first sending end device to the subordinate control network element, and the second uplink video impairment parameter is used to represent a quality impairment degree of second uplink video data sent by the second sending end device to the subordinate control network element via the superior control network element.

6. A method for assessing video quality of experience, comprising:

the method comprises the steps that a control network element receives uplink video data sent by a receiving and sending end device and obtains uplink video damage parameters, wherein the uplink video damage parameters are used for representing the quality damage degree of the uplink video data;

and the control network element sends the uplink video damage parameter to a receiving end device, so that the receiving end device evaluates the video experience quality from the transmitting end device to the receiving end device.

7. The method of claim 6, wherein the uplink video impairment parameters comprise a video quality degradation factor and an uplink transmission delay, the uplink being a transmission link between the originating device and the controlling network element;

the method for acquiring the uplink video damage parameter by the control network element includes:

the control network element obtains the video source quality sQuality of the uplink_cAnd a resolution of the upstream video data;

the control network element determines reference video source quality sQuality corresponding to the resolution of the uplink video data according to the corresponding relation between the resolution and the reference video source quality_oThe reference video source quality characterizes a quality of video source data of the originating device without video coding impairments;

the control network element calculates a video quality attenuation factor F according to the following formula:

and the control network element acquires the uplink transmission delay according to the uplink video data.

8. The method of claim 6 or 7, wherein the method further comprises:

if the number of the transmitting end equipment is one, the uplink video damage parameter comprises a video quality attenuation factor of the transmitting end equipment and the transmission delay of an uplink between the transmitting end equipment and the control network element; and the control network element obtaining the uplink video damage parameter includes:

the control network element obtains the video source quality sQuality of an uplink between the originating device and the control network element according to the uplink video data sent by the originating device_cAnd obtaining the resolution of the uplink video data;

the control network element determines reference video source quality sQuality corresponding to the resolution of the uplink video data according to the corresponding relation between the resolution and the reference video source quality_oThe reference video source quality characterizes a quality of video source data of the originating device without video coding impairments;

the control network element calculates a video quality attenuation factor F according to the following formula:

and the control network element acquires the uplink transmission delay between the transmitting terminal equipment and the control network element according to the uplink video data.

9. The method of claim 6 or 7, wherein the method further comprises:

if the number of the originating devices is at least two, the uplink video impairment parameters include: the average value of the video quality attenuation factors of the at least two paths of uplink video data sent by the at least two sending end devices and the maximum value of the transmission time delay of the at least two paths of uplink between the at least two sending end devices and the control network element;

the method for acquiring the uplink video damage parameter by the control network element includes:

the control network element respectively acquires the video source quality sQuality of at least two paths of uplink between the at least two originating devices and the control network element according to the at least two paths of uplink video data sent by the at least two originating devices_cAnd respectively acquiring the resolution of the at least two paths of uplink video data;

the control network element determines reference video source quality sQuality corresponding to the resolution of each path of uplink video data according to the corresponding relation between the resolution and the reference video source quality_o；

The control network element calculates the video quality attenuation factor F of each path of uplink video data according to the following formula:obtaining at least two Fs, calculating the average value of the at least two Fs

And the control network element respectively acquires the transmission time delays of the at least two paths of uplink links according to the uplink video data and determines the maximum value of the transmission time delays of the at least two paths of uplink links.

10. The method according to any of claims 6-9, wherein said originating device comprises a first originating device and a second originating device, said upstream video data comprises a first upstream video data and a second upstream video data, said control network element is a subordinate control network element in a cascaded mode, said subordinate control network element is connected to a superior control network element;

the control network element receives uplink video data sent by the transceiver device, and the control network element includes:

the lower control network element receives the first uplink video data sent by the first sender equipment; and

the lower control network element receives the second uplink video data sent by the second sending end device through the upper control network element;

correspondingly, the acquiring, by the control network element, the uplink video damage parameter includes:

the lower control network element acquires a first uplink video damage parameter according to first uplink video data, wherein the first uplink video damage parameter is used for representing the quality damage degree of the first uplink video data; and

the lower control network element receives an upper uplink video damage parameter sent by the upper control network element, wherein the upper uplink video damage parameter is used for representing the quality damage degree of upper uplink video data from the second transmitting terminal equipment to the upper control network element; the lower control network element calculates the second uplink video damage parameter based on the upper uplink video damage parameter and the upper and lower uplink video damage parameters, wherein the upper and lower uplink video damage parameters are used for representing the quality damage degree of the upper and lower uplink video data from the upper control network element to the lower control network element, and the second uplink video damage parameter is used for representing the quality damage degree of the second uplink video data;

and the lower control network element determines the uplink video damage parameter according to the first uplink video damage parameter and the second uplink video damage parameter.

11. An apparatus for assessing quality of experience of a video, comprising:

the receiving unit is used for receiving an uplink video damage parameter sent by a control network element, wherein the uplink video damage parameter is used for representing the quality damage degree of uplink video data sent to the control network element by a sending-end device;

a processing unit, configured to evaluate quality of experience of the video from the originating device to the apparatus based on the uplink video impairment parameter and the downlink video impairment parameter received by the receiving unit, where the downlink video impairment parameter is used to represent a quality impairment degree of downlink video data sent to the apparatus by the control network element.

12. The apparatus of claim 11, wherein the uplink video impairment parameters comprise a video quality degradation factor and an uplink transmission delay, the uplink being a transmission link between the originating device and the controlling network element; the downlink video impairment parameter comprises video source quality, interactive experience quality and transmission delay of a downlink, and the downlink is a transmission link between the control network element and the device;

the processing unit is specifically configured to:

determining a video source quality from the originating device to the apparatus in combination with the video source quality of the downlink and the video quality degradation factor;

determining a transmission delay from the originating device to the apparatus in conjunction with the transmission delay of the uplink and the transmission delay of the downlink, and determining a quality of viewing experience based on the determined transmission delay from the originating device to the apparatus;

determining a quality of video experience from the originating device to the apparatus based on the determined quality of video source from the originating device to the apparatus, the quality of interactive experience, and the quality of viewing experience.

13. The apparatus of claim 12, wherein the video quality degradation factor conforms to the following equation:

wherein F is the video quality attenuation factor, the sQuality_cFor the video source quality of the uplink, the sQuality_oThe reference video source quality of the video source data of the originating device is obtained when the video source data is not damaged by video coding;

the processing unit is configured to determine a quality of a video source from the originating device to the apparatus, and specifically includes:

multiplying the video source quality of the downlink by the video quality attenuation factor, determining the resulting product as the video source quality from the originating device to the apparatus.

14. The apparatus according to claim 12 or 13, wherein the processing unit is configured to determine a transmission delay from the originating device to the apparatus, and specifically includes:

adding the transmission delay of the uplink to the transmission delay of the downlink, and determining the sum as the transmission delay from the originating device to the apparatus.

15. The apparatus according to any of claims 11 to 14, wherein the originating device comprises a first originating device and a second originating device, the upstream video data comprises a first upstream video data and a second upstream video data, the control network element is a lower level control network element in a cascaded mode, and the lower level control network element is connected to an upper level control network element;

the receiving unit is specifically configured to:

receiving an uplink video damage parameter sent by the subordinate control network element, where the uplink video damage parameter is determined by a first uplink video damage parameter and a second uplink video damage parameter, the first uplink video damage parameter is used to represent a quality damage degree of first uplink video data sent by the first sending end device to the subordinate control network element, and the second uplink video damage parameter is used to represent a quality damage degree of second uplink video data sent by the second sending end device to the subordinate control network element via the superior control network element.

16. An apparatus for assessing quality of experience of a video, comprising:

the receiving unit is used for receiving the uplink video data sent by the sending end equipment;

the processing unit is used for acquiring uplink video damage parameters, and the uplink video damage parameters are used for representing the quality damage degree of the uplink video data;

and the sending unit is used for sending the uplink video damage parameters acquired by the processing unit to a receiving end device, and the receiving end device is used for evaluating the video experience quality from the transmitting end device to the receiving end device.

17. The apparatus of claim 16, wherein the uplink video impairment parameters comprise a video quality degradation factor and an uplink transmission delay, the uplink being a transmission link between the originating device to the apparatus;

the processing unit is specifically configured to:

obtaining video source quality sQuality of uplink_cAnd a resolution of the upstream video data;

determining reference video source quality sQuality corresponding to the resolution of the uplink video data according to the corresponding relation between the resolution and the reference video source quality_oThe reference video source quality characterizes a quality of video source data of the originating device without video coding impairments;

the video quality attenuation factor F is calculated according to the following formula:

and acquiring uplink transmission delay according to the uplink video data.

18. The apparatus of claim 16 or 17,

if the number of the transmitting end equipment is one, the uplink video damage parameter comprises a video quality attenuation factor of the transmitting end equipment and the transmission time delay of an uplink between the transmitting end equipment and the device; and is

The processing unit is specifically configured to:

according to the one originating deviceThe transmitted uplink video data is used for acquiring the video source quality sQuality of an uplink between the transmitting end equipment and the device_cAnd obtaining the resolution of the uplink video data;

determining reference video source quality sQuality corresponding to the resolution of the uplink video data according to the corresponding relation between the resolution and the reference video source quality_oThe reference video source quality characterizes a quality of video source data of the originating device without video coding impairments;

the video quality attenuation factor F is calculated according to the following formula:

and acquiring the uplink transmission delay between the transmitting terminal equipment and the device according to the uplink video data.

19. The apparatus of claim 16 or 17,

if the number of the originating devices is at least two, the uplink video impairment parameters include: the average value of the video quality attenuation factors of the at least two paths of uplink video data sent by the at least two sending end devices and the maximum value of the transmission time delay of the at least two paths of uplink between the at least two sending end devices and the device;

the processing unit is specifically configured to:

respectively acquiring video source quality sQuality of at least two paths of uplink between the at least two originating devices and the device according to at least two paths of uplink video data sent by the at least two originating devices_cAnd respectively acquiring the resolution of the at least two paths of uplink video data;

according to the corresponding relation between the resolution and the reference video source quality, determining the reference video source quality sQuality corresponding to the resolution of each path of uplink video data respectively_o；

Calculating the video quality attenuation of each path of uplink video data according to the following formulaReducing the factor F:obtaining at least two Fs, calculating the average value of the at least two Fs

And respectively acquiring the transmission time delays of at least two paths of uplink links according to the uplink video data, and determining the maximum value of the transmission time delays of the at least two paths of uplink links.

20. The apparatus of any of claims 16-19, wherein the originating device comprises a first originating device and a second originating device, the upstream video data comprises a first upstream video data and a second upstream video data, the apparatus is a subordinate control network element in a cascaded mode, the subordinate control network element is connected to a superior control network element;

the receiving unit is specifically configured to: receiving the first uplink video data sent by the first sending end equipment; receiving a superior uplink video damage parameter sent by the superior control network element, wherein the superior uplink video damage parameter is used for representing the quality damage degree from the second sending end device to superior uplink video data of the superior control network element;

the sending unit is specifically configured to: receiving, by the superior control network element, the second uplink video data sent by the second originating device;

the processing unit is specifically configured to: acquiring a first uplink video damage parameter according to first uplink video data, wherein the first uplink video damage parameter is used for representing the quality damage degree of the first uplink video data; calculating a second uplink video damage parameter based on the upper uplink video damage parameter and the upper and lower uplink video damage parameters, wherein the upper and lower uplink video damage parameters are used for representing the quality damage degree of the upper and lower uplink video data from the upper control network element to the lower control network element, and the second uplink video damage parameter is used for representing the quality damage degree of the second uplink video data; and determining the uplink video damage parameter according to the first uplink video damage parameter and the second uplink video damage parameter.