[go: up one dir, main page]

CN116436870A - Bandwidth adaptive method, device and storage medium - Google Patents

Bandwidth adaptive method, device and storage medium Download PDF

Info

Publication number
CN116436870A
CN116436870A CN202210007381.0A CN202210007381A CN116436870A CN 116436870 A CN116436870 A CN 116436870A CN 202210007381 A CN202210007381 A CN 202210007381A CN 116436870 A CN116436870 A CN 116436870A
Authority
CN
China
Prior art keywords
communication
terminal
bandwidth
conference
estimated
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210007381.0A
Other languages
Chinese (zh)
Inventor
阎江
任志强
陈宇恒
杨书茂
李大伟
涂泾伦
冯杨森
金鑫
王颂阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile IoT Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile IoT Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile IoT Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN202210007381.0A priority Critical patent/CN116436870A/en
Publication of CN116436870A publication Critical patent/CN116436870A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/70Admission control; Resource allocation
    • H04L47/80Actions related to the user profile or the type of traffic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/70Admission control; Resource allocation
    • H04L47/80Actions related to the user profile or the type of traffic
    • H04L47/801Real time traffic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1083In-session procedures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请公开了一种带宽自适应方法、装置和存储介质,带宽自适应方法包括:获取服务端与终端的通信场景;根据通信场景确定预估带宽值,采用预估带宽值与终端进行通信;在检测到通信质量不满足预设通信条件时,调整终端的配置参数。本申请通过结合通信场景预估带宽,然后基于预估带宽值进行通信,再动态调整终端的配置参数,以满足通信质量要求,如此,提高了视频传输质量。

Figure 202210007381

The present application discloses a bandwidth adaptive method, device, and storage medium. The bandwidth adaptive method includes: obtaining a communication scene between a server and a terminal; determining an estimated bandwidth value according to the communication scene, and using the estimated bandwidth value to communicate with the terminal; When it is detected that the communication quality does not meet the preset communication conditions, the configuration parameters of the terminal are adjusted. In this application, the bandwidth is estimated in combination with the communication scene, and then the communication is performed based on the estimated bandwidth value, and then the configuration parameters of the terminal are dynamically adjusted to meet the communication quality requirements. In this way, the video transmission quality is improved.

Figure 202210007381

Description

带宽自适应方法、装置和存储介质Bandwidth adaptive method, device and storage medium

技术领域technical field

本申请涉及音视频传输技术领域,尤其涉及一种带宽自适应方法、装置和存储介质。The present application relates to the technical field of audio and video transmission, and in particular to a bandwidth adaptive method, device and storage medium.

背景技术Background technique

随着移动网络快速发展及智能化硬件终端的普及,促使对业务场景下提供高质量的视频/音频等多媒体服务支撑需求越来越大。With the rapid development of mobile networks and the popularization of intelligent hardware terminals, there is an increasing demand for high-quality video/audio and other multimedia service support in business scenarios.

目前,网络带宽虽然呈现逐步增加的趋势,但由于视频数据流在传输时所需带宽通常大于网络所能提供的容量,尤其是高清视讯,因而通常会出现网络拥塞现象,从而使视频数据在传输过程中大量的丢失,导致接收到的视频图像质量下降。基于此,存在视频传输质量较差的问题。At present, although the network bandwidth is showing a gradual increase trend, because the bandwidth required for video data stream transmission is usually greater than the capacity that the network can provide, especially for high-definition video, network congestion usually occurs, so that video data is transmitted A large number of losses in the process lead to a decrease in the quality of the received video image. Based on this, there is a problem of poor video transmission quality.

发明内容Contents of the invention

本申请实施例通过提供一种带宽自适应方法、装置和存储介质,旨在解决视频传输质量较差的问题。The embodiments of the present application aim to solve the problem of poor video transmission quality by providing a bandwidth adaptive method, device and storage medium.

为实现上述目的,本申请一方面提供一种带宽自适应方法,所述方法应用于服务端,所述方法包括:In order to achieve the above purpose, the present application provides a bandwidth adaptive method on the one hand, the method is applied to the server, and the method includes:

获取服务端与终端的通信场景;Obtain the communication scene between the server and the terminal;

根据所述通信场景确定预估带宽值,采用所述预估带宽值与所述终端进行通信;determining an estimated bandwidth value according to the communication scenario, and using the estimated bandwidth value to communicate with the terminal;

在检测到通信质量不满足预设通信条件时,调整所述终端的配置参数。When it is detected that the communication quality does not satisfy the preset communication condition, the configuration parameters of the terminal are adjusted.

可选地,所述在检测到通信质量不满足预设通信条件时,调整所述终端的配置参数的步骤包括:Optionally, when it is detected that the communication quality does not meet the preset communication conditions, the step of adjusting the configuration parameters of the terminal includes:

获取基于所述预估带宽值通信对应的第一通信参数;Acquiring a first communication parameter corresponding to communication based on the estimated bandwidth value;

在所述第一通信参数与设定通信参数不匹配时,确定所述通信质量不满足预设通信条件;When the first communication parameter does not match the set communication parameter, it is determined that the communication quality does not meet the preset communication condition;

根据所述第一通信参数确定通信故障类型,根据所述通信故障类型调整所述终端的配置参数。A communication failure type is determined according to the first communication parameter, and configuration parameters of the terminal are adjusted according to the communication failure type.

可选地,所述根据所述通信故障类型调整所述终端的配置参数的步骤,包括:Optionally, the step of adjusting configuration parameters of the terminal according to the communication failure type includes:

根据所述通信故障类型确定所述终端各个所述配置参数的门限值;determining the threshold value of each of the configuration parameters of the terminal according to the communication fault type;

根据所述门限值调整所述终端的配置参数。Adjusting configuration parameters of the terminal according to the threshold value.

可选地,所述根据所述通信场景确定预估带宽值的步骤包括:Optionally, the step of determining the estimated bandwidth value according to the communication scenario includes:

获取预设的带宽自适应算法;Obtain the preset bandwidth adaptive algorithm;

采用所述预设的带宽自适应算法和所述通信场景确定所述预估带宽值。The estimated bandwidth value is determined by using the preset bandwidth adaptive algorithm and the communication scenario.

可选地,所述采用所述预设的带宽自适应算法和所述通信场景确定所述预估带宽值的步骤包括:Optionally, the step of determining the estimated bandwidth value by using the preset bandwidth adaptive algorithm and the communication scenario includes:

在所述通信场景为音频会议和/或视频会议时,确定所述音频会议和/或所述视频会议的会议信息,所述会议信息包括会议类型、参会人数、参会终端类型、参数终端对应的网络环境中的至少一个;When the communication scenario is an audio conference and/or video conference, determine the conference information of the audio conference and/or the video conference, where the conference information includes the conference type, the number of participants, the participant terminal type, and the parameter terminal At least one of the corresponding network environments;

根据所述预设的带宽自适应算法和所述会议信息确定所述预估带宽值。The estimated bandwidth value is determined according to the preset bandwidth adaptive algorithm and the conference information.

可选地,所述根据所述预设的带宽自适应算法和所述会议信息确定所述预估带宽值的步骤包括:Optionally, the step of determining the estimated bandwidth value according to the preset bandwidth adaptive algorithm and the conference information includes:

在所述服务器与所述终端基于所述会议信息进行通信时,获取所述服务器与所述终端之间数据包的丢包率和收发延时信息;When the server and the terminal communicate based on the conference information, acquire the packet loss rate and sending and receiving delay information of data packets between the server and the terminal;

根据所述丢包率和所述收发延时信息确定网络拥塞情况;determining network congestion according to the packet loss rate and the sending and receiving delay information;

根据所述网络拥塞情况确定所述预估带宽值。The estimated bandwidth value is determined according to the network congestion situation.

可选地,所述方法,还包括:Optionally, the method also includes:

在所述通信场景为音频会议和/或视频会议,且包括至少两个参会终端时,获取每个所述参数终端的第二通信参数;When the communication scenario is an audio conference and/or video conference and includes at least two participating terminals, acquiring a second communication parameter of each parameter terminal;

获取所述第二通信参数与预设通信参数不匹配的目标参会终端;Obtaining target conference participants whose second communication parameters do not match the preset communication parameters;

根据所述通信参数调整与所述目标参会终端的带宽信息。Adjusting the bandwidth information with the target participant terminal according to the communication parameters.

此外,为实现上述目的,本申请另一方面还提供一种带宽自适应装置,所述带宽自适应装置包括获取模块、通信模块和调整模块,其中:In addition, in order to achieve the above purpose, another aspect of the present application provides a bandwidth adaptive device, the bandwidth adaptive device includes an acquisition module, a communication module and an adjustment module, wherein:

获取模块,用于获取服务端与终端的通信场景;The acquisition module is used to acquire the communication scene between the server and the terminal;

通信模块,用于根据所述通信场景确定预估带宽值,采用所述预估带宽值与所述终端进行通信;A communication module, configured to determine an estimated bandwidth value according to the communication scenario, and use the estimated bandwidth value to communicate with the terminal;

调整模块,用于在检测到通信质量不满足预设通信条件时,调整所述终端的配置参数。An adjustment module, configured to adjust configuration parameters of the terminal when it is detected that the communication quality does not meet the preset communication conditions.

此外,为实现上述目的,本申请另一方面还提供一种带宽自适应装置,所述装置包括存储器、处理器及存储在存储器上并在所述处理器上运行带宽自适应程序,所述带宽自适应程序被处理器执行时实现如上所述带宽自适应方法的步骤。In addition, in order to achieve the above object, another aspect of the present application provides a bandwidth adaptive device, the device includes a memory, a processor, and a bandwidth adaptive program stored in the memory and running on the processor, the bandwidth When the adaptive program is executed by the processor, the steps of the above-mentioned bandwidth adaptive method are realized.

此外,为实现上述目的,本申请另一方面还提供一种存储介质,所述存储介质上存储有带宽自适应程序,所述带宽自适应程序被处理器执行时实现如上所述带宽自适应方法的步骤。In addition, in order to achieve the above object, another aspect of the present application also provides a storage medium, on which a bandwidth adaptation program is stored, and when the bandwidth adaptation program is executed by a processor, the bandwidth adaptation method as described above is implemented. A step of.

本申请提出一种带宽自适应方法,通过获取服务端与终端的通信场景;根据通信场景确定预估带宽值,采用预估带宽值与终端进行通信;在检测到通信质量不满足预设通信条件时,调整终端的配置参数。本申请通过结合通信场景预估带宽,然后基于预估带宽值进行通信,再动态调整终端的配置参数,以满足通信质量要求,如此,提高了视频传输质量。This application proposes a bandwidth adaptive method, by obtaining the communication scene between the server and the terminal; determining the estimated bandwidth value according to the communication scene, and using the estimated bandwidth value to communicate with the terminal; when it is detected that the communication quality does not meet the preset communication conditions , adjust the configuration parameters of the terminal. In this application, the bandwidth is estimated in combination with the communication scene, and then the communication is performed based on the estimated bandwidth value, and then the configuration parameters of the terminal are dynamically adjusted to meet the communication quality requirements. In this way, the video transmission quality is improved.

附图说明Description of drawings

图1为本申请实施例方案涉及的硬件运行环境的终端结构示意图;FIG. 1 is a schematic diagram of the terminal structure of the hardware operating environment involved in the solution of the embodiment of the present application;

图2为本申请带宽自适应方法第一实施例的流程示意图;FIG. 2 is a schematic flow chart of the first embodiment of the bandwidth adaptive method of the present application;

图3为本申请带宽自适应方法第一实施例中根据所述通信场景确定预估带宽值的流程示意图;FIG. 3 is a schematic flow diagram of determining an estimated bandwidth value according to the communication scenario in the first embodiment of the bandwidth adaptive method of the present application;

图4为本申请的各通信场景的示意图;FIG. 4 is a schematic diagram of various communication scenarios of the present application;

图5为本申请的各终端的模型参数配置图;Fig. 5 is a model parameter configuration diagram of each terminal of the present application;

图6为本申请带宽自适应方法的模块示意图。FIG. 6 is a block diagram of a bandwidth adaptive method of the present application.

本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional features and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

具体实施方式Detailed ways

应当理解,此处所描述的具体实施例仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application.

目前,主要采用WebRTC中的带宽自适应算法进行带宽评估,该带宽评估方式理论上可改善音视频通讯传输的带宽适应调节,但现阶段的通信应用场景比较复杂,包括移动网络和家用WiFi有时也达不到理想中的稳定,如此,至少存在以下问题:At present, the bandwidth adaptive algorithm in WebRTC is mainly used for bandwidth evaluation. This bandwidth evaluation method can theoretically improve the bandwidth adaptive adjustment of audio and video communication transmission. However, the current communication application scenarios are more complicated, including mobile networks and home WiFi. The ideal stability cannot be achieved, so at least the following problems exist:

第一、接收端带宽实时预测调节滞后:通过基础算法可以保证一定的带宽预测能力,但结合于实时音视频的毫秒级时延要求,通常网络不稳定波动较大时难以确保视讯流畅度,如果视频码率高于当前带宽上限,则会出现播放卡顿的情况,如果码率适配调整太频繁,又将引起视频画面适量的抖动,因此,传统带宽自适应的方式会影响到用户端的视讯感知。First, real-time bandwidth prediction and adjustment lag at the receiving end: the basic algorithm can guarantee a certain bandwidth prediction capability, but combined with the millisecond-level delay requirements of real-time audio and video, it is usually difficult to ensure video fluency when the network is unstable and fluctuates greatly. If the video bit rate is higher than the current bandwidth upper limit, the playback will be stuck. If the bit rate adaptation adjustment is too frequent, it will cause a certain amount of jitter in the video screen. Therefore, the traditional bandwidth adaptive method will affect the video of the client. perception.

第二、弱网环境下的带宽自适应问题:多路音视频用户参会时,某一路或几路从转发服务器到接收端带宽处于弱网条件下,即可能导致整体评估带宽较低,从而采用较差的网络带宽作为采集端编码带宽,如此,虽然可提高最差带宽下的音视频流畅性,但也降低了其他网络条件较好的客户端体验,产生“木桶效应”。Second, the problem of bandwidth self-adaptation in a weak network environment: when multiple audio and video users participate in a conference, the bandwidth of one or several channels from the forwarding server to the receiving end is under weak network conditions, which may lead to a low overall evaluation bandwidth, thus Using poor network bandwidth as the encoding bandwidth of the acquisition end, although it can improve the audio and video fluency under the worst bandwidth, it also reduces the experience of other clients with better network conditions, resulting in a "barrel effect".

第三、由于接收端带宽实时预测调节滞后以及在弱网环境下不合理的带宽评估,导致视频传输质量较差的问题。Third, due to the delay in real-time prediction and adjustment of bandwidth at the receiving end and unreasonable bandwidth evaluation in a weak network environment, the quality of video transmission is poor.

基于此,本申请提出以下各个实施例,基于传统音视频带宽自适应算法的基础上,结合实际应用场景通过终端、会议形式、网络环境、用户人数等多纬度综合制定带宽自适应模型,实现预先配置接入端相应创建模型,使尽可能达到其对应的理想网络传输能力,提升视讯效果。同时基于带宽自适应模型(即带宽评估模型)和定制的参数配置库,对客户端参数进行动态设定,以更合理化地匹配实际业务场景,实现相应模型中的参数配置区间内最小范围动态带宽自适应快速调节。而在个别终端评估带宽能力较差时,只需在该终端模型内进行相应调整,不影响其他正常终端的模型参数,以保证整体会议效果稳定,提升用户音视频体验。Based on this, this application proposes the following embodiments, based on the traditional audio and video bandwidth adaptive algorithm, combined with actual application scenarios, the bandwidth adaptive model is comprehensively formulated through multiple latitudes such as terminals, conference forms, network environment, and number of users, so as to realize Configure the access terminal to create a model accordingly, so as to achieve its corresponding ideal network transmission capacity as much as possible, and improve the video effect. At the same time, based on the bandwidth adaptive model (that is, the bandwidth evaluation model) and the customized parameter configuration library, the client parameters are dynamically set to more rationally match the actual business scenario and realize the minimum dynamic bandwidth within the parameter configuration interval in the corresponding model. Adaptive quick adjustment. When individual terminals evaluate poor bandwidth capability, it only needs to make corresponding adjustments in the terminal model without affecting the model parameters of other normal terminals, so as to ensure the stability of the overall conference effect and improve the user's audio and video experience.

如图1所示,图1为本申请实施例方案涉及的硬件运行环境的终端结构示意图。As shown in FIG. 1 , FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in the solution of the embodiment of the present application.

如图1所示,该终端可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1 , the terminal may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. Optionally, the network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 can be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001 .

本领域技术人员可以理解,图1中示出的终端结构并不构成对终端设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal device, and may include more or less components than those shown in the figure, or combine some components, or arrange different components.

如图1所示,作为一种计算机可读存储介质的存储器1005中可以包括带宽自适应程序。As shown in FIG. 1 , a memory 1005 as a computer-readable storage medium may include a bandwidth adaptation program.

在图1所示的终端中,网络接口1004主要用于与后台服务器进行数据通信;用户接口1003主要用于与客户端(用户端)进行数据通信;在所述终端为服务端时,处理器1001可以用于调用存储器1005中带宽自适应程序,并执行以下操作:In the terminal shown in FIG. 1 , the network interface 1004 is mainly used for data communication with the background server; the user interface 1003 is mainly used for data communication with the client (client); when the terminal is a server, the processor 1001 can be used to call the bandwidth adaptation program in memory 1005, and perform the following operations:

获取服务端与终端的通信场景;Obtain the communication scene between the server and the terminal;

根据所述通信场景确定预估带宽值,采用所述预估带宽值与所述终端进行通信;determining an estimated bandwidth value according to the communication scenario, and using the estimated bandwidth value to communicate with the terminal;

在检测到通信质量不满足预设通信条件时,调整所述终端的配置参数。When it is detected that the communication quality does not satisfy the preset communication condition, the configuration parameters of the terminal are adjusted.

参考图2,图2为本申请带宽自适应方法第一实施例的流程示意图。Referring to FIG. 2 , FIG. 2 is a schematic flowchart of a first embodiment of a bandwidth adaptive method of the present application.

本申请实施例提供了一种带宽自适应方法,需要说明的是,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。The embodiment of the present application provides a bandwidth adaptive method. It should be noted that although the logic sequence is shown in the flow chart, in some cases, the sequence shown or described can be executed in a different sequence than here. A step of.

本实施例的带宽自适应方法应用于服务端,包括以下步骤:The bandwidth adaptive method of this embodiment is applied to the server, including the following steps:

步骤S10,获取服务端与终端的通信场景;Step S10, acquiring the communication scene between the server and the terminal;

可选地,本实施例的通信场景包括网络环境,如公网环境(如移动网络、Wi-Fi)和内网环境(如本地局域网、跨省跨区域网络);终端类型,如Web端和APP端;会议类型,如多人实时音视频和培训换热培训;参会人数,如小型会议(2-10人)、中型会议(11-20人)以及大型会议(20人以上)。Optionally, the communication scenario in this embodiment includes a network environment, such as a public network environment (such as a mobile network, Wi-Fi) and an intranet environment (such as a local area network, a cross-provincial and cross-regional network); terminal types, such as a Web terminal and APP side; meeting type, such as multi-person real-time audio and video training and heat transfer training; number of participants, such as small meeting (2-10 people), medium-sized meeting (11-20 people) and large meeting (more than 20 people).

可选地,本实施例的终端包括采集端(如摄像头、手机等)和接收端(如手机、电脑等),其中,采集端用于采集音视频数据,然后,对采集到的音视频数据进行编码,再音视频数据发送至服务端;服务端保存接收到的音视频数据,同时将音视频数据转发至接收端;接收端对接收到的音视频数据进行解码,然后播放解码后的音视频数据。Optionally, the terminal in this embodiment includes a collection terminal (such as a camera, a mobile phone, etc.) and a receiving terminal (such as a mobile phone, a computer, etc.), wherein the collection terminal is used to collect audio and video data, and then the collected audio and video data Encode, and then send the audio and video data to the server; the server saves the received audio and video data, and forwards the audio and video data to the receiving end; the receiving end decodes the received audio and video data, and then plays the decoded audio video data.

在本实施例中,在服务端与终端通信的过程中,会检测两者所处的通信场景,例如,通过检测服务端与终端之间的通信速率可确定两者之间的网络环境,如公网的码率低于内网的码率;通过检测接入端的数量可以确定会议类型和参会人数;通过检测接入端的分辨率可以确定终端类型,如Web端的分辨率低于APP端。In this embodiment, during the communication process between the server and the terminal, the communication scene where the two are located will be detected. For example, the network environment between the two can be determined by detecting the communication rate between the server and the terminal, such as The code rate of the public network is lower than that of the internal network; the type of meeting and the number of participants can be determined by detecting the number of access terminals; the terminal type can be determined by detecting the resolution of the access terminal, for example, the resolution of the web terminal is lower than that of the APP terminal.

步骤S20,根据所述通信场景确定预估带宽值,采用所述预估带宽值与所述终端进行通信;Step S20, determining an estimated bandwidth value according to the communication scenario, and using the estimated bandwidth value to communicate with the terminal;

在本实施例中,基于带宽自适应算法结合通信场景确定预估带宽值,然后,采用该预估带宽值与终端进行通信。例如,检测数据包的丢包率和延迟信息,基于数据包的丢包率和延迟信息,以及通信场景,包括终端类型、网络环境、会议类型、参会人数等生成带宽自适应模型,然后,基于该带宽自适应模型预先预估带宽值,然后,基于预估带宽值与终端进行通信。In this embodiment, an estimated bandwidth value is determined based on a bandwidth adaptive algorithm combined with a communication scenario, and then the estimated bandwidth value is used to communicate with a terminal. For example, detect the packet loss rate and delay information of data packets, generate a bandwidth adaptive model based on the packet loss rate and delay information of data packets, and communication scenarios, including terminal type, network environment, conference type, number of participants, etc., and then, The bandwidth value is estimated in advance based on the bandwidth adaptive model, and then communication is performed with the terminal based on the estimated bandwidth value.

步骤S30,在检测到通信质量不满足预设通信条件时,调整所述终端的配置参数。Step S30, when it is detected that the communication quality does not meet the preset communication condition, adjusting the configuration parameters of the terminal.

可选地,对于采集端来说,其对应的配置参数为编码参数,其中,该编码参数主要包括封装参数,如直播流封装、点播封装、编码模式、混合码率等;视频参数,如视频编码类型、视频码率、编码级别、格式、帧率、色彩空间、扫描方式等;音频参数,如音频编码类型、码率、声道、采用率等。Optionally, for the acquisition end, the corresponding configuration parameters are encoding parameters, wherein the encoding parameters mainly include packaging parameters, such as live stream packaging, on-demand packaging, coding mode, mixed bit rate, etc.; video parameters, such as video Encoding type, video bit rate, encoding level, format, frame rate, color space, scanning method, etc.; audio parameters, such as audio encoding type, bit rate, channel, adoption rate, etc.

可选地,对于接收端来说,其对应的参数为解码参数,解码参数与采集端的编码参数对应。Optionally, for the receiving end, the corresponding parameters are decoding parameters, and the decoding parameters correspond to the encoding parameters of the collecting end.

在本实施例中,服务端在采用预估带宽值与终端进行通信后,会实时检测终端对应的第一通信参数,包括丢包率、码率/帧率、数据包收发延时信息、视频分辨率等,然后,将检测到的第一通信参数与设定通信参数进行比较,如果第一通信参数与设定通信参数不匹配,则确定通信质量不满足预设通信条件,此时,需要根据第一通信参数确定通信故障类型,包括延时、卡顿、抖动、花屏、音视频不同步等,然后根据通信故障类型调整终端的配置参数。例如,假设出现音视频卡顿,那么三端都有可能是问题的源头,如采集端(主播端)的网络差,导致推流上行不稳定;服务端的线路质量不好,导致分发不稳定;接收端(观众端)的网络不好,导致拉流下行不稳定,此时,需要确定问题的源头,再进行相应的调整,例如,假设是接收端出现了问题,则可以增大缓冲区,以缓解解码不稳定带来的卡顿。In this embodiment, after the server uses the estimated bandwidth value to communicate with the terminal, it will detect the first communication parameters corresponding to the terminal in real time, including packet loss rate, code rate/frame rate, data packet sending and receiving delay information, video resolution, etc., and then compare the detected first communication parameter with the set communication parameter, if the first communication parameter does not match the set communication parameter, it is determined that the communication quality does not meet the preset communication conditions, at this time, it is necessary Determine the type of communication failure according to the first communication parameter, including delay, freeze, jitter, blurred screen, out-of-sync audio and video, etc., and then adjust the configuration parameters of the terminal according to the type of communication failure. For example, assuming audio and video freezes occur, all three ends may be the source of the problem. For example, the poor network of the collection end (anchor end) leads to unstable upstream streaming; the poor line quality of the server end leads to unstable distribution; The network at the receiving end (viewer end) is not good, resulting in unstable downstream streaming. At this time, you need to determine the source of the problem, and then make corresponding adjustments. For example, if there is a problem at the receiving end, you can increase the buffer. To alleviate the stuttering caused by unstable decoding.

可选地,基于通信故障类型确定终端各个配置参数的门限值,然后,根据门限值调整终端的配置参数,例如,假设服务端作为发送端,当发送端在TCP网络环境中向接收端发送TCP包的过程中,发生丢包现象时,发送端要对丢失的包进行重传,以便保证发送端与接收端的通信顺畅,其中,TCP包的丢失可以是由网络拥塞或高误码率等导致的,基于此,可基于丢包情况确定丢包重传门限。Optionally, determine the threshold value of each configuration parameter of the terminal based on the type of communication failure, and then adjust the configuration parameters of the terminal according to the threshold value. In the process of sending TCP packets, when packet loss occurs, the sender must retransmit the lost packets to ensure smooth communication between the sender and the receiver. Among them, the loss of TCP packets can be caused by network congestion or high bit error rate. etc. Based on this, the packet loss retransmission threshold can be determined based on the packet loss situation.

可选地,各个配置参数的门限值包括丢包重传门限、音频混音转发时延门限、请求关键帧最小时间间隔门限、控制码率最低编码下限取值门限、拥塞预判调整门限、服务集群资源并发门限等。Optionally, the threshold values of each configuration parameter include the packet loss retransmission threshold, the audio mixing and forwarding delay threshold, the minimum time interval threshold for requesting key frames, the minimum encoding lower limit value threshold for the control code rate, the congestion prediction adjustment threshold, Service cluster resource concurrency threshold, etc.

本实施例通过获取服务端与终端的通信场景;根据通信场景确定预估带宽值,采用预估带宽值与终端进行通信;在检测到通信质量不满足预设通信条件时,调整终端的配置参数。本申请通过结合通信场景预估带宽,然后基于预估带宽值进行通信,再动态调整终端的配置参数,以满足通信质量要求,如此,提高了视频传输质量。This embodiment obtains the communication scene between the server and the terminal; determines the estimated bandwidth value according to the communication scene, and uses the estimated bandwidth value to communicate with the terminal; when it is detected that the communication quality does not meet the preset communication conditions, adjust the configuration parameters of the terminal . In this application, the bandwidth is estimated in combination with the communication scene, and then the communication is performed based on the estimated bandwidth value, and then the configuration parameters of the terminal are dynamically adjusted to meet the communication quality requirements. In this way, the video transmission quality is improved.

进一步地,参考图3,图3为本申请带宽自适应方法第二实施例的流程示意图。Further, refer to FIG. 3 , which is a schematic flowchart of a second embodiment of a bandwidth adaptive method of the present application.

本申请带宽自适应方法第二实施例与第一实施例的区别在于,所述根据所述通信场景确定预估带宽值的步骤包括:The difference between the second embodiment of the bandwidth adaptive method of this application and the first embodiment is that the step of determining the estimated bandwidth value according to the communication scenario includes:

步骤S21,获取预设的带宽自适应算法;Step S21, acquiring a preset bandwidth adaptive algorithm;

步骤S22,采用所述预设的带宽自适应算法和所述通信场景确定所述预估带宽值。Step S22, using the preset bandwidth adaptive algorithm and the communication scenario to determine the estimated bandwidth value.

本实施例中,获取预设的带宽自适应算法,然后,采用预设的带宽自适应算法和通信场景确定预估带宽值,具体地,在通信场景为音频会议和/或视频会议时,确定音频会议和/或视频会议的会议信息,其中,会议信息包括会议类型、参会人数、参会终端类型、参数终端对应的网络环境中的至少一个,然后,根据预设的带宽自适应算法和会议信息确定预估带宽值。In this embodiment, the preset bandwidth adaptive algorithm is obtained, and then the estimated bandwidth value is determined by using the preset bandwidth adaptive algorithm and the communication scenario. Specifically, when the communication scenario is an audio conference and/or video conference, determine Conference information of the audio conference and/or video conference, wherein the conference information includes at least one of the conference type, the number of participants, the terminal type of the conference, and the network environment corresponding to the parameter terminal, and then, according to the preset bandwidth adaptive algorithm and The meeting information determines the estimated bandwidth value.

可选地,在服务器与终端基于会议信息进行通信时,获取服务器与终端之间数据包的丢包率和收发延时信息,然后,根据丢包率和收发延时信息确定网络拥塞情况,再根据网络拥塞情况确定预估带宽值。Optionally, when the server and the terminal communicate based on the conference information, obtain the packet loss rate and sending and receiving delay information of data packets between the server and the terminal, and then determine the network congestion according to the packet loss rate and sending and receiving delay information, and then Determine the estimated bandwidth value based on network congestion.

一实施例中,在通信场景为音频会议和/或视频会议,且包括至少两个参会终端时,获取每个参数终端的第二通信参数,包括丢包率、码率/帧率、数据包收发延时信息、视频分辨率等,然后,获取第二通信参数与预设通信参数不匹配的目标参会终端,再根据通信参数调整与目标参会终端的带宽信息。例如,假设当前有A、B、C、D四个参会终端,基于每个参会终端的通信参数确定参会终端A和参会终端C出现通信故障,如参会终端A的视频出现延时,而参会终端C的视频画面出现卡顿,此时,分别对应调整参会终端A和参会终端C的配置参数,其他两个参会终端的配置参数保持不变,如此,避免了某一路或几路从转发服务器到接收端带宽处于弱网条件下,导致整体评估带宽较低,从而采用较差的网络带宽作为采集端编码带宽,而本实施例调整故障终端的配置参数,可以确保每个会议终端的视频质量。In one embodiment, when the communication scenario is an audio conference and/or video conference and includes at least two participating terminals, the second communication parameters of each parameter terminal are obtained, including packet loss rate, code rate/frame rate, data Packet sending and receiving delay information, video resolution, etc., and then obtain the target participant terminal whose second communication parameter does not match the preset communication parameter, and then adjust the bandwidth information of the target participant terminal according to the communication parameter. For example, suppose there are currently four participating terminals A, B, C, and D. Based on the communication parameters of each participating terminal, it is determined that there is a communication failure between participating terminal A and participating terminal C. For example, there is a delay in the video of participating terminal A. , but the video screen of participant terminal C freezes, at this time, adjust the configuration parameters of participant terminal A and participant terminal C respectively, and keep the configuration parameters of the other two participant terminals unchanged. One or more channels from the forwarding server to the receiving end bandwidth is under weak network conditions, resulting in a low overall evaluation bandwidth, so that poor network bandwidth is used as the encoding bandwidth of the acquisition end, and this embodiment adjusts the configuration parameters of the faulty terminal, which can Ensure video quality for each conference endpoint.

本实施例通过将音视频通讯带宽评估算法结合实际应用场景通过终端、会议形式、网络环境、用户人数多纬度综合制定带宽自适应模型,实现预先配置接入端相应创建模型,使尽可能达到其对应的理想网络传输能力,提升视讯效果。In this embodiment, by combining the audio and video communication bandwidth evaluation algorithm with the actual application scenario, the bandwidth adaptive model is comprehensively formulated through multiple latitudes such as terminal, conference form, network environment, and number of users, so as to realize the corresponding creation model of the pre-configured access terminal, so as to achieve its maximum value as much as possible. The corresponding ideal network transmission capability improves the video effect.

为了更好地说明本申请的带宽自适应方法,参考图4,图4为本申请的各通信场景的示意图。In order to better illustrate the bandwidth adaptation method of the present application, refer to FIG. 4 , which is a schematic diagram of various communication scenarios of the present application.

本实施例通过带宽自适应算法和通信场景预评估带宽能力,同时结合通信场景相关因素综合评估参数配置模型,通过不同模型来定义终端配置参数,优化提升实际业务应用中的带宽自适应能力。In this embodiment, the bandwidth capability is pre-evaluated through the bandwidth adaptive algorithm and the communication scenario, and the parameter configuration model is comprehensively evaluated in combination with the relevant factors of the communication scenario, and the terminal configuration parameters are defined through different models, so as to optimize and improve the bandwidth adaptive capability in actual business applications.

本实施例提出一个考虑到不同业务场景及参数动态匹配方案:This embodiment proposes a dynamic matching scheme considering different business scenarios and parameters:

(一)结合业务场景(1) Combined with business scenarios

1、终端识别:基于终端类型的复杂性,将采用不同终端不同机型的适配机制,在服务端保存对应的配置模型,接入终端会自动匹配并拉取对应配置,并持续识别新的终端信息自动匹配适应模型。1. Terminal identification: Based on the complexity of the terminal type, the adaptation mechanism of different terminals and different models will be adopted, and the corresponding configuration model will be saved on the server side. The access terminal will automatically match and pull the corresponding configuration, and continue to identify new ones. The terminal information automatically matches the adaptation model.

2、网络环境:通过获取终端网络接入情况,收集所在网络环境信息,经终端反馈探测信息,以实际网络条件适配相应模型,例如,在公网环境下通过移动网络和Wi-Fi网络接入存在的稳定性差异,或者,在内网环境下通过本地局域网和跨省跨地市区域的带宽、时延差异等,将自动评估5s内的平均丢包、平均时延、网络拥塞,并结合带宽自适应算法,考虑其波动情况等因素综合考量创建与之匹配的带宽自适应模型,同时,通过网络环境数据收集建立经验库,持续优化模型配置。2. Network environment: By obtaining the network access status of the terminal, the network environment information is collected, and the detection information is fed back by the terminal, and the corresponding model is adapted to the actual network conditions. In the intranet environment, the average packet loss, average delay, and network congestion within 5s will be automatically evaluated through the bandwidth and delay differences of the local LAN and inter-provincial and inter-city areas, and Combined with the bandwidth adaptive algorithm, consider its fluctuations and other factors to create a matching bandwidth adaptive model, and at the same time, build an experience library through network environment data collection to continuously optimize the model configuration.

3、会议形式及参会人数:基于实际会议规模以匹配对应的带宽自适应模型,确保服务端业务并发时资源合理利用率,合理预判码流转发带宽压力,并反馈给客户端制定。3. Conference format and number of participants: Based on the actual conference scale to match the corresponding bandwidth adaptive model, to ensure the reasonable utilization of resources when the server business is concurrent, to reasonably predict the bandwidth pressure of code stream forwarding, and to feed back to the client for formulation.

(二)模型参数配置(2) Model parameter configuration

可选地,如图5所示,采集端部署了编码参数模型,接收端部署了是解码参数模型,服务端部署了带宽自适应模型。Optionally, as shown in FIG. 5 , an encoding parameter model is deployed at the acquisition end, a decoding parameter model is deployed at the receiving end, and a bandwidth adaptive model is deployed at the server end.

结合各端配置模型,首先按常规的带宽评估方式,将抗丢包及抗网络抖动能力的NACK(丢包重传)、FEC(前向纠错)、接收端Jitter Buffer(媒体流平稳)动态调整等各种机制组合形成自适应带宽调整算法,自动生成参数配置模型库,然后,基于带宽自适应模型进行匹配,在此基础上定制相应的参数配置。例如,某场景下对应Web发送端分辨率配置动态区间,使分辨率动态变化区间为640×480至1920×1080,码率变化为800K至2000K/24fps,如当码率探测区间在2000k以上时评估为高码模型,使用1920×1080分辨率,当带宽评估能力不足时发送端分辨率自动降至640×480,码率下限为800K。当服务端预判到带宽无法承受高清晰视频传输时,则自动转化成低码率并通过优化算法,并只在采集端自动匹配对应的编码模型内调整,同时重点优化低码率下的视频清晰度,使低码率视频清晰度媲美高清视频效果,收集经验数据,并结合实际用户体验,生成参数配置库详见下表:Combined with the configuration model of each end, firstly, according to the conventional bandwidth evaluation method, the NACK (packet loss retransmission), FEC (forward error correction), and the receiving end Jitter Buffer (media flow stability) of the anti-packet loss and anti-network jitter capabilities are dynamically Various mechanisms such as adjustment are combined to form an adaptive bandwidth adjustment algorithm, which automatically generates a parameter configuration model library, and then matches based on the bandwidth adaptive model, and then customizes the corresponding parameter configuration. For example, in a certain scenario, configure the dynamic range corresponding to the resolution of the web sending end, so that the dynamic range of the resolution is 640×480 to 1920×1080, and the bit rate changes from 800K to 2000K/24fps. For example, when the bit rate detection range is above 2000k The evaluation is a high-code model, using a resolution of 1920×1080. When the bandwidth evaluation capability is insufficient, the resolution of the sending end is automatically reduced to 640×480, and the lower limit of the code rate is 800K. When the server predicts that the bandwidth cannot withstand high-definition video transmission, it will automatically convert to a low bit rate and pass the optimization algorithm, and only automatically match the corresponding encoding model at the acquisition end to adjust, and at the same time focus on optimizing the low bit rate video Clarity, so that the low-bit-rate video definition is comparable to the high-definition video effect, collect empirical data, and combine the actual user experience to generate a parameter configuration library, see the following table for details:

Figure BDA0003455564190000091
Figure BDA0003455564190000091

Figure BDA0003455564190000101
Figure BDA0003455564190000101

参数配置库随带宽自适应模型进行应用端匹配,各端通过向服务端拉取模型自动配置,同时各模型均需与服务端进行配合调节,由服务端控制对应模型的音视频转发相关门限,包括:丢包重传门限;音频混音转发时延门限;请求关键帧最小时间间隔门限;控制码率最低编码下限取值门限;拥塞预判调整门限;服务集群资源并发门限等。通过上述控制门限触发合理参数调节,并结合参数配置库方案进行持续优化,完成音视频带宽评估的平滑调整,提升自适应能力及响应时延、音视频稳定性,给用户更好的音视频体验。The parameter configuration library matches the application side with the bandwidth adaptive model, and each end automatically configures the model by pulling the model from the server. Including: packet loss and retransmission threshold; audio mixing and forwarding delay threshold; request key frame minimum time interval threshold; control code rate minimum encoding lower limit value threshold; congestion prediction adjustment threshold; service cluster resource concurrency threshold, etc. Reasonable parameter adjustments are triggered through the above control thresholds, and continuous optimization is carried out in combination with the parameter configuration library scheme to complete the smooth adjustment of audio and video bandwidth evaluation, improve self-adaption ability, response delay, and audio and video stability, and give users a better audio and video experience. .

本实施例通过将音视频通讯带宽评估算法结合实际应用场景通过终端、会议形式、网络环境、用户人数多纬度综合制定带宽自适应模型,实现预先配置接入端相应创建模型,使尽可能达到其对应的理想网络传输能力,提升视讯效果。其次,结合带宽自适应模型,应用对应定制参数配置库,对终端参数进行动态设定,以更合理化的匹配实际业务场景,实现相应模型中的参数配置区间内最小范围动态带宽自适应快速调节。In this embodiment, by combining the audio and video communication bandwidth evaluation algorithm with the actual application scenario, the bandwidth adaptive model is comprehensively formulated through multiple latitudes such as terminal, conference form, network environment, and number of users, so as to realize the corresponding creation model of the pre-configured access terminal, so as to achieve its maximum value as much as possible. The corresponding ideal network transmission capability improves the video effect. Secondly, combined with the bandwidth adaptive model, the corresponding customized parameter configuration library is applied to dynamically set the terminal parameters to more rationally match the actual business scenario, and realize the adaptive and fast adjustment of the minimum range of dynamic bandwidth within the parameter configuration interval in the corresponding model.

此外,本申请还提供一种带宽自适应装置,所述装置包括存储器、处理器及存储在存储器上并在所述处理器上运行的带宽自适应程序,所述装置通过获取服务端与终端的通信场景;根据通信场景确定预估带宽值,采用预估带宽值与终端进行通信;在检测到通信质量不满足预设通信条件时,调整终端的配置参数。本申请通过结合通信场景预估带宽,然后基于预估带宽值进行通信,再动态调整终端的配置参数,以满足通信质量要求,如此,提高了视频传输质量。In addition, the present application also provides a bandwidth adaptive device, the device includes a memory, a processor, and a bandwidth adaptive program stored in the memory and run on the processor, the device obtains the Communication scenario: determine the estimated bandwidth value according to the communication scenario, and use the estimated bandwidth value to communicate with the terminal; when it is detected that the communication quality does not meet the preset communication conditions, adjust the configuration parameters of the terminal. In this application, the bandwidth is estimated in combination with the communication scene, and then the communication is performed based on the estimated bandwidth value, and then the configuration parameters of the terminal are dynamically adjusted to meet the communication quality requirements. In this way, the video transmission quality is improved.

进一步地,参考图6,图6为本申请带宽自适应方法的模块示意图。Further, referring to FIG. 6 , FIG. 6 is a schematic diagram of modules of the bandwidth adaptive method of the present application.

所述带宽自适应装置100包括获取模块10、通信模块20和调整模块30,其中:The bandwidth adaptive device 100 includes an acquisition module 10, a communication module 20 and an adjustment module 30, wherein:

获取模块10,用于获取服务端与终端的通信场景;An acquisition module 10, configured to acquire the communication scene between the server and the terminal;

通信模块20,用于根据所述通信场景确定预估带宽值,采用所述预估带宽值与所述终端进行通信;A communication module 20, configured to determine an estimated bandwidth value according to the communication scenario, and use the estimated bandwidth value to communicate with the terminal;

调整模块30,用于在检测到通信质量不满足预设通信条件时,调整所述终端的配置参数。The adjustment module 30 is configured to adjust the configuration parameters of the terminal when it is detected that the communication quality does not meet the preset communication conditions.

进一步地,所述调整模块30包括第一获取单元、确定单元和调整单元:Further, the adjustment module 30 includes a first acquisition unit, a determination unit and an adjustment unit:

所述第一获取单元,用于获取基于所述预估带宽值通信对应的第一通信参数;The first obtaining unit is configured to obtain a first communication parameter corresponding to communication based on the estimated bandwidth value;

所述确定单元,用于在所述第一通信参数与设定通信参数不匹配时,确定所述通信质量不满足预设通信条件;The determining unit is configured to determine that the communication quality does not meet a preset communication condition when the first communication parameter does not match the set communication parameter;

所述调整单元,用于根据所述第一通信参数确定通信故障类型,根据所述通信故障类型调整所述终端的配置参数。The adjusting unit is configured to determine a communication failure type according to the first communication parameter, and adjust configuration parameters of the terminal according to the communication failure type.

进一步地,所述调整单元包括第一确定子单元和调整子单元:Further, the adjustment unit includes a first determination subunit and an adjustment subunit:

所述第一确定子单元,用于根据所述通信故障类型确定所述终端各个所述配置参数的门限值;The first determination subunit is configured to determine the threshold value of each of the configuration parameters of the terminal according to the communication failure type;

所述调整子单元,用于根据所述门限值调整所述终端的配置参数。The adjustment subunit is configured to adjust configuration parameters of the terminal according to the threshold value.

进一步地,通信模块20包括第二获取单元和确定单元:Further, the communication module 20 includes a second acquisition unit and a determination unit:

所述第二获取单元,用于获取预设的带宽自适应算法;The second obtaining unit is configured to obtain a preset bandwidth adaptive algorithm;

所述确定单元,用于采用所述预设的带宽自适应算法和所述通信场景确定所述预估带宽值。The determining unit is configured to determine the estimated bandwidth value by using the preset bandwidth adaptive algorithm and the communication scenario.

进一步地,所述确定单元包括第二确定子单元:Further, the determining unit includes a second determining subunit:

所述第二确定子单元,用于在所述通信场景为音频会议和/或视频会议时,确定所述音频会议和/或所述视频会议的会议信息,所述会议信息包括会议类型、参会人数、参会终端类型、参数终端对应的网络环境中的至少一个;The second determination subunit is configured to determine conference information of the audio conference and/or video conference when the communication scenario is an audio conference and/or video conference, where the conference information includes conference type, participant At least one of the number of participants, the type of participant terminal, and the network environment corresponding to the parameter terminal;

所述第二确定子单元,还用于根据所述预设的带宽自适应算法和所述会议信息确定所述预估带宽值。The second determining subunit is further configured to determine the estimated bandwidth value according to the preset bandwidth adaptive algorithm and the conference information.

进一步地,所述第二确定子单元,还用于在所述服务器与所述终端基于所述会议信息进行通信时,获取所述服务器与所述终端之间数据包的丢包率和收发延时信息;Further, the second determination subunit is further configured to obtain the packet loss rate and transmission and reception delay of data packets between the server and the terminal when the server and the terminal communicate based on the conference information. time information;

所述第二确定子单元,还用于根据所述丢包率和所述收发延时信息确定网络拥塞情况;The second determining subunit is further configured to determine network congestion according to the packet loss rate and the sending and receiving delay information;

所述第二确定子单元,还用于根据所述网络拥塞情况确定所述预估带宽值。The second determining subunit is further configured to determine the estimated bandwidth value according to the network congestion situation.

进一步地,所述带宽自适应装置100还包括第一获取模块和第一调整模块;Further, the bandwidth adaptive device 100 also includes a first acquisition module and a first adjustment module;

所述第一获取模块,用于在所述通信场景为音频会议和/或视频会议,且包括至少两个参会终端时,获取每个所述参数终端的第二通信参数;The first obtaining module is configured to obtain the second communication parameter of each parameter terminal when the communication scene is an audio conference and/or video conference and includes at least two participating terminals;

所述第一获取模块,还用于获取所述第二通信参数与预设通信参数不匹配的目标参会终端;The first obtaining module is also used to obtain target participants whose second communication parameters do not match the preset communication parameters;

所述调整模块,用于根据所述通信参数调整与所述目标参会终端的带宽信息。The adjustment module is configured to adjust bandwidth information with the target participant terminal according to the communication parameters.

上述的带宽自适应装置各个模块功能的实现与上述方法实施例中的过程相似,在此不再一一赘述。The implementation of the functions of each module of the above-mentioned bandwidth self-adapting device is similar to the process in the above-mentioned method embodiment, and will not be repeated here.

此外,本申请还提供一种存储介质,该存储介质上存储有带宽自适应方法程序,带宽自适应方法程序被处理器执行时实现如上带宽自适应方法的步骤。In addition, the present application also provides a storage medium, on which a bandwidth adaptive method program is stored, and when the bandwidth adaptive method program is executed by a processor, the steps of the above bandwidth adaptive method are realized.

本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams.

应当注意的是,在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的部件或步骤。位于部件之前的单词“一”或“一个”不排除存在多个这样的部件。本申请可以借助于包括有若干不同部件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that, in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

尽管已描述了本申请的可选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所附权利要求意欲解释为包括可选实施例以及落入本申请范围的所有变更和修改。While alternative embodiments of the present application have been described, additional changes and modifications to these embodiments may be made by those skilled in the art once the basic inventive concept is appreciated. Therefore, it is intended that the appended claims be interpreted to cover alternative embodiments and all changes and modifications that fall within the scope of the application.

显然,本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the application without departing from the spirit and scope of the application. In this way, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.

Claims (10)

1.一种带宽自适应方法,其特征在于,应用于服务端,所述方法包括:1. A bandwidth adaptive method, characterized in that being applied to a server, said method comprising: 获取服务端与终端的通信场景;Obtain the communication scene between the server and the terminal; 根据所述通信场景确定预估带宽值,采用所述预估带宽值与所述终端进行通信;determining an estimated bandwidth value according to the communication scenario, and using the estimated bandwidth value to communicate with the terminal; 在检测到通信质量不满足预设通信条件时,调整所述终端的配置参数。When it is detected that the communication quality does not satisfy the preset communication condition, the configuration parameters of the terminal are adjusted. 2.如权利要求1所述的带宽自适应方法,其特征在于,所述在检测到通信质量不满足预设通信条件时,调整所述终端的配置参数的步骤包括:2. The bandwidth adaptive method according to claim 1, wherein the step of adjusting the configuration parameters of the terminal comprises: 获取基于所述预估带宽值通信对应的第一通信参数;Acquiring a first communication parameter corresponding to communication based on the estimated bandwidth value; 在所述第一通信参数与设定通信参数不匹配时,确定所述通信质量不满足预设通信条件;When the first communication parameter does not match the set communication parameter, it is determined that the communication quality does not meet the preset communication condition; 根据所述第一通信参数确定通信故障类型,根据所述通信故障类型调整所述终端的配置参数。A communication failure type is determined according to the first communication parameter, and configuration parameters of the terminal are adjusted according to the communication failure type. 3.如权利要求2所述的带宽自适应方法,其特征在于,所述根据所述通信故障类型调整所述终端的配置参数的步骤,包括:3. The bandwidth adaptive method according to claim 2, wherein the step of adjusting configuration parameters of the terminal according to the type of communication failure comprises: 根据所述通信故障类型确定所述终端各个所述配置参数的门限值;determining the threshold value of each of the configuration parameters of the terminal according to the communication failure type; 根据所述门限值调整所述终端的配置参数。Adjusting configuration parameters of the terminal according to the threshold value. 4.如权利要求1所述的带宽自适应方法,其特征在于,所述根据所述通信场景确定预估带宽值的步骤包括:4. The bandwidth adaptive method according to claim 1, wherein the step of determining an estimated bandwidth value according to the communication scenario comprises: 获取预设的带宽自适应算法;Obtain the preset bandwidth adaptive algorithm; 采用所述预设的带宽自适应算法和所述通信场景确定所述预估带宽值。The estimated bandwidth value is determined by using the preset bandwidth adaptive algorithm and the communication scenario. 5.如权利要求4所述的带宽自适应方法,其特征在于,所述采用所述预设的带宽自适应算法和所述通信场景确定所述预估带宽值的步骤包括:5. The bandwidth adaptive method according to claim 4, wherein the step of determining the estimated bandwidth value using the preset bandwidth adaptive algorithm and the communication scenario comprises: 在所述通信场景为音频会议和/或视频会议时,确定所述音频会议和/或所述视频会议的会议信息,所述会议信息包括会议类型、参会人数、参会终端类型、参数终端对应的网络环境中的至少一个;When the communication scenario is an audio conference and/or video conference, determine the conference information of the audio conference and/or the video conference, where the conference information includes the conference type, the number of participants, the participant terminal type, and the parameter terminal At least one of the corresponding network environments; 根据所述预设的带宽自适应算法和所述会议信息确定所述预估带宽值。The estimated bandwidth value is determined according to the preset bandwidth adaptive algorithm and the conference information. 6.如权利要求5所述的带宽自适应方法,其特征在于,所述根据所述预设的带宽自适应算法和所述会议信息确定所述预估带宽值的步骤包括:6. The bandwidth adaptive method according to claim 5, wherein the step of determining the estimated bandwidth value according to the preset bandwidth adaptive algorithm and the meeting information comprises: 在所述服务器与所述终端基于所述会议信息进行通信时,获取所述服务器与所述终端之间数据包的丢包率和收发延时信息;When the server and the terminal communicate based on the conference information, acquire the packet loss rate and sending and receiving delay information of data packets between the server and the terminal; 根据所述丢包率和所述收发延时信息确定网络拥塞情况;determining network congestion according to the packet loss rate and the sending and receiving delay information; 根据所述网络拥塞情况确定所述预估带宽值。The estimated bandwidth value is determined according to the network congestion situation. 7.如权利要求1所述的带宽自适应方法,其特征在于,所述方法,还包括:7. The bandwidth adaptive method according to claim 1, wherein the method further comprises: 在所述通信场景为音频会议和/或视频会议,且包括至少两个参会终端时,获取每个所述参数终端的第二通信参数;When the communication scenario is an audio conference and/or video conference and includes at least two participating terminals, acquiring a second communication parameter of each parameter terminal; 获取所述第二通信参数与预设通信参数不匹配的目标参会终端;Obtaining target conference participants whose second communication parameters do not match the preset communication parameters; 根据所述通信参数调整与所述目标参会终端的带宽信息。Adjusting the bandwidth information with the target participant terminal according to the communication parameters. 8.一种带宽自适应装置,其特征在于,所述带宽自适应装置包括获取模块、通信模块和调整模块,其中:8. A bandwidth adaptive device, characterized in that the bandwidth adaptive device includes an acquisition module, a communication module and an adjustment module, wherein: 获取模块,用于获取服务端与终端的通信场景;The acquisition module is used to acquire the communication scene between the server and the terminal; 通信模块,用于根据所述通信场景确定预估带宽值,采用所述预估带宽值与所述终端进行通信;A communication module, configured to determine an estimated bandwidth value according to the communication scenario, and use the estimated bandwidth value to communicate with the terminal; 调整模块,用于在检测到通信质量不满足预设通信条件时,调整所述终端的配置参数。An adjustment module, configured to adjust configuration parameters of the terminal when it is detected that the communication quality does not meet the preset communication conditions. 9.一种带宽自适应装置,其特征在于,所述装置包括存储器、处理器及存储在存储器上并在所述处理器上运行带宽自适应程序,所述处理器执行所述带宽自适应程序时实现如权利要求1至7中任一项所述的方法的步骤。9. A bandwidth adaptive device, characterized in that the device includes a memory, a processor and a bandwidth adaptive program stored on the memory and running on the processor, and the processor executes the bandwidth adaptive program When realizing the steps of the method as any one of claims 1 to 7. 10.一种存储介质,其特征在于,所述存储介质上存储有带宽自适应程序,所述带宽自适应程序被处理器执行时实现如权利要求1至7中任一项所述的方法的步骤。10. A storage medium, characterized in that a bandwidth adaptive program is stored on the storage medium, and when the bandwidth adaptive program is executed by a processor, the method according to any one of claims 1 to 7 is implemented. step.
CN202210007381.0A 2022-01-04 2022-01-04 Bandwidth adaptive method, device and storage medium Pending CN116436870A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210007381.0A CN116436870A (en) 2022-01-04 2022-01-04 Bandwidth adaptive method, device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210007381.0A CN116436870A (en) 2022-01-04 2022-01-04 Bandwidth adaptive method, device and storage medium

Publications (1)

Publication Number Publication Date
CN116436870A true CN116436870A (en) 2023-07-14

Family

ID=87087775

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210007381.0A Pending CN116436870A (en) 2022-01-04 2022-01-04 Bandwidth adaptive method, device and storage medium

Country Status (1)

Country Link
CN (1) CN116436870A (en)

Similar Documents

Publication Publication Date Title
EP3866474B1 (en) Video self-adaptation method, related device and storage medium
US10045089B2 (en) Selection of encoder and decoder for a video communications session
US8988486B2 (en) Adaptive video communication channel
US20080100694A1 (en) Distributed caching for multimedia conference calls
US9232244B2 (en) Efficient frame forwarding in large scale real-time screen content sharing meetings
WO2020220902A1 (en) Method and apparatus for distributing transmission parameters of video resources
US8842159B2 (en) Encoding processing for conferencing systems
US9386273B1 (en) Video multicast engine
CN115209189B (en) Video stream transmission method, system, server and storage medium
CN101521583B (en) Resource admission control method, system and device
US20170142029A1 (en) Method for data rate adaption in online media services, electronic device, and non-transitory computer-readable storage medium
KR20140056296A (en) Techniques for dynamic switching between coded bitstreams
US9270937B2 (en) Real time stream provisioning infrastructure
US20240223832A1 (en) Video stream bitrate adjustment method and apparatus, computer device, and storage medium
US11936698B2 (en) Systems and methods for adaptive video conferencing
CN106302377B (en) Media session processing method and related equipment and communication system
CN108574840B (en) Method and device for evaluating video experience quality
CN116436870A (en) Bandwidth adaptive method, device and storage medium
CN115334059B (en) A method, device, equipment and storage medium for audio and video intercommunication
CN116996709A (en) Video streaming transmission method, system, server and storage medium
CN114978935B (en) Method, device and storage medium for applying for service quality resource
CN110708604A (en) Method and device for adapting IP channel bandwidth of video forwarding server
US20240372909A1 (en) Prioritization of data streams between a source of audio/video content and telecommunication clients
CN112770077B (en) Video conference I frame coding method and device
US20200221266A1 (en) Method, base station and user equipment for multicasting and device with a storage capability

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination