[go: up one dir, main page]

CN114374816A - Information interaction method based on video conference, server and terminal equipment - Google Patents

Information interaction method based on video conference, server and terminal equipment Download PDF

Info

Publication number
CN114374816A
CN114374816A CN202011118608.6A CN202011118608A CN114374816A CN 114374816 A CN114374816 A CN 114374816A CN 202011118608 A CN202011118608 A CN 202011118608A CN 114374816 A CN114374816 A CN 114374816A
Authority
CN
China
Prior art keywords
information
mixed
stream
flow
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011118608.6A
Other languages
Chinese (zh)
Inventor
郭斌洁
付家乐
方炜
王晨
于杭
缪新苗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Group Zhejiang Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Group Zhejiang Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Group Zhejiang Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN202011118608.6A priority Critical patent/CN114374816A/en
Publication of CN114374816A publication Critical patent/CN114374816A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/155Conference systems involving storage of or access to video conference sessions

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses an information interaction method based on a video conference, a server and terminal equipment. The method comprises the following steps: acquiring an information stream uploaded by a sending terminal through a mixed channel; wherein the information stream comprises a shared stream and a real-time image stream; uniformly coding the information streams, and distributing corresponding identifiers for each information stream; and carrying out mixed flow treatment on the information flow, and sending the mixed information flow after the mixed flow treatment to a receiving terminal so as to present the mixed information flow in a preset mixed flow layout at the receiving terminal. In the scheme, the server uniformly encodes and mixes the information flow uploaded by the sending terminal through the mixing channel, and sends the mixed flow processing result to each receiving terminal. Therefore, a plurality of participants can share data at the same time in the same video conference, and user experience is improved.

Description

基于视频会议的信息交互方法、服务器及终端设备Information interaction method, server and terminal device based on video conference

技术领域technical field

本发明涉及信息处理技术领域,具体涉及一种基于视频会议的基于视频会议的信息交互方法、服务器及终端设备。The present invention relates to the technical field of information processing, in particular to a video conference-based information interaction method, server and terminal device based on a video conference.

背景技术Background technique

视频会议是指两个或两个以上用户或用户群体,通过传输线路及多媒体设备,将声音、影像及文件资料互传,实现即时且互动的沟通的一种远程会议模式。Video conference refers to a remote conference mode in which two or more users or user groups transmit voice, video and file data to each other through transmission lines and multimedia equipment to achieve instant and interactive communication.

目前的视频会议实施方案中,设置有共享流通道及实时图像流通道,其中,同一个视频会议中仅设置一个共享流通道,在同一视频会议中,同时仅允许一个参会方传输共享流;而其他各参会方可通过各自的实时图像流通道传输实时图像流,并观看该唯一的共享流。In the current video conference implementation solution, a shared stream channel and a real-time image stream channel are provided, wherein only one shared stream channel is set in the same video conference, and in the same video conference, only one participant is allowed to transmit the shared stream at the same time; The other participants can transmit the real-time image stream through their own real-time image stream channel, and watch the unique shared stream.

然而,发明人在实施过程中发现,现有技术中存在如下缺陷:现有技术中的视频会议实施方案,同时仅允许一方进行信息共享,其在多方远程运维等场景中,无法满足多方用户同时共享数据的需求。However, the inventor found in the implementation process that there are the following defects in the prior art: the video conference implementation solution in the prior art allows only one party to share information at the same time, which cannot satisfy multiple users in scenarios such as multi-party remote operation and maintenance. The need to share data at the same time.

发明内容SUMMARY OF THE INVENTION

鉴于上述问题,提出了本发明以便提供一种克服上述问题或者至少部分地解决上述问题的基于视频会议的信息交互方法、服务器及终端设备。In view of the above problems, the present invention is proposed to provide a video conference-based information interaction method, server and terminal device that overcome the above problems or at least partially solve the above problems.

根据本发明的第一个方面,提供了一种基于视频会议的信息交互方法,所述方法在服务器侧执行,所述方法包括:According to a first aspect of the present invention, there is provided an information exchange method based on a video conference, the method is executed on the server side, and the method includes:

获取发送终端通过混合通道上传的信息流;其中,所述信息流包括共享流以及实时图像流;Acquire the information stream uploaded by the sending terminal through the mixed channel; wherein, the information stream includes a shared stream and a real-time image stream;

对所述信息流进行统一编码,为每个信息流分配对应的标识;The information flow is uniformly encoded, and a corresponding identification is allocated for each information flow;

对所述信息流进行混流处理,并将混流处理后的混合信息流发送至接收终端,以供在所述接收终端以预设混流布局呈现所述混合信息流。Mixing processing is performed on the information flow, and the mixed information flow after the mixing processing is sent to the receiving terminal, so that the receiving terminal can present the mixed information flow in a preset mixing layout.

可选的,所述为每个信息流分配对应的标识中包含:用户标识字段和/或信息流类型字段。Optionally, the corresponding identifier assigned to each information stream includes: a user identifier field and/or an information stream type field.

可选的,所述方法还包括:获取接收终端发送的单信息流获取请求;其中,所述单信息流获取请求由针对于接收终端中呈现的混合信息流的预设选择操作触发;Optionally, the method further includes: acquiring a single information stream acquisition request sent by the receiving terminal; wherein the single information stream acquisition request is triggered by a preset selection operation for a mixed information stream presented in the receiving terminal;

将与所述单信息流获取请求对应的单个信息流发送给接收终端,以供接收终端以预设单流布局呈现所述单个信息流;其中,预设单流布局的显示优先级高于预设混流布局的显示优先级。Send the single information stream corresponding to the single information stream acquisition request to the receiving terminal, so that the receiving terminal presents the single information stream in a preset single stream layout; wherein, the display priority of the preset single stream layout is higher than the preset single stream layout. Set the display priority of the mixed flow layout.

根据本发明的第二个方面,提供了一种基于视频会议的信息交互方法,所述方法在发送终端侧执行,所述方法包括:According to a second aspect of the present invention, a video conference-based information exchange method is provided, the method is executed on the sending terminal side, and the method includes:

通过混合通道上传信息流,以供服务器对信息流进行统一编码及混流处理,并供服务器将混流处理后的混合信息流发送至接收终端;The information stream is uploaded through the mixed channel, so that the server can perform unified encoding and mixed stream processing on the information stream, and the server can send the mixed information stream after the mixed stream processing to the receiving terminal;

其中,所述信息流包括共享流以及实时图像流。Wherein, the information flow includes a shared flow and a real-time image flow.

根据本发明的第三方面,提供了一种基于视频会议的信息交互方法,所述方法在接收终端侧执行,所述方法包括:According to a third aspect of the present invention, there is provided an information exchange method based on a video conference, the method is performed on the receiving terminal side, and the method includes:

接收服务器发送的混合信息流;其中,所述混合信息流为服务器通过对发送终端由混合通道上传的信息流进行统一编码及混流处理获得的;Receive the mixed information stream sent by the server; wherein, the mixed information stream is obtained by the server by performing unified encoding and mixed stream processing on the information stream uploaded by the sending terminal through the mixed channel;

以预设混流布局呈现所述混合信息流。The mixed information flow is presented in a preset mixed flow layout.

根据本发明的第四方面,提供了一种服务器,包括:According to a fourth aspect of the present invention, a server is provided, comprising:

获取模块,适于获取发送终端通过混合通道上传的信息流;其中,所述信息流包括共享流以及实时图像流;an acquisition module, adapted to acquire the information stream uploaded by the sending terminal through the mixed channel; wherein, the information stream includes a shared stream and a real-time image stream;

编码模块,适于对所述信息流进行统一编码,为每个信息流分配对应的标识;an encoding module, adapted to uniformly encode the information stream, and assign a corresponding identifier to each information stream;

混流处理模块,适于对所述信息流进行混流处理;a mixed flow processing module, adapted to perform mixed flow processing on the information flow;

发送模块,适于将混流处理后的混合信息流发送至接收终端,以供在所述接收终端以预设混流布局呈现所述混合信息流。The sending module is adapted to send the mixed flow processed mixed information flow to the receiving terminal, so that the mixed information flow can be presented at the receiving terminal in a preset mixed flow layout.

可选的,所述为每个信息流分配对应的标识中包含:用户标识字段和/或信息流类型字段。Optionally, the corresponding identifier assigned to each information stream includes: a user identifier field and/or an information stream type field.

可选的,所述获取模块还适于:获取接收终端发送的单信息流获取请求;其中,所述单信息流获取请求由针对于接收终端中呈现的混合信息流的预设选择操作触发;Optionally, the obtaining module is further adapted to: obtain a single information stream obtaining request sent by the receiving terminal; wherein the single information stream obtaining request is triggered by a preset selection operation for the mixed information stream presented in the receiving terminal;

所述发送模块进一步适于:将与所述单信息流获取请求对应的单个信息流发送给接收终端,以供接收终端以预设单流布局呈现所述单个信息流;其中,预设单流布局的显示优先级高于预设混流布局的显示优先级。The sending module is further adapted to: send a single information stream corresponding to the single information stream acquisition request to the receiving terminal, so that the receiving terminal can present the single information stream in a preset single stream layout; wherein the preset single stream The display priority of the layout is higher than that of the preset muxed layout.

根据本发明的第五方面,提供了一种终端设备,包括:According to a fifth aspect of the present invention, a terminal device is provided, comprising:

上传模块,适于通过混合通道上传信息流,以供服务器对信息流进行统一编码及混流处理,并供服务器将混流处理后的混合信息流发送至接收终端;The uploading module is suitable for uploading the information stream through the mixed channel, so that the server can perform unified encoding and mixed stream processing on the information stream, and the server can send the mixed information stream after the mixed stream processing to the receiving terminal;

其中,所述信息流包括共享流以及实时图像流。Wherein, the information flow includes a shared flow and a real-time image flow.

根据本发明的第六方面,提供了一种终端设备,包括:According to a sixth aspect of the present invention, a terminal device is provided, comprising:

接收模块,适于接收服务器发送的混合信息流;其中,所述混合信息流为服务器通过对发送终端由混合通道上传的信息流进行统一编码及混流处理获得的;a receiving module, adapted to receive the mixed information stream sent by the server; wherein, the mixed information stream is obtained by the server by performing unified encoding and mixed stream processing on the information stream uploaded by the sending terminal through the mixed channel;

呈现模块,适于以预设混流布局呈现所述混合信息流。The presentation module is adapted to present the mixed information flow in a preset mixed flow layout.

根据本发明的第七方面,提供了一种计算设备,包括:处理器、存储器、通信接口和通信总线,所述处理器、所述存储器和所述通信接口通过所述通信总线完成相互间的通信;According to a seventh aspect of the present invention, a computing device is provided, comprising: a processor, a memory, a communication interface, and a communication bus, and the processor, the memory, and the communication interface complete mutual communication through the communication bus. communication;

所述存储器用于存放至少一可执行指令,所述可执行指令使所述处理器执行上述基于视频会议的信息交互方法对应的操作。The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform operations corresponding to the above-mentioned video conference-based information interaction method.

根据本发明的第八方面,提供了一种计算机存储介质,所述存储介质中存储有至少一可执行指令,所述可执行指令使处理器执行上述基于视频会议的信息交互方法对应的操作。According to an eighth aspect of the present invention, a computer storage medium is provided, wherein the storage medium stores at least one executable instruction, and the executable instruction enables a processor to perform operations corresponding to the above-mentioned video conference-based information interaction method.

本方案为发送终端提供混合通道,发送终端既可以通过该混合通道上传实时图像流,也可以通过该混合通道上传共享流,并通过服务器来对信息流进行统一编码及混流处理,从而避免现有技术中各参会方需抢占共享流通道后才能共享信息的弊端,实现同一会议可多方同时共享;并且能够便于用户根据实际需求选择感兴趣的共享流,从而提升用户体验。This solution provides a mixed channel for the sending terminal. The sending terminal can upload a real-time image stream through the mixed channel, or upload a shared stream through the mixed channel, and perform unified encoding and mixed stream processing on the information stream through the server, so as to avoid the existing In the technology, each participant needs to preempt the shared stream channel before sharing information, so that the same conference can be shared by multiple parties at the same time; and it is convenient for the user to select the shared stream of interest according to the actual needs, thereby improving the user experience.

上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。The above description is only an overview of the technical solutions of the present invention, in order to be able to understand the technical means of the present invention more clearly, it can be implemented according to the content of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand , the following specific embodiments of the present invention are given.

附图说明Description of drawings

通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for the purpose of illustrating preferred embodiments only and are not to be considered limiting of the invention. Also, the same components are denoted by the same reference numerals throughout the drawings. In the attached image:

图1示出了根据本发明实施例一提供的一种基于视频会议的信息交互方法的流程示意图;1 shows a schematic flowchart of a method for information interaction based on a video conference provided according to Embodiment 1 of the present invention;

图2示出了根据本发明实施例二提供的一种基于视频会议的信息交互方法的流程示意图;2 shows a schematic flowchart of a method for information interaction based on a video conference provided according to Embodiment 2 of the present invention;

图3示出了根据本发明实施例三提供的一种基于视频会议的信息交互方法的流程示意图;3 shows a schematic flowchart of a method for information interaction based on a video conference provided according to Embodiment 3 of the present invention;

图4示出了根据本发明实施例四提供的一种基于视频会议的信息交互方法的流程示意图;4 shows a schematic flowchart of a method for information interaction based on a video conference provided according to Embodiment 4 of the present invention;

图5示出了根据本发明实施例五提供的一种服务器的功能结构示意图;FIG. 5 shows a schematic functional structure diagram of a server according to Embodiment 5 of the present invention;

图6示出了根据本发明实施例六提供的一种终端设备的功能结构示意图;FIG. 6 shows a schematic functional structure diagram of a terminal device according to Embodiment 6 of the present invention;

图7示出了根据本发明实施例七提供的一种终端设备的功能结构示意图;FIG. 7 shows a schematic functional structure diagram of a terminal device according to Embodiment 7 of the present invention;

图8示出了根据本发明实施例八提供的一种信息交互系统的功能结构示意图;FIG. 8 shows a schematic functional structure diagram of an information interaction system according to Embodiment 8 of the present invention;

图9示出了根据本发明实施例十提供的一种计算设备的结构示意图。FIG. 9 shows a schematic structural diagram of a computing device according to Embodiment 10 of the present invention.

具体实施方式Detailed ways

下面将参照附图更详细地描述本发明的示例性实施例。虽然附图中显示了本发明的示例性实施例,然而应当理解,可以以各种形式实现本发明而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本发明,并且能够将本发明的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present invention will be more thoroughly understood, and will fully convey the scope of the present invention to those skilled in the art.

实施例一Example 1

图1示出了根据本发明实施例一提供的一种基于视频会议的信息交互方法的流程示意图。其中,本实施例所提供的基于视频会议的信息交互方法由服务器端执行。FIG. 1 shows a schematic flowchart of a method for information interaction based on a video conference according to Embodiment 1 of the present invention. The information interaction method based on the video conference provided in this embodiment is executed by the server.

如图1所示,该方法包括:As shown in Figure 1, the method includes:

步骤S110:获取发送终端通过混合通道上传的信息流。Step S110: Acquire the information stream uploaded by the sending terminal through the hybrid channel.

其中,信息流包括共享流以及实时图像流。共享流具体为共享方通过桌面共享或文件共享等方式形成的信息流,如其可以为共享方终端中的显示文稿或文件等等;实时图像流具体为通过会议参会方终端中的图像采集设备(如摄像头)等实时采集到的信息流,如其可以包括参会方的表情、动作、语音等信息。The information flow includes shared flow and real-time image flow. The shared stream is the information stream formed by the sharing party through desktop sharing or file sharing. For example, it can be the displayed document or file in the sharing party's terminal; the real-time image stream is the image acquisition device in the terminal of the conference participant. (such as a camera) and other information streams collected in real time, for example, it may include information such as expressions, actions, and voices of participants.

不同于现有技术中为共享流独立设置共享通道,本实施例中为各个发送终端提供一个统一的信息流传输通道,即混合通道。发送终端可通过该混合通道上传共享流及实时图像流。而服务器可及时获取各个发送终端上传的信息流。Different from the independent setting of shared channels for shared streams in the prior art, in this embodiment, each sending terminal is provided with a unified information stream transmission channel, that is, a mixed channel. The sending terminal can upload the shared stream and the real-time image stream through the mixed channel. The server can obtain the information stream uploaded by each sending terminal in time.

步骤S120:对信息流进行统一编码,为每个信息流分配对应的标识。Step S120 : uniformly encode the information streams, and assign a corresponding identifier to each information stream.

在现有技术中,两类信息流(共享流及实时图像流)按照不同的编码方式进行编码。而本申请是将两类信息流进行混合,继而按照一种编码方式,来对各个信息流进行统一编码,从而每个信息流能够获得唯一标识。In the prior art, two types of information streams (shared stream and real-time image stream) are encoded according to different encoding methods. In the present application, two types of information streams are mixed, and then each information stream is uniformly encoded according to one encoding method, so that each information stream can obtain a unique identifier.

在一种可选的实施方式中,为了便于对信息流的管理及处理等,本实施例为每个信息流分配对应的标识中包含:用户标识字段和/或信息流类型字段。其中,同一用户上传的信息流,其对应的用户标识字段内容相同;同一类型的信息流其信息流类型字段内容相同,信息流类型包括共享流类型及实时图像流类型。从而在实现信息流细粒度管理过程中,可依据用户标识字段和/或信息流类型字段,对信息流进行集合划分;进而基于划分的集合进行批量化处理等等。In an optional implementation manner, in order to facilitate the management and processing of the information flow, in this embodiment, the corresponding identifier allocated to each information flow includes: a user identification field and/or an information flow type field. Among them, the information flow uploaded by the same user has the same content of the corresponding user ID field; the information flow of the same type has the same content of the information flow type field, and the information flow type includes the shared flow type and the real-time image flow type. Therefore, in the process of realizing the fine-grained management of the information flow, the information flow can be divided into sets according to the user identification field and/or the information flow type field; and batch processing can be performed based on the divided sets.

在又一种可选的实施方式中,为了保障信息安全,可采用相应的加密算法对信息流进行加密处理。其中,本实施例对具体的加密处理算法不作限定。In another optional implementation manner, in order to ensure information security, a corresponding encryption algorithm may be used to encrypt the information flow. Wherein, this embodiment does not limit the specific encryption processing algorithm.

步骤S130:对信息流进行混流处理,并将混流处理后的混合信息流发送至接收终端,以供在接收终端以预设混流布局呈现混合信息流。Step S130: Perform mixed flow processing on the information flow, and send the mixed flow processed mixed information flow to the receiving terminal, so that the mixed information flow can be presented at the receiving terminal in a preset mixed flow layout.

服务器在获得各个发送终端上传的信息流之后,可对各个发送终端上传的信息流进行混流处理。其中,具体的混流处理方式可采用MCU(Multipoint Conferencing Unit)混流处理算法。本实施例在此不做赘述。After obtaining the information streams uploaded by each sending terminal, the server may perform mixing processing on the information streams uploaded by each sending terminal. The specific mixed flow processing method may use an MCU (Multipoint Conferencing Unit) mixed flow processing algorithm. This embodiment will not be repeated here.

进一步地,将混流处理后的混合信息流发送给各个接收终端。接收终端在接收到混合信息流之后继而以预设混流布局呈现该混合信息流。Further, the mixed information stream processed by the mixed stream is sent to each receiving terminal. After receiving the mixed information flow, the receiving terminal then presents the mixed information flow in a preset mixed flow layout.

在一种可选的实施方式中,接收终端在以预设混流布局呈现该混合信息流之后,接收终端用户可根据需求自由地从呈现的信息流中选择其感兴趣的单个信息流,其中,该单个信息流通常为共享流。In an optional implementation manner, after the receiving terminal presents the mixed information flow in a preset mixed flow layout, the user of the receiving terminal can freely select a single information flow of interest from the presented information flows according to requirements, wherein, This single information flow is usually a shared flow.

在接收终端用户通过预设选择操作触发单信息流获取请求之后,服务器可获取接收终端发送的单信息流获取请求;其中,单信息流获取请求由针对于接收终端中呈现的混合信息流的预设选择操作触发;并进一步地将与单信息流获取请求对应的单个信息流发送给接收终端,以供接收终端以预设单流布局呈现单个信息流;其中,预设单流布局的显示优先级高于预设混流布局的显示优先级,即呈现的单个信息流将覆盖显示的混合信息流。换言之,服务器在获取接收终端发送的单信息流获取请求之后,不仅向该接收终端继续发送混合信息流,还进一步向该接收终端发送对应的单信息流。但在该接收终端中,该单信息流覆盖显示在混合信息流之上,从而接收终端用户在视觉上仅能看到该单信息流,但可同时获取到混合信息流中的音频等信息。After the receiving terminal user triggers the single information stream acquisition request through the preset selection operation, the server may acquire the single information stream acquisition request sent by the receiving terminal; wherein, the single information stream acquisition request is determined by a pre-prepared information stream for the mixed information stream presented in the receiving terminal. Set the selection operation to be triggered; and further send the single information stream corresponding to the single information stream acquisition request to the receiving terminal, so that the receiving terminal can present the single information stream in the preset single stream layout; wherein, the display of the preset single stream layout takes precedence The display priority is higher than the preset mixed flow layout, that is, the single information flow presented will override the displayed mixed flow. In other words, after acquiring the single information stream acquisition request sent by the receiving terminal, the server not only continues to send the mixed information stream to the receiving terminal, but also further sends the corresponding single information stream to the receiving terminal. However, in the receiving terminal, the single information stream is overlaid and displayed on the mixed information stream, so that the receiving terminal user can only see the single information stream visually, but can simultaneously obtain information such as audio in the mixed information stream.

在又一种可选的实施方式中,为了提高带宽利用率,保障信息流展示质量,及提升终端用户的使用体验。本实施例可进一步地通过自适应带宽测算来控制发送端的的传输速率。在具体的实施过程中,具体是利用发送端的基于丢包率的视频码率控制及利用接收端的基于延迟的视频码率控制。其中,在利用发送端的基于丢包率的视频码率控制过程中,发送端收到来自接收端的RTCP RR报文,根据其Report Block中携带的丢包率信息,动态调整发送端码率As;在利用接收端的基于延迟的视频码率控制过程中,根据数据包到达的时间延迟,通过到达时间滤波器,估算出网络延迟,继而通过过载检测器判断当前网络的拥塞状况,最终在码率控制器根据规则计算出远端估计最大码率Ar,并将该最大码率反馈给发送端。最终发送端综合As、Ar和预配置的上下限,计算出最终的目标码率A,继而利用该目标码率控制发送端的码率。In another optional implementation manner, in order to improve bandwidth utilization, ensure the quality of information flow display, and improve the use experience of end users. In this embodiment, the transmission rate of the transmitting end can be further controlled by adaptive bandwidth measurement. In a specific implementation process, the video rate control based on the packet loss rate at the transmitting end and the delay-based video rate control at the receiving end are used. Wherein, in the process of using the video rate control process based on the packet loss rate of the sender, the sender receives the RTCP RR message from the receiver, and dynamically adjusts the sender bit rate As according to the packet loss rate information carried in its Report Block; In the process of using the delay-based video rate control at the receiving end, according to the time delay of the arrival of the data packets, the network delay is estimated through the arrival time filter, and then the current network congestion status is judged by the overload detector, and finally the rate control is performed. The controller calculates the far-end estimated maximum code rate Ar according to the rules, and feeds the maximum code rate back to the sender. Finally, the sending end integrates As, Ar and the preconfigured upper and lower limits to calculate the final target code rate A, and then uses the target code rate to control the code rate of the sending end.

在再一种可选的实施方式中,本实施例具体在私网中部分相关服务,并通过SIP服务网管等公网映射实现私网与公网互通,从而进一步保障服务的安全性。In yet another optional implementation manner, this embodiment specifically includes some related services in the private network, and realizes the intercommunication between the private network and the public network through public network mapping such as SIP service network management, thereby further ensuring the security of services.

由此可见,本实施例对发送终端通过混合通道上传的信息流进行统一的编码及混流处理,并将混流处理结果一并发送给各个接收终端。从而能够使得在同一视频会议中,多个参会方同时共享数据,提升用户体验。It can be seen that this embodiment performs unified encoding and stream mixing processing on the information stream uploaded by the sending terminal through the mixed channel, and sends the mixed stream processing result to each receiving terminal together. Therefore, in the same video conference, multiple participants can share data at the same time, thereby improving user experience.

实施例二Embodiment 2

图2示出了根据本发明实施例二提供的一种基于视频会议的信息交互方法的流程示意图。其中,本实施例所提供的基于视频会议的信息交互方法由发送终端执行。其中,本实施例中的发送终端可以为手机、电脑、智能可穿戴设备等等。本实施例对发送终端的具体类型不作限定。FIG. 2 shows a schematic flowchart of a method for information interaction based on a video conference according to Embodiment 2 of the present invention. Wherein, the video conference-based information interaction method provided in this embodiment is executed by the sending terminal. The sending terminal in this embodiment may be a mobile phone, a computer, a smart wearable device, or the like. This embodiment does not limit the specific type of the sending terminal.

如图2所示,该方法包括:As shown in Figure 2, the method includes:

步骤S210:建立与服务器之间的混合通道。Step S210: Establish a hybrid channel with the server.

可选的,发送终端在发送信息流之前,可先通过身份验证。在具体的实施过程中,发送终端向服务器发送身份验证请求,以获得认证令牌;继而建立该发送终端与服务器之间的socket通信连接。Optionally, before sending the information flow, the sending terminal may first pass identity verification. In a specific implementation process, the sending terminal sends an identity verification request to the server to obtain an authentication token; then a socket communication connection between the sending terminal and the server is established.

进一步地,发送终端与服务器之间进行SDP交互,并建立发送终端与服务器之间的混合通道。Further, SDP interaction is performed between the sending terminal and the server, and a mixed channel between the sending terminal and the server is established.

步骤S220:通过混合通道上传信息流,以供服务器对信息流进行统一编码及混流处理,并供服务器将混流处理后的混合信息流发送至接收终端。Step S220 : upload the information stream through the mixed channel, so that the server can perform unified encoding and mixed stream processing on the information stream, and the server can send the mixed information stream after the mixed stream processing to the receiving terminal.

其中,信息流包括共享流以及实时图像流。不同于现有技术中为共享流独立设置共享通道,本实施例中为各个发送终端提供一个统一的信息流传输通道,即混合通道。发送终端可通过该混合通道上传共享流及实时图像流。The information flow includes shared flow and real-time image flow. Different from the independent setting of shared channels for shared streams in the prior art, in this embodiment, each sending terminal is provided with a unified information stream transmission channel, that is, a mixed channel. The sending terminal can upload the shared stream and the real-time image stream through the mixed channel.

服务器在获取信息流之后,对信息流进行统一编码及混流处理,并将混流处理后的混合信息流发送至各个接收终端。After acquiring the information flow, the server performs unified encoding and mixed flow processing on the information flow, and sends the mixed information flow after the mixed flow processing to each receiving terminal.

由此可见,本实施例为发送终端提供混合通道,发送终端既可以通过该混合通道上传实时图像流,也可以通过该混合通道上传共享流,从而避免现有技术中各参会方需抢占共享流通道后才能共享信息的弊端,能够实现同一会议多方同时共享的效果,从而提升用户体验。It can be seen that this embodiment provides a mixed channel for the sending terminal, and the sending terminal can upload a real-time image stream through the mixed channel, and can also upload a shared stream through the mixed channel, thereby avoiding the need for each participant to preempt the sharing in the prior art The disadvantage of sharing information only after the streaming channel can achieve the effect of simultaneous sharing by multiple parties in the same conference, thereby improving the user experience.

实施例三Embodiment 3

图3示出了根据本发明实施例三提供的一种基于视频会议的信息交互方法的流程示意图。其中,本实施例所提供的基于视频会议的信息交互方法由接收终端执行。其中,本实施例中的接收终端可以为手机、电脑、智能可穿戴设备等等。本实施例对接收终端的具体类型不作限定。FIG. 3 shows a schematic flowchart of a video conference-based information interaction method according to Embodiment 3 of the present invention. Wherein, the video conference-based information interaction method provided in this embodiment is executed by the receiving terminal. The receiving terminal in this embodiment may be a mobile phone, a computer, a smart wearable device, or the like. This embodiment does not limit the specific type of the receiving terminal.

进一步地,在实际的应用场景中,由于同一终端既可以发送信息流,也可以接收信息流,从而实施例二及实施例三中的信息交互方法可以由同一终端设备执行。Further, in an actual application scenario, since the same terminal can both send and receive information streams, the information interaction methods in Embodiment 2 and Embodiment 3 can be executed by the same terminal device.

如图3所示,该方法包括:As shown in Figure 3, the method includes:

步骤S310:接收服务器发送的混合信息流;其中,混合信息流为服务器通过对发送终端由混合通道上传的信息流进行统一编码及混流处理获得的。Step S310: Receive the mixed information stream sent by the server; wherein, the mixed information stream is obtained by the server by performing unified encoding and mixed stream processing on the information stream uploaded by the sending terminal through the mixed channel.

可选的,接收终端在接收信息流之前,同样需先通过身份验证。在具体的实施过程中,可向服务器发送身份验证请求,以获得认证令牌;继而建立该接收终端与服务器之间的socket通信连接,继而执行后续步骤。Optionally, before receiving the information stream, the receiving terminal also needs to pass identity verification. In a specific implementation process, an authentication request may be sent to the server to obtain an authentication token; then a socket communication connection between the receiving terminal and the server is established, and subsequent steps are performed.

服务器通过对发送终端由混合通道上传的信息流进行统一编码及混流处理后生成混合信息流,接收终端继而接收服务器发送的混合信息流。The server generates a mixed information stream by uniformly encoding and mixing the information stream uploaded by the sending terminal through the mixed channel, and the receiving terminal then receives the mixed information stream sent by the server.

步骤S320:以预设混流布局呈现混合信息流。Step S320: Present the mixed information flow in a preset mixed flow layout.

在接收到混合信息流之后,可通过相应的混流布局呈现该混合信息流。其中,该预设混流布局可以为基于混合信息流中信息流个数的布局方式。例如,当混合信息流包含4个信息流时,可采用2行2列的布局方式在接收终端中呈现给4个信息流。其中,本实施例对具体的混流布局方式不作限定。After the mixed flow of information is received, the mixed flow of information can be presented through a corresponding mixed flow layout. The preset mixed flow layout may be a layout manner based on the number of information flows in the mixed information flow. For example, when the mixed information stream includes 4 information streams, a layout of 2 rows and 2 columns may be used to present the 4 information streams in the receiving terminal. Wherein, this embodiment does not limit the specific mixed-flow layout manner.

进一步地,在混流布局显示过程中,分别记录各个显示区域与混合信息流中各个信息流的标识之间的映射关系。如显示区域A(屏幕左上角)中显示混合信息流中的信息流X,则建立信息流X与显示区域A之间的映射关系。Further, in the process of displaying the mixed flow layout, the mapping relationship between each display area and the identifier of each information flow in the mixed information flow is recorded respectively. If the information flow X in the mixed information flow is displayed in the display area A (the upper left corner of the screen), the mapping relationship between the information flow X and the display area A is established.

接收终端的用户在观看呈现的混合信息流过程中,可以根据需求通过相应的预设选择操作来选取感兴趣的信息流。在实际的实施过程中,接收终端监测用户的预设选择操作,继而确定出用户选择的单个信息流。例如,当监测到用户点击显示页面时,定位出用户点击位置所对应的显示区域,继而根据预先记录的显示区域与信息流的标识之间的映射关系,确定出用户选择的单个信息流。继而向服务器发送针对于该信息流的单信息流获取请求。In the process of viewing the presented mixed information stream, the user of the receiving terminal may select the interested information stream through a corresponding preset selection operation according to requirements. In the actual implementation process, the receiving terminal monitors the user's preset selection operation, and then determines a single information stream selected by the user. For example, when it is detected that the user clicks on the display page, the display area corresponding to the user's click position is located, and then the single information stream selected by the user is determined according to the pre-recorded mapping relationship between the display area and the identifier of the information stream. Then, a single information flow acquisition request for the information flow is sent to the server.

服务器根据该请求中携带的信息流标识,能够快速地确定出待下发的信息流,继而将该单个信息流下发至该接收终端,可选的,在单流交互过程中,若服务器与接收终端点对点穿越失败的情形下,可利用WebRTC ICE(Interactive Connectivity Establishment:交互式连通建立方式)中的TURN协调功能,即借助于TURN服务的转发功能,即以公网的服务器作为一个中继,对来往的数据进行转发。The server can quickly determine the information flow to be delivered according to the information flow identifier carried in the request, and then deliver the single information flow to the receiving terminal. In the case of point-to-point traversal failure of the terminal, the TURN coordination function in WebRTC ICE (Interactive Connectivity Establishment) can be used, that is, the forwarding function of the TURN service is used, that is, the public network server is used as a relay. The incoming and outgoing data is forwarded.

进一步地,接收终端在接收到该单个信息流之后,以预设单流布局呈现该单个信息流。其中,由于预设单流布局的显示优先级高于预算混流布局,从而在具体实施过程中,可创建一个能够覆盖原始显示混合信息流窗口的新窗口,并在该新窗口中显示该单个信息流。从而在视觉呈现上,用户观看到的是单个信息流,但听到的是原始混合信息流的音频。Further, after receiving the single information stream, the receiving terminal presents the single information stream in a preset single-stream layout. Among them, since the display priority of the preset single-stream layout is higher than the budget mixed-stream layout, in the specific implementation process, a new window can be created that can cover the original display mixed-information flow window, and the single information can be displayed in the new window. flow. As a result, in terms of visual presentation, the user sees a single stream of information, but hears the audio of the original mixed stream of information.

当用户通过相关的关闭操作结束该单个信息流的显示后,呈现该单个信息流的窗口关闭,从而呈现出原始的混合信息流窗口,并且,服务器将不再向该终端用户发送发送该单个信息流。After the user ends the display of the single information stream through the relevant closing operation, the window presenting the single information stream is closed, thereby presenting the original mixed information stream window, and the server will no longer send the single information to the end user. flow.

由此可见,本实施例以预设混流布局方式来呈现服务器对发送终端通过混合通道上传的信息流进行统一的编码及混流处理的混合信息流,能够便于用户根据实际需求选择感兴趣的共享流,从而提升用户体验。It can be seen that this embodiment uses a preset mixed flow layout to present the mixed information flow that the server performs unified encoding and mixed flow processing on the information flow uploaded by the sending terminal through the mixed channel, which can facilitate the user to select the interested shared flow according to actual needs. , so as to improve the user experience.

实施例四Embodiment 4

图4示出了根据本发明实施例四提供的一种基于视频会议的信息交互方法的流程示意图。其中,本实施例所提供的信息交互方法具体为服务器、接收终端及发送终端之间的信息交互。FIG. 4 shows a schematic flowchart of a video conference-based information interaction method according to Embodiment 4 of the present invention. The information interaction method provided in this embodiment is specifically information interaction among a server, a receiving terminal, and a sending terminal.

具体地,本方法包括以下步骤:Specifically, the method includes the following steps:

步骤S410:发送终端通过混合通道向服务器上传信息流。Step S410: The sending terminal uploads the information flow to the server through the mixed channel.

步骤S420:服务器对信息流进行统一编码,为每个信息流分配对应的标识,并对信息流进行混流处理。Step S420: The server performs unified encoding on the information streams, assigns a corresponding identifier to each information stream, and performs mixed stream processing on the information streams.

步骤S430:服务器将混流处理后的混合信息流发送至接收终端。Step S430: The server sends the mixed information stream processed by the mixed stream to the receiving terminal.

步骤S440:接收终端以预设混流布局呈现混合信息流,并根据监测到的针对呈现的混合信息流的预设选择操作,确定选择的单信息流。Step S440: The receiving terminal presents the mixed information flow in a preset mixed flow layout, and determines the selected single information flow according to the monitored preset selection operation for the presented mixed information flow.

步骤S450:接收终端向服务器发送单信息流获取请求。Step S450: The receiving terminal sends a request for obtaining a single information stream to the server.

步骤S460:服务器根据单信息流获取请求向接收终端下发该单个信息流。Step S460: The server delivers the single information flow to the receiving terminal according to the single information flow acquisition request.

步骤S470:接收终端以预设单流布局呈现该单个信息流。Step S470: The receiving terminal presents the single information stream in a preset single-stream layout.

其中,本实施例中服务器、接收终端及发送终端之间的信息交互可通过WebRTC协议。Wherein, in this embodiment, the information interaction among the server, the receiving terminal, and the sending terminal may use the WebRTC protocol.

本实施例中各步骤的具体执行过程可参照实施例一至实施例三中相应部分的描述,本实施例在此不做赘述。For the specific execution process of each step in this embodiment, reference may be made to the descriptions of the corresponding parts in Embodiment 1 to Embodiment 3, which will not be repeated in this embodiment.

由此可见,本实施例为发送终端提供混合通道,发送终端既可以通过该混合通道上传实时图像流,也可以通过该混合通道上传共享流,并通过服务器来对信息流进行统一编码及混流处理,从而避免现有技术中各参会方需抢占共享流通道后才能共享信息的弊端,实现同一会议可多方同时共享;并且能够便于用户根据实际需求选择感兴趣的共享流,从而提升用户体验;并且,实施过程简单易行,各终端可即插即用,从而大幅提升用户体验。It can be seen that this embodiment provides a mixed channel for the sending terminal, and the sending terminal can upload a real-time image stream through the mixed channel, or upload a shared stream through the mixed channel, and perform unified encoding and mixed stream processing on the information stream through the server. , so as to avoid the disadvantage in the prior art that each participant needs to preempt the shared stream channel before sharing information, so that the same conference can be shared by multiple parties at the same time; and it is convenient for the user to select the shared stream of interest according to the actual needs, thereby improving the user experience; In addition, the implementation process is simple and easy to implement, and each terminal can be plugged and played, thereby greatly improving the user experience.

实施例五Embodiment 5

图5示出了根据本发明实施例五提供的一种服务器的功能结构示意图。如图5所示,该服务器包括:获取模块51、编码模块52、混流处理模块53、以及发送模块54。FIG. 5 shows a schematic functional structure diagram of a server according to Embodiment 5 of the present invention. As shown in FIG. 5 , the server includes: an acquisition module 51 , an encoding module 52 , a stream mixing processing module 53 , and a sending module 54 .

获取模块51,适于获取发送终端通过混合通道上传的信息流;其中,所述信息流包括共享流以及实时图像流;The acquisition module 51 is adapted to acquire the information stream uploaded by the sending terminal through the mixed channel; wherein, the information stream includes a shared stream and a real-time image stream;

编码模块52,适于对所述信息流进行统一编码,为每个信息流分配对应的标识;an encoding module 52, adapted to uniformly encode the information stream, and assign a corresponding identifier to each information stream;

混流处理模块53,适于对所述信息流进行混流处理;a mixed flow processing module 53, adapted to perform mixed flow processing on the information flow;

发送模块54,适于将混流处理后的混合信息流发送至接收终端,以供在所述接收终端以预设混流布局呈现所述混合信息流。The sending module 54 is adapted to send the mixed information stream processed by the mixed flow to the receiving terminal, so that the receiving terminal can present the mixed information flow in a preset mixed flow layout.

可选的,所述为每个信息流分配对应的标识中包含:用户标识字段和/或信息流类型字段。Optionally, the corresponding identifier assigned to each information stream includes: a user identifier field and/or an information stream type field.

可选的,所述获取模块还适于:获取接收终端发送的单信息流获取请求;其中,所述单信息流获取请求由针对于接收终端中呈现的混合信息流的预设选择操作触发;Optionally, the obtaining module is further adapted to: obtain a single information stream obtaining request sent by the receiving terminal; wherein the single information stream obtaining request is triggered by a preset selection operation for the mixed information stream presented in the receiving terminal;

所述发送模块进一步适于:将与所述单信息流获取请求对应的单个信息流发送给接收终端,以供接收终端以预设单流布局呈现所述单个信息流;其中,预设单流布局的显示优先级高于预设混流布局的显示优先级。The sending module is further adapted to: send a single information stream corresponding to the single information stream acquisition request to the receiving terminal, so that the receiving terminal can present the single information stream in a preset single stream layout; wherein the preset single stream The display priority of the layout is higher than that of the preset muxed layout.

其中,本实施例中服务器各模块的具体实施过程可参照方法实施例中相应部分的描述,本实施例在此不做赘述。For the specific implementation process of each module of the server in this embodiment, reference may be made to the description of the corresponding part in the method embodiment, which is not repeated in this embodiment.

由此可见,本实施例为发送终端提供混合通道,发送终端既可以通过该混合通道上传实时图像流,也可以通过该混合通道上传共享流,从而避免现有技术中各参会方需抢占共享流通道后才能共享信息的弊端,能够实现同一会议多方同时共享的效果,从而提升用户体验。It can be seen that this embodiment provides a mixed channel for the sending terminal, and the sending terminal can upload a real-time image stream through the mixed channel, and can also upload a shared stream through the mixed channel, thereby avoiding the need for each participant to preempt the sharing in the prior art The disadvantage of sharing information only after the streaming channel can achieve the effect of simultaneous sharing by multiple parties in the same conference, thereby improving the user experience.

实施例六Embodiment 6

图6示出了根据本发明实施例六提供的一种终端设备的功能结构示意图。其中,该终端设备具体为发送终端。如图6所示,该发送终端包括:通道建立模块61及上传模块62。FIG. 6 shows a schematic functional structure diagram of a terminal device according to Embodiment 6 of the present invention. The terminal device is specifically a sending terminal. As shown in FIG. 6 , the sending terminal includes: a channel establishing module 61 and an uploading module 62 .

通道建立模块61,适于建立与服务器之间的混合通道;A channel establishment module 61, adapted to establish a mixed channel with the server;

上传模块62,适于通过混合通道上传信息流,以供服务器对信息流进行统一编码及混流处理,并供服务器将混流处理后的混合信息流发送至接收终端;其中,所述信息流包括共享流以及实时图像流。The uploading module 62 is adapted to upload the information flow through the mixed channel, so that the server can perform unified encoding and mixed flow processing on the information flow, and for the server to send the mixed information flow after the mixed flow processing to the receiving terminal; wherein, the information flow includes sharing streaming as well as live image streaming.

其中,本实施例中服务器各模块的具体实施过程可参照方法实施例中相应部分的描述,本实施例在此不做赘述。For the specific implementation process of each module of the server in this embodiment, reference may be made to the description of the corresponding part in the method embodiment, which is not repeated in this embodiment.

由此可见,本实施例为发送终端提供混合通道,发送终端既可以通过该混合通道上传实时图像流,也可以通过该混合通道上传共享流,从而避免现有技术中各参会方需抢占共享流通道后才能共享信息的弊端,能够实现同一会议多方同时共享的效果,从而提升用户体验。It can be seen that this embodiment provides a mixed channel for the sending terminal, and the sending terminal can upload a real-time image stream through the mixed channel, and can also upload a shared stream through the mixed channel, thereby avoiding the need for each participant to preempt the sharing in the prior art The disadvantage of sharing information only after the streaming channel can achieve the effect of simultaneous sharing by multiple parties in the same conference, thereby improving the user experience.

实施例七Embodiment 7

图7示出了根据本发明实施例七提供的一种终端设备的功能结构示意图。其中,该终端设备具体为接收终端。如图7所示,该接收终端包括:接收模块71及呈现模块72。FIG. 7 shows a schematic functional structure diagram of a terminal device according to Embodiment 7 of the present invention. The terminal device is specifically a receiving terminal. As shown in FIG. 7 , the receiving terminal includes: a receiving module 71 and a presenting module 72 .

接收模块71,适于接收服务器发送的混合信息流;其中,所述混合信息流为服务器通过对发送终端由混合通道上传的信息流进行统一编码及混流处理获得的;The receiving module 71 is adapted to receive the mixed information stream sent by the server; wherein, the mixed information stream is obtained by the server by performing unified encoding and mixed stream processing on the information stream uploaded by the sending terminal through the mixed channel;

呈现模块72,适于以预设混流布局呈现所述混合信息流。The presentation module 72 is adapted to present the mixed information flow in a preset mixed flow layout.

其中,本实施例中服务器各模块的具体实施过程可参照方法实施例中相应部分的描述,本实施例在此不做赘述。For the specific implementation process of each module of the server in this embodiment, reference may be made to the description of the corresponding part in the method embodiment, which is not repeated in this embodiment.

由此可见,本实施例以预设混流布局方式来呈现服务器对发送终端通过混合通道上传的信息流进行统一的编码及混流处理的混合信息流,能够便于用户根据实际需求选择感兴趣的共享流,从而提升用户体验。It can be seen that this embodiment uses a preset mixed flow layout to present the mixed information flow that the server performs unified encoding and mixed flow processing on the information flow uploaded by the sending terminal through the mixed channel, which can facilitate the user to select the shared flow of interest according to actual needs. , so as to improve the user experience.

实施例八Embodiment 8

图8示出了根据本发明实施例八提供的一种信息交互系统的功能结构示意图。其中,该系统包括服务器81、发送终端82及接收终端83。FIG. 8 shows a schematic functional structure diagram of an information interaction system according to Embodiment 8 of the present invention. The system includes a server 81 , a sending terminal 82 and a receiving terminal 83 .

本实施例为发送终端提供混合通道,发送终端既可以通过该混合通道上传实时图像流,也可以通过该混合通道上传共享流,并通过服务器来对信息流进行统一编码及混流处理,从而避免现有技术中各参会方需抢占共享流通道后才能共享信息的弊端,实现同一会议可多方同时共享;并且能够便于用户根据实际需求选择感兴趣的共享流,从而提升用户体验。This embodiment provides a mixed channel for the sending terminal. The sending terminal can upload a real-time image stream through the mixed channel, or upload a shared stream through the mixed channel, and perform unified encoding and mixed stream processing on the information stream through the server, so as to avoid the current situation. In the prior art, each participant needs to preempt the shared stream channel before sharing information, so that the same conference can be shared by multiple parties at the same time; and it is convenient for the user to select the shared stream of interest according to the actual needs, thereby improving the user experience.

实施例九Embodiment 9

根据本发明实施例九提供了一种非易失性计算机存储介质,所述计算机存储介质存储有至少一可执行指令,该计算机可执行指令可执行上述任意方法实施例中的方法。According to the ninth embodiment of the present invention, a non-volatile computer storage medium is provided, where the computer storage medium stores at least one executable instruction, and the computer-executable instruction can execute the method in any of the foregoing method embodiments.

具体地,可执行指令可执行如下操作:Specifically, the executable instructions can perform the following operations:

获取发送终端通过混合通道上传的信息流;其中,所述信息流包括共享流以及实时图像流;Acquire the information stream uploaded by the sending terminal through the mixed channel; wherein, the information stream includes a shared stream and a real-time image stream;

对所述信息流进行统一编码,为每个信息流分配对应的标识;The information flow is uniformly encoded, and a corresponding identification is allocated for each information flow;

对所述信息流进行混流处理,并将混流处理后的混合信息流发送至接收终端,以供在所述接收终端以预设混流布局呈现所述混合信息流。Mixing processing is performed on the information flow, and the mixed information flow after the mixing processing is sent to the receiving terminal, so that the receiving terminal can present the mixed information flow in a preset mixing layout.

在一种可选的实施方式中,所述为每个信息流分配对应的标识中包含:用户标识字段和/或信息流类型字段。In an optional implementation manner, the corresponding identification assigned to each information flow includes: a user identification field and/or an information flow type field.

在一种可选的实施方式中,可执行指令可执行如下操作:In an optional implementation, the executable instructions may perform the following operations:

获取接收终端发送的单信息流获取请求;其中,所述单信息流获取请求由针对于接收终端中呈现的混合信息流的预设选择操作触发;acquiring a single information stream acquisition request sent by the receiving terminal; wherein the single information stream acquisition request is triggered by a preset selection operation for a mixed information stream presented in the receiving terminal;

将与所述单信息流获取请求对应的单个信息流发送给接收终端,以供接收终端以预设单流布局呈现所述单个信息流;其中,预设单流布局的显示优先级高于预设混流布局的显示优先级。Send the single information stream corresponding to the single information stream acquisition request to the receiving terminal, so that the receiving terminal presents the single information stream in a preset single stream layout; wherein, the display priority of the preset single stream layout is higher than the preset single stream layout. Set the display priority of the mixed flow layout.

在一种可选的实施方式中,可执行指令可执行如下操作:In an optional implementation, the executable instructions may perform the following operations:

建立与服务器之间的混合通道;Establish a hybrid channel with the server;

通过混合通道上传信息流,以供服务器对信息流进行统一编码及混流处理,并供服务器将混流处理后的混合信息流发送至接收终端;The information stream is uploaded through the mixed channel, so that the server can perform unified encoding and mixed stream processing on the information stream, and the server can send the mixed information stream after the mixed stream processing to the receiving terminal;

其中,所述信息流包括共享流以及实时图像流。Wherein, the information flow includes a shared flow and a real-time image flow.

在一种可选的实施方式中,可执行指令可执行如下操作:In an optional implementation, the executable instructions may perform the following operations:

接收服务器发送的混合信息流;其中,所述混合信息流为服务器通过对发送终端由混合通道上传的信息流进行统一编码及混流处理获得的;Receive the mixed information stream sent by the server; wherein, the mixed information stream is obtained by the server by performing unified encoding and mixed stream processing on the information stream uploaded by the sending terminal through the mixed channel;

以预设混流布局呈现所述混合信息流。The mixed information flow is presented in a preset mixed flow layout.

本实施例为发送终端提供混合通道,发送终端既可以通过该混合通道上传实时图像流,也可以通过该混合通道上传共享流,并通过服务器来对信息流进行统一编码及混流处理,从而避免现有技术中各参会方需抢占共享流通道后才能共享信息的弊端,实现同一会议可多方同时共享;并且能够便于用户根据实际需求选择感兴趣的共享流,从而提升用户体验。This embodiment provides a mixed channel for the sending terminal. The sending terminal can upload a real-time image stream through the mixed channel, or upload a shared stream through the mixed channel, and perform unified encoding and mixed stream processing on the information stream through the server, so as to avoid the current situation. In the prior art, each participant needs to preempt the shared stream channel before sharing information, so that the same conference can be shared by multiple parties at the same time; and it is convenient for the user to select the shared stream of interest according to the actual needs, thereby improving the user experience.

实施例十Embodiment ten

图9示出了根据本发明实施例十提供的一种计算设备的结构示意图,本发明具体实施例并不对计算设备的具体实现做限定。FIG. 9 shows a schematic structural diagram of a computing device according to Embodiment 10 of the present invention. The specific embodiment of the present invention does not limit the specific implementation of the computing device.

如图9所示,该计算设备可以包括:处理器(processor)902、通信接口(Communications Interface)904、存储器(memory)906、以及通信总线908。As shown in FIG. 9 , the computing device may include: a processor (processor) 902 , a communications interface (Communications Interface) 904 , a memory (memory) 906 , and a communication bus 908 .

其中:处理器902、通信接口904、以及存储器906通过通信总线908完成相互间的通信。通信接口904,用于与其它设备比如客户端或其它服务器等的网元通信。处理器902,用于执行程序910,具体可以执行上述任一方法实施例中的相关步骤。The processor 902 , the communication interface 904 , and the memory 906 communicate with each other through the communication bus 908 . The communication interface 904 is used to communicate with network elements of other devices such as clients or other servers. The processor 902 is configured to execute the program 910, and specifically may execute the relevant steps in any of the foregoing method embodiments.

具体地,程序910可以包括程序代码,该程序代码包括计算机操作指令。Specifically, the program 910 may include program code including computer operation instructions.

处理器902可能是中央处理器CPU,或者是特定集成电路ASIC(ApplicationSpecific Integrated Circuit),或者是被配置成实施本发明实施例的一个或多个集成电路。计算设备包括的一个或多个处理器,可以是同一类型的处理器,如一个或多个CPU;也可以是不同类型的处理器,如一个或多个CPU以及一个或多个ASIC。The processor 902 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors included in the computing device may be the same type of processors, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.

存储器906,用于存放程序910。存储器906可能包含高速RAM存储器,也可能还包括非易失性存储器(non-volatile memory),例如至少一个磁盘存储器。The memory 906 is used to store the program 910 . Memory 906 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.

程序910具体可以用于使得处理器902执行以下操作:The program 910 can specifically be used to cause the processor 902 to perform the following operations:

获取发送终端通过混合通道上传的信息流;其中,所述信息流包括共享流以及实时图像流;Acquire the information stream uploaded by the sending terminal through the mixed channel; wherein, the information stream includes a shared stream and a real-time image stream;

对所述信息流进行统一编码,为每个信息流分配对应的标识;The information flow is uniformly encoded, and a corresponding identification is allocated for each information flow;

对所述信息流进行混流处理,并将混流处理后的混合信息流发送至接收终端,以供在所述接收终端以预设混流布局呈现所述混合信息流。Mixing processing is performed on the information flow, and the mixed information flow after the mixing processing is sent to the receiving terminal, so that the receiving terminal can present the mixed information flow in a preset mixing layout.

在一种可选的实施方式中,所述为每个信息流分配对应的标识中包含:用户标识字段和/或信息流类型字段。In an optional implementation manner, the corresponding identification assigned to each information flow includes: a user identification field and/or an information flow type field.

在一种可选的实施方式中,程序910具体可以用于使得处理器902执行以下操作:In an optional implementation manner, the program 910 may specifically be used to cause the processor 902 to perform the following operations:

获取接收终端发送的单信息流获取请求;其中,所述单信息流获取请求由针对于接收终端中呈现的混合信息流的预设选择操作触发;acquiring a single information stream acquisition request sent by the receiving terminal; wherein the single information stream acquisition request is triggered by a preset selection operation for a mixed information stream presented in the receiving terminal;

将与所述单信息流获取请求对应的单个信息流发送给接收终端,以供接收终端以预设单流布局呈现所述单个信息流;其中,预设单流布局的显示优先级高于预设混流布局的显示优先级。Send the single information stream corresponding to the single information stream acquisition request to the receiving terminal, so that the receiving terminal presents the single information stream in a preset single stream layout; wherein, the display priority of the preset single stream layout is higher than the preset single stream layout. Set the display priority of the mixed flow layout.

在一种可选的实施方式中,程序910具体可以用于使得处理器902执行以下操作:In an optional implementation manner, the program 910 may specifically be used to cause the processor 902 to perform the following operations:

建立与服务器之间的混合通道;Establish a hybrid channel with the server;

通过混合通道上传信息流,以供服务器对信息流进行统一编码及混流处理,并供服务器将混流处理后的混合信息流发送至接收终端;The information stream is uploaded through the mixed channel, so that the server can perform unified encoding and mixed stream processing on the information stream, and the server can send the mixed information stream after the mixed stream processing to the receiving terminal;

其中,所述信息流包括共享流以及实时图像流。Wherein, the information flow includes a shared flow and a real-time image flow.

在一种可选的实施方式中,程序910具体可以用于使得处理器902执行以下操作:In an optional implementation manner, the program 910 may specifically be used to cause the processor 902 to perform the following operations:

接收服务器发送的混合信息流;其中,所述混合信息流为服务器通过对发送终端由混合通道上传的信息流进行统一编码及混流处理获得的;Receive the mixed information stream sent by the server; wherein, the mixed information stream is obtained by the server by performing unified encoding and mixed stream processing on the information stream uploaded by the sending terminal through the mixed channel;

以预设混流布局呈现所述混合信息流。The mixed information flow is presented in a preset mixed flow layout.

本实施例为发送终端提供混合通道,发送终端既可以通过该混合通道上传实时图像流,也可以通过该混合通道上传共享流,并通过服务器来对信息流进行统一编码及混流处理,从而避免现有技术中各参会方需抢占共享流通道后才能共享信息的弊端,实现同一会议可多方同时共享;并且能够便于用户根据实际需求选择感兴趣的共享流,从而提升用户体验。This embodiment provides a mixed channel for the sending terminal. The sending terminal can upload a real-time image stream through the mixed channel, or upload a shared stream through the mixed channel, and perform unified encoding and mixed stream processing on the information stream through the server, so as to avoid the current situation. In the prior art, each participant needs to preempt the shared stream channel before sharing information, so that the same conference can be shared by multiple parties at the same time; and it is convenient for the user to select the shared stream of interest according to the actual needs, thereby improving the user experience.

在此提供的算法或显示不与任何特定计算机、虚拟系统或者其它设备固有相关。各种通用系统也可以与基于在此的示教一起使用。根据上面的描述,构造这类系统所要求的结构是显而易见的。此外,本发明实施例也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本发明的内容,并且上面对特定语言所做的描述是为了披露本发明的最佳实施方式。The algorithms or displays provided herein are not inherently related to any particular computer, virtual system, or other device. Various general-purpose systems can also be used with teaching based on this. The structure required to construct such a system is apparent from the above description. Furthermore, embodiments of the present invention are not directed to any particular programming language. It is to be understood that various programming languages may be used to implement the inventions described herein, and that the descriptions of specific languages above are intended to disclose the best mode for carrying out the invention.

在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. It will be understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

类似地,应当理解,为了精简本发明并帮助理解各个发明方面中的一个或多个,在上面对本发明的示例性实施例的描述中,本发明实施例的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本发明要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如下面的权利要求书所反映的那样,发明方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本发明的单独实施例。Similarly, it is to be understood that, in the above description of exemplary embodiments of the invention, various features of the embodiments of the invention are sometimes grouped together into a single implementation in order to simplify the invention and to aid in the understanding of one or more of the various aspects of the invention. examples, figures, or descriptions thereof. This disclosure, however, should not be construed as reflecting an intention that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art will understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and further they may be divided into multiple sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination unless at least some of such features and/or procedures or elements are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

此外,本领域的技术人员能够理解,尽管在此的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如,在下面的权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, it will be understood by those skilled in the art that although some of the embodiments herein include certain features, but not others, included in other embodiments, that combinations of features of the different embodiments are intended to be within the scope of the present invention And form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

本发明的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。Various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components according to the embodiments of the present invention. The present invention can also be implemented as apparatus or apparatus programs (eg, computer programs and computer program products) for performing part or all of the methods described herein. Such a program implementing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.

应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。上述实施例中的步骤,除有特殊说明外,不应理解为对执行顺序的限定。It should be noted that the above-described embodiments illustrate rather than limit the invention, and that alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names. The steps in the above embodiments should not be construed as limitations on the execution order unless otherwise specified.

Claims (10)

1. An information interaction method based on video conference, characterized in that the method is executed on a server side, and the method comprises:
acquiring an information stream uploaded by a sending terminal through a mixed channel; wherein the information stream comprises a shared stream and a real-time image stream;
uniformly coding the information streams, and distributing corresponding identifiers for each information stream;
and carrying out mixed flow treatment on the information flow, and sending the mixed information flow after the mixed flow treatment to a receiving terminal so as to present the mixed information flow in a preset mixed flow layout at the receiving terminal.
2. The method of claim 1, wherein assigning a corresponding identifier to each information stream comprises: a user identification field and/or an information flow type field.
3. The method of claim 1, further comprising:
acquiring a single information flow acquisition request sent by a receiving terminal; the single information flow acquisition request is triggered by a preset selection operation aiming at the mixed information flow presented in the receiving terminal;
sending a single information stream corresponding to the single information stream acquisition request to a receiving terminal so that the receiving terminal presents the single information stream in a preset single stream layout; the display priority of the preset single-flow layout is higher than that of the preset mixed-flow layout.
4. An information interaction method based on video conference, characterized in that the method is executed at the side of a sending terminal, and the method comprises:
establishing a mixing channel with a server;
uploading the information flow through the mixing channel, so that the server can uniformly encode and mix the information flow, and the server can send the mixed information flow after mixing processing to a receiving terminal;
wherein the information stream comprises a shared stream and a real-time image stream.
5. An information interaction method based on video conference, characterized in that the method is executed at a receiving terminal side, and the method comprises:
receiving a mixed information stream sent by a server; the mixed information stream is obtained by uniformly coding and mixing the information stream uploaded by the mixed channel from the sending terminal by the server;
and presenting the mixed information flow in a preset mixed flow layout.
6. A server, comprising:
the acquisition module is suitable for acquiring the information flow uploaded by the sending terminal through the mixed channel; wherein the information stream comprises a shared stream and a real-time image stream;
the coding module is suitable for uniformly coding the information streams and distributing corresponding identification to each information stream;
the mixed flow processing module is suitable for carrying out mixed flow processing on the information flow;
and the sending module is suitable for sending the mixed information flow after mixed flow treatment to a receiving terminal so as to present the mixed information flow in a preset mixed flow layout at the receiving terminal.
7. A terminal device, comprising:
the channel establishing module is suitable for establishing a mixed channel with the server;
the uploading module is suitable for uploading the information flow through the mixing channel so that the server can uniformly encode and mix the information flow, and the server can send the mixed information flow after the mix-flow processing to the receiving terminal;
wherein the information stream comprises a shared stream and a real-time image stream.
8. A terminal device, comprising:
the receiving module is suitable for receiving the mixed information stream sent by the server; the mixed information stream is obtained by uniformly coding and mixing the information stream uploaded by the mixed channel from the sending terminal by the server;
a presentation module adapted to present the mixed information stream in a preset mixed flow layout.
9. A computing device, comprising: the system comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus;
the memory is used for storing at least one executable instruction, and the executable instruction causes the processor to execute the operation corresponding to the information interaction method based on the video conference in any one of claims 1-5.
10. A computer storage medium having at least one executable instruction stored therein, the executable instruction causing a processor to perform operations corresponding to the information interaction method based on video conference according to any one of claims 1-5.
CN202011118608.6A 2020-10-19 2020-10-19 Information interaction method based on video conference, server and terminal equipment Pending CN114374816A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011118608.6A CN114374816A (en) 2020-10-19 2020-10-19 Information interaction method based on video conference, server and terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011118608.6A CN114374816A (en) 2020-10-19 2020-10-19 Information interaction method based on video conference, server and terminal equipment

Publications (1)

Publication Number Publication Date
CN114374816A true CN114374816A (en) 2022-04-19

Family

ID=81137844

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011118608.6A Pending CN114374816A (en) 2020-10-19 2020-10-19 Information interaction method based on video conference, server and terminal equipment

Country Status (1)

Country Link
CN (1) CN114374816A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115499619A (en) * 2022-09-15 2022-12-20 维沃移动通信有限公司 Image transmission method and device, electronic equipment and readable storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101083576A (en) * 2006-05-29 2007-12-05 腾讯科技(深圳)有限公司 Point-to-point data transmission method and system
KR20100062559A (en) * 2008-12-02 2010-06-10 에스케이 텔레콤주식회사 System for video call service and method thereof
CN102883135A (en) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 Screen sharing and control method thereof
CN103517029A (en) * 2012-06-26 2014-01-15 华为技术有限公司 Data processing method of video call, terminal and system
CN105453557A (en) * 2013-08-15 2016-03-30 阿尔卡特朗讯公司 A method for generating an immersive video of a plurality of persons
CN110798652A (en) * 2019-10-17 2020-02-14 广州国音智能科技有限公司 Control method, terminal, device and readable storage medium for shared screen
CN110875914A (en) * 2018-09-03 2020-03-10 中国移动通信有限公司研究院 A method and device for transmitting messages based on a shared session link

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101083576A (en) * 2006-05-29 2007-12-05 腾讯科技(深圳)有限公司 Point-to-point data transmission method and system
KR20100062559A (en) * 2008-12-02 2010-06-10 에스케이 텔레콤주식회사 System for video call service and method thereof
CN103517029A (en) * 2012-06-26 2014-01-15 华为技术有限公司 Data processing method of video call, terminal and system
CN102883135A (en) * 2012-11-01 2013-01-16 成都飞视美视频技术有限公司 Screen sharing and control method thereof
CN105453557A (en) * 2013-08-15 2016-03-30 阿尔卡特朗讯公司 A method for generating an immersive video of a plurality of persons
CN110875914A (en) * 2018-09-03 2020-03-10 中国移动通信有限公司研究院 A method and device for transmitting messages based on a shared session link
CN110798652A (en) * 2019-10-17 2020-02-14 广州国音智能科技有限公司 Control method, terminal, device and readable storage medium for shared screen

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115499619A (en) * 2022-09-15 2022-12-20 维沃移动通信有限公司 Image transmission method and device, electronic equipment and readable storage medium

Similar Documents

Publication Publication Date Title
CN104754284B (en) A kind of live broadcast of video conference method, equipment and system
CN105763832B (en) A kind of video interactive, control method and device
US10893080B2 (en) Relaying multimedia conferencing utilizing software defined networking architecture
US8830294B2 (en) Method and system for video conference control, videoconferencing network equipment, and videoconferencing site
US8689313B2 (en) Real time streaming data communications through a security device
CN104580995B (en) A kind of means of communication and device for video conference
US11489891B2 (en) Virtual video driver bridge system for multi-source collaboration within a web conferencing system
CN101641936B (en) Media stream setup in a group communication system
US20150188928A1 (en) Private-public chat functionality
CN110475094B (en) Video conference processing method, device and readable storage medium
CN103647921A (en) Method and apparatus for the efficient transmission of multimedia streams for teleconferencing
US9560096B2 (en) Local media rendering
WO2011088656A1 (en) Method and system for implementing three-party call of videophone by mobile terminals
CN105472306A (en) Video conference data sharing method and related device
WO2016082577A1 (en) Video conference processing method and device
CN105763831A (en) Method of realizing video conference, apparatus and system thereof
US9270937B2 (en) Real time stream provisioning infrastructure
CN104902111A (en) Web RTC-based method, equipment and system for establishing multi party call
CN110943977A (en) Multimedia service data transmission method, server, equipment and storage medium
US9264662B2 (en) Chat preauthorization
WO2014177082A1 (en) Video conference video processing method and terminal
CN107181926A (en) A kind of communication means, device and server
CN114338625B (en) Real-time communication method, device, equipment and storage medium
CN114374816A (en) Information interaction method based on video conference, server and terminal equipment
US20170201720A1 (en) Media Control Method and Device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination