CN118921436A - Video conference processing method and system, electronic equipment and storage medium - Google Patents
Video conference processing method and system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN118921436A CN118921436A CN202411152682.8A CN202411152682A CN118921436A CN 118921436 A CN118921436 A CN 118921436A CN 202411152682 A CN202411152682 A CN 202411152682A CN 118921436 A CN118921436 A CN 118921436A
- Authority
- CN
- China
- Prior art keywords
- terminal
- encrypted
- audio
- encryption
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims description 8
- 238000000034 method Methods 0.000 claims abstract description 71
- 238000012545 processing Methods 0.000 claims abstract description 60
- 230000005540 biological transmission Effects 0.000 claims abstract description 56
- 238000006243 chemical reaction Methods 0.000 claims description 28
- 238000004590 computer program Methods 0.000 claims description 9
- 238000007726 management method Methods 0.000 description 46
- 230000008569 process Effects 0.000 description 32
- 230000006870 function Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 12
- 230000000007 visual effect Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000001934 delay Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 1
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 1
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/157—Conference systems defining a virtual conference space and using avatars or agents
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
- H04L63/045—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload wherein the sending and receiving network entities apply hybrid encryption, i.e. combination of symmetric and asymmetric encryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
- H04L65/4038—Arrangements for multi-party communication, e.g. for conferences with floor control
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
技术领域Technical Field
本发明涉及视频会议技术领域,特别是涉及一种视频会议的处理方法、一种视频会议的处理系统以及一种电子设备和一种计算机可读存储介质。The present invention relates to the technical field of video conferencing, and in particular to a method for processing a video conferencing, a system for processing a video conferencing, an electronic device, and a computer-readable storage medium.
背景技术Background Art
在现代视频会议系统中,数据传输的安全性和保密性是至关重要的因素。因此,越来越多的视频会议系统开始采用加密技术,以确保会议内容在传输过程中不会被窃听或篡改。然而,在实际应用中,视频会议系统往往会混合使用加密终端和非加密终端。其中,加密终端可以通过加密算法对音视频流进行加密处理,以防止未经授权的用户访问会议内容。非加密终端由于缺乏解密功能,无法直接解码加密终端发出的音视频流。因此,在混合使用加密终端和非加密终端的会议环境中,非加密终端的用户无法观看或听取来自加密终端的音视频内容,这就限制了其在会议中的参与能力。In modern video conferencing systems, the security and confidentiality of data transmission are crucial factors. Therefore, more and more video conferencing systems have begun to adopt encryption technology to ensure that the content of the meeting will not be eavesdropped or tampered with during transmission. However, in actual applications, video conferencing systems often use a mixture of encrypted terminals and non-encrypted terminals. Among them, the encrypted terminal can encrypt the audio and video streams through an encryption algorithm to prevent unauthorized users from accessing the conference content. The non-encrypted terminal cannot directly decode the audio and video streams sent by the encrypted terminal due to the lack of decryption function. Therefore, in a conference environment where encrypted terminals and non-encrypted terminals are mixed, users of non-encrypted terminals cannot watch or hear the audio and video content from the encrypted terminals, which limits their ability to participate in the meeting.
为了解决这一问题,当前的一种解决方案是使用一个加密终端(以下简称“A终端”)解码加密后的音视频流,然后将解码后的音视频信号作为另一个非加密终端(以下简称“B终端”)的输入源。通过这种方式,B终端可以参与会议并传递解码后的音视频流给其他非加密终端。然而,这种方法存在以下几个显著问题:To solve this problem, a current solution is to use an encrypted terminal (hereinafter referred to as "terminal A") to decode the encrypted audio and video stream, and then use the decoded audio and video signal as the input source of another non-encrypted terminal (hereinafter referred to as "terminal B"). In this way, terminal B can participate in the conference and pass the decoded audio and video stream to other non-encrypted terminals. However, this method has the following significant problems:
1.延时问题:由于需要通过A终端进行解码和转发,音视频流的传输会引入较大的延时。这种延时可能会对会议的实时性和交互性产生负面影响,尤其是在需要即时反应的场景下,可能导致会议体验的显著下降。1. Delay problem: Since the audio and video streams need to be decoded and forwarded through terminal A, the transmission will introduce a large delay. This delay may have a negative impact on the real-time and interactivity of the meeting, especially in scenarios that require immediate response, which may lead to a significant decline in the meeting experience.
2.操作复杂:为了实现上述功能,通常需要同时开启两场会议——一场由A终端解码加密音视频流,另一场由B终端作为输入源转发解码后的音视频流。这不仅增加了操作的复杂性,还需要多个终端之间的密切配合和协调,给会议组织者和参与者带来了额外的负担。2. Complex operation: In order to achieve the above functions, two conferences usually need to be started at the same time - one for terminal A to decode the encrypted audio and video stream, and the other for terminal B to forward the decoded audio and video stream as the input source. This not only increases the complexity of the operation, but also requires close cooperation and coordination between multiple terminals, which brings additional burdens to conference organizers and participants.
3.管理困难:由于B终端参与的会议与A终端所在的会议是两个独立的会议,这意味着两个会议之间的协同操作难度增加。例如,操作人员可能需要在两个不同的会议界面之间频繁切换,以确保音视频内容的正常转发和接收,这给操作带来了诸多不便。3. Difficult management: Since the conference in which terminal B participates is independent of the conference in which terminal A is participating, the coordination between the two conferences becomes more difficult. For example, operators may need to frequently switch between two different conference interfaces to ensure the normal forwarding and reception of audio and video content, which brings a lot of inconvenience to the operation.
综上所述,现有的解决方案在混合使用加密终端和非加密终端的会议场景中存在明显的不足。In summary, existing solutions have obvious deficiencies in conference scenarios where encrypted terminals and non-encrypted terminals are mixed.
发明内容Summary of the invention
鉴于上述问题,提出了本发明实施例以便提供一种克服上述问题或者至少部分地解决上述问题的一种视频会议的处理方法、一种视频会议的处理系统以及一种电子设备和一种计算机可读存储介质。In view of the above problems, embodiments of the present invention are proposed to provide a method for processing a video conference, a processing system for a video conference, an electronic device, and a computer-readable storage medium that overcome the above problems or at least partially solve the above problems.
为了解决上述问题,本发明实施例公开了一种视频会议的处理方法,应用于服务器,所述方法包括:为视频会议配置加密终端和加密虚拟终端;获取所述视频会议中发言方终端的音视频流;针对所述视频会议中的加密参会方终端,利用所述加密终端传输所述音视频流至所述加密参会方终端;针对所述视频会议中的非加密参会方终端,利用所述加密虚拟终端传输所述音视频流至所述非加密参会方终端。In order to solve the above problems, an embodiment of the present invention discloses a method for processing a video conference, which is applied to a server, and the method includes: configuring an encrypted terminal and an encrypted virtual terminal for the video conference; obtaining the audio and video stream of the speaker terminal in the video conference; for the encrypted participant terminal in the video conference, using the encrypted terminal to transmit the audio and video stream to the encrypted participant terminal; for the non-encrypted participant terminal in the video conference, using the encrypted virtual terminal to transmit the audio and video stream to the non-encrypted participant terminal.
可选地,所述为视频会议配置加密终端和加密虚拟终端,包括:将所述加密终端设置为所述视频会议的主持人角色,并通过发送广播的方式建立所述加密终端与所述加密虚拟终端之间的专属互通隧道。Optionally, configuring the encryption terminal and the encryption virtual terminal for the video conference includes: setting the encryption terminal as a host role of the video conference, and establishing an exclusive intercommunication tunnel between the encryption terminal and the encryption virtual terminal by sending a broadcast.
可选地,所述利用所述加密终端传输所述音视频流至所述加密参会方终端,包括:若所述发言方终端属于所述加密参会方终端,则将所述音视频流传输至所述加密终端,并利用所述加密终端转发所述音视频流至所述视频会议的其他加密参会方终端。Optionally, using the encryption terminal to transmit the audio and video stream to the encryption participant terminal includes: if the speaker terminal belongs to the encryption participant terminal, transmitting the audio and video stream to the encryption terminal, and using the encryption terminal to forward the audio and video stream to other encryption participant terminals of the video conference.
可选地,所述利用所述加密虚拟终端传输所述音视频流至所述非加密参会方终端,包括:若所述发言方终端属于所述加密参会方终端,则将所述音视频流传输至所述加密终端,并利用所述加密终端通过所述专属互通隧道转发所述音视频流至所述加密虚拟终端;利用所述加密虚拟终端对所述音视频流进行解密处理,并将解密处理后的音视频流传输至所述视频会议的非加密参会方终端。Optionally, the use of the encrypted virtual terminal to transmit the audio and video stream to the non-encrypted participant terminal includes: if the speaker terminal belongs to the encrypted participant terminal, transmitting the audio and video stream to the encrypted terminal, and using the encrypted terminal to forward the audio and video stream to the encrypted virtual terminal through the exclusive intercommunication tunnel; using the encrypted virtual terminal to decrypt the audio and video stream, and transmitting the decrypted audio and video stream to the non-encrypted participant terminal of the video conference.
可选地,所述利用所述加密终端传输所述音视频流至所述加密参会方终端,包括:若所述发言方终端属于所述非加密参会方终端,则将所述音视频流传输至所述加密终端,并利用所述加密终端对所述音视频流进行加密处理;利用所述加密终端将加密处理后的音视频流转发至所述视频会议的所述加密参会方终端。Optionally, the use of the encryption terminal to transmit the audio and video stream to the encrypted participant terminal includes: if the speaking terminal belongs to the non-encrypted participant terminal, transmitting the audio and video stream to the encryption terminal, and encrypting the audio and video stream using the encryption terminal; and forwarding the encrypted audio and video stream to the encrypted participant terminal of the video conference using the encryption terminal.
可选地,所述利用所述加密虚拟终端传输所述音视频流至所述非加密参会方终端,包括:若所述发言方终端属于所述非加密参会方终端,则将所述音视频流传输至所述加密虚拟终端,并利用所述加密虚拟终端转发所述音视频流至所述视频会议的其他非加密参会方终端。Optionally, the use of the encrypted virtual terminal to transmit the audio and video stream to the non-encrypted participant terminal includes: if the speaker terminal belongs to the non-encrypted participant terminal, transmitting the audio and video stream to the encrypted virtual terminal, and using the encrypted virtual terminal to forward the audio and video stream to other non-encrypted participant terminals of the video conference.
可选地,所述将解密处理后的音视频流传输至所述视频会议的非加密参会方终端,包括:将解密处理后的视频流的进行分辨率转换处理,并将解密处理后的音频流进行码率转换处理;将分辨率转换处理后的视频流和码率转换处理后的音频流传输至所述视频会议的所述非加密参会终端。Optionally, the transmitting of the decrypted audio and video stream to the non-encrypted participant terminal of the video conference includes: performing resolution conversion processing on the decrypted video stream and performing bit rate conversion processing on the decrypted audio stream; transmitting the resolution-converted video stream and the bit rate-converted audio stream to the non-encrypted participant terminal of the video conference.
本发明实施例还公开了一种视频会议的处理系统,应用于服务器,所述系统包括:终端配置模块,用于为视频会议配置加密终端和加密虚拟终端;音视频流获取模块,用于获取所述视频会议中发言方终端的音视频流;加密传输模块,用于针对所述视频会议中的加密参会方终端,利用所述加密终端传输所述音视频流至所述加密参会方终端;非加密传输模块,用于针对所述视频会议中的非加密参会方终端,利用所述加密虚拟终端传输所述音视频流至所述非加密参会方终端。An embodiment of the present invention also discloses a video conference processing system, which is applied to a server, and the system includes: a terminal configuration module, which is used to configure an encrypted terminal and an encrypted virtual terminal for a video conference; an audio and video stream acquisition module, which is used to acquire the audio and video stream of the speaker terminal in the video conference; an encrypted transmission module, which is used to transmit the audio and video stream to the encrypted participant terminal in the video conference using the encrypted terminal; and a non-encrypted transmission module, which is used to transmit the audio and video stream to the non-encrypted participant terminal in the video conference using the encrypted virtual terminal.
可选地,所述终端配置模块,用于将所述加密终端设置为所述视频会议的主持人角色,并通过发送广播的方式建立所述加密终端与所述加密虚拟终端之间的专属互通隧道。Optionally, the terminal configuration module is used to set the encryption terminal as the host role of the video conference, and establish an exclusive intercommunication tunnel between the encryption terminal and the encryption virtual terminal by sending a broadcast.
可选地,所述加密传输模块,包括:加密终端转发模块,用于用于若所述发言方终端属于所述加密参会方终端,则将所述音视频流传输至所述加密终端,并利用所述加密终端转发所述音视频流至所述视频会议的其他加密参会方终端。Optionally, the encrypted transmission module includes: an encrypted terminal forwarding module, which is used to transmit the audio and video stream to the encrypted terminal if the speaker terminal belongs to the encrypted participant terminal, and use the encrypted terminal to forward the audio and video stream to other encrypted participant terminals of the video conference.
可选地,所述非加密传输模块,包括:专属隧道转发模块,用于若所述发言方终端属于所述加密参会方终端,则将所述音视频流传输至所述加密终端,并利用所述加密终端通过所述专属互通隧道转发所述音视频流至所述加密虚拟终端;音视频流解密模块,用于利用所述加密虚拟终端对所述音视频流进行解密处理,并将解密处理后的音视频流传输至所述视频会议的非加密参会方终端。Optionally, the non-encrypted transmission module includes: an exclusive tunnel forwarding module, which is used to transmit the audio and video stream to the encrypted terminal if the speaker terminal belongs to the encrypted participant terminal, and use the encrypted terminal to forward the audio and video stream to the encrypted virtual terminal through the exclusive intercommunication tunnel; an audio and video stream decryption module, which is used to use the encrypted virtual terminal to decrypt the audio and video stream, and transmit the decrypted audio and video stream to the non-encrypted participant terminal of the video conference.
可选地,所述加密传输模块,包括:加密终端加密模块,用于若所述发言方终端属于所述非加密参会方终端,则将所述音视频流传输至所述加密终端,并利用所述加密终端对所述音视频流进行加密处理;所述加密终端转发模块,还用于利用所述加密终端将加密处理后的音视频流转发至所述视频会议的所述加密参会方终端。Optionally, the encryption transmission module includes: an encryption terminal encryption module, which is used to transmit the audio and video stream to the encryption terminal if the speaking terminal belongs to the non-encrypted participant terminal, and use the encryption terminal to encrypt the audio and video stream; the encryption terminal forwarding module is also used to use the encryption terminal to forward the encrypted audio and video stream to the encrypted participant terminal of the video conference.
可选地,所述非加密传输模块,包括:加密虚拟终端转发模块,用于若所述发言方终端属于所述非加密参会方终端,则将所述音视频流传输至所述加密虚拟终端,并利用所述加密虚拟终端转发所述音视频流至所述视频会议的其他非加密参会方终端。Optionally, the non-encrypted transmission module includes: an encrypted virtual terminal forwarding module, which is used to transmit the audio and video stream to the encrypted virtual terminal if the speaker terminal belongs to the non-encrypted participant terminal, and use the encrypted virtual terminal to forward the audio and video stream to other non-encrypted participant terminals of the video conference.
可选地,所述音视频流解密模块,包括:转换处理模块,用于将解密处理后的视频流的进行分辨率转换处理,并将解密处理后的音频流进行码率转换处理;音视频流传输模块,用于将分辨率转换处理后的视频流和码率转换处理后的音频流传输至所述视频会议的所述非加密参会终端。Optionally, the audio and video stream decryption module includes: a conversion processing module, used to perform resolution conversion processing on the decrypted video stream, and to perform bit rate conversion processing on the decrypted audio stream; an audio and video stream transmission module, used to transmit the video stream after resolution conversion processing and the audio stream after bit rate conversion processing to the non-encrypted participating terminals of the video conference.
本发明实施例还公开了一种电子设备,包括:一个或多个处理器;和其上存储有指令的一个或多个机器可读介质,当由所述一个或多个处理器执行时,使得所述电子设备执行如上所述的视频会议的处理方法。An embodiment of the present invention also discloses an electronic device, comprising: one or more processors; and one or more machine-readable media storing instructions thereon, which, when executed by the one or more processors, enables the electronic device to execute the video conference processing method as described above.
本发明实施例还公开了一种计算机可读存储介质,其存储的计算机程序使得处理器执行如上所述的视频会议的处理方法。The embodiment of the present invention further discloses a computer-readable storage medium, which stores a computer program that enables a processor to execute the video conference processing method as described above.
本发明实施例包括以下优点:The embodiments of the present invention include the following advantages:
本发明实施例提供的视频会议的处理方案,应用于服务器。该服务器为视频会议配置加密终端和加密虚拟终端。获取视频会议中发言方终端的音视频流。进而,针对视频会议中的加密参会方终端,利用加密终端传输音视频流至视频会议的加密参会方终端,针对视频会议中的非加密参会方终端,利用加密虚拟终端传输音视频流至视频会议的非加密参会方终端。The video conference processing scheme provided by the embodiment of the present invention is applied to a server. The server configures an encryption terminal and an encryption virtual terminal for the video conference. The audio and video stream of the speaker terminal in the video conference is obtained. Furthermore, for the encrypted participant terminal in the video conference, the audio and video stream is transmitted to the encrypted participant terminal of the video conference using the encryption terminal, and for the non-encrypted participant terminal in the video conference, the audio and video stream is transmitted to the non-encrypted participant terminal of the video conference using the encryption virtual terminal.
本发明实施例通过服务器配置的加密终端和加密虚拟终端来处理音视频流,避免了传统方案中需要A终端解码和B终端转发的复杂过程,减少了音视频流的传输延时。这有助于提高会议的实时性,改善参会者的互动体验,尤其是在需要快速响应的会议场景中,更加有效。服务器直接管理加密终端和加密虚拟终端的音视频流传输,避免了传统方案中需要手动开启两场会议和多个终端之间的复杂协调。这不仅简化了操作流程,还减少了对操作人员的技能要求,提高了会议组织和管理的效率。通过服务器对加密终端和加密虚拟终端的集中管理,消除了传统方案中两个独立会议之间的协同问题。操作人员只需在一个统一的会议界面中管理所有参会终端,无需频繁切换会议界面,从而大大降低了管理的复杂性,提高了操作的便捷性和会议的可控性。通过引入加密虚拟终端,使得非加密参会方能够顺利接收到会议音视频流,从而提升了加密终端与非加密终端混合使用场景下的兼容性。这意味着不需要对现有非加密终端进行硬件升级或更换,降低了成本,增强了系统的灵活性。The embodiment of the present invention processes audio and video streams through the encryption terminal and encryption virtual terminal configured by the server, avoiding the complex process of A terminal decoding and B terminal forwarding in the traditional solution, and reducing the transmission delay of the audio and video stream. This helps to improve the real-time nature of the meeting and improve the interactive experience of the participants, especially in the meeting scene that requires a quick response, which is more effective. The server directly manages the audio and video stream transmission of the encryption terminal and the encryption virtual terminal, avoiding the complex coordination between the two meetings and multiple terminals that need to be manually opened in the traditional solution. This not only simplifies the operation process, but also reduces the skill requirements for operators and improves the efficiency of conference organization and management. Through the centralized management of encryption terminals and encryption virtual terminals by the server, the coordination problem between two independent meetings in the traditional solution is eliminated. The operator only needs to manage all participating terminals in a unified conference interface, without frequently switching the conference interface, thereby greatly reducing the complexity of management, improving the convenience of operation and the controllability of the meeting. By introducing the encryption virtual terminal, the non-encrypted participants can smoothly receive the conference audio and video streams, thereby improving the compatibility of the encryption terminal and the non-encrypted terminal in the mixed use scenario. This means that there is no need to upgrade or replace the hardware of existing non-encrypted terminals, which reduces costs and enhances the flexibility of the system.
综上所述,本发明实施例有效解决了背景技术中的延时、操作复杂性和管理困难等问题,带来了更高效、更简便的会议体验。In summary, the embodiments of the present invention effectively solve the problems of delay, operation complexity and management difficulty in the background technology, and bring a more efficient and simpler conference experience.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是本发明实施例的一种视频会议的处理方法的步骤流程图;FIG1 is a flowchart of a method for processing a video conference according to an embodiment of the present invention;
图2是本发明实施例的一种基于视联网的混合会议处理方案的原理示意图;FIG2 is a schematic diagram of a hybrid conference processing solution based on a visual network according to an embodiment of the present invention;
图3是本发明实施例的一种基于视联网的音视频流的处理方案的原理示意图;3 is a schematic diagram of the principle of a solution for processing audio and video streams based on a visual network according to an embodiment of the present invention;
图4是本发明实施例的一种视频会议的处理系统的结构框图。FIG. 4 is a structural block diagram of a video conference processing system according to an embodiment of the present invention.
具体实施方式DETAILED DESCRIPTION
为使本发明的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本发明作进一步详细的说明。In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
本发明实施例提出的视频会议处理方案通过在服务器上配置加密终端和加密虚拟终端,优化了混合使用加密终端和非加密终端的会议环境。具体而言,服务器获取发言方终端的音视频流后,针对视频会议中的加密参会方终端,利用加密终端将音视频流传输至加密参会方终端,同时,针对视频会议中的非加密参会方终端,通过加密虚拟终端将音视频流传输至非加密参会方终端。此方案简化了操作流程,减少了音视频流的传输延时,统一了加密与非加密终端的管理,提升了系统的兼容性与会议的整体体验,有效解决了传统方案中延时大、操作复杂和管理困难等问题。The video conference processing solution proposed in the embodiment of the present invention optimizes the conference environment that uses a mixture of encrypted terminals and non-encrypted terminals by configuring encrypted terminals and encrypted virtual terminals on the server. Specifically, after the server obtains the audio and video streams of the speaker's terminal, it uses the encrypted terminal to transmit the audio and video streams to the encrypted participant's terminal in the video conference. At the same time, for the non-encrypted participant's terminal in the video conference, the audio and video streams are transmitted to the non-encrypted participant's terminal through the encrypted virtual terminal. This solution simplifies the operating process, reduces the transmission delay of audio and video streams, unifies the management of encrypted and non-encrypted terminals, improves the compatibility of the system and the overall experience of the conference, and effectively solves the problems of large delays, complex operations and difficult management in traditional solutions.
参照图1,示出了本发明实施例的一种视频会议的处理方法的步骤流程图。该视频会议的处理方法可以应用于服务器,该视频会议的处理方法具体可以包括如下步骤:1, a flowchart of a method for processing a video conference according to an embodiment of the present invention is shown. The method for processing a video conference can be applied to a server, and the method for processing a video conference can specifically include the following steps:
步骤101,为视频会议配置加密终端和加密虚拟终端。Step 101: configure an encryption terminal and an encryption virtual terminal for a video conference.
在本发明的实施例中,加密终端是指能够对音视频流进行加密处理的设备或软件模块。通过使用加密算法(Encryption Algorithm),加密终端能够将音视频数据转换成无法被直接解读的密文,只有拥有相应解密权限的设备才能解码并播放这些音视频内容。这种加密终端通常用于保护敏感信息,防止未经授权的访问。在配置加密终端时,服务器需要考虑多个因素,包括所使用的加密算法类型、加密密钥的管理方式、以及终端与服务器之间的认证机制等。例如,在配置一个基于高级加密标准(Advanced Encryption Standard,简称AES)加密算法的加密终端时,服务器需要确保加密密钥的安全存储和分发,并为每个加密终端分配唯一的密钥以增强安全性。In an embodiment of the present invention, an encryption terminal refers to a device or software module that can encrypt audio and video streams. By using an encryption algorithm, the encryption terminal can convert audio and video data into ciphertext that cannot be directly interpreted, and only devices with corresponding decryption permissions can decode and play these audio and video contents. This type of encryption terminal is usually used to protect sensitive information and prevent unauthorized access. When configuring an encryption terminal, the server needs to consider multiple factors, including the type of encryption algorithm used, the management method of encryption keys, and the authentication mechanism between the terminal and the server. For example, when configuring an encryption terminal based on the Advanced Encryption Standard (AES) encryption algorithm, the server needs to ensure the secure storage and distribution of encryption keys, and assign a unique key to each encryption terminal to enhance security.
加密虚拟终端则是用于在非加密环境中模拟加密终端功能的软件模块。它能够接收加密音视频流,并通过解密过程将这些音视频流转换为可供非加密终端接收和播放的普通音视频流。加密虚拟终端的配置需要考虑其与服务器的集成方式、解密算法的选择以及数据流的转发机制。例如,如果非加密参会方的设备不支持复杂的加密协议,那么服务器可以通过配置加密虚拟终端来代替这些设备进行解密操作,然后将解密后的数据流传输给这些设备,以确保它们能够正常接收和播放会议内容。The encrypted virtual terminal is a software module used to simulate the functions of an encrypted terminal in a non-encrypted environment. It can receive encrypted audio and video streams and convert them into ordinary audio and video streams that can be received and played by non-encrypted terminals through the decryption process. The configuration of the encrypted virtual terminal needs to consider its integration with the server, the choice of decryption algorithm, and the forwarding mechanism of the data stream. For example, if the devices of non-encrypted participants do not support complex encryption protocols, the server can configure the encrypted virtual terminal to perform decryption operations on behalf of these devices, and then transmit the decrypted data stream to these devices to ensure that they can receive and play the conference content normally.
通过配置加密终端和加密虚拟终端,服务器能够有效管理加密和非加密参会方的音视频流传输,为不同安全需求的参会方提供个性化的服务。这不仅增强了系统的安全性和灵活性,还为处理不同类型的终端奠定了基础。在实际应用中,一个典型的例子是某企业的视频会议系统需要处理内部员工和外部合作伙伴的会议需求。内部员工使用的设备为加密终端,能够直接接收和解码加密的音视频流,而外部合作伙伴使用的非加密终端则通过加密虚拟终端接收解密后的数据流,确保会议的顺畅进行。By configuring encrypted terminals and encrypted virtual terminals, the server can effectively manage the transmission of audio and video streams of encrypted and non-encrypted participants, and provide personalized services for participants with different security requirements. This not only enhances the security and flexibility of the system, but also lays the foundation for handling different types of terminals. In practical applications, a typical example is that a company's video conferencing system needs to handle the meeting needs of internal employees and external partners. The devices used by internal employees are encrypted terminals that can directly receive and decode encrypted audio and video streams, while the non-encrypted terminals used by external partners receive the decrypted data streams through encrypted virtual terminals to ensure the smooth progress of the meeting.
步骤102,获取视频会议中发言方终端的音视频流。Step 102: Acquire the audio and video streams of the terminal of the speaker in the video conference.
在本发明的实施例中,发言方终端是指当前正在进行发言或展示的参会者所使用的设备。获取音视频流通常涉及两个主要过程:音视频捕获和数据传输。音视频捕获是指通过发言方终端的摄像头和麦克风等硬件设备,实时采集会议现场的图像和声音信号。这些信号通常以未压缩或轻度压缩的格式捕获,以确保音视频内容的高质量。例如,在使用高清摄像头和专业麦克风的会议设备时,捕获的音视频信号可以达到1080p甚至4K的分辨率,音频也可以达到48kHz以上的采样率,这为会议提供了清晰、真实的交流体验。In an embodiment of the present invention, the speaker terminal refers to the device used by the participant who is currently speaking or presenting. Obtaining audio and video streams generally involves two main processes: audio and video capture and data transmission. Audio and video capture refers to the real-time collection of image and sound signals at the conference site through hardware devices such as the camera and microphone of the speaker terminal. These signals are usually captured in an uncompressed or lightly compressed format to ensure the high quality of the audio and video content. For example, when using conference equipment with a high-definition camera and a professional microphone, the captured audio and video signals can reach a resolution of 1080p or even 4K, and the audio can also reach a sampling rate of more than 48kHz, which provides a clear and realistic communication experience for the meeting.
数据传输是指将捕获的音视频信号通过网络传输至服务器的过程。在这一过程中,发言方终端需要对音视频信号进行编码(Encoding),将原始的音视频数据压缩成适合网络传输的格式,以减少带宽占用和传输延时。常见的编码格式包括H.264视频编码标准和进阶音频编码(Advanced Audio Coding,简称AAC)音频编码标准,它们能够在保证音视频质量的同时,有效地减少数据量。传输过程中,发言方终端还需要使用传输控制协议(Transmission Control Protocol,简称TCP)或实时传输协议(Real-time TransportProtocol,简称RTP)等网络协议,确保数据在传输过程中不丢失、不过时,并能够被服务器正确接收和处理。Data transmission refers to the process of transmitting captured audio and video signals to the server through the network. In this process, the speaker terminal needs to encode the audio and video signals (Encoding), compressing the original audio and video data into a format suitable for network transmission to reduce bandwidth usage and transmission delay. Common encoding formats include the H.264 video encoding standard and the Advanced Audio Coding (AAC) audio encoding standard, which can effectively reduce the amount of data while ensuring the quality of audio and video. During the transmission process, the speaker terminal also needs to use network protocols such as the Transmission Control Protocol (TCP) or the Real-time Transport Protocol (RTP) to ensure that the data is not lost or outdated during the transmission process, and can be correctly received and processed by the server.
在实际应用中,例如一个远程教育系统中,教师的电脑或移动设备就是发言方终端。通过高清摄像头和麦克风,教师将自己的讲解和板书内容实时捕获为音视频流,然后通过网络传输到教育平台的服务器。服务器再将这些音视频流转发给所有在线学生,确保他们能够同步接收到教师的讲课内容。In practical applications, such as a distance education system, the teacher's computer or mobile device is the speaking terminal. Through a high-definition camera and microphone, the teacher captures his or her own explanations and blackboard writings in real time as audio and video streams, which are then transmitted to the education platform server through the network. The server then forwards these audio and video streams to all online students to ensure that they can receive the teacher's lectures synchronously.
步骤103,针对视频会议中的加密参会方终端,利用加密终端传输音视频流至加密参会方终端。Step 103, for the encrypted participant terminal in the video conference, use the encrypted terminal to transmit the audio and video stream to the encrypted participant terminal.
在本发明的实施例中,加密终端会对获取的音视频流进行加密处理。加密处理是指通过加密算法,将音视频流转换成密文,使得未经授权的用户无法理解或访问这些数据。常用的加密算法包括对称加密算法如高级加密标准(Advanced Encryption Standard,简称AES)和非对称加密算法。对于实时性要求较高的视频会议场景,通常会选择AES这类对称加密算法,因为其加密和解密速度较快,能够在保证安全性的同时,降低传输延时。In an embodiment of the present invention, the encryption terminal encrypts the acquired audio and video streams. Encryption processing refers to converting the audio and video streams into ciphertext through an encryption algorithm, so that unauthorized users cannot understand or access these data. Common encryption algorithms include symmetric encryption algorithms such as the Advanced Encryption Standard (AES) and asymmetric encryption algorithms. For video conferencing scenarios with high real-time requirements, symmetric encryption algorithms such as AES are usually selected because they have fast encryption and decryption speeds, which can reduce transmission delays while ensuring security.
加密处理完成后,音视频流以加密格式从加密终端传输至加密参会方终端。传输过程中,采用安全传输协议如传输层安全协议(Transport Layer Security,简称TLS)或安全实时传输协议(Secure Real-time Transport Protocol,简称SRTP),确保加密数据在网络上传输时不被窃听或篡改。这些协议通过加密会话密钥和认证机制,进一步增强了音视频流传输的安全性。After the encryption process is completed, the audio and video streams are transmitted from the encryption terminal to the encryption participant terminal in an encrypted format. During the transmission process, secure transmission protocols such as Transport Layer Security (TLS) or Secure Real-time Transport Protocol (SRTP) are used to ensure that the encrypted data is not eavesdropped or tampered with when transmitted on the network. These protocols further enhance the security of audio and video stream transmission through encrypted session keys and authentication mechanisms.
在接收到加密音视频流后,加密参会方终端会利用其本地存储的解密密钥对数据进行解密,将其恢复为可播放的音视频内容。例如,在一个高层会议中,各参会人使用的设备都是加密参会方终端。服务器通过加密终端将发言方的音视频流加密后传输给各个加密参会方终端,确保会议内容在传输过程中不会被第三方窃听或篡改。各个加密参会方终端会根据预先配置的密钥,对接收到的音视频流进行解密,从而能够清晰、准确地接收和参与会议内容。After receiving the encrypted audio and video stream, the encrypted participant terminal will use its locally stored decryption key to decrypt the data and restore it to playable audio and video content. For example, in a high-level meeting, the devices used by each participant are encrypted participant terminals. The server encrypts the speaker's audio and video stream through the encrypted terminal and transmits it to each encrypted participant terminal to ensure that the conference content will not be eavesdropped or tampered with by a third party during the transmission process. Each encrypted participant terminal will decrypt the received audio and video stream according to the pre-configured key, so that it can clearly and accurately receive and participate in the conference content.
步骤104,针对视频会议中的非加密参会方终端,利用加密虚拟终端传输音视频流至非加密参会方终端。Step 104, for the non-encrypted participant terminal in the video conference, use the encrypted virtual terminal to transmit the audio and video stream to the non-encrypted participant terminal.
在本发明的实施例中,由于非加密参会方终端无法直接解密加密的音视频流,因此通过加密虚拟终端,将音视频流从加密格式解密为普通格式后传输至非加密参会方终端。加密虚拟终端会接收到来自加密终端的加密音视频流。这些音视频流是经过加密处理的密文,非加密参会方终端无法直接使用。加密虚拟终端的任务是通过解密算法,将这些密文还原为原始的音视频数据。这一过程通常涉及对称解密算法,例如AES中的解密过程。加密虚拟终端会利用其与加密终端共享的解密密钥,对音视频流进行逐帧解密,确保解密后的音视频数据与原始数据一致。In an embodiment of the present invention, since the non-encrypted participant terminal cannot directly decrypt the encrypted audio and video stream, the encrypted virtual terminal is used to decrypt the audio and video stream from the encrypted format to the ordinary format and then transmit it to the non-encrypted participant terminal. The encrypted virtual terminal will receive the encrypted audio and video stream from the encryption terminal. These audio and video streams are encrypted ciphertexts and cannot be used directly by the non-encrypted participant terminal. The task of the encrypted virtual terminal is to restore these ciphertexts to the original audio and video data through a decryption algorithm. This process usually involves a symmetric decryption algorithm, such as the decryption process in AES. The encrypted virtual terminal will use the decryption key shared with the encryption terminal to decrypt the audio and video stream frame by frame to ensure that the decrypted audio and video data is consistent with the original data.
解密完成后,加密虚拟终端会对音视频流进行编码和封装,使其符合非加密终端所能接收的格式。例如,常见的非加密参会方终端支持的格式包括H.264视频编码和AAC音频编码。这一步骤确保了解密后的音视频流能够被非加密参会方终端正确识别和播放。随后,加密虚拟终端通过标准的传输协议如RTP,将解密后的音视频流传输至非加密参会方终端。After decryption is complete, the encrypted virtual terminal will encode and encapsulate the audio and video streams to conform to the format that the non-encrypted terminal can receive. For example, the formats supported by common non-encrypted participant terminals include H.264 video encoding and AAC audio encoding. This step ensures that the decrypted audio and video streams can be correctly recognized and played by the non-encrypted participant terminals. Subsequently, the encrypted virtual terminal transmits the decrypted audio and video streams to the non-encrypted participant terminals through standard transmission protocols such as RTP.
在实际应用中,假设一个视频会议系统中,部分员工使用的设备是加密参会方终端,而部分外部合作伙伴使用的设备是非加密参会方终端。服务器通过加密终端将会议发言者的音视频流加密后传输至加密虚拟终端,加密虚拟终端再将这些音视频流解密并转发给外部合作伙伴的非加密参会方终端,确保他们能够正常接收和参与会议。In actual applications, suppose that in a video conferencing system, some employees use encrypted participant terminals, while some external partners use non-encrypted participant terminals. The server encrypts the audio and video streams of the conference speaker through the encrypted terminal and transmits them to the encrypted virtual terminal. The encrypted virtual terminal then decrypts these audio and video streams and forwards them to the non-encrypted participant terminals of the external partners to ensure that they can receive and participate in the conference normally.
需要说明的是,步骤104可以在步骤102或者步骤103之后执行。It should be noted that step 104 can be performed after step 102 or step 103.
本发明实施例提供的视频会议的处理方案,应用于服务器。该服务器为视频会议配置加密终端和加密虚拟终端。获取视频会议中发言方终端的音视频流。进而,针对视频会议中的加密参会方终端,利用加密终端传输音视频流至视频会议的加密参会方终端,针对视频会议中的非加密参会方终端,利用加密虚拟终端传输音视频流至视频会议的非加密参会方终端。The video conference processing scheme provided by the embodiment of the present invention is applied to a server. The server configures an encryption terminal and an encryption virtual terminal for the video conference. The audio and video stream of the speaker terminal in the video conference is obtained. Furthermore, for the encrypted participant terminal in the video conference, the audio and video stream is transmitted to the encrypted participant terminal of the video conference using the encryption terminal, and for the non-encrypted participant terminal in the video conference, the audio and video stream is transmitted to the non-encrypted participant terminal of the video conference using the encryption virtual terminal.
本发明实施例通过服务器配置的加密终端和加密虚拟终端来处理音视频流,避免了传统方案中需要A终端解码和B终端转发的复杂过程,减少了音视频流的传输延时。这有助于提高会议的实时性,改善参会者的互动体验,尤其是在需要快速响应的会议场景中,更加有效。服务器直接管理加密终端和加密虚拟终端的音视频流传输,避免了传统方案中需要手动开启两场会议和多个终端之间的复杂协调。这不仅简化了操作流程,还减少了对操作人员的技能要求,提高了会议组织和管理的效率。通过服务器对加密终端和加密虚拟终端的集中管理,消除了传统方案中两个独立会议之间的协同问题。操作人员只需在一个统一的会议界面中管理所有参会终端,无需频繁切换会议界面,从而大大降低了管理的复杂性,提高了操作的便捷性和会议的可控性。通过引入加密虚拟终端,使得非加密参会方能够顺利接收到会议音视频流,从而提升了加密终端与非加密终端混合使用场景下的兼容性。这意味着不需要对现有非加密终端进行硬件升级或更换,降低了成本,增强了系统的灵活性。The embodiment of the present invention processes audio and video streams through the encryption terminal and encryption virtual terminal configured by the server, avoiding the complex process of A terminal decoding and B terminal forwarding in the traditional solution, and reducing the transmission delay of the audio and video stream. This helps to improve the real-time nature of the meeting and improve the interactive experience of the participants, especially in the meeting scene that requires a quick response, which is more effective. The server directly manages the audio and video stream transmission of the encryption terminal and the encryption virtual terminal, avoiding the complex coordination between the two meetings and multiple terminals that need to be manually opened in the traditional solution. This not only simplifies the operation process, but also reduces the skill requirements for operators and improves the efficiency of conference organization and management. Through the centralized management of encryption terminals and encryption virtual terminals by the server, the coordination problem between two independent meetings in the traditional solution is eliminated. The operator only needs to manage all participating terminals in a unified conference interface, without frequently switching the conference interface, thereby greatly reducing the complexity of management, improving the convenience of operation and the controllability of the meeting. By introducing the encryption virtual terminal, the non-encrypted participants can smoothly receive the conference audio and video streams, thereby improving the compatibility of the encryption terminal and the non-encrypted terminal in the mixed use scenario. This means that there is no need to upgrade or replace the hardware of existing non-encrypted terminals, which reduces costs and enhances the flexibility of the system.
综上所述,本发明实施例有效解决了背景技术中的延时、操作复杂性和管理困难等问题,带来了更高效、更简便的会议体验。In summary, the embodiments of the present invention effectively solve the problems of delay, operation complexity and management difficulty in the background technology, and bring a more efficient and simpler conference experience.
在本发明的一种示例性实施例中,为视频会议配置加密终端和加密虚拟终端的一种实施方式为,将加密终端设置为视频会议的主持人角色,并通过发送广播的方式建立加密终端与加密虚拟终端之间的专属互通隧道。在实际应用过程中,将加密终端配置为视频会议的主持人角色,这意味着加密终端将承担视频会议的核心管理和控制职能。在一个视频会议中,主持人角色通常负责启动和结束会议、管理参会者的权限、控制发言顺序、以及分配和管理音视频资源等功能。通过赋予加密终端这一角色,可以确保所有敏感的管理操作都在一个加密环境下进行,从而防止未经授权的用户访问会议管理功能。这也意味着加密终端可以利用其内置的加密算法(如AES),对所有的管理命令和会议数据进行加密处理,进一步提升了会议的安全性。In an exemplary embodiment of the present invention, an implementation method for configuring an encryption terminal and an encryption virtual terminal for a video conference is to set the encryption terminal as the host role of the video conference, and establish an exclusive intercommunication tunnel between the encryption terminal and the encryption virtual terminal by sending a broadcast. In actual application, the encryption terminal is configured as the host role of the video conference, which means that the encryption terminal will assume the core management and control functions of the video conference. In a video conference, the host role is usually responsible for starting and ending the conference, managing the permissions of the participants, controlling the order of speaking, and allocating and managing audio and video resources. By assigning this role to the encryption terminal, it can be ensured that all sensitive management operations are performed in an encrypted environment, thereby preventing unauthorized users from accessing the conference management function. This also means that the encryption terminal can use its built-in encryption algorithm (such as AES) to encrypt all management commands and conference data, further improving the security of the meeting.
在此基础上,通过广播方式建立加密终端与加密虚拟终端之间的专属互通隧道,是为了确保加密数据在多个终端之间的安全传输。广播在这里指的是加密终端向一组特定的接收者(即加密虚拟终端)发送数据,而不对其他非目标终端进行传输。专属互通隧道则是指在加密终端和加密虚拟终端之间建立的一个安全通道,用于传输加密后的音视频数据和管理命令。这一隧道的建立和维护依赖于加密通信协议(如TLS)和加密算法,确保数据在传输过程中不被窃听或篡改。On this basis, an exclusive intercommunication tunnel is established between the encryption terminal and the encryption virtual terminal through broadcasting to ensure the secure transmission of encrypted data between multiple terminals. Broadcasting here means that the encryption terminal sends data to a specific group of recipients (i.e., encryption virtual terminals) without transmitting to other non-target terminals. An exclusive intercommunication tunnel refers to a secure channel established between the encryption terminal and the encryption virtual terminal for transmitting encrypted audio and video data and management commands. The establishment and maintenance of this tunnel depends on encrypted communication protocols (such as TLS) and encryption algorithms to ensure that data is not eavesdropped or tampered with during transmission.
这一实施方式的优势在于,它使得视频会议系统中的加密数据和管理命令能够以广播的方式快速、可靠地传递给所有加密虚拟终端,从而实现了对非加密参会方终端的兼容支持。例如,当一个视频会议需要同时连接多个加密参会者和非加密参会者时,加密终端通过广播建立的专属隧道,可以确保加密数据只传输给需要解密的加密虚拟终端,而非加密参会方终端则只接收到已经解密的数据流,从而保证了系统的整体安全性和数据一致性。The advantage of this implementation is that it enables encrypted data and management commands in the video conferencing system to be quickly and reliably transmitted to all encrypted virtual terminals in a broadcast manner, thereby achieving compatible support for non-encrypted participant terminals. For example, when a video conference needs to connect multiple encrypted participants and non-encrypted participants at the same time, the encrypted terminal can ensure that the encrypted data is only transmitted to the encrypted virtual terminal that needs to be decrypted through the dedicated tunnel established by the broadcast, while the non-encrypted participant terminal only receives the decrypted data stream, thereby ensuring the overall security and data consistency of the system.
由于加密终端被赋予了主持人角色,系统管理员不再需要在多个终端之间手动分配和管理加密密钥或配置安全通道,这减少了管理复杂性并降低了操作错误的风险。加密终端通过广播自动与加密虚拟终端建立互通隧道,确保了所有需要解密数据的参会方终端都能够无缝接收到会议内容。这不仅提高了系统的可操作性,还增强了视频会议的流畅性和实时性,特别是在需要连接大量参会者的大规模会议中,具有显著的优势。Since the encrypted terminal is given the role of host, the system administrator no longer needs to manually distribute and manage encryption keys or configure secure channels between multiple terminals, which reduces management complexity and reduces the risk of operational errors. The encrypted terminal automatically establishes an intercommunication tunnel with the encrypted virtual terminal through broadcasting, ensuring that all participating terminals that need to decrypt data can seamlessly receive the conference content. This not only improves the operability of the system, but also enhances the fluency and real-time nature of video conferencing, which has significant advantages, especially in large-scale meetings that need to connect a large number of participants.
在本发明的一种示例性实施例中,利用加密终端传输音视频流至加密参会方终端的一种实施方式为,若发言方终端属于加密参会方终端,则将音视频流传输至加密终端,并利用加密终端转发音视频流至视频会议的其他加密参会方终端。加密参会方终端是指具备加密功能的终端设备,这些设备能够通过加密算法对音视频流进行加密处理和解密处理,确保数据在传输过程中不被窃听或篡改。当发言方终端本身也是加密参会方终端时,其生成的音视频流自然是经过加密的。这种加密通常基于对称加密算法,可以在保证安全性的同时提高加密和解密的效率。In an exemplary embodiment of the present invention, an implementation method of transmitting audio and video streams to an encrypted participant terminal using an encryption terminal is that if the speaker terminal belongs to an encrypted participant terminal, the audio and video streams are transmitted to the encryption terminal, and the encryption terminal is used to transfer the audio and video streams to other encrypted participant terminals of the video conference. An encrypted participant terminal refers to a terminal device with encryption function, which can encrypt and decrypt audio and video streams through encryption algorithms to ensure that the data is not eavesdropped or tampered with during transmission. When the speaker terminal itself is also an encrypted participant terminal, the audio and video streams it generates are naturally encrypted. This encryption is usually based on a symmetric encryption algorithm, which can improve the efficiency of encryption and decryption while ensuring security.
在实际应用过程中,将加密参会方终端生成的音视频流传输至加密终端。加密终端作为视频会议的核心管理设备,承担着音视频流的集中处理和转发任务。由于发言方终端的音视频流已经加密,因此在传输至加密终端的过程中,数据的安全性能够得到充分保障,加密终端仅需进行必要的管理和调度,而无需对音视频流进行二次加密处理。这种设计极大地简化了系统的处理流程,同时也减少了数据在传输过程中的延时。接下来,利用加密终端将音视频流转发至视频会议的其他加密参会方终端。在此过程中,加密终端扮演了“数据中继”的角色,它接收来自发言方终端的加密音视频流,并根据会议的实际需求,将这些数据分发给其他加密参会方终端。由于这些终端都具备解密能力,能够直接解码和播放从加密终端接收到的音视频流,从而保证了会议内容在不同加密终端之间的同步和一致性。In actual application, the audio and video streams generated by the encrypted participant terminal are transmitted to the encryption terminal. As the core management device of the video conference, the encryption terminal is responsible for the centralized processing and forwarding of audio and video streams. Since the audio and video streams of the speaker terminal have been encrypted, the security of the data can be fully guaranteed during the transmission to the encryption terminal. The encryption terminal only needs to perform necessary management and scheduling without the need to perform secondary encryption on the audio and video streams. This design greatly simplifies the processing flow of the system and also reduces the delay of data during transmission. Next, the encryption terminal is used to forward the audio and video streams to other encrypted participant terminals of the video conference. In this process, the encryption terminal plays the role of "data relay". It receives the encrypted audio and video streams from the speaker terminal and distributes these data to other encrypted participant terminals according to the actual needs of the conference. Since these terminals have decryption capabilities, they can directly decode and play the audio and video streams received from the encryption terminal, thereby ensuring the synchronization and consistency of the conference content between different encryption terminals.
本发明实施例通过加密终端的中介作用,音视频流在整个传输链条上始终处于加密状态,这避免了任何可能的窃听或数据泄露风险。在多个加密参会方终端之间传输的数据也得到了保护,确保了会议内容的机密性。由于加密终端集中处理并转发音视频流,减少了多终端之间的直接通信,降低了网络带宽的占用。此外,加密终端的高效调度能力使得音视频数据能够迅速而稳定地传输到各个加密参会方终端,减少了由于多终端协同带来的延时问题,从而提高了会议的流畅性和实时性。系统管理员不再需要在不同终端之间手动配置加密密钥或设置专用通道。所有加密和解密过程都由加密终端集中管理,终端设备只需按照预定的协议与加密终端通信即可。这种集中化管理不仅减少了操作复杂性,还降低了配置错误的风险,确保了系统的稳定运行。In the embodiment of the present invention, the audio and video streams are always encrypted throughout the entire transmission chain through the intermediary role of the encryption terminal, which avoids any possible risk of eavesdropping or data leakage. The data transmitted between multiple encrypted conference participant terminals is also protected, ensuring the confidentiality of the conference content. Since the encryption terminal centrally processes and transcodes the audio and video streams, direct communication between multiple terminals is reduced, and the network bandwidth occupancy is reduced. In addition, the efficient scheduling capability of the encryption terminal enables audio and video data to be quickly and stably transmitted to each encrypted conference participant terminal, reducing the delay problem caused by multi-terminal collaboration, thereby improving the fluency and real-time nature of the meeting. System administrators no longer need to manually configure encryption keys or set up dedicated channels between different terminals. All encryption and decryption processes are centrally managed by the encryption terminal, and the terminal device only needs to communicate with the encryption terminal according to a predetermined protocol. This centralized management not only reduces the complexity of operation, but also reduces the risk of configuration errors, ensuring the stable operation of the system.
在本发明的一种示例性实施例中,利用加密虚拟终端传输音视频流至非加密参会方终端的一种实施方式为,若发言方终端属于加密参会方终端,则将音视频流传输至加密终端,并利用加密终端通过专属互通隧道转发音视频流至加密虚拟终端;利用加密虚拟终端对音视频流进行解密处理,并将解密处理后的音视频流传输至视频会议的非加密参会方终端。在实际应用过程中,当发言方终端为加密参会方终端时,生成的音视频流是经过加密处理的。这些加密数据通过安全通道传输至加密终端。加密终端在视频会议系统中起着核心管理和调度的作用,其主要任务是接收来自加密参会方终端的音视频流,并利用专属的互通隧道,将这些数据安全地传输给加密虚拟终端。接下来,加密虚拟终端对接收到的音视频流进行解密处理。解密的过程通常使用与加密终端相同的解密算法,如AES,确保数据能够正确还原为原始的音视频内容。解密后的音视频流随即被传输至非加密参会方终端。这些终端不具备解密能力,因此加密虚拟终端的解密操作是确保非加密参会方终端能够正常接收到会议内容的关键步骤。通过这种方式,非加密参会方终端用户可以与加密参会方终端用户同步参与会议,而不受加密技术的限制。In an exemplary embodiment of the present invention, an implementation method of transmitting audio and video streams to non-encrypted participant terminals using an encrypted virtual terminal is that if the speaker terminal belongs to an encrypted participant terminal, the audio and video streams are transmitted to the encrypted terminal, and the encrypted terminal is used to transfer the audio and video streams to the encrypted virtual terminal through a dedicated intercommunication tunnel; the encrypted virtual terminal is used to decrypt the audio and video streams, and the decrypted audio and video streams are transmitted to the non-encrypted participant terminals of the video conference. In actual application, when the speaker terminal is an encrypted participant terminal, the generated audio and video streams are encrypted. These encrypted data are transmitted to the encryption terminal through a secure channel. The encryption terminal plays a core management and scheduling role in the video conferencing system. Its main task is to receive audio and video streams from the encrypted participant terminals and use a dedicated intercommunication tunnel to securely transmit these data to the encryption virtual terminal. Next, the encryption virtual terminal decrypts the received audio and video streams. The decryption process usually uses the same decryption algorithm as the encryption terminal, such as AES, to ensure that the data can be correctly restored to the original audio and video content. The decrypted audio and video streams are then transmitted to the non-encrypted participant terminals. These terminals do not have decryption capabilities, so the decryption operation of the encrypted virtual terminal is a key step to ensure that the non-encrypted participant terminals can receive the conference content normally. In this way, non-encrypted participant terminal users can participate in the conference synchronously with encrypted participant terminal users without being restricted by encryption technology.
本发明实施例通过将加密终端和加密虚拟终端作为中介,所有音视频流在传输过程中都经过加密处理,且仅在加密虚拟终端中解密,防止了敏感数据的泄露。这对于需要高安全性的会议,如企业机密会议或政府机构会议,尤为重要。由于加密虚拟终端负责解密并转发音视频流,非加密参会方终端可以在不具备加密解密功能的情况下参与视频会议。这种设计使得不同类型的终端设备能够在同一个会议环境中协同工作,提高了系统的灵活性,适应了多种应用场景。通过专属互通隧道,加密终端和加密虚拟终端之间的通信得以优化,减少了数据传输的延时。此外,解密后的数据由加密虚拟终端直接传输至非加密参会方终端,简化了数据流的路径,避免了不必要的中间处理环节。这种方式确保了会议内容的实时传输和同步,从而提升了用户的会议体验。The embodiment of the present invention uses the encryption terminal and the encryption virtual terminal as intermediaries, and all audio and video streams are encrypted during the transmission process and are only decrypted in the encryption virtual terminal, thereby preventing the leakage of sensitive data. This is particularly important for meetings that require high security, such as corporate confidential meetings or government agency meetings. Since the encryption virtual terminal is responsible for decrypting and transcribing the audio and video streams, the non-encrypted participant terminal can participate in the video conference without encryption and decryption functions. This design enables different types of terminal devices to work together in the same conference environment, improves the flexibility of the system, and adapts to a variety of application scenarios. Through the exclusive intercommunication tunnel, the communication between the encryption terminal and the encryption virtual terminal is optimized, reducing the delay in data transmission. In addition, the decrypted data is directly transmitted from the encryption virtual terminal to the non-encrypted participant terminal, which simplifies the path of the data flow and avoids unnecessary intermediate processing links. This method ensures the real-time transmission and synchronization of the conference content, thereby improving the user's conference experience.
在本发明的一种示例性实施例中,利用加密终端传输音视频流至加密参会方终端的一种实施方式为,若发言方终端属于非加密参会方终端,则将音视频流传输至加密终端,并利用加密终端对所述音视频流进行加密处理;利用加密终端将加密处理后的音视频流转发至视频会议的加密参会方终端。在实际应用过程中,非加密参会方终端指的是没有内置加密功能的终端设备,这些终端在视频会议中生成的音视频流是未加密的,这意味着它们容易受到窃听或篡改的风险。因此,当非加密参会方终端作为发言方时,为了确保会议数据的安全性,需要将音视频流传输至具有加密能力的加密终端。加密终端在接收到来自非加密参会方终端的音视频流后,会立即进行加密处理。加密处理通常使用对称加密算法,如AES,这种算法既能确保数据的安全性,又能保证加密处理的效率。在加密过程中,原始的音视频数据被转化为加密数据,只有具备相应解密能力的加密参会方终端才能对其进行解码和还原。完成加密后,加密终端将加密处理后的音视频流转发至会议中的其他加密参会方终端。这些加密参会方终端具备解密功能,可以通过预先共享的密钥或公钥加密系统进行解密操作,从而恢复原始的音视频内容。这种方式确保了所有加密参会方终端能够同步接收并正确解码音视频流,同时保护了数据的机密性。In an exemplary embodiment of the present invention, an implementation method of transmitting an audio and video stream to an encrypted participant terminal using an encryption terminal is that if the speaker terminal belongs to a non-encrypted participant terminal, the audio and video stream is transmitted to the encryption terminal, and the audio and video stream is encrypted by the encryption terminal; the encrypted audio and video stream is forwarded to the encrypted participant terminal of the video conference by the encryption terminal. In actual application, the non-encrypted participant terminal refers to a terminal device without a built-in encryption function. The audio and video streams generated by these terminals in the video conference are unencrypted, which means that they are vulnerable to the risk of eavesdropping or tampering. Therefore, when the non-encrypted participant terminal is used as the speaker, in order to ensure the security of the conference data, the audio and video stream needs to be transmitted to an encryption terminal with encryption capability. After receiving the audio and video stream from the non-encrypted participant terminal, the encryption terminal will immediately perform encryption processing. Encryption processing usually uses a symmetric encryption algorithm, such as AES, which can ensure both the security of the data and the efficiency of the encryption processing. During the encryption process, the original audio and video data is converted into encrypted data, and only the encrypted participant terminal with the corresponding decryption capability can decode and restore it. After encryption is completed, the encryption terminal forwards the encrypted audio and video stream to other encrypted participant terminals in the conference. These encrypted participant terminals have decryption capabilities and can perform decryption operations through pre-shared keys or public key encryption systems to restore the original audio and video content. This method ensures that all encrypted participant terminals can synchronously receive and correctly decode the audio and video streams while protecting the confidentiality of the data.
本发明实施例通过将非加密参会方终端生成的音视频流在加密终端进行加密处理,防止了未经授权的用户窃听或篡改会议内容。这种方式特别适用于需要高安全性的视频会议场景,如企业机密会议或政府部门的远程会议。由于加密终端能够对来自非加密参会方终端的音视频流进行加密处理,确保了会议中不同类型的终端设备能够协同工作。在混合使用加密和非加密终端的会议环境中,这种设计为系统提供了更高的灵活性,使其能够适应不同的应用需求。通过集中在加密终端进行加密处理,减少了多终端之间的直接通信和加密配置过程,优化了数据流传输的路径,降低了网络带宽的占用。这种集中化的加密处理方式不仅提高了数据传输的效率,还减少了由于多终端协同处理可能带来的延时问题,从而改善了会议的实时性和交互性。The embodiment of the present invention prevents unauthorized users from eavesdropping or tampering with the content of the meeting by encrypting the audio and video streams generated by the non-encrypted participant terminal at the encryption terminal. This method is particularly suitable for video conferencing scenarios that require high security, such as corporate confidential meetings or remote meetings of government departments. Since the encryption terminal can encrypt the audio and video streams from the non-encrypted participant terminal, it ensures that different types of terminal devices in the meeting can work together. In a conference environment where encrypted and non-encrypted terminals are mixed, this design provides the system with greater flexibility, enabling it to adapt to different application requirements. By centralizing encryption processing on the encryption terminal, direct communication and encryption configuration processes between multiple terminals are reduced, the data stream transmission path is optimized, and the network bandwidth occupancy is reduced. This centralized encryption processing method not only improves the efficiency of data transmission, but also reduces the delay problem that may be caused by the collaborative processing of multiple terminals, thereby improving the real-time and interactivity of the meeting.
在本发明的一种示例性实施例中,利用加密虚拟终端传输音视频流至非加密参会方终端的一种实施方式为,若发言方终端属于非加密参会方终端,则将音视频流传输至加密虚拟终端,并利用加密虚拟终端转发音视频流至视频会议的其他非加密参会方终端。在实际应用过程中,当发言方终端为非加密参会方终端时,它生成的音视频流被传输至加密虚拟终端。加密虚拟终端是一种虚拟化的加密设备,它模拟了加密终端的功能,能够在不改变非加密终端硬件的情况下,对音视频流进行安全处理。在此过程中,加密虚拟终端接收到非加密参会方终端的音视频流后,会对数据进行必要的安全检查和处理,确保其能够在安全的基础上继续传播。接下来,加密虚拟终端会将经过处理的音视频流转发至视频会议中的其他非加密参会方终端。例如,在一个企业的远程会议中,M部门的发言人使用的设备为非加密参会方终端,而N部门的参会人员也使用非加密参会方终端。此时,M部门发言人的音视频流将传输到加密虚拟终端,由其进行处理后,再将音视频流传输给N部门的所有参会人员。由于加密虚拟终端可以作为音视频流的中转站和安全防护层,这确保了即使在非加密环境中,音视频流的传输依然能够得到良好的管理和控制。In an exemplary embodiment of the present invention, an implementation method of using an encrypted virtual terminal to transmit an audio and video stream to a non-encrypted participant terminal is that if the speaker terminal belongs to a non-encrypted participant terminal, the audio and video stream is transmitted to the encrypted virtual terminal, and the encrypted virtual terminal is used to forward the audio and video stream to other non-encrypted participant terminals of the video conference. In actual application, when the speaker terminal is a non-encrypted participant terminal, the audio and video stream generated by it is transmitted to the encrypted virtual terminal. The encrypted virtual terminal is a virtualized encryption device that simulates the function of the encryption terminal and can process the audio and video stream securely without changing the non-encrypted terminal hardware. In this process, after receiving the audio and video stream from the non-encrypted participant terminal, the encrypted virtual terminal will perform necessary security checks and processing on the data to ensure that it can continue to be transmitted on a secure basis. Next, the encrypted virtual terminal will forward the processed audio and video stream to other non-encrypted participant terminals in the video conference. For example, in a remote conference of an enterprise, the device used by the speaker of the M department is a non-encrypted participant terminal, and the participants of the N department also use non-encrypted participant terminals. At this point, the audio and video streams of the spokesperson of Department M will be transmitted to the encrypted virtual terminal, which will process them and then transmit them to all participants of Department N. Since the encrypted virtual terminal can serve as a transit station and security protection layer for audio and video streams, this ensures that the transmission of audio and video streams can still be well managed and controlled even in a non-encrypted environment.
本发明实施例通过使用加密虚拟终端,可以确保在不升级或更换现有硬件设备的前提下,非加密参会方终端依然能够参与到安全级别较高的视频会议中。加密虚拟终端的使用无需对非加密参会方终端进行物理改动,这对于大规模部署或资源有限的情况下,提供了极大的便利。在传统的混合环境中,操作人员可能需要手动调整多个终端的配置以确保会议的顺畅进行。而通过加密虚拟终端的集中管理,可以自动化处理音视频流的接收与传输工作,降低了会议管理的复杂性,并减少了人为操作带来的错误风险。例如,在跨国公司的全球会议中,由于参与者可能分布在不同国家和地区,使用不同的设备类型,通过加密虚拟终端的统一管理,可以有效简化全球范围内的会议部署和管理。The embodiments of the present invention can ensure that the non-encrypted participant terminals can still participate in video conferences with a higher security level without upgrading or replacing existing hardware equipment by using encrypted virtual terminals. The use of encrypted virtual terminals does not require physical changes to the non-encrypted participant terminals, which provides great convenience for large-scale deployments or when resources are limited. In a traditional hybrid environment, operators may need to manually adjust the configurations of multiple terminals to ensure the smooth progress of the meeting. Through the centralized management of encrypted virtual terminals, the reception and transmission of audio and video streams can be automated, reducing the complexity of conference management and the risk of errors caused by human operations. For example, in a global meeting of a multinational company, since participants may be distributed in different countries and regions and use different types of equipment, the unified management of encrypted virtual terminals can effectively simplify the deployment and management of meetings on a global scale.
在本发明的一种示例性实施例中,将解密处理后的音视频流传输至视频会议的非加密参会方终端的一种实施方式为,将解密处理后的视频流的进行分辨率转换处理,并将解密处理后的音频流进行码率转换处理;将分辨率转换处理后的视频流和码率转换处理后的音频流传输至视频会议的非加密参会终端。在视频会议系统中,为了确保音视频内容在不同终端之间的无缝传输,尤其是在混合了加密与非加密终端的环境中,需要对音视频流进行适当的处理。特别是当音视频流需要从加密终端传输至非加密终端时,解密处理后的音视频流可能需要进行进一步的优化,以确保不同类型的终端能够正常接收和播放这些流媒体内容。在实际应用过程中,当音视频流通过加密虚拟终端进行解密后,需要对视频流和音频流进行进一步的处理。解密后的视频流可能具有较高的分辨率,这在一些非加密参会方终端上可能无法完美呈现,或者会导致播放时出现卡顿、延迟等问题。因此,将视频流进行分辨率转换处理是必要的步骤。分辨率转换是一种将视频的像素密度进行调整的技术,使其适应目标显示设备的分辨率。比如,将一个1080p(1920×1080像素)的高分辨率视频流转换为720p(1280×720像素)或480p(854×480像素),以适应显示能力较弱的非加密参会方终端。这不仅可以降低非加密参会终端的处理负担,还能减少视频传输过程中的数据量,从而提高传输效率和播放流畅度。In an exemplary embodiment of the present invention, an implementation method of transmitting the decrypted audio and video stream to the non-encrypted participant terminal of the video conference is to perform resolution conversion processing on the decrypted video stream and perform bit rate conversion processing on the decrypted audio stream; the video stream after resolution conversion and the audio stream after bit rate conversion are transmitted to the non-encrypted participant terminal of the video conference. In a video conferencing system, in order to ensure seamless transmission of audio and video content between different terminals, especially in an environment where encrypted and non-encrypted terminals are mixed, the audio and video streams need to be properly processed. In particular, when the audio and video stream needs to be transmitted from an encrypted terminal to a non-encrypted terminal, the decrypted audio and video stream may need to be further optimized to ensure that different types of terminals can normally receive and play these streaming media contents. In actual application, after the audio and video stream is decrypted by the encrypted virtual terminal, the video stream and the audio stream need to be further processed. The decrypted video stream may have a higher resolution, which may not be perfectly presented on some non-encrypted participant terminals, or may cause problems such as freezes and delays during playback. Therefore, it is a necessary step to perform resolution conversion processing on the video stream. Resolution conversion is a technology that adjusts the pixel density of a video to adapt it to the resolution of the target display device. For example, a 1080p (1920×1080 pixels) high-resolution video stream is converted to 720p (1280×720 pixels) or 480p (854×480 pixels) to accommodate non-encrypted participant terminals with weaker display capabilities. This not only reduces the processing burden of non-encrypted participant terminals, but also reduces the amount of data during video transmission, thereby improving transmission efficiency and playback fluency.
对于音频流的处理也同样重要。解密后的音频流可能采用了高码率(Bitrate)的编码方式,以保证音质的优越性。然而,在非加密参会方终端上,过高的码率可能会导致播放不流畅或延迟,尤其是在网络带宽有限的情况下。因此,需要对音频流进行码率转换处理。码率转换是指将音频流的传输速率调整到一个合适的范围内,以匹配非加密终端的播放能力和网络环境。例如,将一个320kbps(千比特每秒)的高码率音频流转换为128kbps,以确保非加密参会方终端能够在较低带宽环境下顺利播放音频内容,同时维持较好的音质体验。The processing of audio streams is equally important. The decrypted audio stream may be encoded in a high bitrate to ensure superior sound quality. However, on the non-encrypted participant terminal, too high a bitrate may cause playback to be jerky or delayed, especially when the network bandwidth is limited. Therefore, the audio stream needs to be bitrate converted. Bitrate conversion refers to adjusting the transmission rate of the audio stream to a suitable range to match the playback capabilities and network environment of the non-encrypted terminal. For example, a high-bitrate audio stream of 320kbps (kilobits per second) is converted to 128kbps to ensure that the non-encrypted participant terminal can smoothly play the audio content in a lower bandwidth environment while maintaining a good sound quality experience.
在完成分辨率转换和码率转换后,处理过的音视频流即可传输至视频会议的非加密参会方终端。例如,在一个跨国公司的视频会议中,如果发言人的视频流为1080p的高分辨率视频,但部分参会人员使用的终端为处理能力较弱的非加密参会方设备(如低端智能手机或老旧的电脑),这时通过上述的分辨率和码率转换处理,可以确保所有参会人员都能够流畅地观看和聆听发言人的内容,而不受设备差异的影响。After completing the resolution conversion and bit rate conversion, the processed audio and video streams can be transmitted to the non-encrypted participant terminals of the video conference. For example, in a multinational company's video conference, if the speaker's video stream is a 1080p high-resolution video, but some participants use non-encrypted participant devices with weak processing capabilities (such as low-end smartphones or old computers), then the above-mentioned resolution and bit rate conversion processing can ensure that all participants can smoothly watch and listen to the speaker's content without being affected by device differences.
本发明实施例通过对视频流的分辨率转换,可以确保视频内容能够在各种终端上进行有效展示,而不会因为分辨率过高导致播放不流畅。这不仅提升了用户的观看体验,还避免了由于终端硬件差异造成的显示问题。对音频流进行码率转换,有助于在不同的网络环境下提供更流畅的音频体验。无论是高带宽的网络,还是低带宽的环境,码率转换都能保证音频流以合适的速率进行传输,从而提升音频的清晰度和连贯性。The embodiment of the present invention can ensure that the video content can be effectively displayed on various terminals by converting the resolution of the video stream, without causing unsmooth playback due to too high a resolution. This not only improves the user's viewing experience, but also avoids display problems caused by differences in terminal hardware. Converting the bit rate of the audio stream helps to provide a smoother audio experience in different network environments. Whether it is a high-bandwidth network or a low-bandwidth environment, bit rate conversion can ensure that the audio stream is transmitted at an appropriate rate, thereby improving the clarity and coherence of the audio.
基于上述关于一种视频会议的处理方法实施例的相关说明,下面介绍一种基于视联网的混合会议处理方案。参照图2,示出了本发明实施例的一种基于视联网的混合会议处理方案的原理示意图。该一种基于视联网的混合会议处理方案可以涉及到:密码管理服务器、综合管理服务器、核心管理服务器、加密终端、加密虚拟终端、非加密参会方终端、加密参会方终端。综合管理服务器分别与密码管理服务器和核心管理服务器通信连接。核心管理服务器与视频会议的各个终端,包括但不限于加密终端、加密虚拟终端、非加密参会方终端、加密参会方终端通信连接。其中,综合管理服务器是会议管理服务的主要平台,包括自治子服务、会管子服务、网管子服务等。密码管理服务器为综合管理服务器提供密码相关功能的服务。核心管理服务器对视联网下的各个终端进行注册管理等。核心管理服务器连接至少一个加密终端。该加密终端并非视频会议中登录视频会议用户的参会方终端。该加密终端支持加密、解密、分辨率转换等处理。加密虚拟终端可以为一个虚拟的服务器。加密终端与加密虚拟终端之间通过发送广播的方式建立专属互通隧道。具体地,加密终端向加密虚拟终端发送广播,加密虚拟终端接收广播并响应,经过3次握手后,加密终端与加密虚拟终端进行连接。Based on the above description of the embodiment of a method for processing a video conference, a hybrid conference processing solution based on a visual network is introduced below. Referring to FIG. 2, a schematic diagram of the principle of a hybrid conference processing solution based on a visual network according to an embodiment of the present invention is shown. The hybrid conference processing solution based on a visual network may involve: a password management server, an integrated management server, a core management server, an encryption terminal, an encryption virtual terminal, a non-encrypted participant terminal, and an encrypted participant terminal. The integrated management server is respectively connected to the password management server and the core management server in communication. The core management server is connected to each terminal of the video conference, including but not limited to an encryption terminal, an encryption virtual terminal, a non-encrypted participant terminal, and an encrypted participant terminal. Among them, the integrated management server is the main platform for conference management services, including autonomous sub-services, conference management sub-services, network management sub-services, etc. The password management server provides services for password-related functions for the integrated management server. The core management server performs registration management and the like for each terminal under the visual network. The core management server is connected to at least one encryption terminal. The encryption terminal is not a participant terminal of a user who logs in to a video conference in a video conference. The encryption terminal supports encryption, decryption, resolution conversion, and other processing. The encryption virtual terminal can be a virtual server. The encryption terminal and the encryption virtual terminal establish a dedicated intercommunication tunnel by sending broadcasts. Specifically, the encryption terminal sends a broadcast to the encryption virtual terminal, the encryption virtual terminal receives the broadcast and responds, and after three handshakes, the encryption terminal and the encryption virtual terminal are connected.
参照图3,示出了本发明实施例的一种基于视联网的音视频流的处理方案的原理示意图。3 , there is shown a schematic diagram of the principle of a solution for processing audio and video streams based on visual networking according to an embodiment of the present invention.
综合管理客户端发起视频会议,设置加密终端为主持人角色,并设置加密虚拟终端。其他终端为登录用户的加密参会方终端和非加密参会方终端,加密参会方终端和非加密参会方终端为普通参会方角色。The integrated management client initiates a video conference, sets the encrypted terminal as the host role, and sets an encrypted virtual terminal. Other terminals are the encrypted participant terminal and non-encrypted participant terminal of the logged-in user, and the encrypted participant terminal and non-encrypted participant terminal are ordinary participant roles.
综合管理服务器根据参会角色设置参会方终端的编解码数量,设置参会方终端的编码数为5,解码数为8,设置加密终端和加密虚拟终端的编码数为8,解码数为8。综合管理服务器开启视频会议,自治子服务把参会方终端拉入视频会议。The integrated management server sets the number of codecs for the participant's terminal according to the participant's role, setting the number of codecs for the participant's terminal to 5 and the number of decodes to 8, and setting the number of codecs for the encrypted terminal and encrypted virtual terminal to 8 and the number of decodes to 8. The integrated management server starts the video conference, and the autonomous sub-service pulls the participant's terminal into the video conference.
各参会方终端入会后,给普通参会方角色的加密参会方终端调加密终端的音视频流,给非加密参会方终端调流加密虚拟终端的音视频流。非加密参会方终端如果退会后再入会,无需重新调流。After each participant terminal joins the conference, the encrypted participant terminal with the ordinary participant role will be tuned to the encrypted terminal's audio and video stream, and the non-encrypted participant terminal will be tuned to the encrypted virtual terminal's audio and video stream. If a non-encrypted participant terminal rejoins the conference after leaving the conference, it does not need to re-tune the stream.
加密参会方终端切为发言方终端时,调度子服务把调流指令发给自治子服务,自治子服务给加密终端和加密虚拟终端发送切流指令收看发言方终端的音视频流,非加密参会方终端一直收看加密虚拟终端的音视频流。When the encrypted participant terminal switches to the speaking terminal, the scheduling sub-service sends the flow adjustment instruction to the autonomous sub-service, and the autonomous sub-service sends the flow switching instruction to the encrypted terminal and the encrypted virtual terminal to watch the audio and video stream of the speaking terminal, and the non-encrypted participant terminal always watches the audio and video stream of the encrypted virtual terminal.
加密虚拟终端为一虚拟的加密服务器,收到加密的音视频流后先进行解密,再转成1080P分辨率的非加密视频流和非加密音频流。The encrypted virtual terminal is a virtual encryption server. After receiving the encrypted audio and video stream, it will be decrypted first and then converted into a non-encrypted video stream and non-encrypted audio stream with a resolution of 1080P.
需要说明的是,对于方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明实施例并不受所描述的动作顺序的限制,因为依据本发明实施例,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作并不一定是本发明实施例所必须的。It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.
参照图4,示出了本发明实施例的一种视频会议的处理系统的结构框图。该视频会议的处理系统应用于服务器,该视频会议的处理系统具体可以包含如下模块。4, a structural block diagram of a video conference processing system according to an embodiment of the present invention is shown. The video conference processing system is applied to a server, and the video conference processing system may specifically include the following modules.
终端配置模块41,用于为视频会议配置加密终端和加密虚拟终端;The terminal configuration module 41 is used to configure an encrypted terminal and an encrypted virtual terminal for a video conference;
音视频流获取模块42,用于获取所述视频会议中发言方终端的音视频流;The audio and video stream acquisition module 42 is used to acquire the audio and video stream of the speaker terminal in the video conference;
加密传输模块43,用于针对所述视频会议中的加密参会方终端,利用所述加密终端传输所述音视频流至所述加密参会方终端;An encryption transmission module 43 is used for transmitting the audio and video stream to the encryption participant terminal in the video conference by using the encryption terminal;
非加密传输模块44,用于针对所述视频会议中的非加密参会方终端,利用所述加密虚拟终端传输所述音视频流至所述非加密参会方终端。The non-encrypted transmission module 44 is used to transmit the audio and video streams to the non-encrypted participant terminals in the video conference by using the encrypted virtual terminal.
在本发明的一种示例性实施例中,所述终端配置模块41,用于将所述加密终端设置为所述视频会议的主持人角色,并通过发送广播的方式建立所述加密终端与所述加密虚拟终端之间的专属互通隧道。In an exemplary embodiment of the present invention, the terminal configuration module 41 is used to set the encryption terminal as the host role of the video conference, and establish an exclusive intercommunication tunnel between the encryption terminal and the encryption virtual terminal by sending a broadcast.
在本发明的一种示例性实施例中,所述加密传输模块43,包括:In an exemplary embodiment of the present invention, the encryption transmission module 43 includes:
加密终端转发模块,用于用于若所述发言方终端属于所述加密参会方终端,则将所述音视频流传输至所述加密终端,并利用所述加密终端转发所述音视频流至所述视频会议的其他加密参会方终端。The encryption terminal forwarding module is used to transmit the audio and video stream to the encryption terminal if the speaker terminal belongs to the encryption participant terminal, and use the encryption terminal to forward the audio and video stream to other encryption participant terminals of the video conference.
在本发明的一种示例性实施例中,所述非加密传输模块44,包括:In an exemplary embodiment of the present invention, the non-encrypted transmission module 44 includes:
专属隧道转发模块,用于若所述发言方终端属于所述加密参会方终端,则将所述音视频流传输至所述加密终端,并利用所述加密终端通过所述专属互通隧道转发所述音视频流至所述加密虚拟终端;A dedicated tunnel forwarding module, used for transmitting the audio and video stream to the encryption terminal if the speaker terminal belongs to the encryption participant terminal, and using the encryption terminal to forward the audio and video stream to the encryption virtual terminal through the dedicated intercommunication tunnel;
音视频流解密模块,用于利用所述加密虚拟终端对所述音视频流进行解密处理,并将解密处理后的音视频流传输至所述视频会议的非加密参会方终端。The audio and video stream decryption module is used to use the encrypted virtual terminal to decrypt the audio and video stream, and transmit the decrypted audio and video stream to the non-encrypted participant terminal of the video conference.
在本发明的一种示例性实施例中,所述加密传输模块43,包括:In an exemplary embodiment of the present invention, the encryption transmission module 43 includes:
加密终端加密模块,用于若所述发言方终端属于所述非加密参会方终端,则将所述音视频流传输至所述加密终端,并利用所述加密终端对所述音视频流进行加密处理;An encryption terminal encryption module, used for transmitting the audio and video stream to the encryption terminal if the speaker terminal belongs to the non-encrypted participant terminal, and encrypting the audio and video stream using the encryption terminal;
所述加密终端转发模块,还用于利用所述加密终端将加密处理后的音视频流转发至所述视频会议的所述加密参会方终端。The encryption terminal forwarding module is also used to use the encryption terminal to forward the encrypted audio and video streams to the encryption participant terminal of the video conference.
在本发明的一种示例性实施例中,所述非加密传输模块44,包括:In an exemplary embodiment of the present invention, the non-encrypted transmission module 44 includes:
加密虚拟终端转发模块,用于若所述发言方终端属于所述非加密参会方终端,则将所述音视频流传输至所述加密虚拟终端,并利用所述加密虚拟终端转发所述音视频流至所述视频会议的其他非加密参会方终端。The encrypted virtual terminal forwarding module is used to transmit the audio and video stream to the encrypted virtual terminal if the speaker terminal belongs to the non-encrypted participant terminal, and use the encrypted virtual terminal to forward the audio and video stream to other non-encrypted participant terminals of the video conference.
在本发明的一种示例性实施例中,所述音视频流解密模块,包括:In an exemplary embodiment of the present invention, the audio and video stream decryption module includes:
转换处理模块,用于将解密处理后的视频流的进行分辨率转换处理,并将解密处理后的音频流进行码率转换处理;The conversion processing module is used to perform resolution conversion processing on the decrypted video stream and bit rate conversion processing on the decrypted audio stream;
音视频流传输模块,用于将分辨率转换处理后的视频流和码率转换处理后的音频流传输至所述视频会议的所述非加密参会终端。The audio and video stream transmission module is used to transmit the video stream after resolution conversion and the audio stream after bit rate conversion to the non-encrypted participating terminals of the video conference.
对于系统实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。As for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
本领域内的技术人员应明白,本发明实施例的实施例可提供为方法、装置、或计算机程序产品。因此,本发明实施例可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明实施例可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
本发明实施例是参照根据本发明实施例的方法、终端设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理终端设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理终端设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The embodiments of the present invention are described with reference to the flowcharts and/or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and/or box in the flowchart and/or block diagram, as well as the combination of the processes and/or boxes in the flowchart and/or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate a device for implementing the functions specified in one process or multiple processes in the flowchart and/or one box or multiple boxes in the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理终端设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理终端设备上,使得在计算机或其他可编程终端设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程终端设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce computer-implemented processing, so that the instructions executed on the computer or other programmable terminal device provide steps for implementing the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.
尽管已描述了本发明实施例的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例做出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本发明实施例范围的所有变更和修改。Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.
最后,还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者终端设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者终端设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者终端设备中还存在另外的相同要素。Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
以上对本发明所提供的一种视频会议的处理方法和一种视频会议的处理系统,进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。The above is a detailed introduction to a video conference processing method and a video conference processing system provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202411152682.8A CN118921436A (en) | 2024-08-21 | 2024-08-21 | Video conference processing method and system, electronic equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202411152682.8A CN118921436A (en) | 2024-08-21 | 2024-08-21 | Video conference processing method and system, electronic equipment and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN118921436A true CN118921436A (en) | 2024-11-08 |
Family
ID=93297780
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202411152682.8A Pending CN118921436A (en) | 2024-08-21 | 2024-08-21 | Video conference processing method and system, electronic equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118921436A (en) |
-
2024
- 2024-08-21 CN CN202411152682.8A patent/CN118921436A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US12316618B2 (en) | Securely recording and retrieving encrypted video conferences | |
US9032461B2 (en) | System and method for video conferencing through a television forwarding device | |
US11394924B1 (en) | Systems and methods for enabling sub-meetings in encrypted video conferences | |
US7474326B2 (en) | Inter-network and inter-protocol video conference privacy method, apparatus, and computer program product | |
US8681981B2 (en) | Method and apparatus for transmitting voice communications related to a multimedia session | |
WO2011140739A1 (en) | Method, system and server for sharing remote document | |
US11882386B2 (en) | Sharing content across videoconferencing sub-meetings | |
CN105142008B (en) | A method of playing second terminal data using first terminal | |
US11800058B2 (en) | Generating composite presentation content in video conferences | |
CN108881801B (en) | Code stream transmission method, system, electronic equipment and storage medium for video conference | |
US20110258657A1 (en) | System and method for secured digital video broadcasting of instantaneous testimony | |
CN119484019A (en) | A method and device for recording audio and video based on quantum key | |
JP2003271530A (en) | Communication system, inter-system relevant device, program and recording medium | |
CN112653868A (en) | Cloud-based multi-person remote scene secure video conference communication system | |
CN118921436A (en) | Video conference processing method and system, electronic equipment and storage medium | |
US10142590B2 (en) | Devices, system and method for sharing a presentation | |
CN115883883A (en) | Safe transmission method and system for broadcast and television live broadcast signals | |
KR102608667B1 (en) | Electronic apparatus, server and method for controlling thereof | |
CN100356789C (en) | Method and device for protecting broadband audio-video broadcasting content | |
US12342103B2 (en) | Recording virtual whiteboards during virtual meetings | |
JP3931261B2 (en) | Distance learning system | |
US20240357059A1 (en) | Sharing content across videoconferencing sub-meetings | |
CN101714904B (en) | Key management system and method | |
WO2021109998A1 (en) | Media content transmission method and apparatus, and storage medium | |
CN101515830A (en) | Transmission method for program key of multimedia broadcast service |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication |