RU205445U1 - Distributed Controller Video Wall - Google Patents

Abstract

The utility model relates to communication technology, namely to the field of digital processing and exchange of control information, and can be used as a hardware and software complex capable of operating in video conferencing systems (VCS) using video walls (Video Wall). The technical result is to expand the functionality of the video wall by using a distributed controller as part of it. The proposed video wall includes several adjacent displays, and the display surfaces of adjacent displays form a continuous or quasi-continuous display surface of the video wall. The video wall contains a distributed controller, which includes a digital stream capture unit, the input of which receives an external video signal, and the output of the digital stream capture unit is connected through the video stream encoding unit with an IP network interface unit, which is connected to the first and second control units, respectively, connected to the first and second memory units, the first control unit being connected through the digital stream decoding unit with the digital stream broadcasting unit, the output of which is connected to the input of the display surface of the video wall. 1 ill.

Description

The utility model relates to communication technology, namely to the field of digital processing and exchange of control information, and can be used as a hardware and software complex capable of operating in video conferencing systems (VCS) using video walls (Video Wall). The distributed video wall controller (RVC) is made in a single design and contains a set of blocks, some of which are equipped with interfaces for interacting via an IP network with the external environment (telecommunication networks, databases, videoconferencing servers and terminal equipment), as well as with the video wall itself.

The proposed device is intended for use in operating telecommunication networks (public and any departmental or interdepartmental affiliation), as well as in the emerging NGN (next generation network) and post-NGN (next generation NGN network) networks. It is also possible to use a video wall with a distributed controller in SDN (software-defined network) networks with support for NFV (network function virtualization) technology. If necessary, joint work with newly emerging telecommunication networks and information systems is ensured by adapting algorithms as part of the video wall controller software.

The proposed device is designed to provide all currently used videoconferencing services with various attributes (the number of connected terminals, their functionality, geographical location, etc.), as well as with a wide range of additional types of services (change in the composition of videoconference participants, unified communications, joint work on a project, etc.).

Various solutions are known in this area.

All of them are based on technical solutions that are set out in a number of monographs, dissertations, articles and patents on video conferencing:

1. Arthur J. Improve Your Virtual Meetings: How to Communicate from Anywhere, Master Video and Conference Calls, and Collaborate Like a Pro. Kindle Edition, 2020, 101 p.

2. Jansen B.A. Performance Analysis of WebRTC-based Video Conferencing. -Master of Science Thesis, 2016, 78 p.

3. Jain P. Global Video Conferencing Market Analysis, Forecast to 2023. - Frost & Sullivan, 2019, 44 p.

4. Chachin P. Videoconferencing effortlessly. - The first mile, 2018, no. 3, p. 54-56.

5. Savelyev A.I. Optimization of algorithms for distributing multimedia data streams between server and client in video conferencing applications. - Proceedings of SPIIRAS, 2013, No. 31, p. 61-79.

6. Video wall display system. - European Patent Application EP 2 328 073 A3, 2011.

7. Video wall. - United States Patent Application Publication US 7262746 A1, 2003.

8. Video wall control system and method. Korean Patent No. 102079918, priority date 12/16/2013 (Application No. 10-2013-0164157,2013).

In patents (6) and (7), video wall-class videoconferencing equipment is implemented as a passive device in terms of resource management. Placement of controls of the controller type as part of the video wall is not provided. This approach was acceptable for the previous generation of hardware and software for video conferencing. Resource management was carried out centrally through the use of equipment called in the English language technical literature the Multipoint Control Unit (MCU) terminal group control module. The patent (8) is based on the inclusion of an MCU-type device in the video wall, which is economically unprofitable for video conferencing, but is quite appropriate for systems for continuous monitoring of hazardous objects.

The functionality of the known technical solutions does not fully meet the requirements typical of the present time and in the foreseeable future. In particular, the following important requirements are not met:

efficient use of available transport resources for transmission and reception of information required for video conferencing;

support for the required (and constantly increasing) requirements for the quality of video conferencing;

the possibility of introducing new additional types of services without significant modernization of hardware and software;

increasing the reliability of the video conferencing system due to the decentralization of management tools for its resources;

reducing the cost of organizing video conferencing, achieved by abandoning expensive means of the MCU type.

Multilateral video conferencing (VCS) has traditionally been an expensive service that was used only in corporate communication networks. First of all, this was due to the complexity and high cost of the central element of the classical video conferencing - the module for mixing media streams in the MCU [1]. This element of the videoconferencing network implements the most important functions for processing media streams that it receives from each terminal. The MCU module provides voice mixing, receiving video streams from each terminal and generating personal video streams towards the terminals with individual layouts (distribution of the received images on the screen).

This architecture significantly reduces the congestion of data transmission channels, increases the controllability of the communication network and allows providing the level of services at the proper level. At the same time, the central MCU module must contain high-performance hardware resources that ensure the implementation of the tasks.

In the classical architecture of the video conferencing organization, the terminals perform the task of encoding one video stream for transmission to the MCU and decoding one video stream coming from the MCU. In turn, the MCU performs the tasks of receiving and decoding multiple video streams, rearranging images according to the required layouts, encoding new layouts and sending them to participants. The number of active videoconferencing participants, the number of passive observers, as well as the requested quality of processed video signals are the main attributes that determine the amount of MCU resource utilization.

Many companies are facing congestion in their MCU systems, not only because of the growing number of subscribers wanting to make a video call, but also because of the increased requirements for video quality. Some subscriber terminals support not only Full HD resolution (Full High Definition resolution of 1920 × 1080 pixels) and a frame rate of at least 24 per second, but also 4K (4096 × 2160 pixels resolution) at up to 60 frames per second. The request to process a large number of high-resolution streams leads to the need to increase the capacity of the MCU, which is a complex and expensive task. An alternative to this approach is to change the principle of organizing video conferencing by using the architecture of a distributed video conferencing network. Within the framework of this architecture, tasks are redistributed between the central module of the network and the terminals.

The closest in terms of the set of essential features to the proposed solution is "Video Wall" (US Patent 7262746), which is selected as a prototype. A video wall consists of several adjacent displays. The display surfaces of adjacent displays form a continuous or quasi-continuous display surface of the video wall. The wall has an entrance adapted to receive images from multiplexed sources. Images from multiplexed sources are demultiplexed in a demultiplexer. The demultiplexer provides images from demultiplex sources to processors for display on adjacent displays. Using multiplexed sources can reduce the number of cables entering the wall or increase the number of images that can be simultaneously displayed on the wall.

Disadvantages of the prototype:

1. Inability to use the promising technology SFU (Selective Forwarding Unit) - selective forwarding.

2. Insufficient volume of additional services due to the use of a centralized control device.

3. High costs for the creation and development of video conferencing systems with poorly predictable traffic parameters.

4. Low reliability of the video conferencing system due to the use of a centralized control device.

The technical problem solved by the proposed utility model is the creation of such a device to support the functioning of video walls during videoconferencing, which will significantly improve the quality, reliability and efficiency of providing a wide range of services.

The technical result, which this technical solution is aimed at, is to expand the functionality of the video wall by using a distributed controller in its composition, which controls the operation of each video wall separately, thereby significantly improving the quality, reliability and efficiency of video conferencing.

The technical result is achieved due to the fact that the video wall, including several adjacent displays, and the display surfaces of adjacent displays form a continuous or quasi-continuous display surface of the video wall, contains a distributed controller including a digital stream capture unit, the input of which receives an external video signal, and the output of the digital capture unit flow is connected through a video stream coding unit with an IP network interface unit, which is connected to the first and second control units associated respectively with the first and second memory units, while the first control unit is connected through the digital stream decoding unit to the digital stream broadcasting unit, the output of which is connected to the input of the display surface of the video wall.

In the case of centralized distribution of video streams over N video walls, the video wall equipment is a passive device. With a decentralized distribution of video streams over N video walls, the video wall equipment becomes an active device, which makes it possible to implement the above new functionalities. At the same time, unlike a solution based on the use of a centralized control module, which independently generates personal media streams for transmission to video walls, a distributed controller sends packets, modifying their headers if necessary without video re-encoding. As a result, the performance of this type of device is significantly increased. To efficiently use the available transport resources, the distributed controller does not send all incoming packets to the video walls of the conference participants, but uses a selective sending algorithm, determining which streams should be sent to each of the video walls.

The essence of the utility model is illustrated by the following graphic materials: FIG. 1, which shows a schematic diagram of a video wall with a distributed controller, where

1 - digital stream broadcast unit,

2 - digital stream decoding unit,

3 - memory block,

4 - control unit,

5 - block for capturing a digital stream,

6 - video stream encoding unit,

7 - unit for interfacing with an IP network,

8 - memory block (duplicate block 3),

9 - control unit (backup unit 4),

10 - distributed controller, 11 - video wall displays.

The distributed controller consists of nine blocks interconnected as shown in FIG. 1. All main blocks are duplicated to ensure high reliability of the device.

Block 1 for broadcasting a digital stream (BTTSP) is designed to display information on the screens of the video wall with RVC. For this purpose, video display units (VOV) are used as part of the video wall. The hardware part of the BTCP is made in the form of boards of the same type, each of which provides communication with the BOV. When connecting M BOV, the number of boards is equal to M. Plus, one board is used as a reserve. BTCP boards are manufactured by the applicant on the basis of the following element base: Cyclone programmable logic microcircuit (FPGA), multifunctional ADSP processor.

Block 2 of digital stream decoding (BDTSP) forms a sequence of bits, which is perceived in block 1. The hardware part of BDTSP / MVT is made in the form of a software board and is manufactured by the applicant based on the following element base: Com Express super component, Congatec N4200 processor module.

The block 3 memory (BP) in the composition stores all the necessary information for the operation of the distributed controller. The PSU hardware is manufactured by the applicant based on the following element base: Com Express super component, Congatec N4200 processor module.

Control unit 4 (CU) contains the logic of the distributed video wall controller. The CU hardware and software interact with the memory block 3 and interface with the IP network 7. The information necessary for the operation of the CU is retrieved from the memory block 3. The CU hardware is manufactured by the applicant on the basis of the following element base: Com Express super component, processor module Congatec N4200.

Block 5 capture digital stream (BZTSP) provides information reception from an external video source. The source of the video signal can be any device used in the video conferencing system. The hardware part of the BZTsP is made in the form of the same type of boards, each of which provides communication with a video signal source. When L video signal sources are connected, the number of cards is L. Plus one card is used as a reserve. BZTsP boards are manufactured by the applicant on the basis of the following element base: Cyclone programmable logic microcircuit (FPGA), multifunctional ADSP processor.

Block 6 coding video stream (BKV) converts the information coming from block 5 into a sequence of bits determined by the adopted data coding law. The BKV hardware part is manufactured by the applicant based on the following element base: Com Express super component, Congatec N4200 processor module.

Unit 7 for interfacing with an IP network (BS-IP) provides functions for exchanging information with external video conferencing modules. The distributed controller uses a standard IP network based on the TCP / IP protocol stack. The BS-IP hardware part is manufactured by the applicant based on the following element base: Com Express super component, Congatec N4200 processor module.

Block 8 memory (BP) in the composition stores all the necessary information for the operation of the distributed controller. The PSU hardware is manufactured by the applicant based on the following element base: Com Express super component, Congatec N4200 processor module. It duplicates the work of block 3.

The control unit 9 (CU) contains the logic of the distributed video wall controller. The CU hardware and software interact with the memory block 3 and interface with the IP network 7. The information necessary for the operation of the CU is retrieved from the memory block 3. The CU hardware is manufactured by the applicant on the basis of the following element base: Com Express super component, processor module Congatec N4200. It duplicates the work of block 4.

Claims (1)

A video wall that includes several adjacent displays, and the display surfaces of adjacent displays form a continuous or quasi-continuous display surface of the video wall, characterized in that it contains a distributed controller including a digital stream capture unit, the input of which receives an external video signal, and the output of the digital stream capture unit is connected through the unit encoding a video stream with an IP network interface unit, which is connected to the first and second control units associated with the first and second memory units, respectively, while the first control unit is connected through the digital stream decoding unit to the digital stream broadcast unit, the output of which is connected to the surface input display video wall.

Images