CN113709540B - Multi-source video acquisition switching and display system and method based on domestic processor - Google Patents
Multi-source video acquisition switching and display system and method based on domestic processor Download PDFInfo
- Publication number
- CN113709540B CN113709540B CN202110958848.5A CN202110958848A CN113709540B CN 113709540 B CN113709540 B CN 113709540B CN 202110958848 A CN202110958848 A CN 202110958848A CN 113709540 B CN113709540 B CN 113709540B
- Authority
- CN
- China
- Prior art keywords
- video
- source
- board
- network
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2665—Gathering content from different sources, e.g. Internet and satellite
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- Astronomy & Astrophysics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to a multi-source video acquisition switching and display system and method based on a domestic processor, and belongs to the field of video display. The system comprises a video board, a network switch and a state control board, wherein the video board is connected to the network switch, the (n + 1) th video board is connected with a large screen, the other 0-n video boards finish video acquisition and coding functions, and the (n + 1) th video board and the state control board acquire a display mode and video stream information to be displayed through UART (universal asynchronous receiver/transmitter) serial port communication; the network switch completes the function of gigabit network switch, and the network video streams coded by all the video boards and other network video streams needing to be displayed are all accessed to the network switch to realize the fast switching of the video streams; the state control panel collects key information, after the display mode and the video source information needing to be displayed are obtained, the control command is sent to the video panel through the UART, and meanwhile the state information of the video panel is received and displayed on the state display screen through the other UART. The invention meets the requirements of modern informatization combat systems.
Description
Technical Field
The invention belongs to the field of video display, and particularly relates to a multi-source video acquisition switching and display system and method based on a domestic processor.
Background
In the current informatization combat system, a commander needs to observe multi-source videos such as battlefield situations, target tracks, combat data calculation, camera videos and large-screen images of other command centers, and the large-screen display of most of the command centers is accessed and switched based on a DVI matrix, so that the system has the advantages of poor expansibility, strong customization and limited supported video source types, and cannot meet the requirements of quick access and expansion of the multi-source videos.
In recent years, due to rapid development and popularization of network technologies, network-based video stream coding and decoding technologies, multi-channel network video switching and multi-window fusion display technologies are rapidly developed and applied. There is an urgent need for improvements in multi-source video switching and display for command centers based on network technology.
Disclosure of Invention
Technical problem to be solved
The technical problem to be solved by the invention is how to provide a multi-source video acquisition switching and display system and method based on a domestic processor, so as to solve the problems that large-screen display of most command centers is accessed and switched based on a DVI matrix, the expansibility is poor, the customization is strong, the types of supported video sources are limited, and the requirements of quick access and expansion of multi-source videos cannot be met.
(II) technical scheme
In order to solve the technical problem, the invention provides a multi-source video acquisition switching and display system based on a domestic processor, which comprises 1 or more video boards, a network switch and a state control board,
all the video boards are completely independent, all the video boards are connected to a network switch through 1000Base-T to realize sharing of network video streams, the (n + 1) th video board is connected with a large screen to realize video acquisition, decoding and multi-window fusion display functions, the rest 0-n video boards finish the video acquisition and coding functions, and the (n + 1) th video board and the state control board acquire a display mode and video stream information to be displayed through UART (universal asynchronous receiver transmitter) serial port communication;
the network switch completes the kilomega network switching function, a multi-channel 1000Base-T Ethernet interface is realized through the multi-channel PHY chip, and network video streams coded by all the video boards and other network video streams needing to be displayed are all accessed into the network switch to realize the quick switching of the video streams;
the state control panel collects key information, after the display mode and the video source information needing to be displayed are obtained, the control command is sent to the video panel through the UART, and meanwhile the state information of the video panel is received and displayed on the state display screen through the other UART.
Further, when the video source is not larger than 8 paths, 1 video board is adopted to finish the acquisition of the video source of 8 paths, and simultaneously, the network video stream of the network interface is decoded, and the multi-window fusion display is carried out according to the display mode received by the UART and the video source to be displayed; when the video source is larger than 8 paths, n +1 video boards are needed, wherein the 0 th to n th video boards finish multi-path video source collection and encode the multi-path video source collection into network video streams to be shared on the network switch, each video board finishes 8 paths, the n +1 th video boards finish the collection of the video sources of the rest paths, simultaneously the network video streams needing to be displayed in the network switch are decoded, and finally multi-window fusion display is also carried out according to the display mode received by the UART and the video sources needing to be displayed.
Furthermore, the video board takes a processor made in Haisi Hi3559 as a core, and various interfaces are realized through rich peripheral interfaces of Hi 3559.
Furthermore, the state control board mainly takes domestic single-chip microcomputer GD32F407 which is easy to innovate, and is provided with a plurality of GPIO ports for collecting keys and a plurality of UARTs for communication.
Further, the video board software and the state control board software communicate through a UART, the video board software comprises a hardware layer, an operating system layer, a supporting layer and an application layer, and the application layer flow is as follows: the video source is collected by the VICAP and VIPROC components and then output to the VPSS component for processing, meanwhile, the video stream receives a video stream to be displayed through the RTSP client and then is decoded by the video decoding module VDEC, the decoded video data are output to the VPSS component, and finally, the VPSS component outputs all the processed video data to the HDMI interface of the video output VO for on-screen display.
The invention provides a multi-source video acquisition switching and display method based on a domestic processor, which is characterized by comprising the following steps:
s1, when a video source is not larger than 8 paths, 1 video board based on a domestic processor finishes 8 paths of video source collection, simultaneously decodes network video stream of a network interface, and performs multi-window fusion display according to a display mode received by a UART and the video source to be displayed; when the video source is more than 8 paths, adopting n +1 video boards, wherein 0-n video boards finish multi-path video source acquisition and encode into network video streams to be shared on a network switch, each video board finishes 8 paths, the n +1 video boards finish the acquisition of the video sources of the rest paths, simultaneously decoding the network video streams needing to be displayed in the network switch, and finally performing multi-window fusion display according to a display mode received by a UART and the video sources needing to be displayed;
s2, the n +1 th video board domestic processor communicates with a domestic single chip microcomputer of the state control board through a UART (universal asynchronous receiver/transmitter), acquires a display mode acquired by the domestic single chip microcomputer and video source information to be displayed, and replies the video board state information to the domestic single chip microcomputer, and the domestic single chip microcomputer displays the video board state information on a state indication screen through another UART;
and S3, finally, the home-made processor of the video board displays the appointed video source to the appointed position according to the display mode and displays the appointed video source on the screen through the HDMI interface.
Further, when the video source is not greater than 8 paths, 1 video board collects the video source, namely the video source is processed by the capture sub-module VICAP and the processing sub-module VIPROC and then output to the VPSS component of the display module.
Further, when the video source is larger than 8 paths of 1080P, the video acquisition module of the video board software receives the video data in real time and stores the video data in the DDR, and the video coding module enables the video data of the DDR to realize real-time generation of network code stream through the VEDU coder; and the rtsp client is integrated in the video board software, receives the network code stream through a network switch, receives multiple paths of code streams by adopting IO multiplexing, transmits each path of code stream to a VDEC decoder in a multithreading mode after receiving the multiple paths of code streams, decodes the code stream, transmits the decoded code stream to a VPSS video processing subsystem, and directly transmits the scaled VPSS video processing subsystem to an HDMI (high-definition multimedia interface) of a V0 video output module for on-screen display.
Further, the domestic single chip microcomputer monitors whether a key is pressed down in real time in an interrupt mode, if yes, the domestic single chip microcomputer sends a control command of the key to the video board domestic processor, the domestic processor switches a display mode and a video source according to the key command, the domestic single chip microcomputer simultaneously monitors reply information of the domestic processor, and when the reply information is periodic information or state information, display information of the state indication screen is updated.
Further, when the video source is 20 paths, 3 video boards are adopted, wherein the 1 st video board and the 2 nd video board finish 16 paths of video source collection and encode the video source into network video streams to be shared on a network switch, the 3 rd video board finishes 4 paths of video source collection, simultaneously decodes the network video streams needing to be displayed in the network switch, and finally performs multi-window fusion display according to the display mode received by the UART and the video source needing to be displayed.
(III) advantageous effects
The invention provides a multi-source video acquisition switching and display system and method based on a domestic processor, which take a network switch as a video switching core, realize the quick access of multi-source videos by a video coding and decoding technology, show more auxiliary decision information by a multi-window fusion technology, provide a display system with strong expansibility and flexible access, support rich video source types, meet the requirements of a modern informatization combat system, ensure that a commander can grasp battlefield situations more accurately and make decisions more quickly.
Drawings
Fig. 1 is a technical solution of multi-source video acquisition switching and display based on a domestic processor according to the present invention.
FIG. 2 is a general block diagram of the software of the present invention;
FIG. 3 is a flowchart of the application software of the present invention;
fig. 4 is a flow chart of interaction between the video board software and the state control board software.
Detailed Description
In order to make the objects, contents and advantages of the present invention more apparent, the following detailed description of the present invention will be made in conjunction with the accompanying drawings and examples.
The invention relates to the technical field of video acquisition, network video encoding and decoding, video processing, video switching and fusion display, in particular to a multi-source video real-time acquisition and decoding, multi-channel video processing, multi-channel video switching and multi-window fusion display technology.
The invention provides a multisource video acquisition, switching and display system and method based on a domestic processor, aiming at the defects of the existing method. The invention designs a software and hardware technical scheme to realize the method.
The technical scheme is that the video display device comprises 1 or more video boards, a network switch and a state control board, all the video boards are completely independent and have no interconnection relation, all the video boards are connected to the network switch through 1000Base-T to realize sharing of network video streams, but only the (n + 1) th video board is connected with a large screen and needs to realize video acquisition, decoding and multi-window fusion display functions, the rest 0-n video boards only need to complete video acquisition and coding functions, and a display mode and video stream information needing to be displayed are obtained between the (n + 1) th video board and the state control board through UART serial port communication. The technical scheme is shown in a schematic block diagram in figure 1.
The video board mainly accomplishes 8 way 1080p video acquisition, decodes (coding) and the multiple window amalgamation display function, and the existing coding function of video board also has the decoding function, when the video source is not more than 8 ways, needs 1 video board, mainly accomplishes 8 ways video source and gathers, decodes network interface's network video stream simultaneously, carries out the multiple window amalgamation display according to the display mode that UART received and the video source that needs the demonstration. When the video source is larger than 8 paths (if 20 paths), 3 video boards are needed, wherein the 1 st video board and the 2 nd video board finish 16 paths of video source collection and encode the video source into network video streams to be shared on a network switch, the 3 rd video board finishes 4 paths of video source collection, simultaneously the network video streams needing to be displayed in the network switch are decoded, and finally multi-window fusion display is carried out according to a display mode received by a UART and the video source needing to be displayed. The video board takes a processor made by Haisi Hi3559 as a core, and various interfaces are realized through rich peripheral interfaces of Hi 3559:
1) A 2-channel DDR4 memory controller is embedded, DDR4 particles are expanded, and the maximum capacity can reach 8GB;
2) 2 GMACs are integrated, RGMII/RMII interfaces are supported, 2 paths of 1000Base-T network interfaces are provided externally through PHY chips, and network video stream access is realized after 1 path of the 1000Base-T network interfaces is connected with a network switch;
3) The HDMI2.0 is supported, the output of 4K @60fps is supported to the maximum extent, and the output can be directly displayed and output to the HDMI interface large screen;
4) The serial input is supported to 8 paths of 1080P MIPI/LVDS interfaces of 16xLane (8 x 2 Lane) at most, the conversion from a DVI interface to the MIPI interface is completed through video interface chips such as ADV7482, if the video source interface is not DVI, only the video interface chip needs to be replaced, and the access is flexible;
5) And 5 UART interfaces are supported, and 1 UART interface is communicated with the state control board to realize the display mode, the acquisition of video source information to be displayed and the reply of the state of the video board.
The network switch mainly completes the function of gigabit network switching, 12 paths of 1000Base-T Ethernet interfaces are realized through a multichannel PHY chip, 2 paths of the 1000Base-T Ethernet interfaces are realized through an electric light conversion module, 2 paths of optical fiber interfaces are realized, network video streams coded by all video boards and other network video streams needing to be displayed are accessed into the network switch, and the video streams are switched rapidly.
The state control panel mainly collects key information, sends a control command to the video panel through the UART after acquiring a display mode and video source information to be displayed, and simultaneously receives state information of the video panel and displays the state information on the state display screen through another UART. The state control board mainly takes domestic GD32F407 which is a single chip microcomputer and is easy to innovate, and is provided with a plurality of GPIO ports for collecting keys and a plurality of UARTs for communication.
The technical scheme comprises video board software and state control board software in terms of software, and the general block diagram of the video board software and the state control board software is shown in figure 2. The video board software and the state control board software communicate through UART, and the video board software comprises a hardware layer, an operating system layer, a supporting layer and an application layer:
hardware layer: is composed of Haisi processor Hi3559 and necessary peripheral devices. The peripheral chip comprises Flash, DDR, a video interface chip, an audio interface chip, a network PHY and the like;
operating system layer: running a Linux operating system and boot firmware;
the support layer contains the media processing platform and peripheral drivers:
the media processing platform: and shielding the difference of the operating system, supporting the media processing platform to run on the Linux operating system, and controlling the chip to complete the corresponding media processing function. The system shields hardware processing details for an application layer, provides an API (application program interface) for the application layer to complete corresponding functions, and the VICAP, the VIPROC, the VEDU, the VDEC, the VPSS and the VO are components of an MPP (media processing platform) -media processing platform;
peripheral drive: except the media software processing platform, providing corresponding drive for other related hardware processing units of the domestic processor;
application layer: based on a media software processing platform and a peripheral driver, an application software system developed by a user comprises a video acquisition module, a video encoding module, an rtsp client, a video decoding module and a display module, and an application layer flow chart is shown in fig. 3. And after being collected by the VICAP and VIPROC components, the video source is output to the VPSS component for processing, meanwhile, the video stream receives a video stream to be displayed through the RTSP client and is decoded by the video decoding module, the decoded video data is output to the VPSS component, and finally, the VPSS component outputs all processed video data to the HDMI interface of the VO for on-screen display.
The state control board software mainly completes the state control function, and sends control commands such as display mode switching, video source switching and the like to the video board software through key touch interruption.
The technical scheme adopted by the invention for solving the technical problem comprises the following steps:
s1, when the video source is not larger than 8 paths, 1 video board based on a Haisi Hi3559 domestic processor is needed to mainly finish the acquisition of the video source of 8 paths, and simultaneously, the network video stream of a network interface is decoded, and multi-window fusion display is carried out according to a display mode received by a UART and the video source needing to be displayed. When the video source is larger than 8 paths (if 20 paths), n +1 video boards are needed, wherein the 0 th to n th video boards finish multi-path video source collection and are encoded into network video streams to be shared on a network switch, each video board finishes 8 paths, the n +1 th video board finishes the collection of the video sources of the rest paths, the network video streams needing to be displayed in the network switch are decoded, and finally, multi-window fusion display is carried out according to the display mode received by the UART and the video sources needing to be displayed, so that the problems of multi-source, multi-path and switching are solved, the fast access and the system expansion are facilitated, each video board supports the video input collection of 8 paths of 1080P MIPI/LVDS serial interfaces, and the multi-path 1080P network video streams enter a domestic processor for decoding processing. For example, when a video source is greater than 8 channels (if 20 channels), 3 video boards are needed, wherein the 1 st and 2 video boards complete 16 channels of video source collection and encode the video sources into network video streams to be shared on a network switch, the 3 rd video board completes 4 channels of video source collection, simultaneously decodes the network video streams needing to be displayed in the network switch, and finally performs multi-window fusion display according to a display mode received by a UART and the video sources needing to be displayed, so that the problems of multi-source, multi-channel and switching are solved, a quick access and expansion system are facilitated, each video board supports video input collection of 8 channels of 1080P MIPI/LVDS serial interfaces, and 16 channels of 1080P network video streams enter a domestic processor for decoding processing;
s2, the n +1 th video board domestic processor communicates with a domestic single chip microcomputer of the state control board through a UART (universal asynchronous receiver/transmitter), key information such as display modes (single screen, 4-split screen or multi-split screen) acquired by the domestic single chip microcomputer and video sources needing to be displayed is acquired, the state information of the video boards is replied to the domestic single chip microcomputer, and the domestic single chip microcomputer displays the state information of the video boards on a state indication screen through another UART;
and S3, finally, the home-made processor of the video board displays the appointed video source to the appointed position according to the display mode and displays the appointed video source on the screen through the HDMI interface.
The key points of the invention are as follows:
(1) and (3) completing multi-channel video source acquisition and encoding: when the video source is not larger than 8 paths, only 1 video board is needed to be configured to collect the video source, namely the video source is processed by a capture sub-module VICAP and a processing sub-module VIPROC and then output to a VPSS component of a display module; when the video source is larger than 8 paths of 1080P, a plurality of video boards (each video board supports at most 8 paths of 1080P video sources) are needed to be configured to collect and encode the video source into a network video stream to the network switch, and due to the universality of the network, the problems of multi-source, multi-path and switching are solved, and the rapid access and expansion of the system are realized through the network. The realization method is mainly realized through a video acquisition module and a video coding module of video board software, wherein the video acquisition module is responsible for receiving video data in real time and storing the video data to the DDR, and the video coding module is responsible for realizing real-time generation of network code stream through a VEDU coder for the video data of the DDR.
(2) Decoding a video stream to be displayed on a screen: as shown in fig. 3, a rtsp client is integrated in the video board software, the rtsp client receives a network code stream through a network switch, the rtsp protocol itself transmits data based on TCP/UDP, and since multiple paths of video streams come from different network addresses, IO multiplexing is required to receive multiple paths of code streams, and after receiving the multiple paths of code streams, the rtsp client transmits each path of code stream to a VDEC (decoder) in a multithreading manner for decoding (threads corresponding to code streams not displayed on a screen are in a suspended state), and then transmits the decoded code streams to a VPSS (video processing subsystem) module.
(3) The video board domestic processor acquires key information such as a display mode (single screen, 4-split screen or multi-split screen) and a video source needing on-screen display and the like acquired by the state control board domestic singlechip through the UART, meanwhile, the video board feeds the state information back to the state control board through the UART, the interactive flow chart of video board software and state control board software is shown in figure 4, the domestic singlechip monitors whether a key is pressed down in an interrupt mode in real time, if the key is pressed down, the domestic singlechip sends a control command of the key to the video board domestic processor, the domestic processor switches the display mode and the video source according to the key command, the domestic singlechip monitors reply information of the domestic processor at the same time, and when the reply information is cycle information or state information, the display information of the state indication screen is updated;
(4) and finally, the video board domestic processor scales the acquired video and the decoded network stream according to the display mode, and directly transmits the scaled video to the HDMI interface of V0 (video output) for on-screen display.
The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, it is possible to make various improvements and modifications without departing from the technical principle of the present invention, and those improvements and modifications should be considered as the protection scope of the present invention.
Claims (9)
1. A multi-source video acquisition switching and display system based on a domestic processor is characterized in that the system comprises 1 or more video boards, a network switch and a state control board,
all the video boards are completely independent, all the video boards are connected to a network switch through 1000Base-T to realize sharing of network video streams, the (n + 1) th video board is connected with a large screen to realize video acquisition, decoding and multi-window fusion display functions, the rest 0-n video boards finish video acquisition and encoding functions, and the (n + 1) th video board and the state control board acquire display modes and video stream information to be displayed through UART (universal asynchronous receiver/transmitter) serial port communication;
the network switch completes the function of kilomega network switching, a multi-channel 1000Base-T Ethernet interface is realized through a multi-channel PHY chip, and network video streams coded by all video boards and other network video streams needing to be displayed are accessed into the network switch to realize the quick switching of the video streams;
the state control board acquires key information, after acquiring a display mode and video source information to be displayed, sends a control command to the video board through the UART, and simultaneously receives the state information of the video board and displays the state information on the state display screen through another UART;
when the video source is not more than 8 paths, 1 video board is adopted to finish the acquisition of the video source of 8 paths, and meanwhile, the network video stream of the network interface is decoded, and multi-window fusion display is carried out according to the display mode received by the UART and the video source to be displayed; when the video source is larger than 8 paths, n +1 video boards are needed, wherein the 0 th to n th video boards finish multi-path video source collection and are encoded into network video streams to be shared on a network switch, each video board finishes 8 paths, the n +1 th video board finishes the collection of the video sources of the rest paths, simultaneously the network video streams needing to be displayed in the network switch are decoded, and finally multi-window fusion display is carried out according to the display mode received by the UART and the video source needing to be displayed.
2. The multi-source video capture switching and display system based on a domestic processor of claim 1 wherein the video board is centered on the Hi3559 domestic processor and implements various interfaces through Hi3559 rich peripheral interfaces.
3. The multi-source video acquisition switching and display system based on domestic processors of claim 1, wherein the state control board is a domestic single-chip microcomputer megainnovation GD32F407 with multi-channel GPIO ports for acquisition keys and multi-channel UARTs for communication.
4. The multi-source video acquisition switching and display system based on a domestic processor of claim 1 wherein the video board software communicates with the state control board software through UART, the video board software comprises a hardware layer, an operating system layer, a support layer and an application layer, and the application layer flow is: and the video source is acquired by the VICAP and VIPROC components and then output to the VPSS component for processing, meanwhile, the video stream receives a video stream to be displayed through the RTSP client and is decoded by the video decoding module VDEC, the decoded video data is output to the VPSS component, and finally, the VPSS component outputs all processed video data to the HDMI interface of the video output VO for screen display.
5. A domestic processor based multi-source video capture switching and display method based on the system of any one of claims 1-4, the method comprising the steps of:
s1, when a video source is not larger than 8 paths, 1 video board based on a domestic processor finishes 8 paths of video source collection, simultaneously decodes network video stream of a network interface, and performs multi-window fusion display according to a display mode received by a UART and the video source to be displayed; when the video source is more than 8 paths, adopting n +1 video boards, wherein the 0 th to n th video boards finish multi-path video source collection and encode the multi-path video source into network video streams to be shared on a network switch, each video board finishes 8 paths, the n +1 th video board finishes the collection of the video source of the rest paths, simultaneously decoding the network video stream needing to be displayed in the network switch, and finally performing multi-window fusion display according to a display mode received by a UART and the video source needing to be displayed;
s2, the n +1 th video board domestic processor communicates with a domestic single chip microcomputer of the state control board through a UART (universal asynchronous receiver/transmitter), acquires a display mode acquired by the domestic single chip microcomputer and video source information to be displayed, and replies the video board state information to the domestic single chip microcomputer, and the domestic single chip microcomputer displays the video board state information on a state indication screen through another UART;
and S3, finally, the video board domestic processor displays the specified video source to the specified position according to the display mode and displays the video source on the screen through the HDMI.
6. The multi-source video capture switching and display method based on a domestic processor as claimed in claim 5, wherein when the video source is not greater than 8-way, 1 video board captures the video source, i.e. outputs to the VPSS component of the display module after being processed by the capture sub-module VICAP and the processing sub-module VIPROC.
7. The multi-source video acquisition switching and display method based on a domestic processor as claimed in claim 5, wherein when a video source is larger than 8 way 1080P, a video acquisition module of video board software receives video data in real time and stores the video data to DDR, and a video coding module realizes real-time generation of network code stream for the DDR video data through a VEDU coder; the video board software is internally integrated with a rtsp client, the rtsp client receives network code streams through a network switch, IO multiplexing is adopted to receive multi-path code streams, the rtsp client receives the multi-path code streams, transmits each path of code stream to a VDEC decoder in a multithreading mode to be decoded and then transmits the code streams to a VPSS video processing subsystem, and the VPSS video processing subsystem directly transmits the code streams to an HDMI interface of a VO video output module after zooming to perform on-screen display.
8. The multi-source video acquisition switching and display method based on a domestic processor as claimed in claim 5, wherein the domestic singlechip monitors whether a key is pressed in an interrupt manner in real time, if yes, the domestic singlechip sends a control command of the key to the video board domestic processor, the domestic processor switches the display mode and the video source according to the key command, the domestic singlechip monitors reply information of the domestic processor at the same time, and when the reply information is period information or state information, the display information of the state indication screen is updated.
9. The domestic processor-based multi-source video acquisition switching and display method according to any one of claims 5-8, wherein when the video source is 20-way, 3 video boards are used, wherein the 1 st and 2 nd video boards complete the acquisition of 16-way video source and encode the video source into network video stream to be shared on the network switch, the 3 rd video board completes the acquisition of 4-way video source, and decodes the network video stream to be displayed in the network switch, and finally performs multi-window fusion display according to the display mode received by UART and the video source to be displayed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110958848.5A CN113709540B (en) | 2021-08-20 | 2021-08-20 | Multi-source video acquisition switching and display system and method based on domestic processor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110958848.5A CN113709540B (en) | 2021-08-20 | 2021-08-20 | Multi-source video acquisition switching and display system and method based on domestic processor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113709540A CN113709540A (en) | 2021-11-26 |
| CN113709540B true CN113709540B (en) | 2022-10-25 |
Family
ID=78653605
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110958848.5A Active CN113709540B (en) | 2021-08-20 | 2021-08-20 | Multi-source video acquisition switching and display system and method based on domestic processor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113709540B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114900622A (en) * | 2022-05-17 | 2022-08-12 | 四川中普盈通科技有限公司 | Multi-channel audio and video acquisition system based on Haisi chip |
| CN116347016B (en) * | 2023-05-30 | 2023-08-22 | 广东视腾电子科技有限公司 | Matrix switcher for video conference |
| CN117676192A (en) * | 2023-12-13 | 2024-03-08 | 北京拓目科技有限公司 | An MVPS series video processing device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1720283A2 (en) * | 2003-01-16 | 2006-11-08 | Sony United Kingdom Limited | Video/audio network |
| CN106101651A (en) * | 2016-07-29 | 2016-11-09 | 天津埃特维科技有限公司 | Automated container terminal video monitoring system |
| CN108737690A (en) * | 2018-05-30 | 2018-11-02 | 湖北安心智能科技有限公司 | A kind of distributed collaboration interactive system and method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8922658B2 (en) * | 2010-11-05 | 2014-12-30 | Tom Galvin | Network video recorder system |
-
2021
- 2021-08-20 CN CN202110958848.5A patent/CN113709540B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1720283A2 (en) * | 2003-01-16 | 2006-11-08 | Sony United Kingdom Limited | Video/audio network |
| CN106101651A (en) * | 2016-07-29 | 2016-11-09 | 天津埃特维科技有限公司 | Automated container terminal video monitoring system |
| CN108737690A (en) * | 2018-05-30 | 2018-11-02 | 湖北安心智能科技有限公司 | A kind of distributed collaboration interactive system and method |
Non-Patent Citations (2)
| Title |
|---|
| The design of 4-channel video multiplexer based on FPGA;Xiaojun Xue;《2010 2nd IEEE International Conference on Information Management and Engineering》;20100603;全文 * |
| 视频监控多微机联网显示控制的设计与实现;胡刚等;《电脑学习》;20020601(第03期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113709540A (en) | 2021-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113709540B (en) | Multi-source video acquisition switching and display system and method based on domestic processor | |
| KR101488094B1 (en) | Techniques for video analytics of captured video content | |
| US8217895B2 (en) | Non-contact selection device | |
| CN108803568B (en) | Avionics control simulation system and method based on ARINC429 bus | |
| CN101577816B (en) | Device and method supporting multichannel high definition video decoding | |
| CN205160696U (en) | Show accuse equipment with multichannel video concatenation function | |
| CN102184723A (en) | Echoing device and method for multi-screen splicing processing system | |
| CN101923843A (en) | System and method for realizing redundancy backup of video signals | |
| CN111064906A (en) | Domestic processor and domestic FPGA multi-path 4K high-definition video comprehensive display method | |
| CN101527825A (en) | Monitoring system | |
| CN104113705A (en) | Distributed matrix switching system | |
| CN107807777A (en) | Multinuclear embedded television tracker human-computer interaction device and method | |
| CN113852841A (en) | Visual scene establishing method, device, equipment, medium and system | |
| CN202210851U (en) | Control device for standard definition and high-definition audio and video coding and decoding | |
| CN101547317B (en) | Multi-path video frequency matrix soft switching system and method | |
| CN102256074B (en) | Integrated personal computer-television adopting system modular design | |
| CN206413093U (en) | A kind of display with image record storage function | |
| CN210518587U (en) | Multi-channel high-definition video distributed processing equipment | |
| CN204206351U (en) | A ship-borne video integrated display and control device | |
| CN204086867U (en) | A kind of novel medical front end system control device | |
| CN201489451U (en) | Computer device | |
| CN110737385A (en) | video mouse interaction method, intelligent terminal and storage medium | |
| CN113132783B (en) | Multi-machine shared multi-screen display control system and method | |
| CN112735140B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN111866405A (en) | Video matrix equipment based on optical fiber transmission |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |