CN115174844B - Intelligent system based on video monitoring and video conference fusion - Google Patents
Intelligent system based on video monitoring and video conference fusion Download PDFInfo
- Publication number
- CN115174844B CN115174844B CN202210768285.8A CN202210768285A CN115174844B CN 115174844 B CN115174844 B CN 115174844B CN 202210768285 A CN202210768285 A CN 202210768285A CN 115174844 B CN115174844 B CN 115174844B
- Authority
- CN
- China
- Prior art keywords
- processor
- conference
- data
- client
- media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 91
- 230000004927 fusion Effects 0.000 title claims abstract description 12
- 238000007405 data analysis Methods 0.000 claims abstract description 22
- 230000005540 biological transmission Effects 0.000 claims description 20
- 238000000034 method Methods 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 10
- 238000004458 analytical method Methods 0.000 claims description 6
- 230000000977 initiatory effect Effects 0.000 claims description 3
- 238000011161 development Methods 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0876—Network architectures or network communication protocols for network security for authentication of entities based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Power Engineering (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an intelligent system based on video monitoring and video conference fusion, which comprises a conference end, an authentication module, a data analysis module, a client end module, a monitoring module, a server and a controller.
Description
Technical Field
The invention belongs to the field of intelligent systems for video monitoring and video conference fusion, and particularly relates to an intelligent system based on video monitoring and video conference fusion.
Background
The video monitoring system and the video conference system are two completely independent systems, are not related in management and use, and cannot realize intercommunication. The video monitoring system is mainly used for realizing local or remote video image display and storage and the like, and can only realize unidirectional video transmission and can not realize audio and video communication in real time. In fact, the video monitoring system and the video conference system have a plurality of common characteristics, both adopt the same video coding and decoding technology, and both realize the exchange and the distribution of video code streams by the central control unit; video images of a monitoring site need to be transmitted to a video conference site in real-time command scheduling. Therefore, the video monitoring system and the video conference system should not be two independent systems, but can be integrated technically, and should be integrated more from the practical application point of view.
The system based on video monitoring and video conference fusion cannot ensure that the video conference is free from losing and sticking in the data transmission process, is inconvenient for the development and monitoring inquiry of the video conference, cannot ensure the smoothness of the system under the condition of long-term use, and cannot ensure the safety of audio and video data generated in the use process of the system.
Disclosure of Invention
The invention aims to provide an intelligent system based on video monitoring and video conference fusion.
The technical problems to be solved by the invention are as follows:
(1) The situation that data are not lost and packet is stuck in the transmission process of the video conference cannot be guaranteed, and development and monitoring inquiry of the video conference are inconvenient;
(2) How to ensure the smoothness of the system under the condition of long service time limit of the system;
(3) How to safely use the audio and video data generated in the using process of the system.
The aim of the invention can be achieved by the following technical scheme:
the intelligent system based on video monitoring and video conference fusion comprises a conference end, an authentication module, a data analysis module, a client module, a monitoring module, a server and a controller;
The conference terminal is used for initiating and recording conference media files and comprises a first processor, a conference audio/video codec and a conference display unit, wherein the first processor sends conference instructions to the controller, the controller receives the conference instructions sent by the first processor, the controller generates inquiry instructions after receiving the conference instructions sent by the first processor, and the controller transmits the inquiry instructions to the authentication module after generating the inquiry instructions;
The client is used for developing a display conference, the client module comprises a third processor, a client audio and video acquisition unit, a media database and a client display unit, the third processor receives a conference start instruction transmitted by the controller and then generates a conference receiving instruction, the third processor transmits the conference receiving instruction to the controller after generating the conference receiving instruction, the controller receives the conference receiving instruction transmitted by the third processor, the controller transmits the start instruction to the conference after receiving the conference receiving instruction transmitted by the third processor, the first processor receives the start instruction transmitted by the controller, the first processor transmits the start instruction to the conference display unit at the same time after receiving the conference start instruction transmitted by the controller, the conference display unit receives the start instruction transmitted by the first processor and then starts the conference and displays the conference on a desktop of the conference display unit, and the conference display unit starts the conference and synchronously transmits conference contents to the client module according to an RTCP protocol after displaying the conference desktop, and the steps are as follows:
c1: the first processor generates and initiates a one-to-many mode session to the client according to the SIP protocol;
C2: the first processor acquires audio and video media data after the conference display unit starts a conference and transmits the audio and video media data to the conference audio and video codec;
And C3: the conference audio and video codec encodes the acquired audio and video media data according to an H.264 format and generates a conference media file;
and C4: the first processor transmits the conference media file to a server according to a certain transmission step;
The specific transmission steps are as follows:
D1: the first processor converts the media file into a media data stream;
D2: the first processor acquires the size of the media data stream and transmits the media data stream according to a certain anti-packet-loss rule through a TCP protocol, wherein the specific anti-packet-loss rule is as follows:
E1: the first processor converts the media data stream into fixed length bytes using a struct module;
E2: the first processor sequentially converts the media data stream into bytes with fixed length by using the struct module as a header of the media data stream and sends the media data stream as data to the server;
The server is used for receiving and processing the media data stream, the server comprises an audio/video codec, and the server receives and processes the media data according to a certain receiving rule, wherein the specific processing rule is as follows:
F1: the server receives data transmitted by the first processor;
f2: the server reads the data transmitted by the first processor to obtain bytes with fixed length;
F3: the server receives data transmitted by the first processor for the second time according to the acquired fixed-length bytes;
f4: the server converts the data transmitted by the first processor for the second time into media data, converts the media data into media files through the audio/video decoding module and sets expiration time for one month;
The server transmits the media file to the client module, the third processor receives the media file transmitted to the client module by the server, the third processor transmits the media file to the client display unit after receiving the media file transmitted to the client module by the server, the client display unit receives the media file transmitted by the third processor, and the client display unit displays the media file on the client display screen after receiving the media file transmitted by the third processor;
The client audio and video acquisition unit is used for acquiring audio and video files of the client, and the specific acquisition steps are as follows:
Step one: time division is carried out, wherein the time is divided into 24 standard time periods, and the standard time periods are from 00:00 to 01:00 is a standard time period, all standard time periods Tn are obtained by analogy, n=1, 24, n is a positive integer;
step two: the video and the audio of the client are sequentially collected according to the standard time period, and recording data are generated;
The third processor obtains the recording data and the recording time, the third processor generates a corresponding recording media file by taking the recording time as a file name after obtaining the recording data and the recording time, the third processor stores the recording media file in a media database after generating the corresponding recording media file, and the media database is used for storing the local address of the recording media file.
The authentication module is used for registering and authenticating MAC address information of the conference terminal and the monitoring terminal, the authentication module comprises a second processor, a client information database and a monitoring information database, the second processor receives a query instruction transmitted to the authentication module by the controller, and the second processor queries conference client data in the conference client information database according to a certain rule after receiving the query instruction transmitted to the authentication module by the controller, and generates client information data, wherein the specific query rule is as follows:
A1: the MAC is used as a query field to accurately query the client information database through the sql structured query statement;
a2: splicing the queried data according to a certain splicing rule to generate client information data;
The specific splicing rules are as follows:
b1: the second processor respectively acquires MAC address data Mi corresponding to an MAC field in a conference client information database, wherein i is a positive integer greater than or equal to 1;
B2: storing the data corresponding to the MAC field in the conference client information database respectively acquired by the second processor in a list, and separating to acquire a group of information data consisting of a list [ M1, M2, mi ] form;
b3: the second processor takes the MAC as a key of a field and the list [ M1, M2, ], mi as a value of a dictionary to splice, so as to obtain a group of conference client information data formed by the dictionary { MAC: [ M1, M2, ], mi;
The second processor transmits the client information data to the data analysis module, the data analysis module receives the client information data transmitted by the second processor, and the data analysis module analyzes the client information data to a plurality of groups of MAC address data according to a certain analysis rule after receiving the client information data transmitted by the second processor, wherein the specific analysis rule is as follows:
s1: the second processor acquires client information data and acquires key MAC of the dictionary;
s2: acquiring a value list [ M1, M2, & Mi ] corresponding to the key MAC of the dictionary through the key MAC of the dictionary;
S3: each data in the list is taken out in a list index slice mode to obtain a plurality of groups of MAC address data;
The data analysis module transmits a plurality of groups of MAC address data to the controller, the controller is used for sending a conference opening instruction to the client module, the controller receives the plurality of groups of MAC address data transmitted by the data analysis module, and the controller transmits the conference opening instruction to the client module after receiving the plurality of groups of MAC address data transmitted by the data analysis module.
The video monitoring terminal comprises a fourth processor and a monitoring terminal display unit, and the video monitoring module is used for monitoring the conference terminal and the client terminal and comprises the following specific steps:
g1: the fourth processor transmits an authentication instruction to the controller;
And G2: the controller transmits a query instruction to the authentication module;
And G3: the second processor receives a query instruction transmitted by the controller to the authentication module, and queries the monitoring authentication data in the monitoring information database according to a certain rule to generate authentication data when receiving the query instruction transmitted by the controller to the authentication module, wherein the specific query rule is as follows:
H1: the MAC is used as a query field to accurately query the monitoring information database through the sql structured query statement, and authentication data is generated;
the second processor transmits authentication data to the monitoring end, the fourth processor receives the authentication data transmitted by the second processor, the fourth processor acquires the MAC address of the authentication data after receiving the authentication data transmitted by the second processor, the fourth processor acquires the MAC address of the monitoring end, the fourth processor compares the acquired MAC address of the monitoring end with the MAC address of the authentication data and generates a monitoring permission instruction after successful comparison, the fourth processor transmits the monitoring permission instruction to the controller, the controller receives the monitoring permission instruction transmitted by the fourth processor and then respectively transmits a media transmission instruction to the server and transmits a query instruction to the client, the server receives the media transmission instruction transmitted by the controller, the server synchronously transmits the media file transmitted to the client module to the monitoring end after receiving the media control instruction transmitted by the controller, the fourth processor displays the media file in the monitoring end display unit after receiving the media file transmitted by the server, the third processor receives the media file, the media file is transmitted by the third processor after receiving the media file, the media file is queried by the third processor, the media file is transmitted by the third processor according to a certain rule, the media file is queried after the third processor receives the media file transmitted by the media file, the third processor is queried according to the media file received by the media control instruction, the third processor is transmitted by the third processor:
L1: the third processor transmits the media file to the client audio/video codec;
l2: the client audio/video codec encodes the acquired audio/video media data according to an H.264 format and generates a client media file;
l3: the third processor transmits the client-side media file to the server according to a certain transmission step;
The specific transmission steps are as follows:
p1: the third processor converts the media file into a media data stream;
P2: the third processor acquires the size of the media data stream and transmits the media data stream according to a certain anti-packet-loss rule through a TCP protocol, wherein the specific anti-packet-loss rule is as follows:
Q1: the third processor converts the media data stream into fixed length bytes using a struct module;
Q2: the third processor sequentially converts the media data stream into bytes with fixed length by using the struct module as a header of the media data stream and sends the media data stream as data to the server;
The server is used for receiving and processing the media data stream, and the server receives and processes the media data according to a certain receiving rule, wherein the specific processing rule is as follows:
r1: the server receives the data transmitted by the third processor;
r2: the server reads the data transmitted by the third processor to obtain bytes with fixed length;
R3: the server receives data transmitted by the third processor for the second time according to the acquired fixed-length bytes;
r4: the server converts the data transmitted by the third processor for the second time into media data, converts the media data into media files through an audio-video encoder and sets expiration time for one month;
The server transmits the media file to the monitoring end, the fourth processor receives the media file and transmits the media file to the monitoring end display unit, and the monitoring end display unit receives the media file transmitted by the fourth processor and displays the media file on the monitoring screen.
The invention has the beneficial effects that:
(1) The invention makes the message head with fixed length by using the size of the media data, the server receives and analyzes the message head, and receives the media data according to the information transmitted by the message head, thereby avoiding the phenomena of losing and sticking packets in the process of data transmission;
(2) According to the invention, the media data stored by the conference terminal are stored in the server, so that the phenomenon of blocking of the conference terminal in the process of starting the conference is avoided, the media data of the client terminal are stored in the client terminal, and the phenomenon of unsmooth system under the condition of long service life of the system caused by excessive storage of the media data by the server is avoided.
(3) According to the invention, the second processor is used for acquiring the transmitted authentication data of the client and the monitoring end and the MAC addresses stored in the client information database and the monitoring information database, and the second processor is used for respectively transmitting the MAC addresses to the client and the monitoring end and comparing the MAC addresses of the client and the monitoring end, so that other unauthorized operation is prevented from entering a system to check the video in the system, and the safety of audio and video data generated in the use process of the system is ensured.
Drawings
The present invention is further described below with reference to the accompanying drawings for the convenience of understanding by those skilled in the art.
Fig. 1 is a system block diagram of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
As shown in fig. 1, the intelligent system based on video monitoring and video conference fusion comprises a conference end, an authentication module, a data analysis module, a client module, a monitoring module, a server and a controller.
The conference terminal is used for initiating and recording conference media files and comprises a first processor, a conference audio/video codec and a conference display unit, wherein the first processor sends conference instructions to the controller, the controller receives the conference instructions sent by the first processor, the controller generates inquiry instructions after receiving the conference instructions sent by the first processor, and the controller transmits the inquiry instructions to the authentication module after generating the inquiry instructions;
The authentication module is used for registering and authenticating MAC address information of the conference terminal and the monitoring terminal, the authentication module comprises a second processor, a client information database and a monitoring information database, the second processor receives a query instruction transmitted to the authentication module by the controller, and the second processor queries conference client data in the conference client information database according to a certain rule after receiving the query instruction transmitted to the authentication module by the controller, and generates client information data, wherein the specific query rule is as follows:
A1: the MAC is used as a query field to accurately query the client information database through the sql structured query statement;
a2: splicing the queried data according to a certain splicing rule to generate client information data;
The specific splicing rules are as follows:
b1: the second processor respectively acquires MAC address data Mi corresponding to an MAC field in a conference client information database, wherein i is a positive integer greater than or equal to 1;
B2: storing the data corresponding to the MAC field in the conference client information database respectively acquired by the second processor in a list, and separating to acquire a group of information data consisting of a list [ M1, M2, mi ] form;
B3: the second processor concatenates the MAC as a key of the field and the list [ M1, M2, mi ] as a value of the dictionary to obtain a set of conference client information data in the form of the dictionary { MAC: [ M1, M2, mi ] }.
The second processor transmits the client information data to the data analysis module, the data analysis module receives the client information data transmitted by the second processor, and the data analysis module analyzes the client information data to a plurality of groups of MAC address data according to a certain analysis rule after receiving the client information data transmitted by the second processor, wherein the specific analysis rule is as follows:
s1: the second processor acquires client information data and acquires key MAC of the dictionary;
s2: acquiring a value list [ M1, M2, & Mi ] corresponding to the key MAC of the dictionary through the key MAC of the dictionary;
s3: and taking out each data in the list in a list index slice mode to obtain a plurality of groups of MAC address data.
The data analysis module transmits a plurality of groups of MAC address data to the controller, the controller is used for sending a conference opening instruction to the client module, the controller receives the plurality of groups of MAC address data transmitted by the data analysis module, and the controller transmits the conference opening instruction to the client module after receiving the plurality of groups of MAC address data transmitted by the data analysis module.
The client is used for developing a display conference, the client module comprises a third processor, a client audio and video acquisition unit, a media database and a client display unit, the third processor receives a conference start instruction transmitted by the controller and then generates a conference receiving instruction, the third processor transmits the conference receiving instruction to the controller after generating the conference receiving instruction, the controller receives the conference receiving instruction transmitted by the third processor, the controller transmits the start instruction to the conference after receiving the conference receiving instruction transmitted by the third processor, the first processor receives the start instruction transmitted by the controller, the first processor transmits the start instruction to the conference display unit at the same time after receiving the conference start instruction transmitted by the controller, the conference display unit receives the start instruction transmitted by the first processor and then starts the conference and displays the conference on a desktop of the conference display unit, and the conference display unit starts the conference and synchronously transmits conference contents to the client module according to an RTCP protocol after displaying the conference desktop, and the steps are as follows:
c1: the first processor generates and initiates a one-to-many mode session to the client according to the SIP protocol;
C2: the first processor acquires audio and video media data after the conference display unit starts a conference and transmits the audio and video media data to the conference audio and video codec;
And C3: the conference audio and video codec encodes the acquired audio and video media data according to an H.264 format and generates a conference media file;
and C4: the first processor transmits the conference media file to a server according to a certain transmission step;
The specific transmission steps are as follows:
D1: the first processor converts the media file into a media data stream;
D2: the first processor acquires the size of the media data stream and transmits the media data stream according to a certain anti-packet-loss rule through a TCP protocol, wherein the specific anti-packet-loss rule is as follows:
E1: the first processor converts the media data stream into fixed length bytes using a struct module;
E2: the first processor sequentially converts the media data stream using the struct module into fixed length bytes as a header of the media data stream and transmits the media data stream as data to the server.
The server is used for receiving and processing the media data stream, the server comprises an audio/video codec, and the server receives and processes the media data according to a certain receiving rule, wherein the specific processing rule is as follows:
F1: the server receives data transmitted by the first processor;
f2: the server reads the data transmitted by the first processor to obtain bytes with fixed length;
F3: the server receives data transmitted by the first processor for the second time according to the acquired fixed-length bytes;
F4: the server converts the data transmitted by the first processor for the second time into media data and into media files through the audio/video decoding module, and sets expiration time for one month.
The server transmits the media file to the client module, the third processor receives the media file transmitted to the client module by the server, the third processor transmits the media file to the client display unit after receiving the media file transmitted to the client module by the server, the client display unit receives the media file transmitted by the third processor, and the client display unit displays the media file on the client display screen after receiving the media file transmitted by the third processor.
The client audio and video acquisition unit is used for acquiring audio and video files of the client, and the specific acquisition steps are as follows:
Step one: time division is carried out, wherein the time is divided into 24 standard time periods, and the standard time periods are from 00:00 to 01:00 is a standard time period, all standard time periods Tn are obtained by analogy, n=1, 24, n is a positive integer;
step two: and acquiring video and audio of the client in turn according to the standard time period, and generating recording data.
The third processor obtains the recording data and the recording time, the third processor generates a corresponding recording media file by taking the recording time as a file name after obtaining the recording data and the recording time, the third processor stores the recording media file in a media database after generating the corresponding recording media file, and the media database is used for storing the local address of the recording media file.
The video monitoring terminal comprises a fourth processor and a monitoring terminal display unit, and the video monitoring module is used for monitoring the conference terminal and the client terminal and comprises the following specific steps:
g1: the fourth processor transmits an authentication instruction to the controller;
And G2: the controller transmits a query instruction to the authentication module;
And G3: the second processor receives a query instruction transmitted by the controller to the authentication module, and queries the monitoring authentication data in the monitoring information database according to a certain rule to generate authentication data when receiving the query instruction transmitted by the controller to the authentication module, wherein the specific query rule is as follows:
H1: the MAC is used as a query field to accurately query the monitoring information database through the sql structured query statement, and authentication data is generated;
the second processor transmits authentication data to the monitoring end, the fourth processor receives the authentication data transmitted by the second processor, the fourth processor acquires the MAC address of the authentication data after receiving the authentication data transmitted by the second processor, the fourth processor acquires the MAC address of the monitoring end, the fourth processor compares the acquired MAC address of the monitoring end with the MAC address of the authentication data and generates a monitoring permission instruction after successful comparison, the fourth processor transmits the monitoring permission instruction to the controller, the controller receives the monitoring permission instruction transmitted by the fourth processor and then respectively transmits a media transmission instruction to the server and transmits a query instruction to the client, the server receives the media transmission instruction transmitted by the controller, the server synchronously transmits the media file transmitted to the client module to the monitoring end after receiving the media control instruction transmitted by the controller, the fourth processor displays the media file in the monitoring end display unit after receiving the media file transmitted by the server, the third processor receives the media file, the media file is transmitted by the third processor after receiving the media file, the media file is queried by the third processor, the media file is transmitted by the third processor according to a certain rule, the media file is queried after the third processor receives the media file transmitted by the media file, the third processor is queried according to the media file received by the media control instruction, the third processor is transmitted by the third processor:
L1: the third processor transmits the media file to the client audio/video codec;
l2: the client audio/video codec encodes the acquired audio/video media data according to an H.264 format and generates a client media file;
l3: the third processor transmits the client-side media file to the server according to a certain transmission step;
The specific transmission steps are as follows:
p1: the third processor converts the media file into a media data stream;
P2: the third processor acquires the size of the media data stream and transmits the media data stream according to a certain anti-packet-loss rule through a TCP protocol, wherein the specific anti-packet-loss rule is as follows:
Q1: the third processor converts the media data stream into fixed length bytes using a struct module;
Q2: the third processor sequentially converts the media data stream using the struct module into fixed length bytes as a header of the media data stream and transmits the media data stream as data to the server.
The server is used for receiving and processing the media data stream, and the server receives and processes the media data according to a certain receiving rule, wherein the specific processing rule is as follows:
r1: the server receives the data transmitted by the third processor;
r2: the server reads the data transmitted by the third processor to obtain bytes with fixed length;
R3: the server receives data transmitted by the third processor for the second time according to the acquired fixed-length bytes;
R4: the server converts the data transferred by the third processor for the second time into media data and into media files by the audio-video encoder and sets the expiration time for one month.
The server transmits the media file to the monitoring end, the fourth processor receives the media file and transmits the media file to the monitoring end display unit, and the monitoring end display unit receives the media file transmitted by the fourth processor and displays the media file on the monitoring screen.
In the description of the present specification, the descriptions of the terms "one embodiment," "example," "specific example," and the like, mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. The foregoing is merely illustrative and explanatory of the invention, as various modifications and additions may be made to the particular embodiments described, or in a similar manner, by those skilled in the art, without departing from the scope of the invention or exceeding the scope of the invention as defined in the claims.
Claims (3)
1. The intelligent system based on video monitoring and video conference fusion is characterized by comprising a conference end, an authentication module, a data analysis module, a client module, a monitoring module, a server and a controller;
The conference terminal is used for initiating and recording conference media files and comprises a first processor, a conference audio/video codec and a conference display unit, wherein the first processor sends conference instructions to the controller, the controller receives the conference instructions sent by the first processor, the controller generates inquiry instructions after receiving the conference instructions sent by the first processor, and the controller transmits the inquiry instructions to the authentication module after generating the inquiry instructions;
The client is used for developing a display conference, the client module comprises a third processor, a client audio and video acquisition unit, a media database and a client display unit, the third processor receives a conference start instruction transmitted by the controller and then generates a conference receiving instruction, the third processor transmits the conference receiving instruction to the controller after generating the conference receiving instruction, the controller receives the conference receiving instruction transmitted by the third processor, the controller transmits the start instruction to the conference after receiving the conference receiving instruction transmitted by the third processor, the first processor receives the start instruction transmitted by the controller, the first processor transmits the start instruction to the conference display unit at the same time after receiving the conference start instruction transmitted by the controller, the conference display unit receives the start instruction transmitted by the first processor and then starts the conference and displays the conference on a desktop of the conference display unit, and the conference display unit starts the conference and synchronously transmits conference contents to the client module according to an RTCP protocol after displaying the conference desktop, and the steps are as follows:
c1: the first processor generates and initiates a one-to-many mode session to the client according to the SIP protocol;
C2: the first processor acquires audio and video media data after the conference display unit starts a conference and transmits the audio and video media data to the conference audio and video codec;
And C3: the conference audio and video codec encodes the acquired audio and video media data according to an H.264 format and generates a conference media file;
and C4: the first processor transmits the conference media file to a server according to a certain transmission step;
The specific transmission steps are as follows:
D1: the first processor converts the media file into a media data stream;
D2: the first processor acquires the size of the media data stream and transmits the media data stream according to a certain anti-packet-loss rule through a TCP protocol, wherein the specific anti-packet-loss rule is as follows:
E1: the first processor converts the media data stream into fixed length bytes using a struct module;
E2: the first processor sequentially converts the media data stream into bytes with fixed length by using the struct module as a header of the media data stream and sends the media data stream as data to the server;
The server is used for receiving and processing the media data stream, the server comprises an audio/video codec, and the server receives and processes the media data according to a certain receiving rule, wherein the specific processing rule is as follows:
F1: the server receives data transmitted by the first processor;
f2: the server reads the data transmitted by the first processor to obtain bytes with fixed length;
F3: the server receives data transmitted by the first processor for the second time according to the acquired fixed-length bytes;
f4: the server converts the data transmitted by the first processor for the second time into media data, converts the media data into media files through the audio/video decoding module and sets expiration time for one month;
The server transmits the media file to the client module, the third processor receives the media file transmitted to the client module by the server, the third processor transmits the media file to the client display unit after receiving the media file transmitted to the client module by the server, the client display unit receives the media file transmitted by the third processor, and the client display unit displays the media file on the client display screen after receiving the media file transmitted by the third processor;
The client audio and video acquisition unit is used for acquiring audio and video files of the client, and the specific acquisition steps are as follows:
Step one: time division is carried out, wherein the time is divided into 24 standard time periods, and the standard time periods are from 00:00 to 01:00 is a standard time period, all standard time periods Tn are obtained by analogy, n=1, 24, n is a positive integer;
step two: the video and the audio of the client are sequentially collected according to the standard time period, and recording data are generated;
The third processor obtains the recording data and the recording time, the third processor generates a corresponding recording media file by taking the recording time as a file name after obtaining the recording data and the recording time, the third processor stores the recording media file in a media database after generating the corresponding recording media file, and the media database is used for storing the local address of the recording media file.
2. The intelligent system based on video monitoring and video conference fusion according to claim 1, wherein the authentication module is used for registering and authenticating MAC address information of the conference end and the monitoring end, the authentication module comprises a second processor, a client information database and a monitoring information database, the second processor receives a query instruction transmitted from the controller to the authentication module, the second processor queries conference client data in the conference client information database according to a certain rule after receiving the query instruction transmitted from the controller to the authentication module, and the specific query rule is as follows:
A1: the MAC is used as a query field to accurately query the client information database through the sql structured query statement;
a2: splicing the queried data according to a certain splicing rule to generate client information data;
The specific splicing rules are as follows:
b1: the second processor respectively acquires MAC address data Mi corresponding to an MAC field in a conference client information database, wherein i is a positive integer greater than or equal to 1;
B2: storing the data corresponding to the MAC field in the conference client information database respectively acquired by the second processor in a list, and separating to acquire a group of information data consisting of a list [ M1, M2, mi ] form;
b3: the second processor takes the MAC as a key of a field and the list [ M1, M2, ], mi as a value of a dictionary to splice, so as to obtain a group of conference client information data formed by the dictionary { MAC: [ M1, M2, ], mi;
The second processor transmits the client information data to the data analysis module, the data analysis module receives the client information data transmitted by the second processor, and the data analysis module analyzes the client information data to a plurality of groups of MAC address data according to a certain analysis rule after receiving the client information data transmitted by the second processor, wherein the specific analysis rule is as follows:
s1: the second processor acquires client information data and acquires key MAC of the dictionary;
s2: acquiring a value list [ M1, M2, & Mi ] corresponding to the key MAC of the dictionary through the key MAC of the dictionary;
S3: each data in the list is taken out in a list index slice mode to obtain a plurality of groups of MAC address data;
The data analysis module transmits a plurality of groups of MAC address data to the controller, the controller is used for sending a conference opening instruction to the client module, the controller receives the plurality of groups of MAC address data transmitted by the data analysis module, and the controller transmits the conference opening instruction to the client module after receiving the plurality of groups of MAC address data transmitted by the data analysis module.
3. The intelligent system based on video monitoring and video conference fusion according to claim 2, wherein the video monitoring terminal comprises a fourth processor and a monitoring terminal display unit, and the video monitoring module is used for monitoring the conference terminal and the client terminal, and specifically comprises the following steps:
g1: the fourth processor transmits an authentication instruction to the controller;
And G2: the controller transmits a query instruction to the authentication module;
And G3: the second processor receives a query instruction transmitted by the controller to the authentication module, and queries the monitoring authentication data in the monitoring information database according to a certain rule to generate authentication data when receiving the query instruction transmitted by the controller to the authentication module, wherein the specific query rule is as follows:
H1: the MAC is used as a query field to accurately query the monitoring information database through the sql structured query statement, and authentication data is generated;
The second processor transmits authentication data to the monitoring end, the fourth processor receives the authentication data transmitted by the second processor, the fourth processor acquires the MAC address of the authentication data after receiving the authentication data transmitted by the second processor, the fourth processor acquires the MAC address of the monitoring end, the fourth processor compares the acquired MAC address of the monitoring end with the MAC address of the authentication data and generates a monitoring permission instruction after successful comparison, the fourth processor transmits the monitoring permission instruction to the controller, the controller receives the monitoring permission instruction transmitted by the fourth processor and then respectively transmits a media transmission instruction to the server and transmits a query instruction to the client, the server receives the media transmission instruction transmitted by the controller, the server synchronously transmits the media file transmitted to the client module to the monitoring end after receiving the media control instruction transmitted by the controller, the fourth processor receives the media file transmitted to the monitoring end, displays the media file in a display unit of the monitoring end, the controller receives the media file transmitted by the third processor, and transmits the media file to the third processor after receiving the media file, the media file is queried by the third processor, and the media file is queried according to the media file acquired by the third processor, and the media file is queried by the third processor after the third processor receives the media file data transmitted by the third processor, and the media file is queried by the third processor;
The server transmits the media file to the monitoring end, the fourth processor receives the media file and transmits the media file to the monitoring end display unit, and the monitoring end display unit receives the media file transmitted by the fourth processor and displays the media file on the monitoring screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210768285.8A CN115174844B (en) | 2022-07-01 | 2022-07-01 | Intelligent system based on video monitoring and video conference fusion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210768285.8A CN115174844B (en) | 2022-07-01 | 2022-07-01 | Intelligent system based on video monitoring and video conference fusion |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115174844A CN115174844A (en) | 2022-10-11 |
| CN115174844B true CN115174844B (en) | 2024-06-21 |
Family
ID=83489657
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210768285.8A Active CN115174844B (en) | 2022-07-01 | 2022-07-01 | Intelligent system based on video monitoring and video conference fusion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115174844B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116614682B (en) * | 2023-04-26 | 2024-04-02 | 天地阳光通信科技（北京）有限公司 | All-media integrated audio and video recording and on-demand system and processing method |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040230655A1 (en) * | 2003-05-16 | 2004-11-18 | Chia-Hsin Li | Method and system for media playback architecture |
| CN1913533B (en) * | 2006-09-05 | 2011-01-12 | 北京天地互连信息技术有限公司 | Remote video monitoring system based on session initialize protocol and its implementing method |
| CN101483758B (en) * | 2008-01-11 | 2012-11-21 | 天地阳光通信科技（北京）有限公司 | Fusion system for video monitoring system and video meeting system |
| CN101583021A (en) * | 2009-05-21 | 2009-11-18 | 上海华平信息技术股份有限公司 | Monitoring device used in video conferencing monitoring system |
| KR101008753B1 (en) * | 2010-01-14 | 2011-01-14 | 주식회사 씨앤드디큐브 | Multimedia data streaming system |
| CN102387339B (en) * | 2011-10-24 | 2014-09-10 | 中兴通讯股份有限公司 | Method and system for integrating video conference with video monitoring |
| CN103795962B (en) * | 2012-11-01 | 2017-09-01 | 华平信息技术股份有限公司 | Video conferencing monitoring system |
| CN105898187A (en) * | 2016-05-04 | 2016-08-24 | 广州颐希颉信息科技有限公司 | Method, device and system for implementation of remote communications |
| CN106791576B (en) * | 2016-12-23 | 2020-01-21 | 安徽四创电子股份有限公司 | Fusion method of fusion system of video monitoring system and video conference system |
| US9843606B1 (en) * | 2017-01-13 | 2017-12-12 | Ringcentral, Inc. | Systems and methods for conferencing |
| CN109348163B (en) * | 2018-11-12 | 2021-07-23 | 上海赛连信息科技有限公司 | Video conference and video surveillance fusion system and method |
| CN113645434A (en) * | 2021-10-14 | 2021-11-12 | 深圳市鹏创软件有限公司 | Video conference and video monitoring fusion method, system, terminal and storage medium |
-
2022
- 2022-07-01 CN CN202210768285.8A patent/CN115174844B/en active Active
Non-Patent Citations (2)
| Title |
|---|
| A Grouped Network Video Conference System Based on JMF in Collaborative Design Environment;Pengfei Zeng等;2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System;20080903;第129-136页 * |
| 浅析视频会议系统和视频监控系统的融合建设;侯文超;信息技术与信息化;20190525(第5期);第228-230页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115174844A (en) | 2022-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111683069B (en) | Customized communication protocol and service method based on netty framework | |
| US6205140B1 (en) | Communication of dynamic dependencies along media streams | |
| US7809851B2 (en) | Session description message extensions | |
| TWI519147B (en) | System and method for providing and transmitting condensed streaming content | |
| US7558221B2 (en) | Method and system for recording videoconference data | |
| CN109889762B (en) | Conference control method and device | |
| US7996540B2 (en) | Method and system for replacing media stream in a communication process of a terminal | |
| CN110049271B (en) | Video networking conference information display method and device | |
| CN115174844B (en) | Intelligent system based on video monitoring and video conference fusion | |
| CN109194915B (en) | Video data processing method and system | |
| WO2002087134B1 (en) | Interactive streaming media production tool using communication optimization | |
| CN106060076A (en) | Real-time streaming media multi-path forwarding method and system based on HIKVISION equipment | |
| CN101094389A (en) | Method for downloading video, video server, and monitoring center system | |
| CN110166742B (en) | Video distribution method and device based on video networking | |
| CN102256165B (en) | Method of video conference permission sharing system for network television set-top box | |
| CN110798648A (en) | Video conference processing method and system | |
| CN106534889B (en) | A Real-time Streaming Media Multiplex Forwarding Method Based on Ring Buffer | |
| CN110012063B (en) | Data packet processing method and system | |
| CN110740133A (en) | network voting and election method and system based on RTMP protocol | |
| KR100640918B1 (en) | How to Create a Stream File for an Internet Streaming Service | |
| CN109379553B (en) | Audio and video data display method and system | |
| CN109802944B (en) | Method and system for releasing live broadcast based on video network | |
| CN113746912A (en) | DCS monitoring system and method for acquiring DCS control data | |
| CN110557372B (en) | Data acquisition method and system | |
| US20020174437A1 (en) | Method and apparatus for controlling image quality by culling transmitted image information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |