CN117729295A

CN117729295A - Multi-camera video data transmission method, device, equipment and storage medium

Info

Publication number: CN117729295A
Application number: CN202311767588.9A
Authority: CN
Inventors: 朱健; 张振林; 林文韬
Original assignee: China Automotive Innovation Corp
Current assignee: China Automotive Innovation Corp
Priority date: 2023-12-20
Filing date: 2023-12-20
Publication date: 2024-03-19

Abstract

The application provides a multi-camera video data transmission method, a device, equipment and a storage medium, wherein the method comprises the steps of controlling a preset number of cameras to simultaneously expose so that each camera respectively generates a corresponding target video; controlling each camera to process the corresponding target video respectively to obtain a target data packet corresponding to each camera; and controlling each camera to sequentially transmit the message data in the target data packet corresponding to each camera to a receiving end from the corresponding preset moment according to the preset time interval until all the message data included in each camera are transmitted. According to the technical scheme, video data of a plurality of cameras are almost synchronously transmitted in the gigabit network, the dependence on the ultra-high speed gigabit network is reduced, and therefore the network setting cost is reduced; meanwhile, stability, integrity and bandwidth utilization rate of data transmission are improved, and packet loss rate is reduced.

Description

Multi-camera video data transmission method, device, equipment and storage medium

Technical Field

The application belongs to the technical field of computers, and particularly relates to a multi-camera video data transmission method, device, equipment and storage medium.

Background

In the prior art, when multiple cameras transmit video data, a larger bandwidth is required, especially in the application environment of cooperation of people, roads and clouds, multiple industrial cameras transmit video data at the same time, often a transmission environment of a tera-mega network is required to be set, which means that the network setting cost is high and the bandwidth is wasted much; the use of the gigabit network for transmission can reduce cost, but the use of the gigabit network for transmission of video data of a plurality of industrial cameras is prone to message loss, which results in the situation that the video data cannot be completely transmitted and received.

Disclosure of Invention

In order to solve the technical problems, the application provides a multi-camera video data transmission method, device, equipment and storage medium, so that video data of a plurality of cameras can be almost synchronously transmitted in a gigabit network, the dependence on an ultra-high speed network is reduced, the data transmission efficiency and stability are improved, the data loss rate is reduced, the network setting cost is reduced, and the bandwidth waste is reduced.

In one aspect, the present application proposes a method for transmitting multi-camera video data, the method comprising: controlling a preset number of cameras to simultaneously expose so that each camera respectively generates a corresponding target video; controlling each camera to process the corresponding target video respectively to obtain target data packets corresponding to each camera, wherein each target data packet corresponding to each camera comprises a plurality of message data; and controlling each camera to sequentially transmit the message data in the target data packet corresponding to each camera to a receiving end according to a preset time interval from the corresponding preset time, until all the message data contained in each camera are transmitted, wherein the preset time interval is determined according to the preset number of the cameras, and the difference value between two adjacent preset times is the transmission time of one message data.

In one embodiment of the present invention, the controlling each camera to process the corresponding target video respectively, and obtaining the target data packet corresponding to each camera includes: controlling a preset number of cameras to respectively acquire image data of corresponding target videos; controlling each camera to package image data of a target video corresponding to each camera based on a preset protocol, and obtaining a target data packet corresponding to each camera; the preset protocol is a communication protocol according to which the camera performs data transmission.

In one embodiment of the present invention, the controlling each camera sequentially transmits the message data in the target data packet corresponding to each camera to the receiving end from the corresponding preset time according to the preset time interval until all the message data included in each camera are transmitted completely includes: controlling each camera to respectively transmit any piece of message data in the corresponding target data packet from the corresponding preset moment to a receiving end; after a preset time interval, controlling each camera to respectively take any one of the message data which is not transmitted in the corresponding target data packet as current message data, and controlling each camera to transmit the corresponding current message data to the receiving end; and after repeating the preset time interval, controlling each camera to respectively take any one of the corresponding target data packets and the message data which is not transmitted yet as the current message data, and controlling the operation of transmitting the corresponding current message data to the receiving end by each camera until all the message data in the corresponding target data packets of each camera are transmitted.

In one embodiment of the present invention, the controlling the exposing of the preset number of cameras simultaneously, so that each camera generates a corresponding target video respectively includes: and the control signal source simultaneously transmits pulse signals to each camera through an external connection line, so that each camera simultaneously responds to the pulse signals to expose, and simultaneously generates target videos corresponding to each camera.

In one embodiment of the present invention, the controlling the exposing of the preset number of cameras simultaneously, so that each camera generates a corresponding target video respectively includes: and the control signal source simultaneously sends a camera trigger instruction to each camera through the network switching equipment, so that each camera responds to the camera trigger instruction to simultaneously expose, and simultaneously generates a target video corresponding to each camera.

In one embodiment of the present invention, the controlling each camera sequentially transmits the message data in the target data packet corresponding to each camera to the receiving end from the corresponding preset time according to the preset time interval until all the message data included in each camera are transmitted completely includes:

And in the gigabit Ethernet, controlling each camera to sequentially transmit the message data in the target data packet corresponding to each camera to a receiving end through the gigabit Ethernet according to a preset time interval from a corresponding preset time until all the message data included in each camera are transmitted.

In another aspect, an embodiment of the present application provides a multi-camera video data transmission apparatus, including:

a target video generation module; the method comprises the steps of controlling a preset number of cameras to simultaneously expose so that each camera respectively generates a corresponding target video;

a target data packet generation module; the method comprises the steps that each camera is controlled to process a corresponding target video respectively to obtain a corresponding target data packet of each camera, wherein the corresponding target data packet of each camera comprises a plurality of message data;

a target data packet transmission module; and the method is used for controlling each camera to sequentially transmit the message data in the target data packet corresponding to each camera to a receiving end according to a preset time interval from the corresponding preset time, until all the message data included in each camera are transmitted, wherein the preset time interval is determined according to the preset number of the cameras, and the difference value between two adjacent preset times is the transmission time of one message data.

In one embodiment of the present invention, the destination packet generating module includes: an image data acquisition module; the camera is used for controlling a preset number of cameras to respectively acquire image data of corresponding target videos; an image data encapsulation module; and the camera data package module is used for controlling each camera to package the image data of the target video corresponding to each camera based on a preset protocol to obtain a target data packet corresponding to each camera, wherein the preset protocol is a communication protocol according to which the cameras perform data transmission.

In another aspect, the application proposes an electronic device for multi-camera video data transmission, said electronic device comprising a processor and a memory, in which at least one instruction or at least one program is stored, the at least one instruction or at least one program being loaded and executed by the processor to implement a method as described above.

In another aspect, the present application proposes a computer readable storage medium having stored therein at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by a processor to implement a method as described above.

According to the multi-camera video data transmission method, the method of packet delay transmission is utilized, so that video data of a plurality of cameras can be transmitted almost synchronously, the data loss rate is reduced, the bandwidth waste is reduced, the network setting cost is reduced, and the data transmission efficiency is further improved.

Drawings

In order to more clearly illustrate the technical solutions and advantages of embodiments of the present application or of the prior art, the following description will briefly introduce the drawings that are required to be used in the embodiments or the prior art descriptions, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a flowchart illustrating a multi-camera video data transmission method according to an embodiment of the present invention.

Fig. 2 is a second flowchart of a multi-camera video data transmission method according to an embodiment of the present invention.

Fig. 3 is a flowchart illustrating a multi-camera video data transmission method according to an embodiment of the present invention.

Fig. 4 is a flowchart illustrating a multi-camera video data transmission method according to an embodiment of the present invention.

Fig. 5 is a flowchart of a multi-camera video data transmission method according to an embodiment of the present invention.

Fig. 6 is a block diagram of a multi-camera video data transmission device according to an embodiment of the present invention.

Fig. 7 is a block diagram of a hardware structure of a server according to an embodiment of the present invention.

Fig. 8 is a schematic diagram of single-rod network camera deployment in a road-side application scenario provided by the embodiment of the invention.

Fig. 9 is a network communication schematic diagram of a single-rod network camera in a road-end application scenario provided by the embodiment of the invention.

Fig. 10 is a schematic diagram of parallel transmission of video data by two cameras according to an embodiment of the present invention.

Fig. 11 is a schematic diagram of a two-camera delayed transmission video data according to an embodiment of the present invention.

Fig. 12 is a schematic diagram of a synchronous triggering camera exposure and data transmission according to an embodiment of the present invention.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present application based on the embodiments herein.

It should be noted that the terms "first," "second," and the like in the description and the claims of the embodiments of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present embodiment, unless otherwise specified, the meaning of "plurality" is two or more. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

In order to make the objects, technical solutions and advantages disclosed in the embodiments of the present application more clear, the embodiments of the present application will be described in further detail below with reference to the accompanying drawings and embodiments, and in particular, taking transmission of video data of multiple GigE cameras in a gigabit ethernet as an example. It should be noted that the application in gigabit ethernet is only an example, and the embodiments provided in the present invention may also be applied in other scenarios, and it should be understood that the specific embodiments described herein are merely used to explain the embodiments of the present application, and are not limited to the embodiments of the present application.

Fig. 1 is a schematic flow diagram of a multi-camera video data transmission method according to an embodiment of the present invention, fig. 2 is a schematic flow diagram of a multi-camera video data transmission method according to an embodiment of the present invention, fig. 3 is a schematic flow diagram of a multi-camera video data transmission method according to an embodiment of the present invention, fig. 4 is a schematic flow diagram of a multi-camera video data transmission method according to an embodiment of the present invention, fig. 5 is a schematic flow diagram of a multi-camera video data transmission method according to an embodiment of the present invention, fig. 6 is a block diagram of a multi-camera video data transmission device according to an embodiment of the present invention, fig. 7 is a hardware structure block diagram of a server according to an embodiment of the present invention, fig. 8 is a schematic deployment diagram of a single-rod network camera under a road-end application scenario according to an embodiment of the present invention, fig. 9 is a schematic network communication diagram of a single-rod network camera under a road-end application scenario according to an embodiment of the present invention, fig. 10 is a schematic flow diagram of two cameras for parallel transmission of video data according to an embodiment of the present invention, fig. 11 is a schematic flow diagram of a camera for a video data transmission of two cameras according to an embodiment of the present invention, fig. 11 is a schematic diagram of a camera for triggering of a camera for a video data transmission of an embodiment of the present invention, and fig. 12 is a camera for triggering of the present invention is performed synchronously.

In the following, in order to facilitate understanding of the technical solutions and the technical effects produced by the embodiments of the present application, the embodiments of the present application first explain related terms:

GigE camera: the GigE Vision is an interface standard developed based on the gigabit ethernet communication protocol, which is based on the UDP protocol, for industrial cameras using GigE (Gigabit Ethernet) universal data interfaces.

Bayer RGB: is a primitive image format invented by the scientist Bryce Bayer.

The present specification provides method operational steps as described above, for example, in the examples or flowcharts, but may include more or fewer operational steps based on conventional or non-inventive labor. The order of steps recited in the embodiments is merely one way of performing the order of steps and does not represent a unique order of execution. When implemented in a real system or server product, the methods illustrated in the embodiments or figures may be performed sequentially or in parallel (e.g., in a parallel processor or multithreaded environment).

Referring to fig. 1, fig. 1 is a flowchart of a multi-camera video data transmission method according to an embodiment of the present invention, as shown in fig. 1, the present invention provides a multi-camera video data transmission method, including the following steps:

S102: controlling a preset number of cameras to simultaneously expose so that each camera respectively generates a corresponding target video;

the number of cameras is not particularly limited, for industrial cameras, because the data length of industrial camera transmission is large, the required bandwidth is large, and the number of cameras is controlled within 4 without changing the data transmission frequency of the cameras, so that the preset number of cameras can be 2 or 3.

After the preset number of cameras are simultaneously exposed, each camera generates a target video corresponding to the camera, that is, each exposure is performed by all the cameras simultaneously, and each camera generates a target video.

S104: controlling each camera to process the corresponding target video respectively to obtain target data packets corresponding to each camera, wherein each target data packet corresponding to each camera comprises a plurality of message data;

each camera processes the generated target video respectively, and optionally, the processing means includes image processing and packaging processing, which does not limit specific steps of image processing of the camera, and may include smoothing, noise reduction, brightness adjustment, contrast adjustment, and packaging processing of video data with better human eye visual experience after image processing.

For the GigE camera, the protocol according to which the data is transmitted is UDP, and the video data is encapsulated by UDP to generate a plurality of pieces of packet data, and a frame of image data is taken as an example for illustration, the G ig camera data format is BayerRGB, and the total length of one frame of image data (1920×1200) is: length=width×height× (Bytes/pixel) =1920×1200×1= 2304000Bytes, the image data contained in one UDP packet is 1464Bytes, the number of packets capable of accommodating the total length of 2304000Bytes is 2304000/1464= 1573.77, that is, one frame of image data requires 1574 UDP packets to be continuously transmitted, and 1574 pieces of UDP packet data are correspondingly generated.

S106: and controlling each camera to sequentially transmit the message data in the target data packet corresponding to each camera to a receiving end according to a preset time interval from the corresponding preset time, until all the message data contained in each camera are transmitted, wherein the preset time interval is determined according to the preset number of the cameras, and the difference value between two adjacent preset times is the transmission time of one message data.

The present application does not specifically limit the preset time, but when the difference between two adjacent preset times is one transmission time of the message data, two cameras are taken as an example, and the first camera is from t ₁ When the second camera starts to send message data in the corresponding target data packet, the second camera starts to send the message data from t ₂ When the message data in the corresponding target data packet is started to be transmitted, the transmission time of one message data is t, and t=t ₂ -t ₁ That is, when the first camera finishes transmitting the first message data, the second camera starts to transmit the message data in the corresponding target data packet.

The preset time interval of the cameras is not particularly limited, and illustratively, when the preset number of the cameras is 2 in the gigabit network, the preset time interval is 2t, when the preset number of the cameras is 2, the preset time interval is 3t, and when the preset number of the cameras is 4, the preset time interval is 4t.

According to the multi-camera video data transmission method provided by the invention, each camera is controlled to send out the message data in the corresponding data packet at different preset moments, and the next message data sent out after the preset time interval takes the preset moment as a starting point, so that a plurality of cameras can send out the target data packet of the respective video almost synchronously by utilizing the packet delay sending mode, the bandwidth utilization rate is improved, the data loss rate is reduced, the network setting cost is reduced, and the stability of camera data transmission under the people cloud environment is improved.

Referring to fig. 2, fig. 2 is a second flowchart of a multi-camera video data transmission method according to an embodiment of the present invention, as shown in fig. 2, the step S104 includes:

s1041: controlling a preset number of cameras to respectively acquire image data of corresponding target videos;

s1043: and controlling each camera to package image data of the target video corresponding to each camera based on a preset protocol, and obtaining a target data packet corresponding to each camera.

The preset protocol is a communication protocol according to which the camera performs data transmission.

Optionally, after the preset number of cameras are controlled to generate the target video respectively, processing image data of the target video, where the processing includes image processing and packaging processing performed for data transmission, and the data transmission of the GigE camera is based on a UDP protocol, so that each camera is controlled to perform packaging processing on the respective image data by using the UDP protocol respectively, so as to form a packaged target data packet.

According to the embodiment provided by the invention, each camera is controlled to respectively encapsulate the corresponding video data to obtain the corresponding target data packet, so that the efficiency and controllability of sending the video data of the camera are improved.

Referring to fig. 3, fig. 3 is a flowchart illustrating a multi-camera video data transmission method according to an embodiment of the present invention, as shown in fig. 3, the step S106 includes:

s1061: controlling each camera to respectively transmit any piece of message data in the corresponding target data packet from the corresponding preset moment to a receiving end;

the present application does not specifically limit the message data serving as the current message data, and the message data selected as the current message data may be any piece of message data in the target data packet corresponding to each camera.

S1063: after a preset time interval, controlling each camera to respectively take any one of the message data which is not transmitted in the corresponding target data packet as current message data, and controlling each camera to transmit the corresponding current message data to the receiving end;

the method does not limit the preset time when the cameras start to send the message data, the difference between two adjacent preset times is the transmission time t of one message data, and when the preset number of the cameras is 3, the first camera, the second camera and the third camera are controlled to respectively send the message data from t ₁ 、t ₂ Transmitted at time t3Current message data in respective corresponding target data packet, wherein t ₁ 、t ₂ 、t ₃ For three preset moments arranged in sequence, the difference between two adjacent preset moments is the transmission time t of one message data, namely t ₂ -t ₁ ＝t ₃ -t ₂ ＝t。

S1605: and after repeating the preset time interval, controlling each camera to respectively take any one of the corresponding target data packets and the message data which is not transmitted yet as the current message data, and controlling the operation of transmitting the corresponding current message data to the receiving end by each camera until all the message data in the corresponding target data packets of each camera are transmitted.

Optionally, after the transmission of the current message data is finished, controlling each camera to send each piece of message data in the corresponding target data packet to the receiving end by taking other message data as the current message data according to a preset time interval until the message data in the corresponding target data packet of each camera is completely transmitted.

The method and the device do not limit the preset time interval specifically, the transmission time of one message data is t, the preset time interval is determined according to the number of cameras, the preset time interval is t of the number of cameras, when the number of cameras is 2, the preset time interval is 2t, and when the number of cameras is 3, the preset time interval is 3t.

Illustratively, when the number of cameras is 3, the first camera is from t ₁ After sending out the current message data, the second camera sends out the message data from t ₂ (t ₂ ＝t ₁ +t) sending out current message data, and a third camera sends out the current message data from t ₃ (t ₃ ＝t ₁ +2t) sending out current message data; the first camera re-uses any other message data in the target data packet corresponding to the first camera as the current message data from t ₃ Sending out the current message data at +t, wherein the time difference between the moment of the first camera sending the current message data for the first time and the moment of the second camera sending the current message data is (t) ₃ +t)-t ₁ ＝(t ₁ +2t+t)-t ₁ ＝3t。

Similarly, the second camera also re-uses any other message data in the target data packet corresponding to the second camera as the current message data, and transmits the current message data from the time of t3+2t, wherein the time difference between the time when the second camera transmits the current message data for the first time and the time when the second camera transmits the current message data for the second time is (t) ₃ +2t)-t ₂ ＝(t ₃ +2t)-(t ₁ +t)＝(t ₁ +2t+2t)-t _1- t＝3t。

Similarly, the third camera also re-uses any other message data in the target data packet corresponding to the third camera as the current message data, and transmits the current message data from the time of t3+3t, wherein the time difference between the time when the third camera transmits the current message data for the first time and the time when the third camera transmits the current message data for the second time is (t) ₃ +3t)-t3＝(t ₃ +3t)-(t ₁ +2t)＝(t ₁ +2t+3t)-t _1- 2t＝3t。

As can be seen, when the number of cameras is 3, the preset time interval between two adjacent pieces of current message data in the corresponding target data packet sent by each camera is the number of cameras t.

The method does not limit the hardware foundation of the camera specifically, but because the message data in the target data packet is transmitted in a striped and delayed manner, when the current message data is transmitted, other message data needs to be stored in enough places, so that the camera suitable for the method of the application should have a RAM large enough to buffer the target data packet.

According to the embodiment of the invention, through the method for controlling the cameras to respectively delay and send the message data in the corresponding target data packet, the image data generated by the cameras at the same time can reach the receiving end almost simultaneously, the receiving end can also process the image data sent by the cameras almost simultaneously, the data transmission efficiency and the processing speed can be improved, the bandwidth pressure of the video data transmitted by the cameras at the same time can be reduced, the data loss rate caused by insufficient bandwidth can be reduced, and the smoothness of data transmission can be improved.

Referring to fig. 4, fig. 4 is a flowchart illustrating a multi-camera video data transmission method according to an embodiment of the present invention, as shown in fig. 4, the step S102 includes:

S1021: the control signal source simultaneously sends pulse signals to each camera through an external connection line so that each camera simultaneously responds to the pulse signals for exposure;

the method for controlling simultaneous exposure of the preset number of cameras is not limited, and alternatively, a hard synchronous triggering mode can be selected, namely, the cameras and the network switch equipment are connected through an external circuit, pulse signals are sent to the cameras through the external circuit, and each camera receives the pulse signals and then exposes simultaneously.

S1023: and controlling each camera to respectively and simultaneously generate target videos corresponding to each camera.

The embodiment of the invention adopts a hard synchronous triggering mode, and the external wiring connected to each camera is used for controlling the signal source to simultaneously send pulse signals to each camera through the external wiring, so that each camera is simultaneously exposed and respectively generates a corresponding target video, the fusion processing of the receiving end to the image data is facilitated, and the accuracy of the exposure control of the cameras and the stability of the data generation are improved.

Referring to fig. 5, fig. 5 is a flowchart fifth of a multi-camera video data transmission method according to an embodiment of the present invention, as shown in fig. 5, the step S102 may further include:

S1025: the control signal source simultaneously sends a camera trigger instruction to each camera through the network switching equipment so that each camera responds to the camera trigger instruction to simultaneously expose;

optionally, a soft synchronous triggering mode may be selected, and synchronous exposure control is performed by sending a camera triggering instruction, which is an exemplary message containing an instruction for triggering the camera to perform exposure.

S1027: and controlling each camera to respectively and simultaneously generate target videos corresponding to each camera.

The embodiment provided by the invention adopts a soft synchronous triggering mode to send the message to each camera, so that each camera is exposed simultaneously and generates the corresponding target video respectively, and the accuracy of camera exposure control and the stability of data generation are improved.

Referring to fig. 12, fig. 12 is a schematic diagram of a synchronous triggering camera exposure and data transmission provided by the embodiment of the present invention, the method for triggering the camera is not specifically limited, as described above in connection with fig. 4 and 5, and exemplarily, the method for triggering the camera may select a hard synchronous triggering method or a soft synchronous triggering method, as shown in fig. 12, after a signal source sends a signal for triggering the camera to synchronously expose the camera, the signal may be a pulse signal or a camera triggering instruction, the control camera responds to the triggering signal, each generates a target video corresponding to the camera after synchronously exposing, after performing camera image processing (ISP) on the target video, encapsulates the processed data of the target video with an encapsulation protocol to form a target data packet to be transmitted, where, for the GigE camera, the target data packet is encapsulated packet data of UDP protocol, and the number of the packet is determined according to the size of the video data.

Optionally, the multi-camera video data transmission method provided by the invention can be applied to various network environments, the gigabit ethernet mentioned in the specification is only one network environment, more specifically, an industrial camera at an intersection is taken as an example, and under the age background of man-road cloud cooperation, real-time monitoring is required for road conditions, so that the requirement of immediately transmitting road condition information to a cloud for processing is generated, and in road section equipment deployment, the deployment of cameras and the deployment of network switching equipment have important influence on timeliness of data information transmission.

Fig. 8 is a schematic diagram of single-rod network camera deployment in a road-side application scenario provided by the embodiment of the present invention, as shown in fig. 8, road equipment deployment is implemented by taking a rod as a unit, two network cameras are usually disposed on a single rod, and the network cameras can be understood as GigE cameras, fig. 9 is a network communication schematic diagram of single-rod network camera in the road-side application scenario provided by the embodiment of the present invention, camera a and camera B are connected through a network switching device to form a local area network, and data transmission is performed by means of the local area network, video data is transmitted to a receiving end such as a computer, and the receiving end performs unpacking, reading and processing on received data, in a ten-thousand-megabyte network, due to a large bandwidth, parallel transmission of camera data of two network cameras can be implemented, fig. 10 is a schematic diagram of parallel transmission of video data by two cameras provided by the embodiment of the present invention, as shown in fig. 10, the two cameras each synchronously transmit 1574 messages in corresponding data packets, and a preset time interval is set, and the video data of 200 frames per one hundred thousand frames per hundred thousand frames (fps) are required to be output, namely, the video data of about one hundred thousand frames per hundred thousand frames (fps) is 30, and is equal to 552 m. If 2 GigE cameras transmit simultaneously, the bandwidth peaks at about 138MB/s, i.e., 1104Mbps. If the tera-Ethernet (bandwidth 10000 Mbps) is used, the bandwidth of the tera-Ethernet is far greater than the peak bandwidth data when two GigE cameras are transmitted in parallel, but the bandwidth is wasted, and the setting cost of the tera-Ethernet is far higher than the setting cost of the giga-network; if video data of 2 GigE cameras are transmitted in parallel in the gigabit network, then the peak bandwidth of the transmitted data is not lower than 552×2=1104mbps >1000mbps, and it can be seen that the peak bandwidth exceeds the bandwidth when two camera data are transmitted in parallel in the gigabit network, so that message data loss occurs; in order to ensure that message data is not lost, the data transmission frequency can be reduced, but the reduction of the data transmission frequency can lead to the transmission speed not following the requirement of real-time monitoring of the road condition, so that the problem that the reduction of the data transmission frequency can not substantially solve the problem of improving the integrity and stability of data transmission is solved.

For better understanding the application of the multi-camera video data transmission method in gigabit ethernet, please refer to fig. 11, fig. 11 is a schematic diagram of delay transmission of video data by two cameras according to an embodiment of the present invention, as shown in fig. 11, camera a and camera B delay transmission of message data in respective corresponding target data packets, where camera a is at a preset time T _A When the camera B starts to send the message of the camera A, the camera B starts to send the message of the camera A at the preset time T _B Starts sending the message of camera B, wherein T _B -T _A Time difference between preset moments when camera a and camera B start transmitting messages is 1 message transmission time interval (t_p).

Camera a: and sending out a first UDP message packet_A-1, after the transmission of the first UDP message is finished, after the time delay of a time interval (t_p) of a message transmission time, sending out a second UDP message packet_A-2, and the like until all the messages in the target data Packet of the camera A are transmitted.

Camera B: after the first UDP message packet_A-1 of the camera A is sent, sending out the first UDP message packet_B-1; and after the time delay of a time interval (t_p) of the message transmission time, sending out a second UDP message packet_B-2, and the like until all the messages in the target data Packet of the camera B are transmitted.

According to the embodiment of the invention, the synchronous transmission of the video data of a plurality of GigE cameras is realized by using the method for transmitting the message data in the gigabit Ethernet through delay, the transmission delay and the video frame rate of the normal operation of the GigE cameras are ensured, the integrity and the stability of the data transmission are improved, the dependence on the ultra-high speed gigabit network is greatly reduced, the cost of network hardware is reduced, the bandwidth waste is reduced, and the bandwidth utilization rate is improved.

Referring to fig. 6, fig. 6 is a block diagram of a multi-camera video data transmission device according to an embodiment of the invention. As shown in fig. 6, the apparatus may include at least:

602: a target video generation module; the method comprises the steps of controlling a preset number of cameras to simultaneously expose so that each camera respectively generates a corresponding target video;

604: a target data packet generation module; the method comprises the steps that each camera is controlled to process a corresponding target video respectively to obtain a corresponding target data packet of each camera, wherein the corresponding target data packet of each camera comprises a plurality of message data;

606: a target data packet transmission module; and the method is used for controlling each camera to sequentially transmit the message data in the target data packet corresponding to each camera to a receiving end according to a preset time interval from the corresponding preset time, until all the message data included in each camera are transmitted, wherein the preset time interval is determined according to the preset number of the cameras, and the difference value between two adjacent preset times is the transmission time of one message data.

In an alternative embodiment, the target data packet generating module includes:

An image data acquisition module; the camera is used for controlling a preset number of cameras to respectively acquire image data of corresponding target videos;

an image data encapsulation module; and the camera data package module is used for controlling each camera to package the image data of the target video corresponding to each camera based on a preset protocol to obtain a target data packet corresponding to each camera, wherein the preset protocol is a communication protocol according to which the cameras perform data transmission.

In an alternative embodiment, the target data packet transmission module includes:

a message data transmitting module at preset time; the camera is used for controlling each camera to respectively transmit any piece of message data in the corresponding target data packet to a receiving end from the corresponding preset moment;

a message data transmitting module at preset time; after a preset time interval, controlling each camera to respectively take any one of the message data which is not transmitted in the corresponding target data packet as current message data, and controlling each camera to transmit the corresponding current message data to the receiving end;

a repeated message data sending module; and after repeating the preset time interval, controlling each camera to respectively take any one of the corresponding target data packets and the not-transmitted message data as the current message data, and controlling the operation of transmitting the corresponding current message data to the receiving end by each camera until all the message data in the corresponding target data packets of each camera are transmitted.

In an alternative embodiment, the target video generation module includes:

the pulse signal triggers the control module; and the control signal source is used for simultaneously sending pulse signals to each camera through an external connection line so that each camera can simultaneously respond to the pulse signals to expose and simultaneously generate target videos corresponding to each camera.

In an alternative embodiment, the target video generation module includes:

the message triggers the control module; and the control signal source is used for simultaneously sending a camera trigger instruction to each camera through the network switching equipment so that each camera can simultaneously expose in response to the camera trigger instruction and simultaneously generate a target video corresponding to each camera.

It should be noted that the device embodiments provided in the embodiments of the present application are based on the same inventive concept as the method embodiments described above.

The embodiment of the application also provides an electronic device for multi-camera video transmission, which comprises a processor and a memory, wherein at least one instruction or at least one section of program is stored in the memory, and the at least one instruction or the at least one section of program is loaded and executed by the processor to realize the method provided by any embodiment.

Embodiments of the present application also provide a computer readable storage medium that may be provided in a terminal to hold at least one instruction or at least one program for implementing one of the method embodiments, the at least one instruction or at least one program being loaded and executed by a processor to implement the method as provided by the method embodiments described above.

Alternatively, in the present description embodiment, the storage medium may be located in at least one network server among a plurality of network servers of the computer network. Alternatively, in the present embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The memory of the embodiments of the present specification may be used for storing software programs and modules, and the processor executes various functional applications and data processing by executing the software programs and modules stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for functions, and the like; the storage data area may store data created according to the use of the device, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide access to the memory by the processor.

The method embodiments provided in the embodiments of the present application may be performed in a terminal, a computer terminal, a server, or similar computing device. Taking the operation on the server as an example, fig. 7 is a block diagram of the hardware structure of the server of a method according to an embodiment of the present invention. As shown in fig. 7, the server 700 may vary considerably in configuration or performance and may include one or more central processing units (Central Processing Units, CPU) 710 (the central processing unit 710 may include, but is not limited to, a microprocessor MCU or a processing device such as a programmable logic device FPGA), a memory 730 for storing data, one or more storage mediums 720 (e.g., one or more mass storage devices) for storing applications 723 or data 722. Wherein memory 730 and storage medium 720 may be transitory or persistent. The program stored in the storage medium 720 may include one or more modules, each of which may include a series of instruction operations on the server. Still further, the central processor 710 may be configured to communicate with the storage medium 720 and execute a series of instruction operations in the storage medium 720 on the server 700. The server 700 may also include one or more power supplies 760, one or more wired or wireless network interfaces 750, one or more input/output interfaces 740, and/or one or more operating systems 721, such as Windows ServerTM, mac OS XTM, unixTM, linuxTM, freeBSDTM, and the like.

Input-output interface 740 may be used to receive or transmit data via a network. The specific example of the network described above may include a wireless network provided by a communication provider of the server 700. In one example, the input-output interface 740 includes a network adapter (Network Interface Controller, NIC) that can connect to other network devices through a base station to communicate with the internet. In one example, the input/output interface 740 may be a Radio Frequency (RF) module for communicating with the internet wirelessly.

It will be appreciated by those of ordinary skill in the art that the configuration shown in fig. 7 is merely illustrative and is not intended to limit the configuration of the electronic device described above. For example, server 700 may also include more or fewer components than shown in fig. 7, or have a different configuration than shown in fig. 7.

The multi-camera data transmission method and device provided by the embodiment of the invention have the following technical effects:

1. according to the multi-camera video data transmission method provided by the invention, each camera is controlled to send out the message data in the corresponding data packet at different preset moments, and the next message data sent out after the preset time interval takes the preset moment as a starting point, so that a plurality of cameras can send out the target data packet of the respective video almost synchronously by utilizing the packet delay sending mode, the bandwidth utilization rate is improved, the data loss rate is reduced, the network setting cost is reduced, and the stability of camera data transmission under the people cloud environment is improved.

2. According to the embodiment provided by the invention, each camera is controlled to respectively encapsulate the corresponding video data to obtain the corresponding target data packet, so that the efficiency and controllability of sending the video data of the camera are improved.

3. According to the embodiment of the invention, through the method for controlling the cameras to respectively delay and send the message data in the corresponding target data packet, the image data generated by the cameras at the same time can reach the receiving end almost simultaneously, the receiving end can also process the image data sent by the cameras almost simultaneously, the data transmission efficiency and the processing speed can be improved, the bandwidth pressure of the video data transmitted by the cameras at the same time can be reduced, the data loss rate caused by insufficient bandwidth can be reduced, and the smoothness of data transmission can be improved.

4. The embodiment of the invention adopts a hard synchronous triggering mode, and the external wiring connected to each camera is used for controlling the signal source to simultaneously send pulse signals to each camera through the external wiring, so that each camera is simultaneously exposed and respectively generates a corresponding target video, the fusion processing of the receiving end to the image data is facilitated, and the accuracy of the exposure control of the cameras and the stability of the data generation are improved.

5. The embodiment provided by the invention adopts a soft synchronous triggering mode to send the message to each camera, so that each camera is exposed simultaneously and generates the corresponding target video respectively, and the accuracy of camera exposure control and the stability of data generation are improved.

6. According to the embodiment of the invention, the synchronous transmission of the video data of a plurality of GigE cameras is realized by using the method for transmitting the message data in the gigabit Ethernet through delay, the transmission delay and the video frame rate of the normal operation of the GigE cameras are ensured, the integrity and the stability of the data transmission are improved, the dependence on the ultra-high speed gigabit network is greatly reduced, the cost of network hardware is reduced, the bandwidth waste is reduced, and the bandwidth utilization rate is improved.

It should be noted that: the foregoing sequence of the embodiments of the present application is only for describing, and does not represent the advantages and disadvantages of the embodiments. And the foregoing description has been directed to specific embodiments of this specification. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the device and server embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and references to the parts of the description of the method embodiments are only required.

It will be appreciated by those of ordinary skill in the art that all or part of the steps of implementing the above embodiments may be implemented by hardware, or may be implemented by a program to instruct related hardware, and the program may be stored in a computer readable storage medium, where the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The foregoing description of the preferred embodiments of the present application is not intended to be limiting, but rather is intended to cover any and all modifications, equivalents, alternatives, and improvements within the spirit and principles of the present application.

Claims

1. A method of multi-camera video data transmission, the method comprising:

controlling a preset number of cameras to simultaneously expose so that each camera respectively generates a corresponding target video;

Controlling each camera to process the corresponding target video respectively to obtain target data packets corresponding to each camera, wherein each target data packet corresponding to each camera comprises a plurality of message data;

and controlling each camera to sequentially transmit the message data in the target data packet corresponding to each camera to a receiving end according to a preset time interval from the corresponding preset time, until all the message data contained in each camera are transmitted, wherein the preset time interval is determined according to the preset number of the cameras, and the difference value between two adjacent preset times is the transmission time of one message data.

2. The method of claim 1, wherein the controlling each camera to process the respective corresponding target video to obtain the target data packet corresponding to each camera includes:

controlling a preset number of cameras to respectively acquire image data of corresponding target videos;

controlling each camera to package image data of a target video corresponding to each camera based on a preset protocol, and obtaining a target data packet corresponding to each camera;

3. The method of claim 2, wherein the controlling each camera to sequentially transmit the message data in the target data packet corresponding to each camera to the receiving end from the corresponding preset time according to the preset time interval until all the pieces of message data included in each camera are completely transmitted includes:

controlling each camera to respectively transmit any piece of message data in the corresponding target data packet from the corresponding preset moment to a receiving end;

after a preset time interval, controlling each camera to respectively take any one of the message data which is not transmitted in the corresponding target data packet as current message data, and controlling each camera to transmit the corresponding current message data to the receiving end;

and after repeating the preset time interval, controlling each camera to respectively take any one of the corresponding target data packets and the message data which is not transmitted yet as the current message data, and controlling the operation of transmitting the corresponding current message data to the receiving end by each camera until all the message data in the corresponding target data packets of each camera are transmitted.

4. The method of claim 1, wherein controlling the exposure of a predetermined number of cameras simultaneously such that each of the cameras generates a corresponding target video comprises:

and the control signal source simultaneously transmits pulse signals to each camera through an external connection line, so that each camera simultaneously responds to the pulse signals to expose, and simultaneously generates target videos corresponding to each camera.

5. The method of claim 1, wherein controlling the exposure of a predetermined number of cameras simultaneously such that each of the cameras generates a corresponding target video comprises:

and the control signal source simultaneously sends a camera trigger instruction to each camera through the network switching equipment, so that each camera responds to the camera trigger instruction to simultaneously expose, and simultaneously generates a target video corresponding to each camera.

6. The method according to any one of claims 1 to 5, wherein the controlling each camera sequentially transmits the message data in the target data packet corresponding to each camera to the receiving end from a corresponding preset time according to a preset time interval until all the pieces of message data included in each camera are completely transmitted includes:

7. A multi-camera video data transmission apparatus, the apparatus comprising:

8. The apparatus of claim 7, wherein the target data packet generation module comprises: an image data acquisition module; the camera is used for controlling a preset number of cameras to respectively acquire image data of corresponding target videos; an image data encapsulation module; and the camera data package module is used for controlling each camera to package the image data of the target video corresponding to each camera based on a preset protocol to obtain a target data packet corresponding to each camera, wherein the preset protocol is a communication protocol according to which the cameras perform data transmission.

9. An electronic device for multi-camera video data transmission, characterized in that the device comprises a processor and a memory, in which at least one instruction or at least one program is stored, which at least one instruction or at least one program is loaded by the processor and which performs the method according to any of claims 1-6.

10. A computer readable storage medium having stored therein at least one instruction or at least one program loaded and executed by a processor to implement the method of any one of claims 1-6.