CN119316549A

CN119316549A - Audio transmission method, video processing device and data transmission system

Info

Publication number: CN119316549A
Application number: CN202411853952.8A
Authority: CN
Inventors: 张磊; 龚小满
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2024-12-16
Filing date: 2024-12-16
Publication date: 2025-01-14
Anticipated expiration: 2044-12-16
Also published as: CN119316549B

Abstract

The embodiment of the application provides an audio transmission method, video processing equipment and a data transmission system, which relate to the technical field of audio data transmission, wherein the audio transmission method is applied to the video processing equipment and comprises the steps of acquiring first audio data; modulating an analog audio signal corresponding to the first audio data to obtain a target data signal, sending the target data signal to a target analog camera so that the target analog camera analyzes the analog audio signal, calling a first audio output module to output audio represented by the analog audio signal, responding to receiving a second video signal, analyzing the second video signal to obtain the target analog signal, and calling the second audio output module to output the audio represented by the target analog signal. Through the scheme, the audio of the user side and the audio of the analog camera side can be transmitted in a two-way mode, and therefore communication with the analog camera side is achieved.

Description

Audio transmission method, video processing equipment and data transmission system

Technical Field

The present application relates to the field of audio data transmission technologies, and in particular, to an audio transmission method, a video processing device, and a data transmission system.

Background

Video processing devices such as DVR (Digital Video Recorder, hard disk video recorder) can be connected with the analog camera, and output the video data collected by the analog camera through the corresponding user terminal, for example, output the video data through the remote client terminal corresponding to the video processing device, or output the video data through the display device locally accessed by the video processing device.

In the related art, the analog camera may have an audio capturing function, so that the analog camera may transmit captured audio to the video processing device, so that a user terminal corresponding to the video processing device may output the audio. However, the user side needs to communicate with the acquisition scene of the analog camera side, for example, the user side user has a requirement of intercom of the person in the acquisition scene corresponding to the analog camera, that is, the user side user communicates with the analog camera side.

Therefore, how to bidirectionally transmit the audio of the user side and the audio of the analog camera side to realize the communication with the analog camera side is a problem to be solved.

Disclosure of Invention

The embodiment of the application aims to provide an audio transmission method, video processing equipment and a data transmission system, which can carry out bidirectional mutual transmission on audio of a user side and audio of an analog camera side, thereby realizing communication with the analog camera side. The specific technical scheme is as follows:

In a first aspect, an embodiment of the present application provides an audio transmission method, applied to a video processing device, where the method includes:

acquiring first audio data, wherein the first audio data are audio data which are acquired by calling a first audio acquisition module and take a target analog camera as audio of a playing end;

Modulating an analog audio signal corresponding to the first audio data to a field blanking area corresponding to a first video signal to obtain a target data signal, wherein the first video signal is an analog video signal and is used as a carrier signal corresponding to the target analog camera;

the target data signal is sent to the target analog camera, so that the target analog camera analyzes an analog audio signal from a field blanking area of the target data signal, and a first audio output module is called to perform audio output processing on audio represented by the analog audio signal obtained through analysis;

Analyzing an analog audio signal from a line blanking area of the second video signal in response to receiving the second video signal sent by the target analog camera to obtain a target analog signal, wherein the second video signal is a video signal obtained by modulating the target analog video signal sent to the video processing equipment by the target analog camera, and the modulating process is used for modulating the analog audio signal of the audio acquired in an acquisition scene of the target analog camera to the line blanking area of the target analog video signal;

And performing audio output processing on the audio characterized by the target analog signal by calling a second audio output module.

In a second aspect, an embodiment of the present application provides a video processing apparatus, including a control unit and an analog-to-digital conversion unit;

The control unit is used for acquiring first audio data, wherein the first audio data are audio data which are acquired by calling a first audio acquisition module and take a target analog camera as audio of a playing end;

The analog-to-digital conversion unit is used for modulating the analog audio signal corresponding to the first audio data to a field blanking area corresponding to a first video signal to obtain a target data signal, wherein the first video signal is an analog video signal and is used as a carrier signal corresponding to the target analog camera;

The analog-to-digital conversion unit is further configured to send the target data signal to the target analog camera, so that the target analog camera parses an analog audio signal from a field blanking area of the target data signal, invokes a first audio output module, and performs audio output processing on audio represented by the parsed analog audio signal;

The analog-to-digital conversion unit is further used for responding to the received second video signal sent by the target analog camera, analyzing an analog audio signal from a line blanking area of the second video signal to obtain a target analog signal, and sending the target analog signal to the control unit, wherein the second video signal is a video signal obtained by modulating the target analog video signal sent to the video processing equipment by the target analog camera, and the modulating process is used for modulating an analog audio signal of audio acquired in an acquisition scene of the target analog camera to the line blanking area of the target analog video signal;

The control unit is further configured to receive the target analog signal, and perform audio output processing on audio represented by the target analog signal by calling a second audio output module.

In a third aspect, an embodiment of the present application provides a data transmission system, including a video processing apparatus and a target analog camera;

The video processing equipment is used for acquiring first audio data, modulating the first audio data corresponding to an analog audio signal to a field blanking area corresponding to a first video signal to obtain a target data signal, and sending the target data signal to the target analog camera, wherein the first audio data is audio data of the audio frequency which is obtained by calling a first audio acquisition module and takes the target analog camera as a playing end, and the first video signal is an analog video signal and is taken as a carrier signal corresponding to the target analog camera;

The target analog camera is used for receiving the target data signal, analyzing an analog audio signal from a field blanking area of the target data signal, calling a first audio output module, performing audio output processing on audio represented by the analog audio signal obtained through analysis, and sending a second video signal to the video processing equipment, wherein the second video signal is a video signal obtained by modulating the target analog video signal sent to the video processing equipment by the target analog camera, and the modulating processing is used for modulating the analog audio signal of the audio acquired in an acquisition scene of the target analog camera to the field blanking area of the target analog video signal;

The video processing device is further configured to receive the second video signal, parse an analog audio signal from a line blanking area of the second video signal to obtain a target analog signal, and perform audio output processing on audio represented by the target analog signal by calling a second audio output module.

The embodiment of the application has the beneficial effects that:

The above can be seen that the scheme provided by the embodiment of the application is applied to video processing equipment. When the requirement of intercom with the acquisition scene of the target analog camera side exists, after the video processing equipment acquires the first audio data, modulating an analog audio signal corresponding to the acquired first audio data to a field blanking area corresponding to the first video signal to obtain a target data signal, and then sending the obtained target data signal to the target analog camera to enable the target analog camera to analyze the field blanking area of the target data signal to obtain an analog audio signal, and calling a first audio output module to perform audio output processing on audio represented by the analyzed analog audio signal. And in response to receiving the second video signal sent by the target analog camera, analyzing the analog audio signal from the line blanking area of the second video signal to obtain the target analog signal, and performing audio output processing on the audio represented by the target analog signal by calling the second audio output module.

Based on the above, by applying the scheme provided by the embodiment of the application, the video processing device modulates the analog audio signal corresponding to the audio data to be transmitted to the target analog camera into the vertical blanking region of the first video signal through signal modulation, so as to transmit the audio represented by the analog audio signal to the target analog camera through the first video signal. And the target analog camera modulates an analog audio signal corresponding to the audio data to be transmitted to the video processing device into a line blanking area of a second video signal through signal modulation so as to transmit the audio represented by the analog audio signal through the second video signal. Therefore, through the scheme of the application, the audio of the user side and the audio of the analog camera side can be mutually transmitted in two directions, so that the communication with the analog camera side is realized.

Drawings

In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the application, and other embodiments may be obtained according to these drawings to those skilled in the art.

Fig. 1 is a schematic view of an image data area and a blanking area included in a video signal;

fig. 2 is a schematic flow chart of an audio transmission method according to an embodiment of the present application;

Fig. 3 is a schematic diagram of a modulation position of first audio data according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a modulation position waveform of the first audio data corresponding to FIG. 3;

FIG. 5 is a schematic diagram of an upstream audio waveform;

Fig. 6 is a schematic diagram of a modulation position of second audio data according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a modulation position waveform of a second audio data corresponding to FIG. 6;

FIG. 8 is a schematic diagram of a coaxial audio waveform;

FIG. 9 is a schematic waveform diagram of two-channel audio data;

fig. 10 is a schematic structural diagram of a video processing device according to an embodiment of the present application;

Fig. 11 is a schematic structural diagram of a data transmission system according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of another data transmission system according to an embodiment of the present application;

fig. 13 is a schematic structural diagram of a hard disk video recorder according to an embodiment of the present application;

Fig. 14 is a schematic diagram of a binaural data transmission according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. Based on the embodiments of the present application, all other embodiments obtained by the person skilled in the art based on the present application are included in the scope of protection of the present application.

For ease of understanding, the following description first refers to the terminology used in connection with the present application.

BNC (Bayonet Nut Connector, coaxial line) coaxial cable for connecting analog camera and DVR;

Coaxial audio-audio that analog camera sends to DVR through coaxial line. In a specific application, the analog camera can collect coaxial audio by using a pickup, if the coaxial audio can be collected and modulated into a line blanking area of an analog video signal, it can be understood that if audio data are available, modulation is performed, and finally, the situation that coaxial audio data are not available in each line is possible;

And the uplink audio is audio sent to the analog camera by the DVR through the coaxial BNC, and similar to the coaxial audio, if audio data are provided, the audio data are modulated into the vertical blanking region of the analog video signal. Because the uplink audio is modulated to the vertical blanking region, the storage space of the vertical blanking region of one frame of analog video signal is limited, and when the modulation of the uplink audio is carried out in combination with the actual measurement condition, each frame of analog video signal can be modulated with the data of the uplink audio generally;

AD is an analog-to-digital converter;

DVR is a device with functions of receiving audio and video of analog camera, storing, previewing and replaying;

I2S (Inter-IC Sound) bus, a bus standard for transmitting audio data;

Voice intercom, in which two persons who are not in the same space are talking, in the embodiment of the application, voice intercom between the camera end and the user end is referred to as, for example, voice intercom between the analog camera and the computer end.

In addition, the following description is made for convenience of understanding the vertical blanking and the horizontal blanking:

Each frame of video image may correspond to an analog video signal, which may also be referred to as simply a video signal in the present application. The video signal corresponding to each frame of video image includes valid data and non-valid data, i.e., an image data area and a blanking area. The image data area is used for storing a frame of valid image data, and the blanking area is used for storing invalid data, wherein the invalid data comprises signals such as field synchronization, line synchronization, field blanking and line blanking. That is, one frame of the analog video signal may include an image data area and a blanking area, and fig. 1 is an exemplary diagram regarding the image data area and the blanking area included in the video signal. Where white region 102 is an image data region, dark regions 101 and 103 are blanking regions, and region 101 is vertical blanking (vertical blanking region), and region 103 is horizontal blanking (horizontal blanking region).

And when the scanning point reaches the right edge of the image, the scanning point quickly returns to the left side, and the 2 nd line scanning is restarted under the starting point of the 1 st line, and the return process between the lines is called line blanking. Wherein a signal located in the period of the line blanking may be referred to as a line blanking signal.

The vertical blanking is that a complete image scanning signal is formed by a row signal sequence separated by a row blanking interval, which is called a frame, and after the scanning point scans a frame, the scanning point needs to return to the upper left corner of the image from the lower right corner of the image, and the process of starting scanning of a new frame is called the vertical blanking. Wherein a signal located in the period of the vertical blanking may be referred to as a vertical blanking signal.

In order to perform bidirectional mutual transmission on the audio of the user side and the audio of the analog camera side so as to realize communication with the analog camera side, thereby meeting the communication requirements existing between acquisition scenes of the user side and the analog camera side, the application provides an audio transmission method, video processing equipment and a data transmission system.

An audio transmission method provided by the present application will be described first.

The audio transmission method can be applied to video processing equipment connected with an analog camera, and the video processing equipment can be DVR, a recording and playing host machine capable of being connected with the analog camera, other equipment with coding and video recording functions and the like. The method is suitable for various application scenes of intercom through the analog camera side and the video processing equipment side. For example, the monitoring personnel can carry out voice intercom with the personnel in the acquisition scene of the analog camera side through the supervision system, and for example, the user can carry out voice intercom with the personnel in the acquisition scene of the analog camera side through the mobile phone. In this regard, the embodiment of the present application does not specifically limit the application scenario of the method.

The audio transmission method provided by the embodiment of the application is applied to video processing equipment, and can comprise the following steps:

An exemplary description of an audio transmission method according to an embodiment of the present application is provided below with reference to the accompanying drawings.

As shown in fig. 2, an audio transmission method provided by an embodiment of the present application is applied to a video processing device, and the method may include the following steps:

s201, acquiring first audio data.

The first audio data are audio data which are acquired by calling the first audio acquisition module and take the target analog camera as audio of a playing end.

In the application, when a user has an acquisition scene with the target analog camera side or the user in the acquisition scene needs to speak, the audio data acquired by calling the first audio acquisition module and taking the target analog camera as the audio of the playing end can be used as the first audio data.

The first audio acquisition module can be an acquisition module in a device to which a user terminal corresponding to the video processing device belongs, so that the user terminal corresponding to the video processing device can call the first audio acquisition module to acquire first audio data, and the first audio acquisition module can also be an acquisition module which can be called by the user terminal through a network, so that the user terminal corresponding to the video processing device calls the first audio acquisition module through the network to acquire the first audio data, which is reasonable. Of course, it is also reasonable that the first audio acquisition module may be an audio acquisition module that the video processing device itself can call. The specific called mode of the first audio acquisition module is not limited, and any implementation mode capable of enabling the first audio acquisition module to acquire audio data of audio taking the target analog camera as a playing end can be applied to the application.

Optionally, the user end corresponding to the video processing device is a remote client end running on a mobile phone, a computer, and the like.

Optionally, the user side corresponding to the video processing device is the video processing device itself, that is, the video processing device itself may implement the function of the user side, for example, the video processing device may be connected to a display to perform operations such as displaying and configuring a picture, and the video processing device itself may implement the function of the user side.

In addition, the number of analog cameras accessed by the video processing device may be one or more, and the embodiment of the present application is not limited in particular. That is, the audio transmission method provided by the embodiment of the application can only carry out intercom with the acquisition scene of one analog camera side, and at this time, the analog camera is the target analog camera in the embodiment of the application; the audio transmission method provided by the embodiment of the application can also be used for talkback of the acquired scenes of the multiple analog cameras, and at this time, each of the multiple analog cameras can be used as the target analog camera in the embodiment of the application.

Optionally, in one implementation manner, the first audio data is specifically an intercom instruction formed by triggering a user side corresponding to the video processing device in response to a target intercom operation, the audio data, acquired by the first audio acquisition module, of audio taking the target analog camera as a playing side is called, and the target intercom operation is an operation sent in the user side and used for indicating to carry out intercom on an acquisition scene of the target analog camera.

In this implementation manner, when a user needs to speak with an acquisition scene of the target analog camera side, a target intercom operation for indicating to intercom the acquisition scene of the target analog camera may be sent by a user side corresponding to the video processing device, so that the user side may call, in response to an intercom instruction triggered by the target intercom operation, audio data acquired by the first audio acquisition module and using the target analog camera as audio at the playing end, as first audio data. The first audio data may be digital signal data or analog signal data, which is reasonable.

Optionally, the mode of forming the intercom instruction triggered by the target intercom operation may be that an audio button preset on a display interface of the user side is clicked to trigger forming the intercom instruction. That is, the user side generates the intercom instruction by triggering the audio button, so that the user side invokes the first audio acquisition module to acquire the audio data to be transmitted to the target analog camera by the user.

The audio button may be a button for intercom setting, or may be a button for unidirectional audio transmission, that is, when the audio button is a button for unidirectional audio transmission, a user at the user terminal does not need to obtain a reply, for example, a voice broadcast, of a worker in a collection scene at the target analog camera side. When the audio button is a button for intercom setting, the user at the user side needs to obtain a reply of a worker in the acquisition scene of the target analog camera side, for example, voice intercom.

Optionally, two buttons for audio communication, namely an audio intercom button and a first audio playing button, are preset on a display interface of the user side, and the voice transmission functions corresponding to the two buttons are different. The first audio playing button is used for triggering an instruction of unilateral speaking with an acquisition scene of the target analog camera side, and at the moment, the target analog camera side does not need to carry out audio reply. Of course, the display interface of the user side may also be provided with a second audio play button that outputs only the audio of the target analog camera side.

Optionally, the user side corresponding to the video processing device responds to the instruction for representing speaking to the target analog camera side, and invokes the first audio acquisition module to acquire audio data of the audio taking the target analog camera as the playing side as the first audio data. The above manner of triggering the user side to call the first audio collection module to collect the audio with the target analog camera as the playing side is merely an example, and should not be construed as limiting the present application.

S202, modulating an analog audio signal corresponding to first audio data to a field blanking area corresponding to a first video signal to obtain a target data signal, wherein the first video signal is an analog video signal and is used as a carrier signal corresponding to a target analog camera.

In the application, since the data transmission between the video processing device and the analog camera takes the video signal as a carrier for transmission, the first audio data belongs to the audio data which is required to be additionally transmitted for the video signal to be sent to the analog camera, and the first audio data does not pay attention to the content of the video signal which is taken as the carrier signal thereof when being transmitted, so as not to interfere the data contained in the video signal, the video processing device can insert the analog audio signal corresponding to the first audio data into the field blanking area of the video signal.

It should be noted that, the vertical blanking region of the video signal is located between two video frames, so that, whether the analog audio signal is modulated to the vertical blanking region or the analog audio signal is parsed from the vertical blanking region, the video signal can be rapidly located based on the specificity of the position of the vertical blanking region, so as to improve the efficiency of audio writing and audio parsing. After the video processing device acquires the first audio data, the video processing device can determine an analog audio signal corresponding to the first audio data, so that the determined analog audio signal is modulated to a field blanking area corresponding to the first video signal, and a target data signal is obtained.

Optionally, in one implementation, the first video signal is an analog video signal that is sent by the target analog camera to the video processing device and meets a predetermined filtering condition, where the predetermined filtering condition includes a filtering condition set based on a signal receiving time.

In the implementation manner, considering that the first audio data transmitted to the target analog camera by the video processing device takes an analog video signal sent to the video processing device by the target analog camera as a carrier signal, the audio and video data or the video data acquired by the target analog camera is synchronously transmitted to the video processing device in real time for the real-time performance of audio and video transmission. That is, the video processing apparatus receives an analog video signal transmitted in real time by the target analog camera, and the analog video signal transmitted in real time may be a plurality of pieces of analog video signals received in succession.

Accordingly, a predetermined filtering condition may be set in advance to facilitate the video processing apparatus to filter, as the first video signal, an analog video signal satisfying the predetermined filtering condition from among analog video signals transmitted from the target analog camera.

Wherein, in consideration of real-time property of the analog video signal, the above-mentioned predetermined screening condition includes a screening condition set based on the signal receiving time. For example, an analog video signal having the latest signal receiving time may be used as the first video signal.

Optionally, considering that when the user needs to talk with the acquisition scene of the target analog camera side, the user side sends out a target talk-back operation for indicating to talk with the acquisition scene of the target analog camera through the user side corresponding to the video processing device, so that the user side starts audio transmission in response to a talk-back instruction triggered by the target talk-back operation. Therefore, the predetermined filtering condition includes receiving the analog video signal received by the video processing device as the first video signal after the user side receives the designated duration for forming the intercom command in response to triggering by the target intercom operation.

Optionally, in one implementation manner, step S202, modulating the analog audio signal corresponding to the first audio data to the vertical blanking region corresponding to the first video signal to obtain the target data signal may include the following steps:

a1, determining a first signal system of a first video signal;

And A2, modulating the analog audio signal corresponding to the first audio data to a position corresponding to the first signal system in the idle position of the vertical blanking region corresponding to the first video signal.

Wherein different signal systems correspond to different ones of the idle positions.

Optionally, in one implementation, the idle position is a position in the vertical blanking region other than a position occupied by communication data of a predetermined communication protocol, wherein the predetermined communication protocol is a communication protocol between the video processing device and the analog camera.

In this implementation, the audio transmission between the video processing device and the analog camera is made on the premise that the analog camera conforms to a predetermined communication protocol. That is, the analog camera can complete the reception and processing of the target data signal transmitted to the video processing apparatus only when the analog camera supports the above-described predetermined communication protocol.

The above-described predetermined communication protocol is the basis for ensuring effective cooperation between the video processing device and the analog camera. The video processing device may send control instructions to the analog camera, such as adjusting parameters of focus, exposure, white balance, etc., via a predetermined communication protocol. This allows the user to remotely control the analog camera through the video processing device. Typically, the predetermined communication protocol is inserted into the vertical blanking region of the first video signal transmitted by the target analog camera to the video processing device, thereby occupying a portion of the position in the vertical blanking region. Therefore, the idle position in the vertical blanking region can be used for inserting the first audio data which is additionally required to be transmitted, so that the inserted first audio data cannot influence the preset communication protocol inserted in the vertical blanking region on the premise of not interfering the audio data contained in the video signal, and the stability of the video processing equipment for remotely controlling the analog camera is improved.

The predetermined communication protocol may be a protocol for performing coaxial communication, that is, transmitting and controlling a video stream to a device at the front end of an analog camera or the like through a coaxial cable as a communication medium. The present application is not particularly limited in this regard.

In the implementation manner of the step A1 to the step A2, considering that the video signal is obtained by modulating the video signal after the analog camera collects the video data, because there are multiple analog cameras, the collection parameters of the video data collected by each analog camera are different, for example, the resolution is different, the frame rate is different, so that the signal system of the finally obtained video signal is different. The positions of the signals of different signal systems in the blanking area of the video signal are different, and the positions for modulating the audio data are also different.

For example, the signal system is 1080P25, the first audio data starts from the 11 th line of the field blanking area after the field synchronization, and is 25 lines in total, the signal system is 3K20, the first audio data starts from the 11 th line of the field blanking area after the field synchronization, and is 35 lines in total, and the first audio data starts from the 11 th line of the field blanking area after the field synchronization, and is 20 lines in total, when the signal system is 3K10, the signal system is 1080P 30.

The signal system of the video signal may include, but is not limited to, 1080P25 and 1080P30. Wherein, the signal system 1080P25 indicates that the resolution of the video signal is 1920×1080 and the frame rate is 25 frames/second. The signal system 1080P30 indicates that the resolution of the video signal is 1920×1080 and the frame rate is 30 frames/second.

Meanwhile, it is considered that a part of positions in the vertical blanking region have been occupied by a predetermined communication protocol, and thus, different signal schemes correspond to different positions in the idle positions of the vertical blanking region.

Thus, after the video processing device acquires the first audio data, the first signal system of the first audio data can be determined, and therefore, based on the determined first signal system, the position, corresponding to the first signal system, of the idle position of the vertical blanking region corresponding to the first video signal is determined, and further, the analog audio signal corresponding to the first audio data is modulated to the determined position in the vertical blanking region, so that the insertion of the first audio data is realized.

In addition, the manner in which the video processing apparatus modulates the analog audio signal corresponding to the first audio data to be transmitted to the target analog camera into the vertical blanking region of the first video signal by signal modulation may be referred to as a coaxial insertion manner.

In addition, exemplary, fig. 3 is a schematic diagram of a modulation position of first audio data according to an embodiment of the present application, and fig. 4 is a schematic waveform diagram of a modulation position of first audio data corresponding to fig. 3. The uplink audio in fig. 3 is the first audio data in the embodiment of the present application. The coaxial communication in fig. 4 is a predetermined communication protocol provided in the embodiment of the present application.

The video processing device modulates the uplink audio to a field blanking region of the first video signal by field synchronization with respect to the first video signal, specifically, modulates the uplink audio to a check bit of protocol information of the coaxial communication, thereby obtaining the first video signal. Fig. 5 is a schematic diagram of an uplink audio waveform, which is a display interface diagram in a real scene, wherein the waveform of the right dense area in fig. 5 is the uplink audio of 1080P 25.

S203, sending a target data signal to the target analog camera so that the target analog camera analyzes the analog audio signal from the field blanking area of the target data signal, and calling a first audio output module to perform audio output processing on the audio represented by the analyzed analog audio signal.

In the application, the video processing equipment sends the target data signal to the target analog camera, so that the target analog camera can analyze the target data signal from the field blanking area of the target data signal to obtain the analog audio signal, and then the first audio output module is called to perform audio output processing on the audio represented by the analyzed analog audio signal, so that a user on the side of the target analog camera or a person in an acquisition scene on the side of the target analog camera hears the audio transmitted by the video processing equipment, and the purpose of transmitting the audio which hopes to be played on the side of the analog camera to the analog camera and communicating with the side of the analog camera is realized.

S204, responding to the received second video signal sent by the target analog camera, analyzing an analog audio signal from a line blanking area of the second video signal to obtain a target analog signal;

The second video signal is a video signal obtained by modulating a target analog video signal sent to the video processing device by the target analog camera, and the modulating process is used for modulating an analog audio signal of audio acquired in an acquisition scene of the target analog camera to a line blanking area of the target analog video signal.

S205, performing audio output processing on the audio characterized by the target analog signal by calling a second audio output module.

In the present application, while inserting audio data into the vertical blanking region of a video signal, audio data transmitted from a target analog camera to a video processing apparatus may be inserted into the horizontal blanking region of the video signal in consideration of stability of the transmitted audio data. In this way, the audio data sent to each other by the video processing device and the second video signal sent by the target analog camera are not mutually interfered, and the video processing device can directly analyze the analog audio signal from the second video signal to obtain the target analog signal so as to improve the efficiency of the audio analysis processing. In the application, uplink transmission (namely, the video processing equipment transmits audio data to the target analog camera) is realized by the aid of the vertical blanking area, and downlink transmission (namely, the target analog camera transmits audio data to the video processing equipment) is realized by the aid of the horizontal blanking area, so that the defects of other combination modes can be avoided:

Meanwhile, if the uplink transmission and the downlink transmission are both by means of the line blanking area, different positions of the line blanking area are required to be occupied in order to ensure the requirements of no uplink and downlink interference, stable transmission and the like, and the data storage space of the line blanking area is limited, so that the problem of insufficient data storage space is caused;

for both uplink transmission and downlink transmission by means of a combination mode of a vertical blanking region, in some scenes, in order to be able to transmit audio to a receiver (the receiver of the target analog camera is a video processing device, the receiver corresponding to the video processing device is the target analog camera) at a constant speed, an analog-to-digital conversion unit (an analog-to-digital conversion unit existing in the video processing device and an analog-to-digital conversion unit in the target analog camera) can generally use a memory region to perform constant speed control processing on audio data (for example, the audio data is copied to the memory region first, then the predetermined control algorithm is used for constant speed control processing, and then subsequent audio signal modulation processing), so if the downlink transmission is also used for the vertical blanking region, the memory space required to be allocated by the vertical blanking region is larger, the memory region of the target analog camera is required to be expanded definitely, and the cost of each target analog camera is also greatly increased, and the number of the related target analog cameras is usually multiple, so if the memory region of each target analog camera needs to be expanded, the problem of higher cost for the target analog camera is caused to be more serious;

For the combination mode of uplink transmission by means of the line blanking area and downlink transmission by means of the vertical blanking area, based on the above description of the two other combination modes, it can be known that there are problems that the resolution difficulty of the video processing device itself for the line blanking area is large, and that the cost of the target analog cameras is greatly increased, and if the number of the target analog cameras is large, the problem of the larger cost is more serious.

In summary, the combination mode of uplink transmission by means of the vertical blanking region and downlink transmission by means of the horizontal blanking region has at least the following combination advantages that video processing equipment can rapidly locate and analyze data in the vertical blanking region, processing efficiency is greatly improved, meanwhile, uplink and downlink modulation to different blanking regions can ensure sufficient spatial positions of modulation, and cost of a target analog camera can be well controlled. And then, the video processing equipment performs audio output processing on the audio represented by the target analog signal by calling the second audio output module, so that a user at the user side can hear the audio acquired by the acquisition scene at the target analog camera side. The audio output processing may include processing algorithms such as noise reduction and volume adjustment, which are not specifically limited in this embodiment of the present application.

In addition, for example, in one implementation manner, the second audio output module may be an audio output module that may be called by the video processing device, and in other implementation manner, the second audio output module may be an audio output module that may be called by a user side corresponding to the video processing device. The specific calling mode of the second audio output module is not limited in any way.

Optionally, in one implementation manner, the second video signal is specifically a video signal obtained by modulating a target analog video signal sent to the video processing device by the target analog camera in response to an intercom instruction triggered by a target intercom operation, where the target intercom operation is an operation sent in a user end corresponding to the video processing device and used for indicating to carry out intercom on an acquisition scene of the target analog camera.

In this implementation manner, the user may send a target intercom operation for instructing to carry out intercom with respect to the target analog camera through the user side corresponding to the video processing device, so that after receiving the target intercom operation, the video processing device may trigger to form an intercom instruction through the target intercom operation, and send the formed instruction to the target analog camera, so that after receiving the intercom instruction, the target analog camera responds to the intercom instruction to modulate a target analog video signal for sending to the video processing device, so as to obtain a second video signal. Through the modulation processing, the target analog camera can modulate an analog audio signal of audio acquired from an acquisition scene to a line blanking area of the target analog video signal. The target analog video signal may be an analog video signal, which is not particularly limited in the present application.

Optionally, the video processing device parses the second video signal from a line blanking area to obtain an analog audio signal, and determines a digital audio signal corresponding to the parsed analog audio signal, so that the second audio output module at the user side is invoked to perform audio output processing on the audio represented by the digital audio signal. The second audio data may be digital signal data or analog signal data, which is not limited in the embodiment of the present application.

It should be understood that the video processing device and the corresponding user terminal may be two devices, considering that the audio transmission between the two devices may be transmitted by an analog signal. Therefore, the video processing device analyzes the analog audio signal from the line blanking area of the second video signal to obtain the target analog signal, and then the target analog signal can be sent to the corresponding user terminal, so that the second audio output module is called by the user terminal to perform audio output processing on the audio represented by the target analog signal. Accordingly, considering that the video processing device can be connected with the pickup and the player, the video processing device can be used as an intercom input source and an intercom output source, that is, the video processing device and the corresponding user terminal are the same device, and the user terminal corresponding to the video processing device is the video processing device itself. At this time, after the video processing device obtains the target analog signal, the second audio output module associated with the video processing device can be directly called to perform audio output processing on the audio represented by the target analog signal.

Fig. 6 is a schematic diagram of a modulation position of second audio data according to an embodiment of the present application, and fig. 7 is a schematic waveform of a modulation position of second audio data corresponding to fig. 6. The coaxial audio in fig. 6 is the second audio data in the embodiment of the present application, and may also be referred to as downlink audio.

The target analog camera modulates the coaxial audio into a line blanking area of a second video signal after adding a color carrier synchronization signal applied to image data through line synchronization aiming at a target analog video signal, and specifically, modulates the downlink audio into an audio synchronization signal for marking a starting identification bit of the coaxial audio to obtain the second video signal. Fig. 8 is a schematic diagram of coaxial audio waveforms, which is a display interface diagram in a real scene. The waveform of the dense region in the upper part of fig. 8 is 1080P25 coaxial audio.

In this embodiment, the audio data sent from the target analog camera to the video processing device is inserted into the line blanking area of the video signal, and the audio data sent from the video processing device to the target analog camera is inserted into the field blanking area of the video signal, so that the audio data sent from the target analog camera to the other party will not interfere with each other, and the stability of the transmitted audio data is improved.

Optionally, in another embodiment of the present application, an audio transmission method provided in the embodiment of the present application may further include the following steps:

step B1, responding to the obtained first audio data and the obtained target analog signal, and carrying out preset processing on the obtained first audio data and the second audio data corresponding to the obtained target analog signal to obtain a processing result;

The preset processing is used for indicating the receiver of the acquired first audio data as a target analog camera, and responding to the module which is associated with the second audio output module as the video processing equipment, and indicating the receiver of the second audio data corresponding to the acquired target analog signal as the video processing equipment;

In the step S202, modulating the analog audio signal corresponding to the first audio data to the vertical blanking region corresponding to the first video signal to obtain the target data signal, the method may include the following steps:

Step B2, determining the audio data indicated by the processing result and corresponding to the receiver as a target analog camera to obtain first audio data;

Step B3, modulating the obtained analog audio signal corresponding to the first audio data to a field blanking area corresponding to the first video signal to obtain a target data signal;

When the second audio output module is a module associated with the video processing device itself, the step S205 may include the following steps by calling the second audio output module to perform audio output processing on the audio represented by the target analog signal:

And step B41, responding to the second audio output module as the module associated with the video processing equipment, determining that the corresponding receiver indicated by the processing result is the audio data of the video processing equipment to obtain second audio data, and calling the second audio output module associated with the video processing equipment to perform audio output processing on the audio represented by the second audio data.

In this embodiment, when the second audio output module is a module associated with the video processing device itself, that is, when the user terminal corresponding to the video processing device is the video processing device itself, the video processing device considers that the first audio data needs to be transmitted to the target analog camera for analysis and playing after acquiring the first audio data and the obtained target analog signal, and the second audio data corresponding to the target analog signal needs to be transmitted to the video processing device itself for analysis and playing. Therefore, the video processing device performs predetermined processing on the acquired first audio data and the second audio data corresponding to the acquired target analog signal to obtain a processing result, indicates a receiver of the acquired first audio data as the target analog camera, and indicates a receiver of the second audio data corresponding to the acquired target analog signal as the video processing device itself in response to the second audio output module being a module associated with the video processing device itself. The second audio data corresponding to the target analog signal may be obtained after analog-to-digital conversion.

It should be noted that, the module associated with the video processing device may be a module embedded in the video processing device, for example, a speaker mounted on the video processing device itself, or may be a module in network communication with the video processing device, for example, a bluetooth speaker, which may be directly invoked by the video processing device, which is reasonable.

In summary, when the first audio data is obtained by calling the first audio acquisition module at the user end corresponding to the video processing device, the user end may also call its own audio output module to play the first audio data when performing audio output, so that the case that the second audio output module is a module associated with the video processing device itself may be understood as the case that the video processing device itself is a user end corresponding to the video processing device, that is, the case that the video processing device is integrated with a user end function.

In this way, the video processing device may determine, based on the processing result, that the corresponding receiver indicated by the processing result is the audio data of the target analog camera, so as to obtain first audio data, and modulate the analog audio signal corresponding to the obtained first audio data to the vertical blanking region corresponding to the first video signal, so as to obtain the target data signal.

And in response to the second audio output module being a module associated with the video processing device itself, that is, if the user terminal corresponding to the video processing device is the video processing device itself, it may determine, based on the processing result, that the corresponding receiver indicated by the processing result is the audio data of the video processing device itself, to obtain second audio data, thereby calling the second audio output module associated with the video processing device itself to perform audio output processing for the audio represented by the second audio data.

In this embodiment, considering that when the user side corresponding to the video processing device is the video processing device itself, that is, the second audio output module for playing the second audio data is a module associated with the video processing device itself, in the audio transmission process, two types of audio data exist in the video processing device, where one type is the first audio data that needs to be modulated, and the other type is the second audio data that needs to be locally played. In order to facilitate distinguishing between the two types of data, the video processing apparatus distinguishes between the two types of audio data based on the difference of the receiving sides by predetermined processing after acquiring the two types of data, so as to facilitate execution of the subsequent audio transmission method.

Optionally, based on the difference of the receivers, corresponding receiver tags are marked for the audio data, and when the video processing device processes the audio data, the processing mode of the audio data is determined by identifying the receiver tags carried by the audio data.

If the receiver tag representing the receiver carried by the audio data represents the receiver as a target analog camera, the audio data is first audio data, at this time, the video processing device can modulate the analog audio signal corresponding to the obtained first audio data to the position of a field blanking area corresponding to the first video signal to obtain a target data signal, and if the receiver tag representing the receiver is the video processing device, the audio data is second audio data, at this time, the video processing device can call a second audio output module associated with the video processing device to perform audio output processing on the audio represented by the second audio data.

When the second audio output module is not a module associated with the video processing apparatus itself, the step S205 may include the following steps by calling the second audio output module to perform audio output processing on the audio represented by the target analog signal:

And step B42, responding to the fact that the second audio output module is not a module associated with the video processing equipment, and transmitting audio to the second audio output module based on the target analog signal so as to perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.

In this embodiment, when the second audio output module is not a module associated with the video processing device itself, that is, when the user terminal corresponding to the video processing device is not the video processing device itself, the video processing device considers that the first audio data needs to be transmitted to the target analog camera for analysis and playing after acquiring the first audio data and the obtained target analog signal, and the second audio data corresponding to the target analog signal needs to be transmitted to the second audio output module for analysis and playing. Therefore, the video processing device performs predetermined processing on the obtained first audio data and the obtained second audio data corresponding to the target analog signal to obtain a processing result, indicates a receiver of the obtained first audio data as the target analog camera, and indicates a receiver of the obtained second audio data corresponding to the target analog signal as a user side carrying the second audio output module in response to the second audio output module not being a module associated with the video processing device itself.

It should be noted that, the module not associated with the video processing device refers to a module that the video processing device cannot directly call, that is, if the module is used for audio output, the video processing device needs to transmit audio data to the user terminal on which the module is mounted, and then call the module for audio output through the user terminal on which the module is mounted. Therefore, the situation that the second audio output module is not a module associated with the video processing device itself can be understood that the user terminal corresponding to the video processing device is the user terminal on which the second audio output module is mounted and is not the user terminal of the video processing device itself, where the user terminal can be an electronic device such as a mobile phone or a computer, which is reasonable.

And in response to the second audio output module not being a module associated with the video processing device itself, transmitting audio to the second audio output module based on the target analog signal to perform audio output processing for audio characterized by the target analog signal by invoking the second audio output module. The above process may be understood as determining, based on the processing result, that the corresponding receiving party indicated by the processing result is the audio data of the user terminal corresponding to the video processing device when the user terminal corresponding to the video processing device is not the video processing device itself, to obtain the second audio data, thereby performing audio transmission to the user terminal, so that the user terminal invokes the second audio output module to perform audio output processing.

For example, if the user side on which the second audio output module is mounted is a mobile phone, in response to the second audio output module not being a module associated with the video processing device, audio transmission is performed to the mobile phone based on the target analog signal, so that the mobile phone performs audio output processing on the audio represented by the target analog signal by calling the second audio output module.

That is, when the second audio output module is not a module associated with the video processing device, the video processing device plays a role of a transfer station in the whole audio transmission process, that is, after the video processing device acquires the first audio data and the target analog signal, the video processing device sends the first audio data to the target analog camera, and sends the target analog signal to the corresponding user terminal carrying the second audio output module.

Optionally, in one implementation manner, the step B1 performs predetermined processing on the obtained first audio data and the obtained second audio data corresponding to the target analog signal to obtain a processing result, and may include the following steps:

step C1, generating multichannel data to obtain a processing result;

The method comprises the steps of obtaining first audio data of a first designated channel in multi-channel data, wherein the data of the first designated channel in the multi-channel data are the acquired first audio data, and the data of a second designated channel in the multi-channel data are second audio data corresponding to an obtained target analog signal when a second audio output module is a module associated with video processing equipment, and the data of the second designated channel are predetermined data representing a null value when the second audio output module is not the module associated with the video processing equipment;

Step B2, determining that the corresponding receiver indicated by the processing result is the audio data of the target analog camera, to obtain the first audio data, may include the following steps:

Step C2, acquiring data of a first designated channel in a processing result to obtain first audio data;

step B41, determining that the corresponding receiver indicated by the processing result is the audio data of the video processing device itself, to obtain the second audio data, may include the following steps:

and step C3, acquiring data of a second designated channel in the processing result to obtain second audio data.

In this implementation manner, in the case that the second audio output module is a module associated with the video processing device itself or is not a module associated with the video processing device itself, that is, in the case that the user side corresponding to the video processing device is the video processing device itself or is another electronic device, in the whole audio transmission process, two types of audio data always exist in the video processing device, one type of audio data is first audio data that needs to be modulated, and the other type of audio data is second audio data that is transmitted to the second audio output module to be played. In order to facilitate the subsequent processing of the video processing device, the video processing device may combine the two audio data to generate multi-channel data, thereby obtaining a processing result. Among the multi-channel data, the data of the first designated channel is the acquired first audio data, and the data of the second designated channel is the second audio data corresponding to the acquired target analog signal.

In this way, the video processing device directly determines the data of the first designated channel of the processing result as the first audio data when processing the audio data to be modulated, and correspondingly, the video processing device directly determines the data of the second designated channel of the processing result as the second audio data when processing the audio data to be locally played, namely when the second audio output module is a module associated with the video processing device.

If the second audio output module is not a module associated with the video processing device, the video processing device needs to transmit audio to the second audio output module based on the target analog signal, and at this time, the data of the second designated channel is the data of the predetermined characterization null value. Wherein the video processing device does not need to process the data in the second specified channel when the data in the second specified channel is the above-described predetermined data.

Alternatively, the multi-channel data may be two-channel data. The data of the left channel may be first audio data, and the data of the right channel may be second audio data. Accordingly, the data of the left channel may be the second audio data, and the data of the right channel may be the first audio data, which is reasonable.

Optionally, the video processing device transmits the first audio data and the second audio data according to a predetermined clock cycle, so as to combine the first audio data and the second audio data into binaural data, that is, combine the first audio data and the second audio data into binaural data in a time division multiplexing manner, so that the video processing device can directly distinguish different audio data through the preset clock cycle.

For example, the audio data transmitted in the first predetermined clock period is set as the data transmitted in the left channel, and the audio data transmitted in the second predetermined clock period is set as the data transmitted in the right channel.

The predetermined clock period may be 0.5 period, or may be 1 period, 2 periods, or the like, which is not particularly limited in the embodiment of the present application.

Exemplary, as shown in fig. 9, a waveform diagram of two-channel audio data is shown, where the waveform diagram is a display interface diagram in an actual scene. Wherein the waveform of the upper left part of the figure is the first audio data, the waveform of the lower right part of the figure is the second audio data, and each vertical line of the side waveform starting part represents the second audio data.

Corresponding to the method embodiment, the embodiment of the application also provides video processing equipment. Fig. 10 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application, and as shown in fig. 10, the video processing apparatus according to an embodiment of the present application includes a control unit 1001 and an analog-to-digital conversion unit 1002;

The control unit 1001 is configured to acquire first audio data;

The first audio data are audio data which are acquired by calling the first audio acquisition module and take a target analog camera as audio of a playing end;

the analog-to-digital conversion unit 1002 is configured to modulate an analog audio signal corresponding to the first audio data to a field blanking area corresponding to the first video signal, so as to obtain a target data signal;

The first video signal is an analog video signal and serves as a carrier signal corresponding to the target analog camera;

The analog-to-digital conversion unit 1002 is further configured to send the target data signal to the target analog camera, so that the target analog camera parses an analog audio signal from a field blanking area of the target data signal, and invokes a first audio output module to perform audio output processing on audio represented by the parsed analog audio signal;

the analog-to-digital conversion unit 1002 is further configured to, in response to receiving a second video signal sent by the target analog camera, parse an analog audio signal from a line blanking area of the second video signal to obtain a target analog signal, and send the target analog signal to the control unit 1001, where the second video signal is a video signal obtained by modulating, by the target analog camera, the target analog video signal used for being sent to the video processing device;

The control unit 1001 is further configured to receive the target analog signal, and perform audio output processing on audio represented by the target analog signal by calling a second audio output module.

In this embodiment, when there is a need to talk to an acquisition scene on the side of the target analog camera, that is, when the control unit 1001 of the video processing apparatus acquires first audio data acquired by calling the first audio acquisition module and using the target analog camera as audio at the playing end, the analog-to-digital conversion unit 1002 of the video processing apparatus may modulate an analog audio signal corresponding to the acquired first audio data to a field blanking area corresponding to the first video signal to obtain a target data signal, and then send the obtained target data signal to the target analog camera, so that the target analog camera parses the target data signal from the field blanking area of the target data signal to obtain an analog audio signal, and call the first audio output module to perform audio output processing on audio represented by the parsed analog audio signal. Therefore, the audio of the user side is sent to the analog camera side, and the call requirements of the user side and the analog camera side are met.

The first audio acquisition module can be an acquisition module in a device to which a user terminal corresponding to the video processing device belongs, so that the user terminal corresponding to the video processing device can call the first audio acquisition module to acquire first audio data, and the first audio acquisition module can also be an acquisition module which can be called by the user terminal through a network, so that the user terminal corresponding to the video processing device calls the first audio acquisition module through the network to acquire the first audio data, which is reasonable.

The target analog camera may also modulate the target analog video signal for sending to the analog-to-digital conversion unit 1002 of the video processing apparatus, modulate the analog audio signal of the audio acquired in the acquisition scene of the target analog camera to the line blanking area of the target analog video signal, obtain the second video signal, and send the second video signal to the analog-to-digital conversion unit 1002.

The analog-to-digital conversion unit 1002 may further parse an analog audio signal from a line blanking area of the second video signal in response to receiving the second video signal, to obtain a target analog signal, and send the target analog signal to the control unit 1001, so that the control unit 1001 performs an audio output process on the audio represented by the received target analog signal by calling the second audio output module. Therefore, the audio of the analog camera side is sent to the user side, and the call requirements of the analog camera side and the user side are met, so that the bidirectional mutual transmission of the audio of the user side and the audio of the analog camera side is realized.

Based on the above, by applying the scheme provided by the embodiment of the application, the analog-to-digital conversion unit of the video processing device modulates the analog audio signal corresponding to the audio data to be transmitted to the target analog camera into the vertical blanking region of the first video signal through signal modulation, so as to transmit the audio represented by the analog audio signal to the target analog camera through the first video signal. And the target analog camera modulates an analog audio signal corresponding to the audio data to be transmitted to the video processing device into a line blanking area of a second video signal through signal modulation so as to transmit the audio represented by the analog audio signal through the second video signal. Therefore, through the scheme of the application, the audio of the user side and the audio of the analog camera side can be mutually transmitted in two directions, so that the communication with the analog camera side is realized.

Alternatively, in one implementation, the first and second memory devices,

The control unit 1001 is further configured to perform, in response to the obtained first audio data and the obtained target analog signal, a predetermined process on the obtained first audio data and the obtained second audio data corresponding to the target analog signal, to obtain a processing result, where the predetermined process is configured to instruct a receiver of the obtained first audio data to be the target analog camera, and in response to the second audio output module being a module associated with the video processing device itself, instruct a receiver of the obtained second audio data corresponding to the target analog signal to be the video processing device itself, where the second audio data corresponding to the target analog signal may be obtained after analog-to-digital conversion.

The analog-to-digital conversion unit 1002 modulates the analog audio signal corresponding to the first audio data to a field blanking region corresponding to the first video signal, to obtain a target data signal, including:

Determining the corresponding receiver indicated by the processing result as the audio data of the target simulation camera to obtain the first audio data;

modulating the obtained analog audio signal corresponding to the first audio data to a field blanking area corresponding to the first video signal to obtain a target data signal;

The analog-to-digital conversion unit 1002 is further configured to determine that the corresponding receiver indicated by the processing result is audio data of the video processing device itself in response to the second audio output module being a module associated with the video processing device itself, obtain the second audio data, and call the second audio output module associated with the video processing device itself to perform audio output processing on audio represented by the second audio data;

the control unit 1001 performs audio output processing on the audio characterized by the target analog signal by calling a second audio output module, including:

And responding to the second audio output module not being a module associated with the video processing equipment, and carrying out audio transmission on the second audio output module based on the target analog signal so as to carry out audio output processing on the audio represented by the target analog signal by calling the second audio output module.

Optionally, in one implementation manner, the control unit 1001 performs predetermined processing on the acquired first audio data and the second audio data corresponding to the obtained target analog signal, to obtain a processing result, where the processing result includes:

Generating multi-channel data to obtain a processing result, wherein the data of a first designated channel in the multi-channel data are acquired first audio data, and the data of a second designated channel in the multi-channel data are second audio data corresponding to the acquired target analog signal when the second audio output module is a module associated with the video processing equipment, and the data of the second designated channel are predetermined data representing a null value when the second audio output module is not the module associated with the video processing equipment;

The analog-to-digital conversion unit 1002 determines that the corresponding receiving party indicated by the processing result is the audio data of the target analog camera, and obtains the first audio data, including:

acquiring data of a first designated channel in the processing result to obtain the first audio data;

the analog-to-digital conversion unit 1002 determines that the corresponding receiver indicated by the processing result is audio data of the video processing device itself, to obtain the second audio data, including:

And acquiring data of a second designated channel in the processing result to obtain the second audio data.

Optionally, in one implementation manner, the modulating, by the analog-to-digital conversion unit 1002, the analog audio signal corresponding to the first audio data to a field blanking area corresponding to the first video signal, to obtain the target data signal includes:

Determining a first signal system of the first video signal;

modulating the analog audio signal corresponding to the first audio data to a position corresponding to the first signal system in the idle position of the vertical blanking region corresponding to the first video signal, wherein different signal systems correspond to different positions in the idle position.

Optionally, in one implementation manner, the idle position is a position in the vertical blanking region except a position occupied by communication data of a predetermined communication protocol, wherein the predetermined communication protocol is a communication protocol between the video processing device and the target analog camera.

Optionally, in one implementation, the first video signal is an analog video signal that is sent by the target analog camera to the control unit 1001 of the video processing device and meets a predetermined filtering condition, where the predetermined filtering condition includes a filtering condition set based on a signal receiving time.

Corresponding to the embodiment of the method, the embodiment of the application also provides a data transmission system. As shown in fig. 11, a schematic structural diagram of a data transmission system according to an embodiment of the present application is provided, where the data transmission system according to an embodiment of the present application includes a video processing device 1101 and a target analog camera 1102.

The video processing device 1101 is configured to obtain first audio data, modulate an analog audio signal corresponding to the first audio data to a field blanking area corresponding to a first video signal to obtain a target data signal, and send the target data signal to the target analog camera 1102, where the first audio data is audio data of audio obtained by calling a first audio acquisition module and using the target analog camera 1102 as a playing end, and the first video signal is an analog video signal and is used as a carrier signal corresponding to the target analog camera 1102;

The target analog camera 1102 is configured to receive the target data signal, analyze an analog audio signal from a field blanking area of the target data signal, and call a first audio output module to perform audio output processing on audio represented by the analog audio signal obtained by analysis;

The target analog camera 1102 is further configured to send a second video signal to the video processing device 1101, where the second video signal is a video signal obtained by modulating, by the target analog camera 1102, a target analog video signal that is used to be sent to the video processing device 1101;

The video processing device 1101 is further configured to receive the second video signal, parse an analog audio signal from a line blanking area of the second video signal to obtain a target analog signal, and perform audio output processing on audio represented by the target analog signal by calling a second audio output module.

Based on the above, when the scheme provided by the embodiment of the application is applied to audio transmission, the video processing equipment in the data transmission system modulates the signal of the analog audio signal corresponding to the audio data to be transmitted to the target analog camera, and modulates the analog signal into the field blanking area of the first video signal so as to transmit the audio represented by the analog audio signal to the target analog camera through the first video signal. And the target analog camera modulates an analog audio signal corresponding to the audio data to be transmitted to the video processing device into a line blanking area of a second video signal through signal modulation so as to transmit the audio represented by the analog audio signal through the second video signal. Therefore, through the scheme of the application, the audio of the user side and the audio of the analog camera side can be mutually transmitted in two directions, so that the communication with the analog camera side is realized.

Alternatively, in one implementation, the first and second memory devices,

The video processing device 1101 is further configured to perform predetermined processing on the obtained first audio data and the obtained second audio data corresponding to the obtained target analog signal in response to the obtained first audio data and the obtained target analog signal, so as to obtain a processing result, where the predetermined processing is configured to instruct a receiver of the obtained first audio data to be the target analog camera 1102, and instruct a receiver of the obtained second audio data corresponding to the obtained target analog signal to be the video processing device 1101 in response to a module associated with the second audio output module being the video processing device 1101;

The video processing device 1101 modulates an analog audio signal corresponding to the first audio data to a field blanking area corresponding to the first video signal, to obtain a target data signal, including:

Determining that the corresponding receiver indicated by the processing result is the audio data of the target analog camera 1102, so as to obtain the first audio data; modulating the obtained analog audio signal corresponding to the first audio data to a field blanking area corresponding to the first video signal to obtain a target data signal;

The video processing device 1101 performs audio output processing for the audio characterized by the target analog signal by calling a second audio output module, including:

And determining that the corresponding receiver indicated by the processing result is the audio data of the video processing equipment 1101, and obtaining the second audio data, and calling a second audio output module associated with the video processing equipment 1101 to perform audio output processing on the audio represented by the second audio data, or performing audio transmission to the second audio output module based on the target analog signal in response to the second audio output module not being the module associated with the video processing equipment 1101, wherein the second audio output module is not the module associated with the video processing equipment 1101, and the second audio output module is called to perform audio output processing on the audio represented by the target analog signal.

Alternatively, in one implementation, the first and second memory devices,

The video processing device 1101 performs predetermined processing on the acquired first audio data and the second audio data corresponding to the obtained target analog signal, to obtain a processing result, including:

Generating multi-channel data to obtain a processing result, wherein the data of a first designated channel in the multi-channel data is acquired first audio data, and the data of a second designated channel in the multi-channel data is second audio data corresponding to the acquired target analog signal when the second audio output module is a module associated with the video processing equipment 1101, and the data of the second designated channel is data of a preset characterization null value when the second audio output module is not a module associated with the video processing equipment 1101;

The video processing device 1101 determines that the corresponding receiving party indicated by the processing result is the audio data of the target analog camera 1102, and obtains the first audio data, including:

The video processing device 1101 determines that the corresponding receiver indicated by the processing result is audio data of the video processing device 1101 itself, to obtain the second audio data, including:

Optionally, in one implementation manner, the video processing device 1101 modulates an analog audio signal corresponding to the first audio data to a field blanking area corresponding to the first video signal to obtain a target data signal, including:

Determining a first signal system of the first video signal;

Optionally, in one implementation, the idle position is a position in the vertical blanking region other than a position occupied by communication data of a predetermined communication protocol, wherein the predetermined communication protocol is a communication protocol between the video processing device 1101 and the target analog camera 1102.

Optionally, in one implementation, the first video signal is an analog video signal that is sent by the target analog camera 1102 to the video processing device 1101 and meets a predetermined filtering condition, where the predetermined filtering condition includes a filtering condition set based on a signal receiving time.

The solution provided by the above embodiment of the present application is described below by way of example with reference to specific embodiments.

Fig. 12 is a schematic structural diagram of another data transmission system according to an embodiment of the present application. The camera in fig. 12 is a target analog camera provided by the embodiment of the present application, the DVR is the video processing device provided by the embodiment of the present application, and the far end is the user end corresponding to the video processing device provided by the embodiment of the present application.

The camera and the DVR perform data transmission through the coaxial line, and the DVR performs data transmission through a network cable (network) between the DVR and the far end, and the network cable can be called a backhaul link.

Fig. 13 is a schematic structural diagram of a hard disk video recorder according to an embodiment of the present application. The analog-to-digital converter AD in fig. 13 is an analog-to-digital conversion unit in the embodiment of the present application, and the system level processor is a control unit in the embodiment of the present application. The AD is used for analog-to-digital conversion, and is convenient for a processor in a subsequent DVR to process. In general, the DVR may be connected to the camera via a coaxial line, and receive audio and video data of the camera, and store, play or remotely transmit the received audio and video data to a computer or a mobile phone.

After the camera collects the audio and video signals, the audio can be modulated into the line blanking area of the video signals and transmitted to the AD of the DVR end through the coaxial line, the AD acquires audio data through sampling the specific position (line blanking area) of the video signals, the system level processor of the DVR carries out audio encoding on the audio data after receiving the audio data acquired by the AD and transmits the audio data to the far end, such as a computer or a personal mobile phone end through a network, so that after the computer or the mobile phone end decodes the received audio data, the audio data is output through a corresponding loudspeaker, and thus, a user at the far end side can hear the intercom sound of the camera end. Wherein the audio data transmitted from the camera to the far end is the second audio data in the embodiment of the application,

After the DVR decodes the audio data, the AD can modulate the audio data to a field blanking area of a video signal and transmit the audio data to a camera end through a coaxial line, so that the camera end analyzes the audio data and outputs the analyzed audio data through a loudspeaker. Thus, the user on the camera side can also hear the intercom sound at the far end. The audio data transmitted from the far end to the camera is the first audio data in the embodiment of the application. In addition, can also be connected with the adapter on the DVR, consequently, the DVR itself also can be as the input source of talkbacking, and camera end can talkbacking with the DVR promptly.

The following description is directed to specific procedures for audio transmission between an analog camera and a far end, and between the far end and the analog camera, respectively.

1. The audio transmission process between the analog camera and the far end is that the DVR receives intercom sounds sent by the analog camera, namely coaxial audio (second audio data). The coaxial audio is transmitted to the AD of the DVR via the coaxial line, then to the DVR 'S processor via the I2S bus, and then to the remote end by the DVR' S processor. The method specifically comprises the following steps:

The analog camera modulates video data onto an analog signal to obtain a video signal, and if the analog camera is a coaxial audio camera, the analog camera modulates coaxial audio onto the video signal. I.e. the in-line audio is inserted into the line blanking area. Thus, the AD can obtain an audio signal transmitted by the coaxial line through sampling the data of the specific position (the line blanking area) of the coaxial line, and the audio signal is sent to the DVR through the I2S bus, so that the access of sound is realized. Thus, the DVR side can hear the intercom sound of the analog camera side.

Wherein the AD captures the coaxial audio before it is passed to the DVR device 'S processor via the I2S bus for receipt by the DVR device' S processor. If the device is a large-path cascade device, the master/slave processor is required to perform data interaction through a PCIE bus (PCI-Express, PERIPHERAL COMPONENT INTERCONNECT EXPRESS is a high-speed serial computer expansion bus standard), and the coaxial audio received from the slave processor is sent to the master processor. The main processor receives and then performs G711 encoding (an audio encoding mode formulated by the International telecommunication Union (ITU-T), also called ITU-T G.711), and transmits the encoded audio to a remote computer or mobile phone through a network so as to enable the remote computer or mobile phone to decode and output.

2. The audio transmission process between the far end and the analog camera is that the DVR processor decodes the uplink audio (first audio data), sends the uplink audio to the AD of the DVR through the I2S bus, modulates the uplink audio to the field blanking area of the video signal by the AD of the DVR, sends the uplink audio to the analog camera through the coaxial line, and then analyzes by the AD of the analog camera, and the analog camera side can hear the intercom sound of the far end computer or the mobile phone side.

Since the DVR and the analog camera are transmitted via the coaxial line, the upstream audio transmitted by the far end is additional audio data for the coaxial line. Therefore, in order to transmit additional audio data on the coaxial line without affecting the coaxial audio, the upstream audio may be inserted in the vertical blanking region of a frame of video signal in the form of an insertion code. Because the positions of the signals of different signal systems in the vertical blanking region of the video signal are different, when the AD modulates the uplink audio to the vertical blanking region of the video signal, the AD can modulate the uplink audio to the corresponding position of the vertical blanking region according to the signal system of the video signal.

It is contemplated that audio transmission between the DVR and the analog camera is made possible on the premise that the analog camera conforms to the protocol information of the coaxial communication. That is, the analog camera can complete the reception and processing of the signal transmitted from the DVR only when the analog camera supports the protocol information of the above-mentioned coaxial communication.

The analog camera inserts the coaxial communication protocol information into the blanking area of the video signal, and the coaxial communication protocol information is transmitted to the AD of the DVR through the coaxial line, and the AD transmits the protocol information to the processor of the DVR after being sampled at a specific position (a line blanking area), so that the DVR and the analog camera complete communication according to the coaxial communication protocol information. When the DVR transmits the protocol information of the coaxial communication to the analog camera, the protocol information is modulated into the vertical blanking region of the video signal by the AD and transmitted to the analog camera through the coaxial line. Thus, through the flow of protocol information for coaxial communication above, the DVR and analog camera communicate according to the protocol.

In addition, when audio transmission is performed, the DVR sends a request intercom message to the analog camera, and if the feedback information of the analog camera indicates that the analog camera can finish receiving and processing signals sent by the DVR, the DVR continues to execute the audio transmission method provided by the embodiment of the application.

In this embodiment, by inserting the uplink audio into the vertical blanking region of the video signal and inserting the coaxial audio into the horizontal blanking region of the video signal for audio transmission, two types of audio data to be transmitted can not interfere with each other, so as to improve stability of the transmitted audio data; and through gathering coaxial audio and sending the upstream audio, the DVR can send the coaxial audio that the analog camera sent to the equipment of far-end, sends the upstream audio that the far-end sent to the analog camera to realize the purpose that far-end equipment and analog camera corresponding gathering scene talkback, fill the blank that far-end equipment and analog camera talkback in the audio transmission process.

Since the DVR itself can also be used as the intercom input source, the remote device, i.e., the camera end, can intercom with the DVR. At this time, in the intercom flow of the analog camera and the DVR, the AD of the DVR is required to send intercom sound to the analog camera and locally output sound of the analog camera, at this time, the processor may combine two audio data into two audio data to be sent to the AD of the DVR together, where the left channel data is intercom sound to be sent to the analog camera and the right channel data is sound to be locally output. Thus, after receiving the two-channel data, the AD can send the left-channel data to the analog camera as intercom sound, and the right-channel data to the device audio output port of the DVR as device output data.

Exemplary, as shown in fig. 14, a dual-channel data transmission schematic diagram is provided in an embodiment of the present application. Wherein, I2S is the I2S bus in the embodiment of the present application.

In this embodiment, when the remote device is the DVR itself, the two-channel audio transmission mode is used to upload two different audio data, i.e., the intercom sound to be sent to the analog camera and the sound of the analog camera output locally, so as to realize simultaneous transmission of audio uploading and local output, thereby improving the efficiency of audio transmission.

The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims

1. An audio transmission method, characterized in that it is applied to a video processing device, the method comprising:

Acquire first audio data; wherein the first audio data is audio data acquired by calling a first audio acquisition module and using a target simulated camera as a playback end;

Modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera;

Sending the target data signal to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calling the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal;

In response to receiving a second video signal sent by the target analog camera, an analog audio signal is parsed from a line blanking region of the second video signal to obtain a target analog signal; wherein the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio acquired within the acquisition scene of the target analog camera to the line blanking region of the target analog video signal;

The second audio output module is called to perform audio output processing on the audio represented by the target analog signal.

2. The method according to claim 1, characterized in that the step of modulating the analog audio signal corresponding to the first audio data to the field blanking region corresponding to the first video signal to obtain the target data signal comprises:

Determining a first signal format of the first video signal;

The analog audio signal corresponding to the first audio data is modulated to a position corresponding to the first signal format in an idle position of a field blanking area corresponding to the first video signal; wherein different signal formats correspond to different positions in the idle positions.

3. The method according to claim 2 is characterized in that the idle position is: a position in the field blanking area excluding a position occupied by communication data of a predetermined communication protocol; wherein the predetermined communication protocol is a communication protocol between the video processing device and the target analog camera.

4. The method according to claim 1 is characterized in that the first video signal is an analog video signal sent by the target analog camera to the video processing device and meets a predetermined filtering condition; wherein the predetermined filtering condition includes a filtering condition set based on a signal receiving time.

5. The method according to claim 1 is characterized in that the first audio data is specifically audio data of the audio with the target simulated camera as the playback end, which is collected by calling the first audio collection module in response to the intercom instruction triggered by the target intercom operation, and the target intercom operation is an operation issued in the user end to instruct to intercom the collection scene of the target simulated camera;

The second video signal is specifically a video signal obtained by the target analog camera performing modulation processing on the target analog video signal to be sent to the video processing device in response to the intercom instruction triggered by the target intercom operation.

6. The method according to claim 1, characterized in that the method further comprises:

In response to acquiring the first audio data and the obtained target analog signal, performing predetermined processing on the acquired first audio data and the second audio data corresponding to the obtained target analog signal to obtain a processing result; wherein the predetermined processing is used to indicate the recipient of the acquired first audio data as the target analog camera, and in response to the second audio output module being a module associated with the video processing device itself, indicating the recipient of the second audio data corresponding to the obtained target analog signal as the video processing device itself;

Modulating the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal includes:

Determine the audio data indicated by the processing result and corresponding to the target analog camera as the receiver, and obtain the first audio data;

Modulating the analog audio signal corresponding to the obtained first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal;

The step of calling the second audio output module to perform audio output processing on the audio represented by the target analog signal includes:

In response to the second audio output module being a module associated with the video processing device itself, determining the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, and obtaining the second audio data; and calling the second audio output module associated with the video processing device itself to perform audio output processing on the audio represented by the second audio data;

or,

In response to the second audio output module not being a module associated with the video processing device itself, audio is transmitted to the second audio output module based on the target analog signal, so as to perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.

7. The method according to claim 6, characterized in that the step of performing predetermined processing on the acquired first audio data and the obtained second audio data corresponding to the target analog signal to obtain the processing result comprises:

Generate multi-channel data and obtain a processing result; wherein the data of a first designated channel in the multi-channel data is the acquired first audio data, and when the second audio output module is a module associated with the video processing device itself, the data of a second designated channel in the multi-channel data is the second audio data corresponding to the acquired target analog signal; when the second audio output module is not a module associated with the video processing device itself, the data of the second designated channel is predetermined data representing a null value;

The step of determining the audio data indicated by the processing result and corresponding to the target analog camera as the receiver to obtain the first audio data includes:

Acquire data of a first specified channel in the processing result to obtain the first audio data;

The step of determining the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, and obtaining the second audio data comprises:

The data of the second designated channel in the processing result is obtained to obtain the second audio data.

8. A video processing device, characterized in that it comprises: a control unit and an analog-to-digital conversion unit;

The control unit is used to obtain first audio data; wherein the first audio data is audio data acquired by calling the first audio acquisition module and using the target simulated camera as the playback end;

The analog-to-digital conversion unit is used to modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; wherein the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera;

The analog-to-digital conversion unit is further used to send the target data signal to the target analog camera, so that the target analog camera parses the analog audio signal from the field blanking area of the target data signal, and calls the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal;

The analog-to-digital conversion unit is further used for, in response to receiving a second video signal sent by the target analog camera, parsing an analog audio signal from a line blanking region of the second video signal to obtain a target analog signal, and sending the target analog signal to the control unit; wherein the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio acquired in the acquisition scene of the target analog camera to the line blanking region of the target analog video signal;

The control unit is further used to receive the target analog signal and perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.

9. The video processing device according to claim 8, characterized in that:

The control unit is further used to, in response to the acquisition of the first audio data and the obtained target analog signal, perform predetermined processing on the acquired first audio data and the second audio data corresponding to the obtained target analog signal to obtain a processing result; wherein the predetermined processing is used to indicate the recipient of the acquired first audio data as the target analog camera, and in response to the second audio output module being a module associated with the video processing device itself, indicate the recipient of the second audio data corresponding to the obtained target analog signal as the video processing device itself;

The analog-to-digital conversion unit modulates the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal, including:

The analog-to-digital conversion unit is further used to, in response to the second audio output module being a module associated with the video processing device itself, determine the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, obtain the second audio data, and call the second audio output module associated with the video processing device itself to perform audio output processing on the audio represented by the second audio data;

The control unit performs audio output processing on the audio represented by the target analog signal by calling the second audio output module, including:

10. The video processing device according to claim 9, wherein the control unit performs predetermined processing on the acquired first audio data and the acquired second audio data corresponding to the target analog signal to obtain a processing result, comprising:

The analog-to-digital conversion unit determines the audio data indicated by the processing result and corresponding to the target analog camera as the receiving party, and obtains the first audio data, including:

The analog-to-digital conversion unit determines the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, and obtains the second audio data, including:

11. A data transmission system, characterized in that the data transmission system comprises: a video processing device and a target simulation camera;

The video processing device is used to obtain first audio data; modulate the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal; send the target data signal to the target analog camera; wherein the first audio data is audio data obtained by calling the first audio acquisition module and using the target analog camera as the playback end; the first video signal is an analog video signal and the first video signal serves as a carrier signal corresponding to the target analog camera;

The target analog camera is used to receive the target data signal; parse the analog audio signal from the field blanking area of the target data signal, and call the first audio output module to perform audio output processing on the audio represented by the parsed analog audio signal;

The target analog camera is further used to send a second video signal to the video processing device; wherein the second video signal is a video signal obtained by the target analog camera performing a modulation process on the target analog video signal to be sent to the video processing device; the modulation process is used to modulate the analog audio signal of the audio collected in the collection scene of the target analog camera to the line blanking area of the target analog video signal;

The video processing device is also used to receive the second video signal; parse the analog audio signal from the line blanking area of the second video signal to obtain a target analog signal; and perform audio output processing on the audio represented by the target analog signal by calling the second audio output module.

12. The data transmission system according to claim 11, characterized in that:

The video processing device is further used to, in response to the acquisition of the first audio data and the obtained target analog signal, perform predetermined processing on the acquired first audio data and the second audio data corresponding to the obtained target analog signal to obtain a processing result; wherein the predetermined processing is used to indicate the recipient of the acquired first audio data as the target analog camera, and in response to the second audio output module being a module associated with the video processing device itself, indicate the recipient of the second audio data corresponding to the obtained target analog signal as the video processing device itself;

The video processing device modulates the analog audio signal corresponding to the first audio data to the field blanking area corresponding to the first video signal to obtain a target data signal, including:

In response to the second audio output module being a module associated with the video processing device itself, determining the audio data indicated by the processing result and corresponding to the video processing device itself as the receiver, obtaining the second audio data, and calling the second audio output module associated with the video processing device itself to perform audio output processing on the audio represented by the second audio data;

or,

13. The data transmission system according to claim 12, wherein the video processing device performs predetermined processing on the acquired first audio data and the acquired second audio data corresponding to the target analog signal to obtain a processing result, comprising:

The video processing device determines the audio data indicated by the processing result and corresponding to the target analog camera as the receiver, and obtains the first audio data, including:

The video processing device determines the audio data indicated by the processing result and corresponding to the receiving party being the video processing device itself, and obtains the second audio data, including: