TWI672956B - Apparatus and method for audio and video synchronization - Google Patents

Abstract

The video and audio synchronization device of the present invention includes a receiver, a transmitter, and a processor. The processor is coupled to the receiver and the transmitter. The processor receives the start instruction at the first calibration time, and outputs characteristic image data to the transmitter in response to the start instruction. The transmitter sends the received characteristic image data to the receiver so that the processor receives the characteristic image data at the second correction time. The processor adjusts the sound data delay parameter according to a time difference between the first correction time and the second correction time.

Description

Video synchronization device and video data synchronization method

The present invention relates to a device and method for processing audiovisual materials; specifically, the present invention relates to a device and method for synchronizing audiovisual materials.

Video and audio signals include video and audio signals. Generally, after the video and audio signals are processed by the video and audio devices, the video signals are transmitted to the display device to output images, and the audio signals are transmitted to the sound playback device to output audio. In the process of audio and video signal processing, it is often affected by factors such as hardware resources and the complexity of audio and video processing, resulting in a situation where the output image and sound are not synchronized. Generally speaking, the complexity of image signal processing is much higher than the complexity of audio signal processing. Therefore, the processing time of image signals is often longer than the processing time of audio signals. Therefore, the output time point of audio signals must be delayed. Improved the problem of asynchronous audio and video signal output. The improvement schemes of the asynchronous audio and video proposed by the prior art mostly rely on manual settings or additional external devices to complete, which is inconvenient in operation. In addition, manual setting may also cause artificial inaccuracies. Therefore, the existing audio and video synchronization technology still needs to be improved.

It is an object of the present invention to provide an audio-visual synchronization device and audio-visual data synchronization device. Step-by-step method to improve the out-of-sync situation when playing audiovisual data.

The video synchronization device includes a receiver, a transmitter, and a processor. The processor is coupled to the receiver and the transmitter. The processor receives the start instruction at the first calibration time, and outputs characteristic image data to the transmitter in response to the start instruction. The transmitter sends the received characteristic image data to the receiver so that the processor receives the characteristic image data at the second correction time. The processor adjusts the sound data delay parameter according to a time difference between the first correction time and the second correction time.

The audiovisual data synchronization method includes the following steps: receiving a start instruction at a first correction time; outputting characteristic image data in response to the start instruction; receiving characteristic image data at a second correction time; And adjust the audio data delay parameter based on the time difference.

10‧‧‧Video sync device

110‧‧‧Receiver

120‧‧‧ transmitter

130‧‧‧ processor

132‧‧‧ Feature image generation unit

134‧‧‧Image data receiving unit

140‧‧‧controller

S101, S103, S105, S107, S109, S111, S201, S203, S205, S207, S209‧‧‧ steps

FIG. 1 is a schematic diagram of an embodiment of a video synchronization device according to the present invention.

FIG. 2 is a schematic diagram of another embodiment of a video synchronization device according to the present invention.

FIG. 3 is a flowchart of an embodiment of a method for synchronizing video and audio data according to the present invention.

The invention provides a video synchronization device, which uses a transmitter to connect a receiver to detect a video delay. The audio and video synchronization device may be a device with a digital audio and video transmission interface. The digital audio and video transmission interface may be, for example, a High Definition Multimedia Interface (HDMI), but is not limited thereto.

FIG. 1 is a schematic diagram of an embodiment of a video synchronization device 10 according to the present invention. As shown in FIG. 1, the audiovisual synchronization device 10 includes a receiver 110, a transmitter 120, and a processor 130. The processor 130 is coupled to the receiver 110 and the transmitter 120. In an embodiment, the receiver 110 is HDMI The receiver, and the transmitter 120 is an HDMI transmitter. The processor 130 receives the start instruction at the first correction time, and outputs the characteristic image data to the transmitter 120 according to the start instruction. For example, a control module (not shown) in the processor 130 generates a start instruction and records a first correction time, and the processor 130 outputs characteristic image data to the transmitter 120 according to the start instruction.

The characteristic image data is used as reference data during calibration, and is used to simulate the time consumed when processing image data provided by a signal source (not shown). In one embodiment, the characteristic image data may be reduced image data. In other embodiments, the characteristic image data may be reduced image data, enlarged image data, segmented image data, or synthesized image data.

As shown in FIG. 1, the transmitter 120 sends the received characteristic image data to the receiver 110 so that the processor 130 receives the characteristic image data at the second correction time. In other words, the transmitter 120 returns the characteristic image data to the processor 130 via the receiver 110, and the processor 130 measures the second correction time. For example, the control module in the processor 130 records the first correction time, and records the second correction time when the receiver 110 returns the characteristic image data. The processor 130 adjusts the sound data delay parameter according to a time difference between the first correction time and the second correction time. Therefore, the transmitter 120 is used to connect the output characteristic image data back to the receiver 110 to detect the image delay, so as to achieve the audio-visual synchronization. At the same time, it can avoid the inconvenience of repeated adjustment under manual settings and improve the use quality.

FIG. 2 is a schematic diagram of another embodiment of a video synchronization device 10 according to the present invention. As shown in FIG. 2, the audio-visual synchronization device 10 includes a receiver 110, a transmitter 120, a processor 130, and a controller 140. The processor 130 is coupled to the transmitter 120 and the receiver 110, and the controller 140 is coupled to the processor 130. In addition, the processor 130 includes a feature image generating unit 132 and an image data receiving unit 134. The controller 140 provides a start instruction to the processor 130 at the first calibration time. The feature image generating unit 132 outputs feature image data in response to a start instruction. The transmitter 120 returns the characteristic image data to the processor 130 via the receiver 110, so that the processor 130 provides The end instruction is sent to the controller 140. In detail, the characteristic image data is transmitted by the transmitter 120 and the receiver 110, and is received by the image data receiving unit 134 at the second correction time and an end instruction is output to the controller 140. Then, the controller 140 calculates the time difference between the first correction time and the second correction time in response to the end instruction, and notifies the processor 130 to adjust the sound data delay parameter.

For example, the controller 140 first records the first calibration time, and records the second calibration time when receiving the end instruction, and further calculates the time difference between the first calibration time and the second calibration time. Knowing the time consumed by the video synchronization device 10 in response to different video data processing requirements, the time difference is reported to the processor 130 to adjust the audio data delay parameter. Therefore, the transmitter 120 is used to connect the output characteristic image data back to the receiver 110 to detect the image delay, so as to achieve the audio-visual synchronization. At the same time, it can avoid the inconvenience of repeated adjustment under manual settings and improve the use quality. In addition, in a preferred embodiment, the characteristic image data includes the above-mentioned different types of image data (reduced image data, enlarged image data, divided image data, or synthesized image data, etc.), thereby obtaining images with different complexity Different amounts of time delay incurred during processing.

FIG. 3 is a flowchart of an embodiment of a method for synchronizing video and audio data according to the present invention. As shown in FIG. 3, the audiovisual data synchronization method includes a correction calculation phase and a processing phase of the original audiovisual data. The correction calculation phase may correspond to the operation mode introduced in the audio-visual synchronization device 10 of FIG. 1 or FIG. 2 and includes steps S101, S103, S105, S107, S109, and S111. The stage of processing original audiovisual data includes steps S201, S203, S205, S207, and S209.

As shown in FIG. 3, in step S101: a start instruction is received at a first correction time. The processor receives a start instruction provided by the controller at a first calibration time. In step S103: the feature image data is output in response to the start instruction. For example, after receiving the initial instruction, the processor outputs the characteristic image data through the characteristic image generating unit. In step S105: receiving characteristic image data at a second correction time. For example, the characteristic image data is transmitted by the transmitter and the receiver, and the image by the processor The data receiving unit receives the characteristic image data at the second correction time. In step S107: calculating a time difference between the first correction time and the second correction time, and in step S109: adjusting a sound data delay parameter according to the time difference. For example, the image data receiving unit outputs an end instruction to the controller at the second correction time. Then, the controller calculates the time difference value in response to the end instruction and informs the processor to adjust the sound data delay parameter.

In step S111, it is confirmed whether the adjustment of the sound data delay parameter is completed. If the adjustment is completed, it enters the stage of processing original audiovisual data. Conversely, if the adjustment is not completed, steps S101 to S109 are repeated. For example, the characteristic image data includes different types of image data, such as reducing image data, enlarging image data, dividing image data, or synthesizing image data, so as to obtain different differences in image processing of different complexity. The amount of time delay. After the video synchronization device calculates the correction time difference by reducing the image data and adjusts the delay parameters of the audio data, the process is repeated by enlarging the image data until the adjustment of the delay parameters of the audio data corresponding to the various image data is completed. It should be added that before receiving the start instruction at the first correction time, a step of coupling the video data output end of the video device with the video data reception end may be included. For example, the transmitter 120 and the receiver 110 of the audio-visual synchronization device 10 shown in FIG. 1 are connected to form an output path of the transmitter 120 and an input path of the receiver 110.

As shown in FIG. 3, in step S201: disconnect the video data output terminal and the video data receiver. When the adjustment is completed, disconnect the video data output terminal and the video data receiver. For example, the path connecting the transmitter 120 to the receiver 110 of the audio-visual synchronization device 10 shown in FIG. 1 is disconnected. In step S203: receiving the original video and audio data. The original video and audio data is provided, for example, by a data source device (such as a multimedia data providing device such as a computer, a DVD player, an optical disc drive). In step S205: the original video data is separated into the original video data and the original audio data. In step S207, the original image data is processed according to the image processing mode. For example, the processor processes the raw image data. In one embodiment, the image processing mode may be a reduced image mode. In other embodiments, The image processing mode may be a reduced image mode, an enlarged image mode, a split image mode, or a composite image mode.

In step S209, the processed original image data and the original sound data are output synchronously. For example, after the original image data is processed in the reduced image mode, since the time delay amount of the reduced image data is known during the correction calculation phase, the sound data delay parameters can be automatically adjusted according to this, and the processed original image data is synchronized with the original sound data. Output. To achieve audio and video synchronization.

The present invention has been described by the above related embodiments, but the above embodiments are merely examples for implementing the present invention. It must be noted that the disclosed embodiments do not limit the scope of the invention. On the contrary, modifications and equal settings included in the spirit and scope of the scope of patent application are all included in the scope of the present invention.

Claims (10)

An audio-visual synchronization device includes: a receiver; a transmitter; and a processor coupled to the receiver and the transmitter, receiving a start instruction at a first correction time, and outputting a start instruction in response to the start instruction. The characteristic image data is sent to the transmitter, and the transmitter sends the received characteristic image data to the receiver so that the processor receives the characteristic image data at a second correction time, and the processor according to the first correction time And a time difference between the second correction time to adjust a sound data delay parameter. The audio-visual synchronization device according to claim 1, further comprising a controller coupled to the processor, the controller providing the start instruction to the processor at the first correction time, and the processor at the second correction time An end instruction is provided to the controller, and the controller calculates the time difference in response to the end instruction and notifies the processor to adjust the sound data delay parameter. The audio-visual synchronization device according to claim 1, wherein the processor includes a feature image generating unit, and the feature image generating unit outputs the feature image data in response to a start instruction. The audio-visual synchronization device according to claim 3, wherein the processor includes an image data receiving unit, the characteristic image data is transmitted by the transmitter and the receiver, is received by the image data receiving unit, and the image data is received The unit outputs the end instruction to the controller. The audio-visual synchronization device according to claim 1, wherein the receiver is an HDMI receiver, and the transmitter is an HDMI transmitter. The audio-visual synchronization device according to claim 1, wherein the characteristic image data is one of reduced image data, enlarged image data, segmented image data, and synthetic image data. A method for synchronizing video data of a video device includes the following steps: receiving a start command at a first correction time; Outputting a characteristic image data in response to a start instruction; receiving the characteristic image data at a second correction time; calculating a time difference between the first correction time and the second correction time; and according to the time difference And adjust a sound data delay parameter. The method according to claim 7, wherein before the receiving the first instruction at the first correction time, the method further comprises: an audiovisual data output end and an audiovisual data receiving end coupled to the audiovisual device. The method according to claim 8, further comprising: disconnecting the audio and video data output end and the audio and video data receiving end; receiving an original audio and video data; separating the original audio and video data into an original video data and an original audio data; The image processing mode processes the original image data; and synchronously outputs the processed original image data and the original sound data according to the adjusted sound data delay parameter. The method according to claim 9, wherein the image processing mode is one of a reduced image mode, an enlarged image mode, a divided image mode, and a composite image mode.