CN109379619B - Sound and picture synchronization method and device - Google Patents
Sound and picture synchronization method and device Download PDFInfo
- Publication number
- CN109379619B CN109379619B CN201811380097.8A CN201811380097A CN109379619B CN 109379619 B CN109379619 B CN 109379619B CN 201811380097 A CN201811380097 A CN 201811380097A CN 109379619 B CN109379619 B CN 109379619B
- Authority
- CN
- China
- Prior art keywords
- chip
- time delay
- sound
- video
- played
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000001360 synchronised effect Effects 0.000 claims description 9
- 230000005236 sound signal Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Receiver Circuits (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The embodiment of the invention provides a sound and picture synchronization method and a device, wherein the method comprises the following steps: receiving data of a video to be played; the data of the video to be played comprises image data and sound data; when the resolution of a video to be played is greater than the preset resolution, respectively acquiring a first time delay of a first chip for controlling the display of image data and a second time delay of a second chip for controlling the playing of sound data; and controlling the first chip to delay display of the image data or delay playing of the sound data by the second chip according to the first time delay and the second time delay so as to synchronize the display of the image data with the playing of the sound data. The synchronism of the image and the sound is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of televisions, in particular to a sound and picture synchronization method and device.
Background
With the continuous development of ultra-high definition television technology, the resolution of videos is higher and higher. Currently, the resolution of video can reach 8K (e.g., 7680 × 4320).
In practical applications, a television usually has a System On Chip (SOC), and the SOC can process images with a resolution less than or equal to 4K but cannot process images with a resolution greater than 4K. In order to enable the television to process 8K video, an image processing chip is generally integrated in the television, for example, the image processing chip may be a Frame Rate Conversion (FRC) chip, the image processing chip controls to display images in the 8K video, and the SOC controls to play sound in the 8K video. However, since the image and the sound in the 8K video are controlled by different chips, the image and the sound are less synchronous during the process of playing the 8K video.
Disclosure of Invention
The embodiment of the invention provides a method and a device for synchronizing sound and pictures, which improve the synchronism of images and sound.
In a first aspect, an embodiment of the present invention provides a sound and picture synchronization method, including:
receiving data of a video to be played; the data of the video to be played comprises image data and sound data;
when the resolution of the video to be played is greater than the preset resolution, respectively acquiring a first time delay for controlling the image data to be displayed by a first chip and a second time delay for controlling the sound data to be played by a second chip;
and controlling the first chip to delay the display of the image data or the second chip to delay the playing of the sound data according to the first time delay and the second time delay so as to synchronize the display of the image data and the playing of the sound data.
In a possible implementation manner, obtaining a second time delay for controlling the playing of the sound data by the second chip includes:
determining a first moment when the video to be played is acquired;
controlling to play sound data in the video to be played through the second chip, and controlling a microphone to collect sound in the video to be played through the second chip;
determining a second moment when the microphone acquires the sound in the video to be played;
and determining the second time delay according to the first time and the second time.
In a possible implementation manner, the controlling, by the second chip, to play the sound data in the video to be played includes:
extracting the sound data from the video to be played through the first chip;
compressing the sound data through the first chip;
and decoding the compressed sound data through the second chip, and controlling a sound playing device to play the decoded sound data through the second chip.
In a possible implementation, the determining the second delay according to the first time and the second time includes:
acquiring a first time difference between the second moment and the first moment;
and subtracting a third time delay from the first time difference to obtain the second time delay, wherein the third time delay is the time delay of sound collection of the microphone.
In a possible implementation manner, the controlling the first chip to delay displaying the image data or the second chip to delay playing the sound data according to the second delay and the first delay so as to synchronize the displaying of the image data and the playing of the sound data includes:
if the second time delay is larger than the first time delay, acquiring a first difference value obtained by subtracting the first time delay from the second time delay, and controlling the first chip to delay and display image data in the video to be played according to the first difference value;
and if the second time delay is smaller than the first time delay, acquiring a second difference value obtained by subtracting the second time delay from the first time delay, and controlling the second chip to delay and play the sound data in the video to be played according to the second difference value.
In a second aspect, an embodiment of the present invention provides a sound-picture synchronization apparatus, including a receiving module, an obtaining module, and a control module,
the receiving module is used for receiving data of a video to be played; the data of the video to be played comprises image data and sound data;
the acquisition module is used for respectively acquiring a first time delay for controlling the image data to be displayed by the first chip and a second time delay for controlling the sound data to be played by the second chip when the resolution of the video to be played is greater than the preset resolution;
the control module is used for controlling the first chip to delay display of the image data or the second chip to delay playing of the sound data according to the first time delay and the second time delay, so that the image data display and the sound data playing are synchronous.
In a possible implementation manner, the obtaining module is specifically configured to:
determining a first moment when the video to be played is acquired;
controlling to play sound data in the video to be played through the second chip, and controlling a microphone to collect sound in the video to be played through the second chip;
determining a second moment when the microphone acquires the sound in the video to be played;
and determining the second time delay according to the first time and the second time.
In a possible implementation, the control module is specifically configured to:
extracting the sound data from the video to be played through the first chip;
compressing the sound data through the first chip;
and decoding the compressed sound data through the second chip, and controlling a sound playing device to play the decoded sound data through the second chip.
In a possible implementation manner, the obtaining module is specifically configured to:
acquiring a first time difference between the second moment and the first moment;
and subtracting a third time delay from the first time difference to obtain the second time delay, wherein the third time delay is the time delay of sound collection of the microphone.
In a possible implementation, the control module is specifically configured to:
if the second time delay is larger than the first time delay, acquiring a first difference value obtained by subtracting the first time delay from the second time delay, and controlling the first chip to delay and display image data in the video to be played according to the first difference value;
and if the second time delay is smaller than the first time delay, acquiring a second difference value obtained by subtracting the second time delay from the first time delay, and controlling the second chip to delay and play the sound data in the video to be played according to the second difference value.
In a third aspect, an embodiment of the present invention provides a sound and picture synchronization apparatus, including: a processor coupled with a memory;
the memory is used for storing a computer program;
the processor is configured to execute the computer program stored in the memory to enable the terminal device to perform the method of any of the first aspect.
In a fourth aspect, an embodiment of the present invention provides a readable storage medium, which includes a program or instructions, and when the program or instructions are run on a computer, the method according to any one of the first aspect is performed.
According to the sound and picture synchronization method and device provided by the embodiment of the invention, after the data of the video to be played is received, when the resolution of the video to be played is greater than the preset resolution, a first time delay for controlling the display of the image data by the first chip and a second time delay for controlling the playing of the sound data by the second chip are respectively obtained, and the delay display of the image data by the first chip or the delay playing of the sound data by the second chip is controlled according to the first time delay and the second time delay, so that the display of the image data and the playing of the sound data are synchronized, and the synchronism of sound and pictures in the video playing process is further improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is an architecture diagram of a sound-picture synchronization method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a sound-picture synchronization method according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of a method for determining a second time delay according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating another audio-visual synchronization method according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a sound-picture synchronization apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is an architecture diagram of a sound-picture synchronization method according to an embodiment of the present invention. Referring to fig. 1, the television includes a first chip 11, a second chip 12, a display device 13, and a sound playing device 14.
Optionally, the first chip 11 may be an image processing chip, for example, the first chip 11 may be an FRC chip. The first chip 11 may process the 8K video to extract sound data and image data in the 8K video. The first chip 11 may also perform compression processing on the sound data, for example, compressing the sound data extracted from the 8K video to the sound data corresponding to the 4K video. The first chip 11 may also control display of image data and the like, for example, the first chip 11 may control display of an 8K image in a display device.
Optionally, the second chip 12 may control playing of the sound data, for example, the second chip 12 may control a sound playing device to play the sound data.
In the application, the first chip 11 controls to display 8K image data in 8K video, and the second chip 12 controls to play sound data in 8K video. In the process of playing the 8K video, a first time delay from receiving data of the 8K video to the first chip 11 for controlling display of an image in the video and a second time delay from receiving data of the 8K video to the second chip for controlling playing of sound in the video can be obtained, and the first chip 11 is controlled to display the 8K image in the 8K video and the second chip 12 is controlled to play the sound in the 8K video according to the first time delay and the second time delay, so that the image displayed by the first chip 11 is controlled to be synchronous with the sound played by the second chip 12.
The technical means shown in the present application will be described in detail below with reference to specific examples. It should be noted that the following embodiments may be combined with each other, and the description of the same or similar contents in different embodiments is not repeated.
Fig. 2 is a schematic flow chart of a sound-picture synchronization method according to an embodiment of the present invention. Referring to fig. 2, the method may include:
s201, receiving data of a video to be played, wherein the data of the video to be played comprises image data and sound data.
S202, when the resolution of the video to be played is larger than the preset resolution, respectively acquiring a first time delay of the first chip for controlling the display of the image data and a second time delay of the second chip for controlling the playing of the sound data.
The execution main body of the embodiment of the invention can be a television and can also be a sound and picture synchronization device integrated in the television. Optionally, the sound and picture synchronization device may be integrated into the first chip and/or the second chip, or the sound and picture synchronization device may be integrated into another chip in the television. Alternatively, the audio and video synchronization apparatus may be implemented by software, or the audio and video synchronization apparatus may be implemented by a combination of software and hardware.
Note that the resolution of the video is the resolution of the image in the video, for example, the resolution of the image in the 8K video is 8K (e.g., 7680 × 4320), and the resolution of the image in the 4K video is 4K (e.g., 4096 × 2160).
Alternatively, the preset resolution may be a resolution of an image in the 4K video.
For example, the preset resolution may be 4096 × 2160.
Optionally, the resolution of the video to be played may be 8K, and the like.
Optionally, the video to be played may be a live video, a network video, or a local video of a television.
Optionally, the video to be played may be a video in a High Definition Multimedia Interface (HDMI) format.
Optionally, a display device, such as a display screen, is usually disposed in the television. The first chip can control the image in the video to be played to be displayed on the display screen, and in the process of controlling the image in the video to be played to be displayed on the display screen, the first chip needs to perform processing such as decoding, image quality adjustment and the like on the image in the video to be played, so that the first chip controls the image in the video to be played to have time delay.
Optionally, the first time delay may include: the time length required by the first chip to decode the image in the video to be played, the time length required by the first chip to transmit the image in the video to be played to the display device, the time length required by the display device to display the image and the like.
Optionally, the first time delay may be obtained by the following feasible implementation manners: determining a first moment when the video to be played is acquired, determining a third moment when the image in the video to be played is displayed for the first time in the display device, and determining a difference value between the third moment and the first moment as a first time delay.
Optionally, a sound playing device, such as a speaker, is usually disposed in the television. The second chip can control the sound in the video to be played to be output to the sound playing device, and the sound playing device plays the sound in the video to be played. In the process that the second chip controls the sound playing device to play the sound in the video to be played, the second chip needs to decode and process the sound signal in the video to be played, the sound effect and the like, and therefore the second chip controls the sound playing device to play the sound in the video to be played with time delay.
Optionally, the second delay may include: the second chip decodes the sound in the video to be played for a required time, transmits the sound signal in the video to be played to the sound playing device for a required time, and the sound playing device plays the sound signal for a required time.
It should be noted that, in the embodiment shown in fig. 3, a process of determining the second time delay is described in detail, and details are not described here again.
S203, controlling the first chip to delay display of the image data or the second chip to delay playing of the sound data according to the first time delay and the second time delay, so that the image data display and the sound data playing are synchronous.
If the second time delay is greater than the first time delay, a first difference value obtained by subtracting the first time delay from the second time delay is obtained, and the first chip is controlled to display the image data in the video to be played according to the first difference value, namely, the time delay for displaying the image data in the video to be played by the first chip is controlled to increase the first difference value, and correspondingly, the second chip normally controls to display the image in the video to be played.
If the second time delay is smaller than the first time delay, a second difference value obtained by subtracting the second time delay from the first time delay is obtained, and the second chip is controlled to play the sound data in the video to be played according to the second difference value, that is, the time delay for playing the sound data in the video to be played by the second chip is controlled to increase the second difference value, and correspondingly, the first chip normally controls to play the sound in the video to be played.
It should be noted that, for the same video, the first time delay and the second time delay are generally fixed values, and therefore, in the process of playing a video, the first time delay and the second time delay only need to be determined once when the video starts to be played. The first time delay and the second time delay obtained by the determination can be cached, and the first chip and the second chip are controlled to carry out sound and picture synchronization according to the cached first time delay and the cached second time delay in the video playing process.
According to the sound and picture synchronization method provided by the embodiment of the invention, after the data of the video to be played is received, when the resolution of the video to be played is greater than the video to be played with the preset resolution, a first time delay for controlling the display of the image data by the first chip and a second time delay for controlling the playing of the sound data by the second chip are respectively obtained, and the delay display of the image data by the first chip or the delay playing of the sound data by the second chip is controlled according to the first time delay and the second time delay, so that the display of the image data and the playing of the sound data are synchronized, and the synchronism of sound and pictures in the video playing process is further improved.
On the basis of any of the above embodiments, optionally, the second delay may be determined by the following feasible implementation manner, specifically, please refer to the embodiment described in fig. 3.
Fig. 3 is a flowchart illustrating a method for determining a second time delay according to an embodiment of the present invention. Referring to fig. 3, the method may include:
s301, determining a first moment when the video to be played is acquired.
Optionally, the first time may be a time when a video stream of the video to be played is acquired for the first time. For example, the first time may be the time when the first chip receives the 8K video shown in fig. 1.
S302, controlling to play sound data in the video to be played through the second chip, and controlling the microphone to collect sound in the video to be played through the second chip.
Optionally, the sound in the video to be played may be played by controlling the second chip through a feasible implementation manner as follows: extracting sound data from a video to be played through a first chip; compressing the sound data through a first chip; and decoding the compressed sound data through the second chip, and controlling the voice playing device to play the decoded sound data through the second chip.
Optionally, since the resolution of the video to be played is greater than 4K, correspondingly, the code rate of the sound data in the video to be played is also higher, and in order to avoid that the first chip cannot process the sound data in the video to be played, the sound data in the video to be played may be compressed.
Optionally, after the video to be played is acquired, the second chip starts the microphone, so that the microphone can collect sound. After the sound in the video to be played is played, the microphone can acquire the sound in the video to be played.
And S303, determining a second moment when the microphone acquires the sound in the video to be played.
And after the microphone acquires the sound in the video to be played, determining the moment when the microphone acquires the sound in the video to be played as a second moment.
For example, after the microphone collects the sound in the video to be played, the waveform of the input signal of the microphone changes, and the time when the waveform of the input signal of the microphone changes may be determined as the second time.
And S304, determining a second time delay according to the first time and the second time.
Optionally, a first time difference between the second time and the first time may be obtained, and the third time delay is subtracted from the first time difference to obtain a second time delay; the third time delay is the time delay for the microphone to collect sound, including at least the time the microphone is activated.
Optionally, the third delay is typically a fixed value.
For example, the third time delay may be set in advance.
In the embodiment shown in fig. 3, in the process of determining the second time delay, after the video to be played is received, the sound in the video to be played is played under the control of the second chip, the microphone is started, the microphone acquires the sound signal, and the second time delay can be determined according to the time when the sound signal is acquired by the microphone and the time when the video to be played is received.
On the basis of any of the above embodiments, the following describes in detail the technical solution shown in the above method embodiment by taking a first chip and a second chip as execution main bodies, the first chip being an FRC chip, the second chip being an SOC, and the video to be played being an 8K video, specifically, please refer to the embodiment shown in fig. 4.
Fig. 4 is a schematic flow chart of another audio-visual synchronization method according to an embodiment of the present invention. Referring to fig. 4, the method may include:
s401, the FRC chip receives 8K video through the HDMI.
Optionally, the 8K video may be a live video received by a television, a downloaded network video, a local video of the television, or the like.
S402, the FRC chip sends a first notification message to the SOC.
Optionally, the first notification message includes a first time when the FRC chip acquires the 8K video.
And S403, the SOC starts the microphone according to the first notification message.
S404, extracting sound data and image data in the 8K video by the FRC chip.
The resolution of an image corresponding to image data extracted from an 8K video is 8K.
S405, the FRC chip sends image data to the display screen, so that the display screen displays an image corresponding to the image data.
Optionally, before the FRC chip sends the image data to the display screen, the FRC chip may perform decoding processing, image quality adjustment processing, and the like on the image data.
S406, the FRC chip compresses the sound data.
S407, the FRC chip transmits the compressed audio data to the SOC via the HDMI.
S408, the SOC sends the compressed audio data to the audio playback device, so that the audio playback device plays the compressed audio data.
Optionally, the SOC may perform decoding processing, sound effect processing, and the like on the sound data, and then send the decoded sound data to the sound playing device.
It should be noted that after the sound playing device plays the sound data, the microphone can acquire the sound in the video to be played.
And S409, the SOC acquires a second moment when the microphone acquires the sound in the video to be played.
And S410, the SOC determines a second time delay according to the first time, the second time and a third time delay of sound collection of the microphone.
And the second time delay is the time delay of the SOC chip for controlling the playing of the sound in the 8K video.
Alternatively, the SOC may determine the second time delay as a value obtained by subtracting the first time and the third time delay from the second time.
S411, the SOC obtains a first time delay of the FRC chip to control and display the 8K image.
Optionally, the first time delay may be a preset value, and the SOC may store the first time delay, and accordingly, the SOC may directly obtain the first time delay locally.
S412, the SOC judges whether the first time delay is larger than the second time delay.
If yes, S413 is performed.
If not, go to S414.
S413, the SOC obtains a second difference value obtained by subtracting the second time delay from the first time delay, and increases the time delay of playing the sound by the SOC by the second difference value.
It should be noted that after S413, in the playing process of the 8K video, the time delay of playing the sound controlled by the SOC chip is increased by the second difference.
S414, the SOC obtains a first difference value obtained by subtracting the first time delay from the second time delay.
S415, the SOC sends the first difference value to the FRC chip.
And S416, the FRC chip increases the time delay of the control display image by a first difference value.
It should be noted that after S416, in the playing process of the 8K video, the time delay of controlling the display image by the FRC chip is increased by the first difference.
In the embodiment shown in fig. 4, the process of determining the first delay and the second delay is simple and convenient, and the accuracy of the determined second delay is high. Furthermore, according to the first time delay and the second time delay, the first chip is controlled to display the image in the video to be played and the second chip is controlled to play the sound in the video to be played, so that the image displayed by the first chip is controlled to be synchronous with the sound played by the second chip, and further the synchronism of the sound and the picture in the video playing process is improved.
Fig. 5 is a schematic structural diagram of a sound-picture synchronization apparatus according to an embodiment of the present invention. Referring to fig. 5, the sound-picture synchronization apparatus includes a receiving module 11, an obtaining module 12 and a control module 13, wherein,
the receiving module 11 is configured to receive data of a video to be played; the data of the video to be played comprises image data and sound data;
the obtaining module 12 is configured to, when the resolution of the video to be played is greater than a preset resolution, respectively obtain a first time delay for the first chip to control the image data to be displayed, and a second time delay for the second chip to control the sound data to be played;
the control module 13 is configured to control the first chip to delay displaying the image data or the second chip to delay playing the sound data according to the first delay and the second delay, so that the image data display and the sound data playing are synchronized.
The sound and picture synchronization device provided by the embodiment of the invention can execute the technical scheme shown in the method embodiment, the implementation principle and the beneficial effect are similar, and the details are not repeated here.
In a possible implementation, the obtaining module 12 is specifically configured to:
determining a first moment when the video to be played is acquired;
controlling to play sound data in the video to be played through the second chip, and controlling a microphone to collect sound in the video to be played through the second chip;
determining a second moment when the microphone acquires the sound in the video to be played;
and determining the second time delay according to the first time and the second time.
In a possible implementation, the control module 13 is specifically configured to:
extracting the sound data from the video to be played through the first chip;
compressing the sound data through the first chip;
and decoding the compressed sound data through the second chip, and controlling a sound playing device to play the decoded sound data through the second chip.
In a possible implementation, the obtaining module 12 is specifically configured to:
acquiring a first time difference between the second moment and the first moment;
and subtracting a third time delay from the first time difference to obtain the second time delay, wherein the third time delay is the time delay of sound collection of the microphone.
In a possible implementation, the control module 13 is specifically configured to:
if the second time delay is larger than the first time delay, acquiring a first difference value obtained by subtracting the first time delay from the second time delay, and controlling the first chip to delay and display image data in the video to be played according to the first difference value;
the sound and picture synchronization device provided by the embodiment of the invention can execute the technical scheme shown in the method embodiment, the implementation principle and the beneficial effect are similar, and the details are not repeated here.
The embodiment of the invention provides a sound and picture synchronization device, which comprises: a processor coupled with a memory;
the memory is used for storing a computer program;
the processor is configured to execute the computer program stored in the memory to enable the terminal device to perform the method according to any of the method embodiments described above.
Embodiments of the invention provide a readable storage medium comprising a program or instructions for performing a method as described in any of the method embodiments above when the program or instructions are run on a computer.
The embodiment of the present invention further provides a television, which includes a first chip, a second chip, a display device, and a voice playing device, and the structure of the television can be referred to fig. 1, which is not described again in the embodiments of the present invention.
Optionally, a memory connected to the first chip and the second chip.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the embodiments of the present invention, and are not limited thereto; although embodiments of the present invention have been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the embodiments of the present invention.
Claims (10)
1. A sound and picture synchronization method is characterized by comprising the following steps:
receiving data of a video to be played; the data of the video to be played comprises image data and sound data;
when the resolution of the video to be played is greater than the preset resolution, respectively acquiring a first time delay for controlling the display of the image data by a first chip and a second time delay for controlling the playing of the sound data by a second chip, wherein the second time delay comprises the time length for decoding the sound data by the second chip, the time length for transmitting the sound data to a sound playing device and the time length for playing the sound data by the sound playing device;
and controlling the first chip to delay the display of the image data or the second chip to delay the playing of the sound data according to the first time delay and the second time delay so as to synchronize the display of the image data and the playing of the sound data.
2. The method of claim 1, wherein obtaining a second time delay for a second chip to control playing of the sound data comprises:
determining a first moment when the video to be played is acquired;
controlling to play sound data in the video to be played through the second chip, and controlling a microphone to collect sound in the video to be played through the second chip;
determining a second moment when the microphone acquires the sound in the video to be played;
and determining the second time delay according to the first time and the second time.
3. The method according to claim 2, wherein the controlling, by the second chip, to play the sound data in the video to be played comprises:
extracting the sound data from the video to be played through the first chip;
compressing the sound data through the first chip;
and decoding the compressed sound data through the second chip, and controlling a sound playing device to play the decoded sound data through the second chip.
4. The method of claim 2 or 3, wherein determining the second time delay based on the first time and the second time comprises:
acquiring a first time difference between the second moment and the first moment;
and subtracting a third time delay from the first time difference to obtain the second time delay, wherein the third time delay is the time delay of sound collection of the microphone.
5. The method according to any one of claims 1-3, wherein the controlling the first chip to delay displaying the image data or the second chip to delay playing the sound data according to the second delay and the first delay so as to synchronize the displaying of the image data and the playing of the sound data comprises:
if the second time delay is larger than the first time delay, acquiring a first difference value obtained by subtracting the first time delay from the second time delay, and controlling the first chip to delay and display image data in the video to be played according to the first difference value;
and if the second time delay is smaller than the first time delay, acquiring a second difference value obtained by subtracting the second time delay from the first time delay, and controlling the second chip to delay and play the sound data in the video to be played according to the second difference value.
6. A sound and picture synchronization device is characterized by comprising a receiving module, an acquisition module and a control module, wherein,
the receiving module is used for receiving data of a video to be played; the data of the video to be played comprises image data and sound data;
the acquisition module is used for respectively acquiring a first time delay for controlling the display of the image data by a first chip and a second time delay for controlling the playing of the sound data by a second chip when the resolution of the video to be played is greater than a preset resolution, wherein the second time delay comprises the time length for decoding the sound data by the second chip, the time length for transmitting the sound data to a sound playing device and the time length for playing the sound data by the sound playing device;
the control module is used for controlling the first chip to delay display of the image data or the second chip to delay playing of the sound data according to the first time delay and the second time delay, so that the image data display and the sound data playing are synchronous.
7. The apparatus of claim 6, wherein the obtaining module is specifically configured to:
determining a first moment when the video to be played is acquired;
controlling to play sound data in the video to be played through the second chip, and controlling a microphone to collect sound in the video to be played through the second chip;
determining a second moment when the microphone acquires the sound in the video to be played;
and determining the second time delay according to the first time and the second time.
8. The apparatus of claim 7, wherein the control module is specifically configured to:
extracting the sound data from the video to be played through the first chip;
compressing the sound data through the first chip;
and decoding the compressed sound data through the second chip, and controlling a sound playing device to play the decoded sound data through the second chip.
9. The apparatus according to claim 7 or 8, wherein the obtaining module is specifically configured to:
acquiring a first time difference between the second moment and the first moment;
and subtracting a third time delay from the first time difference to obtain the second time delay, wherein the third time delay is the time delay of sound collection of the microphone.
10. The apparatus according to any one of claims 6-8, wherein the control module is specifically configured to:
if the second time delay is larger than the first time delay, acquiring a first difference value obtained by subtracting the first time delay from the second time delay, and controlling the first chip to delay and display image data in the video to be played according to the first difference value;
and if the second time delay is smaller than the first time delay, acquiring a second difference value obtained by subtracting the second time delay from the first time delay, and controlling the second chip to delay and play the sound data in the video to be played according to the second difference value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811380097.8A CN109379619B (en) | 2018-11-20 | 2018-11-20 | Sound and picture synchronization method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811380097.8A CN109379619B (en) | 2018-11-20 | 2018-11-20 | Sound and picture synchronization method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109379619A CN109379619A (en) | 2019-02-22 |
| CN109379619B true CN109379619B (en) | 2021-05-18 |
Family
ID=65389867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811380097.8A Active CN109379619B (en) | 2018-11-20 | 2018-11-20 | Sound and picture synchronization method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109379619B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112073803B (en) * | 2019-06-10 | 2024-03-29 | 海信视像科技股份有限公司 | Sound reproduction method and display device |
| CN112449229B (en) * | 2019-09-04 | 2022-01-28 | 海信视像科技股份有限公司 | Sound and picture synchronous processing method and display equipment |
| CN112770148B (en) * | 2019-10-21 | 2024-08-23 | 海信视像科技股份有限公司 | Display device, data query method and data storage method |
| CN112738576B (en) * | 2019-10-28 | 2023-03-21 | 海信视像科技股份有限公司 | Display device and sound low-delay processing method |
| CN111479154B (en) * | 2020-04-03 | 2022-03-22 | 海信视像科技股份有限公司 | Equipment and method for realizing sound and picture synchronization and computer readable storage medium |
| CN112272315B (en) * | 2020-10-21 | 2022-07-12 | 深圳创维汽车智能有限公司 | Video playing method, device, equipment and computer readable storage medium |
| CN115603848A (en) * | 2022-10-28 | 2023-01-13 | 惠州市德赛西威汽车电子股份有限公司（Cn） | Method for realizing vehicle prompt signal synchronization, synchronization system and vehicle |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107682715A (en) * | 2016-08-01 | 2018-02-09 | 腾讯科技（深圳）有限公司 | Video synchronization method and device |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101119461B (en) * | 2006-08-02 | 2010-05-12 | 广达电脑股份有限公司 | System and method for keeping synchronous playing of video frame and audio frame |
| US8731370B2 (en) * | 2009-01-12 | 2014-05-20 | At&T Intellectual Property I, L.P. | Method and device for transmitting audio and video for playback |
| CN103237203B (en) * | 2013-04-09 | 2016-03-02 | 广东欧珀移动通信有限公司 | Audio and video synchronization method and system based on mobile terminal |
| CN104104987B (en) * | 2014-07-29 | 2018-05-18 | 小米科技有限责任公司 | Picture and synchronous sound method and device in video playing |
| US9338391B1 (en) * | 2014-11-06 | 2016-05-10 | Echostar Technologies L.L.C. | Apparatus, systems and methods for synchronization of multiple headsets |
| US10034035B2 (en) * | 2014-12-10 | 2018-07-24 | DISH Technologies L.L.C. | Methods, devices and systems for audiovisual synchronization with multiple output devices |
| CN106331562B (en) * | 2015-06-16 | 2020-04-24 | 南宁富桂精密工业有限公司 | Cloud server, control device and audio and video synchronization method |
| CN105451056B (en) * | 2015-11-20 | 2018-10-02 | 小米科技有限责任公司 | Audio and video synchronization method and device |
| CN107734378B (en) * | 2017-10-31 | 2019-11-01 | 维沃移动通信有限公司 | A kind of audio and video synchronization method, device and mobile terminal |
| CN107995503B (en) * | 2017-11-07 | 2020-07-14 | 西安万像电子科技有限公司 | Audio and video playing method and device |
| CN108377406B (en) * | 2018-04-24 | 2020-12-22 | 海信视像科技股份有限公司 | Method and device for adjusting sound and picture synchronization |
-
2018
- 2018-11-20 CN CN201811380097.8A patent/CN109379619B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107682715A (en) * | 2016-08-01 | 2018-02-09 | 腾讯科技（深圳）有限公司 | Video synchronization method and device |
Non-Patent Citations (1)
| Title |
|---|
| 《网络监控系统中音视频同步技术的研究与实现》;司徒涨勇;《中国优秀硕士学位论文全文数据库》;20140315;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109379619A (en) | 2019-02-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109379619B (en) | Sound and picture synchronization method and device | |
| CN111580765B (en) | Screen projection method, screen projection device, storage medium, screen projection equipment and screen projection equipment | |
| CN109089064B (en) | Apparatus and method for processing media signal | |
| CN108540829B (en) | Synchronous playing method, system and terminal for multi-playing device | |
| CN105376628A (en) | Method and device for synchronizing audio-video signals | |
| CN111479154B (en) | Equipment and method for realizing sound and picture synchronization and computer readable storage medium | |
| US10098080B2 (en) | Device, method and computer readable medium | |
| KR20230039723A (en) | Projection data processing method and apparatus | |
| US8582033B2 (en) | Movie reproduction system and movie reproduction method for reducing delay time of reproduced movie | |
| KR101841313B1 (en) | Methods for processing multimedia flows and corresponding devices | |
| CN107517400B (en) | Streaming media playing method and streaming media player | |
| US8593575B2 (en) | Video display apparatus for shortened-delay processing of a video signal and video processing method | |
| JPWO2019008818A1 (en) | Video processing system and video processing method | |
| CN105979187A (en) | Data recording method and device | |
| CN113691862B (en) | Video processing method, electronic device for video playing and video playing system | |
| JP6385236B2 (en) | Video playback apparatus and video playback method | |
| US8982128B2 (en) | Method of providing image and display apparatus applying the same | |
| JP2012222399A (en) | Video playback system, video playback method, and video playback device and program | |
| KR101325129B1 (en) | Apparatus for Moving Prossing Unit and Method Thereof and Storaging Unit | |
| EP4373068A1 (en) | A/v reception apparatus and wireless display system | |
| CN111601157B (en) | Audio output method and display device | |
| EP4554204A2 (en) | Video rendering method and apparatus, medium and electronic device | |
| JP7324087B2 (en) | Video decoder, video system, and program | |
| CN116708908A (en) | HEVC coding and playing method and equipment containing closed captions | |
| CN118018668A (en) | Video data transmission method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant after: Hisense Visual Technology Co., Ltd. Address before: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |