CN1787630A - Control method and audio-visual playback device using subtitle corresponding time as audio-visual playback - Google Patents

Abstract

The invention relates to a control method and an audio-video playing device which take caption corresponding time as audio-video playing, and can control the playing start and end of the audio-video according to the caption corresponding time. The control method comprises the following steps: receiving a user control signal and analyzing the action of the control signal; analyzing the corresponding time of the caption, and when the control signal is in a caption control mode, analyzing the caption display unit and the playing time corresponding to the selected caption; and controlling the video-audio playing, receiving the analyzed playing time, setting a video-audio playing start-end point according to the action of the control signal, and outputting a playing control signal containing the video-audio playing start-end point. Therefore, the control method of the invention using the playing time corresponding to the caption as the video and audio playing can more flexibly control the video and audio playing selection of the video and audio playing device which generally provides the caption information.

Description

Control method and audio-visual playback device using subtitle corresponding time as audio-visual playback

technical field

The present invention relates to an audio-visual playback control method, in particular to a control method and an audio-visual playback device that use the playback time corresponding to subtitles as the starting and ending points of audio-visual playback.

Background technique

General digital audio-visual data, taking DVD (Digital Versatile Disk) as an example, contains audio-visual playback data such as video, audio, subtitles, and playback control information. When a DVD player plays video and audio data, it uses an audio decoder, a video decoder, and a sub-picture decoder to decode an audio signal, a video signal, and a sub-picture. Figure 1 shows the hardware architecture of a typical DVD player. As shown in Figure 1, a general DVD player 10 includes a main control unit (navigator) 11, a demultiplexer (De-muxer) 12, a decoder (decoder) 13, and an audio post process unit (audio post process unit) 14 , an audio output unit (audio output unit) 15, a video post process unit (video post process unit) 16, a video output unit (video output unit) 17, a user interface (user interface) 18, and a control module 19. The control module 19 outputs the playback control signal to the main control unit 11 according to the user's input signal, and the main control unit 11 reads the audio and video data from the optical disc 111 according to the playback control signal, and then transmits the audio data, video and audio data through the demultiplexer 12. The data and sub-picture units are output to an audio decoder 131 , a video decoder 132 , and a sub-picture decoder 133 of the decoder 13 . Of course, some main control units 11 will receive external subtitle data to display subtitles in different languages on the screen. In addition, the audio-visual information of some DVD discs will also contain Line-21 information, so as to provide text information. The so-called Line-21 information refers to the information hidden in the 21st scanning line.

The general sub-picture decoder 133 will decode the playback information (including time, position, color contrast, etc.) of the subtitle image and the subtitle image according to the sub-picture unit (sub-picture unit, SPU) Time outputs the corresponding subtitle image. The subtitle image is generally in a bitmap format. After receiving the subtitle image from the sub-image decoder 133 , the video post-processing unit 16 combines the subtitle image into the video output from the video decoder 132 . The audio decoder 131 , the video decoder 132 , and the sub-image decoder 133 determine the output time according to the timing of the system. A general DVD player takes the playing time of video data or audio data as the benchmark for playing.

The user control signal received by a general DVD player includes functions such as fast playback, slow playback, reverse fast playback, reverse slow playback, and fixed-point playback (including AB playback). The control uses the playing information of the main control unit, the playing time of the image or the output time of the audio as the reference time reference of the playing control. Therefore, the user cannot use the subtitle image as a reference time reference for playback control.

Contents of the invention

In view of the above problems, the purpose of the present invention is to provide a control method and an audio-visual playback device that use the playback time corresponding to the subtitle unit as the start and end points of audio-visual playback.

In order to achieve the above-mentioned purpose, the present invention uses the corresponding time of the subtitle unit as the control method of video and audio playback, including: receiving a user control signal and analyzing the control signal; The subtitle display unit corresponding to the selected subtitle and the playing time; and controlling the video playback, receiving the parsed playback time, setting the starting and ending points of the video and audio playback according to the action of the control signal, and outputting a playback control signal including the starting and ending points of the video and audio playback .

Therefore, the control method of the present invention using the playback time corresponding to the subtitles as the audio and video playback can more flexibly control the audio and video playback options of the audio and video playback devices that generally provide subtitle information.

Description of drawings

Figure 1 shows the hardware architecture of a typical DVD player.

FIG. 2 shows the control device of the present invention using the corresponding time of subtitles as video and audio playback.

FIG. 3 shows the data structure of the sub-picture unit SPU.

4A and 4B show the control method of the present invention using the subtitle corresponding time as the audio and video playback.

FIG. 5 shows another embodiment of the present invention using the subtitle corresponding time as the control device for video and audio playback.

FIG. 6 shows a third embodiment of the present invention using the subtitle corresponding time as the control device for video and audio playback.

FIG. 7 shows a fourth embodiment of the control framework of the video and audio playback device using the corresponding time of subtitles as the video and audio playback according to the present invention.

Detailed ways

Referring to the figures below, taking DVD digital audio-visual data format as an example, the control method of the present invention using the playback time corresponding to the subtitle unit as the starting and ending point of audio-visual playback will be described in detail.

Because the audio data, video data and subtitle data of the DVD disc are respectively processed by different decoders, and the audio signal, video signal and subtitle image are respectively output. Moreover, each sub-picture unit includes display information of one to several subtitle images, such as the start time and mode of playing corresponding to the subtitle image. Therefore, by analyzing the display information of the sub-image unit, the user can select an audio-visual segment including a subtitle image for repeated playback. The action of playing repeatedly can allow the user to learn the content of the subtitle or the corresponding language, so as to achieve the purpose of learning.

FIG. 2 shows the control structure of the audio-visual playback device using the subtitle corresponding time as the video-audio playback according to the present invention. As shown in the figure, the audio-visual playback device 20 of the present invention uses the corresponding time of subtitles as audio-visual playback, including a main control unit 21, a demultiplexer 22, a decoder 23, an audio post-processing unit 24, and an audio output Unit 25 , a video post processing unit 26 , a video output unit 27 , a user interface 28 , and a control module 29 . The decoder 23 includes an audio decoder 231 , a video decoder 232 , and an image decoding and subtitle analysis unit 233 . Therefore, the difference between the audio-visual player 20 and the conventional DVD player (refer to FIG. 1 ) is that the sub-image decoding and subtitle analysis unit 233 of the decoder 23 of the audio-visual player 20 adds the function of subtitle analysis. Moreover, the audio-visual playing device 20 can also use the control module 29 to play the audio-visual data corresponding to the selected subtitles according to the user's selection.

The main control unit 21 is used to read audio-visual data and output the data to the demultiplexer 22 after processing. The audio-visual data can be read from a DVD disc or from a data storage medium such as a hard disk. How the main control unit 21 reads the audio-visual data and processes the audio-visual data is known in the art. And the functions of demultiplexer 22, audio decoder 231, video decoder 232, audio post processing unit 24, audio output unit 25, video post processing unit 26 and video output unit 27 are similar to those of conventional DVD players The functions are the same, so the description will not be repeated.

The sub-image decoding and subtitle analysis unit 233 receives the sub-image unit output from the demultiplexer 22 and the control signal of the control module 29, and outputs the subtitle image to the video post-processing unit 26, and outputs playback time information and reading requirements To control module 29. FIG. 3 shows the data structure of a sub-picture unit SPU in DVD format. As shown in FIG. 3 , the sub-picture unit SPU includes a sub-picture unit header (Sub-picture Unit Header) 31 , pixel data (pixel data) 32 , and a display control sequence table (Sub-picture display control sequence table) 33 . The display control sequence table 33 contains a plurality of display control sequences. Therefore, when the sub-image decoding and subtitle analysis unit 233 receives the sub-image unit SPU output by the demultiplexer 22, it can analyze the minimum display unit of each subtitle, and form the subtitle display required by the control signal from the minimum display unit. unit, and simultaneously calculate the corresponding playback start time and end time as the playback time information. Therefore, when the control signal of the control module 29 requests to switch or play back the audio-visual data corresponding to the subtitle, the secondary image decoding and subtitle analysis unit 233 will send the playback time information corresponding to the required subtitle image to the control module 29 . The control module 29 can generate a play control signal to the main control unit 21 according to the play time information to play the audio-visual data corresponding to the designated subtitle. And when sub-image decoding and subtitle analysis unit 233 do not have the broadcast time information corresponding to the display subtitle required by control module 29, then sub-image decoding and subtitle analysis unit 233 sends a read request to control module 29 immediately, by The control module 29 requires the main control unit 21 to read the required secondary image unit. At this time, the main control unit 21 may suspend the output of the video and audio playback unit, and only provide the required sub-image unit data. And the corresponding broadcasting time information of the subtitle image required by the control module 29 can be the corresponding broadcasting time information of the currently displayed subtitle image, and can also be the previous (rear) one or the previous (rear) N subtitle images. Play time information.

In addition, in order to increase system efficiency and reduce the reading requirements of the sub-picture decoding and subtitle analysis unit 233 for the sub-picture unit SPU, the sub-picture decoding and subtitle analysis unit 233 may include a memory unit (not shown), so that more The sub-picture unit is stored in the sub-picture decoding and subtitle parsing unit 233 . When playing audio-visual data, if the sub-picture unit to be played has been stored in the memory unit, the sub-picture decoding and subtitle analysis unit 233 can directly provide the subtitle image of the sub-picture unit to the video processing unit 26 .

When the user wants to repeatedly play the audio-visual data corresponding to a certain subtitle, he can input a control command (command) through the user interface 28, such as a remote controller (remote controller). After receiving the user's control command, the control module 29 performs control according to the user's control command. For example, when the user wants to repeatedly play the audio-visual data of the last displayed subtitle, the control module 29 sends a control signal to the secondary image decoding and subtitle analysis unit 233 . The secondary image decoding and subtitle parsing unit 233 outputs playing time information corresponding to the last displayed subtitle, such as a start time and an end time. After receiving the play time information (start time and end time), the control module 29 outputs play control signals such as start time and end time to the main control unit 21 . The main control unit 21 can repeatedly play the audio-visual data of the specified time according to the play control signal.

The sub-picture decoding and subtitle analysis unit 233 splits the sub-picture unit into subtitle basic playback units logically including start and end times according to the sub-picture control sequence information in the sub-picture unit SPU. Afterwards, according to the control signal of the control module 29, as the minimum length setting of each subtitle display unit, form the subtitle display unit (display subtitle), and provide the start and end play time of the subtitle display unit of the control module 29 . The secondary image decoding and subtitle analysis unit 233 can also send a reading request to the control module 29, and inform the control module 29 to send a corresponding playback control signal to the main control unit to capture the previous or next secondary image unit for the secondary image The decoding and subtitle analysis unit 233 is used. The control module 29 transmits the control information to the secondary image decoding and subtitle analysis unit 233 according to the information transmitted from the user interface 28, such as setting the size of the subtitle display unit, repeating or switching the subtitle display unit, and so on. Afterwards, the control module 29 converts the playback control signal to the video playback unit according to the start and end time provided by the sub-picture decoding and subtitle analysis unit 233 or the reading request of the sub-picture unit. If the sub-picture decoding and subtitle analysis unit 233 requests to read the sub-picture unit, it can suspend the output of the audio-visual playback unit, and only provide the required sub-picture unit data.

4A and 4B are flow charts of the present invention using the subtitle corresponding time as the control method of video and audio playback. The control method of the present invention will be described in detail below with reference to FIGS. 4A and 4B .

Step S402: start.

Step S404: Read the video and audio data and set the initial playback start and end points. The source of the audio-visual data can be a DVD disc, or a data medium storing the audio-visual data, such as a hard disk. The video and audio data includes subtitle display information. And the default value of the initial playing start and end point can be the beginning and the end of the audio-visual data.

Step S406: Detect whether there is a control command input by the user. When no user control command is received, go to step S428; when a user control command is received, go to the next step.

Step S408: Analyzing the action of the user's control command. The user control commands include general control mode and subtitle control mode.

Step S410: the action of the user control command is to enter the subtitle control mode, skip to the next step S414; otherwise, skip to step S412. Of course, entering the subtitle control mode includes actions such as switching to the previous subtitle, switching to the next subtitle, repeating the subtitle, repeating the previous subtitle, and repeating the next subtitle. As long as it is related to using the time of the subtitles to control the video and audio playback, it can be classified into this step.

Step S412: Determine whether the subtitle control mode is present. If it is currently in subtitle control mode, go to step S416, otherwise go to step S426.

Step S414: Set the subtitle parsing unit, and skip to step S416.

Step S416: Determine whether to switch the size of the subtitle display unit. If the size of the subtitle display unit is switched, go to step S422; if not, go to step S418.

Step S418: Determine whether to switch between playing different subtitles. If switching between different subtitles to play, skip to step S424; if not to switch between different subtitles to play, then skip to step S420.

Step S420: Determine whether to end the subtitle control mode. If the subtitle control mode is ended, go to step S406; if the subtitle control mode has not been ended, go to step S428.

Step S422: Set the size of the subtitle display unit, and skip to step S428.

Step S424: Calculate the start and end points of the video and audio playback according to the corresponding time of the switched subtitles, and skip to step S428.

Step S426: normal operation mode, and skip to step S428.

Step S428: Play the video and audio data according to the start and end points of the video and audio playback. The action of playing audio and video can be handled by a general audio and video playback unit. Then skip to step S406.

Therefore, the control method of the present invention using the corresponding time of the subtitles as the audio and video playback allows the user to select the audio and video data corresponding to the subtitles to be played repeatedly or once.

FIG. 5 shows another embodiment of the control structure of the audio-visual playback device using the corresponding time of subtitles as the video-audio playback according to the present invention. As shown in the figure, the audio-visual playback device 50 of the present invention uses the corresponding time of subtitles as audio-visual playback, including a main control unit 51, a demultiplexer 52, a decoder 53, an audio post-processing unit 24, and an audio output The unit 25 , a video post processing unit 26 , a video output unit 27 , a user interface 28 , and a control module 59 . The decoder 53 includes an audio decoder 531 , a video decoder 532 , and an image decoding and subtitle analysis unit 533 . The video and audio playback device 50 is mainly used to generate video and audio signals, and the audio and video data can be read from DVD discs or from data storage media such as hard disks. The difference between this embodiment and the embodiment in FIG. 2 is that the main control unit 51 can read the external subtitle data corresponding to the played video and audio data, and provide the subtitle information to the secondary image decoding and subtitle analysis unit 533 .

The sub-picture decoding and subtitle analysis unit 233 of the first embodiment parses out the display start and end time corresponding to each subtitle according to the sub-picture unit. The external subtitle data includes the text data of the subtitle and the display start and end time of the text data, or the display start and end time of the subtitle can be converted according to the difference in grammar. Therefore, the sub-picture decoding and subtitle analysis unit 533 does not need to parse the subtitle information from the sub-picture unit of the audio-visual data, but directly parses the subtitle information of the external subtitle data. The other units are the same as those of the first implementation, and will not be described again. Of course, if the subtitle display information is also a sub-picture unit, the sub-picture decoding and subtitle analysis unit 533 has the same function and operation as the sub-picture decoding and subtitle analysis unit 233 in the first embodiment.

FIG. 6 shows a third embodiment of the control structure of the video and audio playback device using the corresponding time of subtitles as the video and audio playback according to the present invention. As shown in the figure, the audio-visual playback device 60 of the present invention uses the corresponding time of subtitles as audio-visual playback, including a main control unit 61, a demultiplexer 62, a decoder 63, an audio post-processing unit 24, and an audio output The unit 25 , a video post processing unit 66 , a video output unit 27 , a user interface 28 , and a control module 69 . The decoder 63 includes an audio decoder 631 , a video decoder 632 , and a subtitle analysis unit 633 . The video and audio playback device 60 is mainly used to generate video and audio signals, and the audio and video data can be read from DVD discs or from data storage media such as hard disks. The difference between this embodiment and the embodiment in FIG. 2 is that the video decoder 632 can obtain the Line-21 information from the video data, and provide the Line-21 information to the subtitle parsing unit 633 .

The Line-21 information includes the displayed text and the corresponding display time of the following image frame. The subtitle parsing unit 633 can interpret the information contained in the Line-21 information according to EIA-608 or subsequent standards. The start time of the Line-21 information is the display time corresponding to the first image frame containing the information or the start code, and the end time is the display time corresponding to the first image frame containing the end code thereafter. This information can be combined into the display time corresponding to the subtitle display unit required by the control unit. Therefore, the subtitle parsing unit 633 can parse out the playing time information corresponding to each subtitle from the Line-21 information.

FIG. 7 shows a fourth embodiment of the control framework of the video and audio playback device using the corresponding time of subtitles as the video and audio playback according to the present invention. The audio-visual playing device 70 of Fig. 7 with subtitle corresponding time as audio-visual playback will master control unit 21, demultiplexer 22, decoder 23, audio post processing unit 24, audio output unit 25, video post in Fig. 2 The processing unit 26 and the video output unit 27 are regarded as an audio-visual playback unit 71, and the subtitle analysis function of the secondary image decoding and subtitle analysis unit 233 is independently formed into a subtitle analysis unit 72, which includes a user interface 77 and a control module 76 . In this way, the subtitle analysis unit can be designed in a general DVD player, that is, the general DVD player can be converted into an audio-visual playback device according to the present invention that uses the corresponding time of the subtitle as the video-audio playback.

Therefore, as shown in FIG. 7, the subtitle analysis unit 72 receives the sub-image unit and the Line-21 information of the audio-visual playback unit 71 (when the audio-visual data contains Line-21 information), and provides the corresponding playback time of the subtitle to the control module. 76. Therefore, the subtitle parsing unit 72 can analyze the playing time corresponding to the displayed subtitle according to the sub-image unit, and can also analyze the corresponding playing time of the displayed subtitle according to the Line-21 information. In addition, if the audio-video playback unit 71 receives the external subtitle information, the subtitle analysis unit 72 can also receive the subtitle information, and analyze the display time corresponding to the subtitle.

Of course, in order to increase the system efficiency and reduce the subtitle analysis unit 72’s reading requirements for the sub-picture unit SPU, the subtitle analysis unit 72 may include a memory unit (not shown) to store more sub-picture units in the subtitle analysis unit Within 72. When playing audio-visual data, if the sub-picture unit to be played has been stored in the memory unit, the subtitle analysis unit 233 can directly provide the subtitle image of the sub-picture unit to the video-audio playback unit 71 .

Claims (19)

1, a kind of control method with subtitle corresponding time as audio-visual broadcasting, it is characterized in that, comprises the following steps: Receive the control signal and analyze the action of the control signal; Analyzing the playback time corresponding to the subtitle unit, when the aforementioned control signal is to switch and display subtitles, analyze the playback time corresponding to the subtitle unit to be switched; and Control video and audio playback, receive the playback time corresponding to the aforementioned subtitle unit, set the video and audio playback start and end points according to the action of the aforementioned control signal, and output a playback control signal including the video and audio playback start and end points. 2. The control method of using subtitle corresponding time as video and audio playback according to claim 1, wherein the step of parsing the playback time corresponding to the subtitle unit is to analyze the playback time corresponding to the subtitle unit according to the sub-image unit of the audio and video data. time. 3. The control method of using subtitle corresponding time as video and audio playback according to claim 1, characterized in that the step of analyzing the playback time corresponding to the subtitle unit is based on the image frame containing the displayed text and corresponding to the displayed text Display the Line-21 information of the time to analyze the playback time corresponding to the subtitle unit. 4. The control method of using subtitle corresponding time as video and audio playback according to claim 1, characterized in that, the step of parsing the playback time corresponding to the subtitle unit is based on the plug-in that includes the displayed text and the corresponding playback time of the displayed text The subtitle information is used to analyze the playback time corresponding to the subtitle unit. 5. An audio-visual playback device using the corresponding time of subtitles as audio-visual playback, characterized in that it includes: An audio-visual playback unit, which reads audio-visual data, outputs video and audio signals according to the playback control signal, and outputs sub-image units; A subtitle analysis unit, receiving the sub-image unit and an analysis control signal, and analyzing the time information corresponding to each subtitle display unit; and A control module receives user control commands and generates the playback control signal and the analysis control signal according to the time information. 6. The audio-visual playback device according to claim 5, wherein the subtitle analysis unit has a memory unit for recording the received sub-picture unit and the analyzed sub-picture information. 7. The audio-visual playback device according to claim 6, wherein the subtitle analysis unit can also output the stored sub-image information. 8. The audio-visual playback device according to claim 7, wherein the video-audio playback unit accepts the sub-image information output by the subtitle analysis unit to decode the sub-image. 9. The audio-visual playback device according to claim 5, wherein the audio-visual playback device uses the subtitle corresponding time as the audio-visual playback unit, wherein the audio-visual playback unit also outputs Line-21 which includes the displayed text and the display time of the image frame corresponding to the displayed text. information. 10. The audio-visual playback device according to claim 9, wherein the subtitle corresponding time is used as the audio-visual playback device, wherein the subtitle analysis unit receives the Line-21 information, and analyzes the time information corresponding to the subtitle unit that can be completely displayed . 11. The audio-visual playback device according to claim 5, wherein the audio-visual playback unit uses the subtitle corresponding time as the audio-visual playback, wherein the audio-visual playback unit also receives the external subtitle information, and outputs the display text and the playback time corresponding to the display text. Plug-in information. 12. The audio-visual playback device according to claim 11, wherein the subtitle analysis unit receives the plug-in information and analyzes the time information corresponding to the subtitle unit that can be completely displayed. 13. An audio-visual playback device using the corresponding time of subtitles as audio-visual playback, characterized in that it includes: A control module, which receives an action command and generates a playback control signal; A main control unit, which reads audio-visual data, and receives the aforementioned playback control signal to generate an output signal; A demultiplexer, receiving the output signal of the above-mentioned main control unit, and decoding and outputting audio data, video data, and sub-image unit; A primary image decoding and subtitle analysis unit receives the aforementioned secondary image unit and analyzes the secondary image unit to output subtitle images and broadcast time information corresponding to the subtitle images; An audio decoder, receiving the aforementioned audio data, and outputting an audio decoding signal after decoding; and A video decoder, which receives the aforementioned video data and outputs a decoded video signal after decoding; Wherein the aforementioned control module also receives the playback time information of the subtitle image from the aforementioned secondary image decoding and subtitle analysis unit to generate the aforementioned playback control signal. 14. The audio-visual playback device using the subtitle corresponding time as the audio-visual playback device according to claim 13, further comprising: A user interface, receiving the user's control to generate the aforementioned action command; A video post-processing unit, receiving the aforementioned video decoding signal and the aforementioned subtitle image, and generating a video signal; and A video output unit receives the aforementioned video signal and generates a video output signal. 15. The audio-visual playback device using subtitle corresponding time as audio-visual playback according to claim 13, further comprising: An audio post-processing unit, which receives the aforementioned audio decoding signal and generates an audio signal; and An audio output unit receives the aforementioned audio signal and generates an audio output signal. 16. The audio-visual playback device according to claim 13, wherein the main control unit also receives external subtitle information, and outputs the subtitle information to the sub-image decoding and subtitle analysis unit. 17. The audio-visual playback device according to claim 16, wherein the subtitle corresponding time is used as the audio-visual playback device, wherein the sub-image decoding and subtitle analysis unit receives the subtitle information, and analyzes and displays the display corresponding to the subtitle according to the subtitle information. time information. 18. The video and audio playback device according to claim 13, which uses the corresponding time of the subtitles as the audio and video playback device, wherein the aforementioned video decoder can also parse the Line-21 information included in the video data, and output the Line-21 information to the aforementioned secondary image decoding and subtitle parsing unit. 19. The audio-visual playback device according to claim 13, wherein the subtitle corresponding time is used as the audio-visual playback device, wherein the sub-image decoding and subtitle analysis unit receives the Line21 information output by the video decoder, and analyzes the information according to the Line21 information Display the display time information corresponding to the subtitle.

Images