CN103188566B - Video playback device and operating method thereof - Google Patents

Abstract

A video playing device and an operation method thereof are provided, the video playing device comprises a video content interface unit, a network interface unit, a label combining unit and a display unit. The video content interface unit outputs at least one video picture. The network interface unit obtains label information corresponding to the video picture from a server through a network, wherein the label information comprises at least one label. The label combining unit outputs a label layer according to the label information, and makes the label layer synchronous with the video picture according to the video information of the video picture. The display unit overlays a label layer on the video picture and displays the label layer and the video picture.

Description

Video playback device and operating method thereof

technical field

The invention relates to a video device, in particular to a video playing device and an operating method thereof.

Background technique

At present, more and more people watch videos (such as movies, TV, etc.) while surfing the Internet, and the proportion has a tendency to increase year by year. Users are often interested in certain (or certain) objects appearing in video content. For an object of interest, the user needs to manually search for the object on the Internet. Obviously, such a conventional device will cause inconvenience in use.

Contents of the invention

The invention provides a video playing device and its operation method, which are used to provide an interactive operation interface in the video content.

An embodiment of the present invention proposes a video playback device, including a video content interface unit, a network interface unit, a tag-mixer and a display unit. The video content interface unit outputs at least one video frame. The network interface unit acquires tag information corresponding to the video frame from a server via a network, wherein the tag information includes at least one tag. The tag combination unit is coupled to the video content interface unit and the network interface unit. The label combination unit outputs a label layer according to the label information, and synchronizes the label layer with the video frame according to the video information of the video frame. The display unit is coupled to the video content interface unit and the label combination unit. The display unit overlays the label layer on the video frame, and displays the label layer and the video frame.

An embodiment of the present invention proposes a method for operating a video playback device, including: providing at least one video frame; obtaining a tag information corresponding to the video frame from a server via a network, wherein the tag information includes at least one tag; A label layer is generated according to the label information; according to a video information of the video frame, the label layer is synchronized with the video frame; the label layer is overlaid on the video frame; and the label layer and the video frame are displayed.

In an embodiment of the present invention, the above-mentioned network may be a WiFi wireless network, an asymmetric digital subscriber loop (Asymmetric Digital Subscriber Line, ADSL) network, a cable modem (Cable MODEM) network, a global microwave interconnection access ( Worldwide Interoperability for Microwave Access, WiMAX) network or Long Term Evolution (Long Term Evolution, LTE) network.

In an embodiment of the present invention, the above label layer is a transparent layer of an On Screen Display (OSD).

In an embodiment of the present invention, the above-mentioned position of the label on the label layer corresponds to the position of an object in the video frame.

In an embodiment of the present invention, the above-mentioned label includes an image, a text string or a region.

In an embodiment of the present invention, the above-mentioned tags include hyperlinks.

In an embodiment of the present invention, the above-mentioned tags include a location field, a maintenance time field, a movement field and a synchronization field.

In an embodiment of the present invention, the above-mentioned label combining unit synchronizes the label layer with the video frame by detecting a time information or a subtitle information of the video information.

In an embodiment of the present invention, after the above-mentioned tag is triggered, the display unit displays an information screen corresponding to the at least one tag on the tag layer according to the tag information.

In an embodiment of the present invention, when the user clicks on the at least one tag, or when the program status meets a preset condition, the at least one tag is triggered.

In an embodiment of the present invention, the above-mentioned video playback device further includes a second device. Wherein, after the at least one tag is triggered, the display unit transmits an information screen corresponding to the at least one tag to the second device according to the tag information.

Based on the above, the embodiments of the present invention provide a video playback device and an operation method thereof, which use the label layer to provide an interactive operation interface in the video content. For example, in some embodiments, when the user is interested in a certain object appearing in the video content, the user only needs to click the label corresponding to the object in the label layer to automatically search for the object on the Internet.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail with reference to the accompanying drawings.

Description of drawings

FIG. 1 is a schematic functional block diagram illustrating a video playback device according to an embodiment of the present invention;

FIG. 2 is a schematic flowchart illustrating an operation method of a video playback device according to an embodiment of the present invention;

FIG. 3 is a schematic diagram illustrating a situation of a video frame and a label layer according to an embodiment of the present invention;

FIG. 4 is a schematic diagram illustrating a situation of a video frame and a label layer according to a second embodiment of the present invention;

FIG. 5 is a schematic diagram illustrating a situation of a video frame and a label layer according to a fourth embodiment of the present invention;

FIG. 6 is a schematic diagram illustrating a scene of a video frame and a label layer according to a fifth embodiment of the present invention.

Reference signs:

11: video source;

12: server;

13: network;

100: video playback device;

110: network interface unit;

120: label binding unit;

130: video content interface unit;

140: display unit;

311～315: label;

500: second device;

510: information screen;

S210～S260: steps;

TL: label layer;

VC: Video screen;

VI: Video information.

detailed description

FIG. 1 is a schematic functional block diagram illustrating a video playback device 100 according to an embodiment of the present invention. The video playing device 100 may be a television, a set-top box (set-top box, STB), a computer, and the like. The video playback device 100 includes a network interface unit 110 , a tag combination unit 120 , a video content interface unit 130 and a display unit 140 . FIG. 2 is a schematic flowchart illustrating an operation method of the video playing device 100 according to an embodiment of the present invention. Please refer to Figure 1 and Figure 2. In step S210 , the video content interface unit 130 can obtain a video signal or a video stream from a video source (video source) 11 , and then provide at least one video frame VC to the display unit 140 . While outputting the video frame VC, the video content interface unit 130 may also synchronously output the corresponding video information VI.

Here, the implementation of the video source 11 is not limited. For example, if a TV system is taken as an example, the video source 11 may be a TV content provider (such as a TV station, a cable TV manufacturer, etc.), and the above-mentioned video information VI may be TV information. The TV information may include electronic program guide (Electronic Program Guide, EPG), event information table (Event Information Table, EIT), time and date table (Time and Date Table, TDT), time difference table (TimeOffset Table, TOT) , Service Description Table (Service Description Table, SDT), Program Association Table (Program Association Table, PAT), Program Mapping Table (Program Map Table, PMT) and/or teletext (teletext), etc. If the video disc system is taken as an example, then the video source 11 can be video recording media such as audio-visual disc (videocompact disk, VCD), digital versatile disc (digital versatile disc, DVD), Blu-ray disc (Blue-Ray disk), and the above-mentioned Video information VI can be time stamp data (TIME STAMP DATA) and/or subtitle (subtitle).

The server 12 is used for storing and collecting tag information and video content-related information. According to the relationship between the tag information and the related information of the video content, the video playback device 100 can correctly present the tag layer TL and the corresponding video frame VC. In step S220 , the network interface unit 110 may obtain tag information corresponding to the video frame VC from the server 12 via the network 13 , and then transmit the tag information with at least one tag to the tag combining unit 120 . In this embodiment, the above-mentioned network 13 may be a WiFi wireless network, an asymmetric digital subscriber loop (Asymmetric Digital Subscriber Line, ADSL) network, a cable modem (Cable MODEM) network, a Worldwide Interoperability for Microwave Access (Worldwide Interoperability for A Microwave Access, WiMAX) network or a Long Term Evolution (Long Term Evolution, LTE) network of a Third Generation Partnership Project (Third Generation Partnership Project, 3GPP). In other embodiments, the above-mentioned server 12 may be a data storage device at the local end, and the network 13 may be a circuit network at the local end. For example, the network interface unit 110 may obtain tag information corresponding to the video frame VC from a flash memory (FLASH memory) via a Universal Serial Bus (USB), and then transmit the tag information to the tag combining unit 120 .

The label combination unit 120 is coupled to the network interface unit 110 and the video content interface unit 130 . The label combining unit 120 outputs the label layer TL according to the label information (step S230 ), and synchronizes the label layer TL with the video frame VC according to the video information VI of the video frame VC (step S240 ). The display unit 140 is coupled to the tag combination unit 120 and the video content interface unit 130 . The display unit 140 has a display element, a driving circuit, a control circuit and/or a scalar inside. The display unit 140 overlays the label layer TL on the video frame VC (step S250 ), and displays the label layer TL and the video frame VC (step S260 ). The above method of overlaying the label layer TL on the video frame VC can be determined according to product design requirements. For example, the label layer TL may be a transparent layer (transparent layer) of an On Screen Display (OSD).

For example, the tag combining unit 120 queries the content of the server 12 through the network interface unit 110 using the current video information VI of the video playback device 100 to obtain the tag information corresponding to the current video frame VC. In other embodiments, before the video is played, the tag combination unit 120 first downloads all the tag information corresponding to the video from the server 12 to the internal buffer of the tag combination unit 120 through the network interface unit 110 . When the video playback device 100 plays the movie, the tag combination unit 120 reads the preloaded tag information from the internal buffer.

Table 1 illustrates an example of data structure and content of tag information according to an embodiment of the present invention. It is assumed here that the video frame VC comes from a TV stream, so the tag combination unit 120 can obtain information such as the program category, program name, and program time of the video frame VC from the electronic program guide (EPG) of the video information VI, and then pass The network interface unit 110 downloads corresponding tag information from the server 12 . The tag information includes multiple fields, for example, the attribute field records the relevant attributes of the corresponding video frame VC. The content "tourism, All, Sunday 12:30" in the attribute column in Table 1 indicates that the program type of the current video screen VC is tourism type, the age classification is universal (all ages can watch it), and the playing time is Every Sunday at 12:30 pm. The synchronization field records the synchronization information of the corresponding video frame VC. For example, when the synchronization field records "MIT Taiwan History Episode 516 4:30", it indicates that a certain label layer TL should correspond to the video frame VC at 4 minutes and 30 seconds in "MIT Taiwan History" episode 516. Therefore, the tag combination unit 120 outputs the tag layer TL according to the tag information, and synchronizes the tag layer TL with the video frame VC according to the synchronization field of the tag information and the time stamp data in the video information VI.

Table 1: Data structure of label information

field parameter value attribute field Travel, AII, Sunday 12:30 sync field MIT Taiwan History Episode 516 4:30 ... ...

The tag combining unit 120 of the embodiment shown in Table 1 above synchronizes the tag layer TL with the video frame VC by detecting the time information of the video information VI. Table 2 illustrates an example of the data structure and content of tag information according to another embodiment of the present invention. The difference from Table 1 is that the synchronous field of Table 2 records the subtitle content of the video information VI. The label combining unit 120 of the embodiment shown in Table 2 synchronizes the label layer TL with the video frame VC by detecting the subtitle information of the video information VI. For example, when the synchronization column records "MIT Taiwan History Episode 516 Subtitles: What we see today is the main peak of Yushan Mountain", it means that a certain label layer TL should correspond to the subtitle in "MIT Taiwan History" Episode 516 as "We What I saw today is the video screen VC at the main peak of Yushan Mountain. Therefore, the tag combining unit 120 outputs the tag layer TL according to the tag information, and synchronizes the tag layer TL with the video frame VC according to the synchronization field of the tag information and the subtitle data in the video information VI.

Table 2: Data structure of label information

After the label combination unit 120 synchronously outputs the label layer TL, the display unit 140 can overlay the label layer TL on the video frame VC, and display the label layer TL and the video frame VC. The fields of the tag in the above tag information will be described in detail later.

FIG. 3 is a schematic diagram illustrating a situation of a video frame VC and a label layer TL according to an embodiment of the present invention. There are people, houses and mountains in the video frame VC, wherein the person wears a watch and a hat. The video playback device 100 can obtain tag information corresponding to the video frame VC from the server 12 through the network 13, and then generate a tag layer TL according to the tag information. In the scenario example shown in FIG. 3 , the label layer TL has labels 311 , 312 , 313 and 314 . The positions of the labels 311-314 on the label layer are respectively corresponding to the positions of watches, hats, mountains, and houses in the video frame VC. The display unit 140 overlays the label layer TL on the video frame VC, and displays the label layer TL and the video frame VC. The video playback device 100 can provide additional information and/or network applications to users through the tag layer TL. Several application examples of the label layer TL will be described below, but the application manner of the label layer TL is not limited thereto.

In the first embodiment, the tags 311 - 314 of the tag layer TL are text strings in a hidden state. Table 3 illustrates an example of the data structure and content of the tag 313 in the tag information according to the embodiment of the present invention, and other tags can be analogized. The string field in Table 3 indicates that the text string of the label 313 is "Yushan", and the position column indicates that the label 313 is located at (800, 20) in the video frame VC. The hold time field indicates that the tag 313 will last for 10 video frames in the tag layer TL. The moving column indicates that the label 313 is moved to the left by 10 pixels (pixel) every time the video frame is changed during the 10 video frames. The trigger mode field indicates that the tag 313 is manually triggered by the user.

Table 3: Data structure of label information

field parameter value name field Jade Mountain show string field Jade Mountain location field (800, 20) hold time field 10 frames mobile field Left 10pixel/frame trigger field manual trigger ... ...

Since the labels 311 - 314 are hidden, the label layer TL overlaid on the video frame VC will not affect the content of the video frame VC for users to watch. When the user triggers the label layer TL through a remote control, mouse, touch panel, etc., the labels 311-314 are also triggered and converted into a visible state, so the user can obtain video images through the labels 311-314 Additional information for VC content. For example, the user can obtain additional information such as the brand and model of the watch in the video screen VC through the tag 311 , and obtain the name of the mountain in the video screen VC as Yushan through the tag 313 .

In the second embodiment, the tags 311 - 314 of the tag layer TL are geometric regions corresponding to corresponding objects in the video frame VC. The geometric regions may be transparent or translucent. When the user clicks/triggers the tags 311 - 314 through remote control, mouse, touch panel, etc., the tag combining unit 120 synchronously displays an information window on the tag layer TL. This information window covers part or all of the video screen VC. For example, FIG. 4 is a schematic diagram illustrating a situation of a video frame VC and a label layer TL according to the second embodiment of the present invention. When the user clicks/triggers the label 312 (ie clicks the hat in the video frame VC), the label combining unit 120 synchronously displays an information window on the label layer TL. The label combination unit 120 displays the additional information of the label 312 in the information window as "N brand mountaineering cap" according to the above display string field. In this embodiment, the command button "Add Queue" is also displayed in the information window. When the user clicks/triggers the command button “AddQueue”, the video playback device 100 will put the tag 312 into the list (wish list or Queue). The video playback device 100 of this embodiment has a tag list storage function. When the user selects a tag, the tag will be added to the list to facilitate the user to browse afterwards. The aforementioned function of adding a tag to the list can store only part or all of the content of the tag, and can also store the corresponding video frame VC at the same time.

In the third embodiment, besides the above-mentioned fields, the data structure of the tag in the tag information also includes a hyperlink field. If the video player 100 has a communication network, when the user clicks/triggers a tab on the tab layer TL, the tab combination unit 120 synchronously displays an information window (information screen) on the tab layer TL. This information window covers part or all of the video screen VC. The label combination unit 120 downloads the relevant webpage in the hyperlink field through the communication network according to the URL recorded in the hyperlink field, and then displays the relevant webpage in the information window. Therefore, when the user is interested in a certain object appearing in the video content, the video playback device 100 can automatically provide the relevant webpage of the object, so as to enhance the convenience of use.

In the fourth embodiment, besides the above-mentioned fields, the data structure of the tag in the tag information also includes a hyperlink field. For example, FIG. 5 is a schematic diagram illustrating the situation of the video frame VC and the label layer TL according to the fourth embodiment of the present invention. Referring to FIG. 5 , the second device 500 is coupled to the video playback device 100 through a wired or wireless communication network. The second device 500 may be a notebook computer, a tablet computer, a smartphone, and the like. In the case that the video playback device 100 has a communication network, when the user clicks/triggers the label 312 (that is, clicks the hat in the video screen VC), the label combination unit 120 learns that the hat is "N brand mountaineering cap". Next, the label combining unit 120 downloads the relevant data of "N brand mountaineering cap" through the communication network according to the URL recorded in the above hyperlink field, and then the video playback device 100 will have the "N brand mountaineering cap" and related data The information screen 510 is transmitted and displayed on the second device 500 . In other embodiments, the video playing device 100 may also transmit and display the URL recorded in the field of "N brand mountaineering hat" and the above hyperlink field on the second device 500 . The second device 500 downloads the relevant data of "N Brand Mountaineering Hat" from the communication network according to the URL provided by the video playback device 100, and then the second device 500 displays an information screen 510 with "N Brand Mountaineering Hat" and related data.

In the fifth embodiment, multiple labels on the label layer TL may be presented in different forms. For example, FIG. 6 is a schematic diagram illustrating a situation of a video frame VC and a label layer TL according to the fifth embodiment of the present invention. Please refer to FIG. 5 , the label layer TL has labels 311 , 313 and 315 . The label 311 is the position of the watch displayed on the video screen VC in the form of an icon. The label 313 shows the position of the mountains in the video frame VC in the area marked by the four L corners. The tag 315 is a text string "WindStopper" that displays the position of the character's clothing in the video screen VC. For the implementation content of the tags 311 , 313 and 315 in this embodiment, reference may be made to the relevant descriptions of the above-mentioned embodiments, so details are not repeated here.

Although the above-mentioned embodiments determine whether to trigger the label based on whether the user clicks on it, the implementation is not limited thereto. For example, when the program status meets a certain preset condition, the label of the label layer will be automatically triggered. The preset conditions for automatic triggering can be based on the status of the program, for example: the video is paused, the video is not updated, the video is in a waiting state, and the video has no signal, etc. can be used as the preset conditions for automatically judging whether to trigger the tag. For example, when the video playback device 100 is playing a fashion show, when the user clicks the freeze button on the remote control to pause the video, the label layer TL will be automatically triggered at this time. And tags appear on the clothes of the characters in the film. For another example, in the process of playing a fashion show on the video playback device 100, the system image is in a waiting state due to a temporarily poor signal from the tuner. At this time, the label layer TL will be automatically triggered and placed on the clothes of the characters Tabs appear.

In other embodiments, the preset condition for automatic triggering may be the playing time of the video content. For example, the trigger setting of the label is "B brand car + 0:10 time". When the B brand car advertisement plays to the 10th second, the label is automatically triggered to display the corresponding additional information (such as a hyperlink). After the user manually clicks on the hyperlink, the TV screen will enter the website linked to the B-brand car. For example, for a 30-second car advertisement test ride, click on the hyperlink of this label to enter the car website, watch the interior or make an appointment for a test ride.

The way of constructing the above tag information can be prepared by relevant manufacturers and provided to the server 12 . For example, the corresponding tag information is pre-prepared by the TV station according to the TV programs. Alternatively, program providers and sponsors pre-prepare corresponding label information according to program content, so as to embed advertisement content in the label layer TL. Alternatively, unspecified network users create corresponding tag information according to specific video content, and upload the tag information to the server 12 for others to download. Multiple people build tags on the content of the same video (television) on different platforms (such as personal computers, mobile phones, and tablet computers) at different times. When the video playback device 100 plays the video (TV), the user can see the latest tag and its corresponding content.

To sum up, the embodiments of the present invention provide a video playback device and its operation method, which utilizes the tag layer TL to provide an interactive operation interface in the video frame VC. For example, in some embodiments, when a user is interested in an object appearing on the video screen VC, the user only needs to click the label corresponding to the object to automatically search for the object on the Internet, so as to improve the user experience. convenience.

Although the present invention has been disclosed above with the embodiments, it is not intended to limit the present invention, and any person of ordinary skill in the art may make some changes and modifications without departing from the spirit and scope of the present invention.

Claims (20)

1. A video playback device, comprising: A video content interface unit, outputting at least one video frame and corresponding video information; A network interface unit, used to obtain a tag information corresponding to the video frame from a server via a network, wherein the tag information has at least one tag, wherein the tag information includes a synchronization field; a label combination unit, coupled to the video content interface unit and the network interface unit, the label combination unit outputs a label layer according to the label information, and compares by detecting a time information or a subtitle information of the video information A time stamp data of the synchronization field is compared with the time information of the video information or a subtitle data of the synchronization field is compared with the subtitle information of the video information, so that the label layer is synchronized with the video frame; and A display unit, coupled to the video content interface unit and the label combining unit, the display unit overlays the label layer on the video frame and displays the label layer and the video frame. 2. The video playback device according to claim 1, wherein the network is a WiFi wireless network, an asymmetric digital subscriber loop network, a cable modem network, a global microwave interconnection access network or a long-term evolution network . 3. The video playback device as claimed in claim 1, wherein the label layer is a transparent layer of an on-screen display menu. 4. The video playback device according to claim 1, wherein the position of the at least one label on the label layer corresponds to the position of at least one object in the video frame corresponding to the video frame. 5. The video playback device according to claim 1, wherein the at least one tag comprises an image, a text string or an area. 6. The video playback device according to claim 1, wherein the at least one tag comprises a hyperlink. 7. The video playback device according to claim 1, wherein the at least one tag comprises a position field, a maintenance time field and a movement field. 8. The video playback device according to claim 1, wherein after the at least one tag is triggered, the display unit displays an information frame corresponding to the at least one tag on the tag layer according to the tag information. 9. The video playback device according to claim 8, wherein when a user clicks on the at least one tag, or when a program status meets a preset condition, the at least one tag is triggered. 10. The video playback device according to claim 1, further comprising: A second device, coupled to the video playback device; After the at least one tag is triggered, the display unit transmits an information frame corresponding to the at least one tag to the second device according to the tag information. 11. A method for operating a video playback device, comprising: Provide at least one video frame; Obtaining a tag information corresponding to the video frame from a server via a network, wherein the tag information has at least one tag, wherein the tag information includes a synchronization field; generating a label layer according to the label information; synchronizing the label layer with the video frame according to a video information of the video frame; overlay the label over the video frame; and Displaying the label layer and the video frame, wherein the step of synchronizing the label layer with the video frame according to the video information of the video frame includes: comparing a time stamp data of the synchronization field with the time information of the video information or comparing a subtitle data of the synchronization field with the video information by detecting a time information or a subtitle information of the video information The subtitle information, so that the label layer is synchronized with the video frame. 12. The operation method of the video playing device according to claim 11, wherein the network is a WiFi wireless network, an asymmetric digital subscriber loop network, a cable modem network, a global microwave interconnection access network or a long-term Evolved network. 13. The operating method of the video playback device according to claim 11, wherein the label layer is a transparent layer of an on-screen display menu. 14. The operating method of the video playing device according to claim 11, wherein the position of the at least one label on the label layer corresponds to the position of at least one object in the video frame corresponding to the video frame. 15. The operating method of the video playback device according to claim 11, wherein the at least one label comprises an image, a text string or an area. 16. The operating method of the video playback device according to claim 11, wherein the at least one label comprises a hyperlink. 17. The operating method of the video playback device according to claim 11, wherein the at least one tag comprises a position field, a maintenance time field and a movement field. 18. The operating method of the video playback device according to claim 11, further comprising: triggering the at least one tag; and After the at least one tag is triggered, an information screen corresponding to the at least one tag is displayed on the tag layer according to the tag information. 19. The operating method of the video playback device according to claim 18, further comprising: When a user clicks on the at least one tag, or when a program status meets a preset condition, the at least one tag is triggered. 20. The operating method of the video playback device according to claim 11, further comprising: triggering the at least one tag; and After the at least one tag is triggered, an information frame corresponding to the at least one tag is transmitted to a second device according to the tag information.