WO2004075542A1

WO2004075542A1 - Program reception device and program display device

Info

Publication number: WO2004075542A1
Application number: PCT/JP2004/001376
Authority: WO
Inventors: Yumiko Kato; Hideyuki Yoshida
Original assignee: Matsushita Electric Industrial Co., Ltd.
Priority date: 2003-02-21
Filing date: 2004-02-10
Publication date: 2004-09-02

Abstract

A broadcast reception device (100) that receives program data including a video/audio stream representing a program content and additional information associated with an object that appears in the program. The device comprises a broadcast reception unit (101) that receives broadcast data; a time selection input unit (103) that receives an “sticky attaching” operation performed by an operator; a control unit (102) that records time information indicating the time at which the “sticky attaching” operation is performed; an information selection unit (106) that identifies an object appearing in the video/audio stream based on the time information and extracts information on the object from the additional information; and a transmission unit (108) that transmits the extracted information on the object to a specified destination via a communication line.

Description

Specification

Program receiving device and program display device

The present invention relates to a device for receiving and displaying program data such as a television broadcast, and more particularly to a device for marking an object appearing in a program. Background art

When watching a program or commercial broadcast on television, if you are interested in an object (such as an “object”) that appeared in the program, you can do so in the third place. There is something I want to tell people. For example, when the jacket that actor A appeared on the program wore was thought to be a very nice jacket, I would like to introduce that jacket to a close friend. There is.

In such a case, the viewer takes notes while watching the program or memorizes it in one corner of the head, so that the viewer can remember the object of interest and end the program. Later, they call friends and tell them about the objects that appeared in the program.

However, taking notes while watching a program is very cumbersome. Usually, it is not assumed that a memo is taken while watching a program, and the memo book is not placed within reach. Also, writing notes while relaxing and watching a TV program can be a daunting task. On the other hand, keeping articles that appeared in a program in one corner of the head is an obstacle to focusing on programs such as dramas, which is an exciting activity.

Eliminate such cumbersome operations such as writing notes while watching a program As a conventional technique, there is a bookmark radio system (for example, refer to Japanese Patent Application No. 2002-123456). According to this conventional technique, when a user receives an operation for attaching a so-called bookmark while receiving a radio broadcast, the user terminal stores specific information arranged in the program data. In advance, a decryption key is obtained from the server device based on the information, and the encrypted data is decrypted into official music data using the obtained decryption key. This allows the user to reliably obtain the desired song data without having to take notes or go to a store to purchase a CD or the like.

However, "bookmarking" in the above-mentioned conventional technology is a simple operation such as a button operation, and can be said to be effective as an operation of designating music to be broadcast in radio broadcasting or the like. It is difficult to specify the individual objects that appear in a. In other words, the above-mentioned “bookmarking” in the conventional technology can be applied to a case where it is sufficient to specify only a temporal position, such as music, but is not a time-consuming object, such as an object appearing in television broadcasting. However, there is a problem that it cannot be applied to the case where the physical position and the spatial position (position on the display screen) must be specified.

Further, according to the above-described conventional technology, the user can only obtain official music data by marking, and cannot say that the information is transmitted to a third party. For example, if you get nice song data and want to give it to a third party, look up the title, singer's name, etc. of that song, and then call that third party, Or create and send an email. In other words, there is a problem that in order to communicate to a third party, troublesome work such as searching for an object to be communicated or making a telephone call is required. Disclosure of the invention

Therefore, the present invention has been made in view of such a situation, and it is possible to mark an object appearing in a video such as a television broadcast by a simple operation, and furthermore, the object can be marked. An object of the present invention is to provide a convenient program receiving device and the like that can reliably transmit information about an object to a desired third party without checking information or making a telephone call.

In order to achieve the above object, a program receiving device according to the present invention receives program data including a video stream and additional information associated with a target appearing in a video indicated by the video stream. A program receiving apparatus, comprising: a receiving unit configured to receive and store the program data; an input unit configured to receive a predetermined input process by an operator; and a recording unit configured to record time information indicating a time at which the input process is performed. By referring to the program data re-received by the receiving means, the video stream re-received by the receiving means at a time corresponding to the time indicated by the time information recorded in the recording means is indicated. Object identification means for identifying an object appearing in a video, and extraction means for extracting information about the identified object from the additional information received by the receiving means. Transmitting means for transmitting the information on the object to a designated destination via a communication path.

As a result, by a predetermined input operation, a “sticky note” process for specifying the time position of the program is performed. Subsequently, the target appearing in the sticky video is specified, and the target is identified. Information is extracted from the additional information and sent to the destination, so when the operator finds an object to be conveyed to a third party while watching the program, the operator can simply perform a simple operation such as attaching a tag. Can reliably, automatically, and automatically transmit information about the subject to a third party. Wear.

In addition, the additional information includes information for identifying a target appearing in the video in association with information on the target, and the information for specifying the target includes a frame image including an image of the target. The time position in the video stream and the spatial position of the target image in the frame image may be included. Further, the program data further includes an audio stream and an audio stream, and the additional information is further associated with an object appearing in the audio stream and the audio stream. It may be. The object may include not only an object such as a product but also a copyrighted work or service such as music.

Here, the target specifying means presents to the operator the video indicated by the video stream received by the receiving means at a time corresponding to the time, and specifies the target according to the operator's instruction for the presentation. I do. For example, the target specifying means specifies the target in accordance with the designation of the spatial position of the video by the operator for the presentation.

With this, the operator can specify the target by specifying the spatial position with respect to the video on which the tag is attached, so that even when a plurality of targets are displayed on one screen, the target can be specified. The information can be transmitted by narrowing down to the target.

Further, the target specifying unit may present a list of targets appearing in the video to the operator together with the video, and may specify the target according to a selection instruction by the operator for the presentation. Thus, the operator can specify the target by selecting from the list of targets, and thus can easily and reliably narrow down the target to be transmitted to the third party.

Further, the target specifying means acquires a character string from an operator, and acquires the acquired sentence. The target may be specified according to a character string. This allows the operator to specify a specific target by inputting a character string, so that, for example, many different targets are displayed in an extremely small display area, or different targets are displayed on the screen. Even if it is difficult to specify the target by the pointing device, the intended target can be specified without fail even if the target device is difficult to display.

Further, the target specifying means may acquire the voice of the operator, and may specify the target according to the acquired voice. Similarly, the input unit accepts an utterance by an operator as input processing, and the recording unit may record time information indicating a time at which the utterance was performed. May perform the voice recognition on the utterance accepted by the input unit, thereby identifying the target. That is, the time position or the spatial position of the program may be specified by the voice of the operator. In particular, when the operator speaks to identify the target while watching the program, the time position of the program may be specified from the timing of the utterance, and the target may be narrowed down based on the uttered content. As a result, the operator can paste a tag and narrow down targets by extremely simple operations.

In addition, the extraction unit further extracts video data indicating a video in which the target appears, from the video stream received by the reception unit, and the transmission unit includes the video data together with information on the target. Data may be sent to the destination. Similarly, the program data includes an audio stream, and the extracting unit further extracts audio data corresponding to the video data from the audio stream received by the receiving unit. The transmitting unit may transmit the audio data to the destination together with the information on the target and the video data. Further, the transmission / reception device includes transmission message acquisition means for acquiring a transmission message from an operator, The transmission means may transmit the transmission message acquired by the transmission message acquisition means to the destination together with the information on the target, the video data and the audio data.

As a result, not only information about the target but also the video and audio in which the target appears are transmitted together, so that the overall situation when the target appeared in the program can be communicated to a third party in detail. Can be

In addition, the transmitting unit transmits only information selected from the information on the target, the video data, the audio data, and the transmission message to the destination according to an attribute of a reception function of the destination. Is also good. As a result, only the data that can be processed by the receiving device is automatically selected and transmitted, so that the selection process by the operator is not required, and the unnecessary data is transmitted because the data that cannot be received is transmitted. Data transfer is avoided.

Further, in order to achieve the above object, a program display device according to the present invention obtains program data including a video stream and additional information corresponding to an object appearing in a video indicated by the video stream. A program display device for acquiring and displaying the program data, input means for receiving a predetermined input process by an operator, and indicating a time at which the input process was performed. Recording means for recording time information; and a target appearing in a video indicated by the video stream re-displayed by the display means at a time corresponding to the time indicated by the time information re-recorded by the recording means. A target specifying means, extracting means for extracting information on the specified target from the additional information obtained by the display means, and the extracted information on the target are designated. Characterized in that it comprises a transmitting means for transmitting via a previously channel.

As a result, not only real-time broadcasting such as TV broadcasting, but also storage It is also possible to “paste a sticky note” when watching a digital data broadcast or when playing back a recorded broadcast by a recording and playback device.

As described above, when the program receiving device or the like according to the present invention finds a target (object) of a product or the like to be conveyed to a third party while watching a program such as a television broadcast, the remote control button is pressed. By simple operations such as pressing and speaking, not only specific scenes, but also objects appearing in the program can be marked in real time, such as attaching sticky notes. Therefore, it is free from troublesome things such as writing down notes of interesting objects while watching the program or memorizing it in one corner of the head, so that the user can concentrate on watching the program.

After the viewing of the program has been completed, for example, by simply specifying the transmission destination, detailed information such as product information, sales information, and related URLs relating to the object on which the sticky note is pasted is displayed in the video where the object appeared. And it can be sent automatically to the third party along with the sound or your own message. This eliminates the need to look up detailed information on the object of interest on the Internet, call a third party to communicate, or create an e-mail. Information about the object can be reliably transmitted to a third party.

As described above, according to the present invention, it is possible to avoid occurrence of useless communication based on ambiguous memory between a broadcast station and a viewer, between a viewer and an information providing site, between viewers, and the like. The communication between them is assured and smooth, and the practical value of the present invention is extremely high.

It should be noted that the present invention can be realized not only as such a program receiving device and a program displaying device, but also as a program receiving method and a program data displaying method in which characteristic means provided in these devices are used as steps. Or implement such means as a program that causes a computer to function. You can also. It goes without saying that the program can be distributed via a recording medium such as a CD-ROM and a transmission medium such as the Internet. BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a diagram showing an overall configuration of a broadcast system according to an embodiment of the present invention.

FIG. 2 is an external view of a remote controller for a broadcast receiving device in the broadcasting system.

FIG. 3 is a flowchart showing an outline of the characteristic functions of the broadcasting system.

FIG. 4 is a diagram showing a data structure of broadcast data of a program with program additional information broadcasted from a broadcasting station of the broadcasting system.

FIG. 5 is a data structure diagram showing contents of content information included in the program additional information shown in FIG.

FIG. 6 is a diagram showing a specific example of the program additional information shown in FIG. FIG. 7 is a functional block diagram showing a detailed configuration of the broadcast receiving device according to the first embodiment.

FIG. 8 is a diagram showing a data structure of a destination database of the broadcast receiving device.

FIG. 9 is a flowchart showing an operation procedure of the broadcast receiving device. FIG. 10 is a diagram showing a state of a dialogue between the viewer and the broadcast receiving device. FIG. 11 is a functional block diagram showing a detailed configuration of the broadcast receiving apparatus according to the second embodiment.

Fig. 12 is a diagram showing an example (first half) of content information in which details and time position of objects appearing in a program are described in the program additional information. You.

FIG. 13 is a diagram showing an example (second half) of content information in which details and time positions of objects appearing in a program are described in the program additional information.

FIG. 14 is a diagram showing an example of content information in which a spatial position of an object appearing in a program is described in the program additional information.

FIG. 15 is a flowchart showing the operation procedure of the broadcast receiving device. FIG. 16 is a diagram showing a state of a dialogue between the viewer and the broadcast receiving device. FIG. 17 is a more detailed diagram of the flowchart shown in FIG. 15 with respect to the interaction processing between the viewer and the broadcast receiving device.

Fig. 18 is a diagram showing the process until the transmission information is generated from the video and audio streams of the program.

FIG. 19 is a functional block diagram showing a detailed configuration of the broadcast receiving apparatus according to the third embodiment.

FIG. 20 is a flowchart showing the operation procedure of the broadcast receiving device. FIG. 21 is a diagram showing a state of a dialogue between the viewer and the broadcast receiving device. FIG. 22 is a diagram illustrating an example (first half) of program additional information in which a service is an object.

FIG. 23 is a diagram illustrating an example (second half) of the program additional information in which the service is an object.

FIG. 24 is a diagram illustrating an example (first half) of the program additional information in which a work (BGM) is an object.

FIG. 25 is a diagram showing an example (second half) of program additional information in which a work (BGM) is an object.

FIG. 26 is a functional block diagram illustrating a detailed configuration of the broadcast receiving apparatus according to the fourth embodiment. FIG. 27 is a flowchart showing the operation procedure of the broadcast receiving device. FIG. 28 is a diagram illustrating a state of a dialogue between the viewer and the broadcast receiving device. FIG. 29 is a functional block diagram showing a detailed configuration of the broadcast receiving device according to the fifth embodiment.

FIG. 30 is a flowchart showing an operation procedure of the broadcast receiving device. FIG. 31 is a diagram illustrating a state of a dialogue between the viewer and the broadcast receiving device. FIG. 32 is a functional block diagram showing a detailed configuration of the broadcast receiving apparatus according to the sixth embodiment.

FIG. 33 is a diagram showing the data structure of the time ■ recognition result table storage unit of the broadcast receiving apparatus.

FIG. 34 is a flowchart showing the operation procedure of the broadcast receiving device. FIG. 35 is a diagram showing a state of a dialogue between the viewer and the broadcast receiving device. FIG. 36 is a more detailed diagram of the flowchart shown in FIG. 34 regarding the interaction processing between the viewer and the broadcast receiving device.

FIG. 37 is a diagram illustrating the principle of specifying an object.

FIG. 38 is a functional block diagram showing a configuration of one broadcast receiving apparatus having the functions of the broadcast receiving apparatuses of Embodiments 1 to 6.

FIG. 39 is a diagram illustrating an operation mode of the broadcast receiving device.

FIG. 40 is a diagram illustrating an example (first half) of program additional information in which music information or the like is an object.

FIG. 41 is a diagram illustrating an example (second half) of program additional information in which music information or the like is an object. BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. (Embodiment 1) FIG. 1 is a diagram illustrating an overall configuration of a broadcast system 10 according to Embodiment 1 of the present invention. The broadcast system 10 uses a simple mark-up process, such as pressing a button on a remote control when a viewer finds an interesting object while watching a program (hereinafter, such a process is referred to as “tagging a tag”). This is a TV broadcasting system that can automatically transmit information about the object to friends, etc. by pre-processing. Broadcast receiver (TVZS TB) 31 a and 31 b as a program receiver according to the present invention installed at 30 c, remote controller 32, fax 33, and mobile terminal 4 0a and 40b, and a stationary telephone 50 etc. Here, the broadcast station 20 and the broadcast receiving devices 31a and 31b are connected by a CATV network or the like, and two-way communication is possible, and the broadcast receiving devices 31a and 31b and the fax 3 3. The mobile terminals 40a and 40b and the stationary telephone 50 are connected to a communication network such as a telephone network.

The broadcast station 20 is a broadcast station that creates and broadcasts a program with program additional information. Here, the program additional information 22 is additional data that is multiplexed and transmitted together with the video and audio 21, and in the present embodiment, detailed information on the product appearing in the video and the video are Includes product information, etc., in which the information to be specified is described in accordance with MPEG (Moving Picture Expert Group) -7.

The broadcast receivers 31a and 31b are two-way broadcast receivers as TV receivers or STBs (Set Top Boxes) used in conjunction with them, and appear in programs according to the instructions of the viewer. This is a device that can paste a sticky note on an attached object and send information about the attached object to a specified destination.

The remote controller 32 remotely controls the broadcast receiving device 31a. Remote control, and also has a function as a user interface for attaching sticky notes. In other words, as shown in FIG. 2, this remote controller 32, in addition to the general operation button 32b, also displays an interesting product or the like while watching a program. Sticky note button for attaching a sticky note 3 2 a, display screen 3 2 c for displaying programs and user interface images transmitted from the broadcast receiving device 3 1 a, and audio for the broadcast receiving device 3 1 a A microphone 32d for giving instructions is provided.

FAX 33 is a facsimile receiver that receives images and the like. The mobile terminals 40a and 4Ob are a mobile phone, a PDA (Personal Digital Assistant), and the like, which can perform data communication via the Internet. The stationary telephone 50 is a telephone that does not have a data communication function and can only make voice calls.

FIG. 3 is a flowchart showing an outline of characteristic functions of the broadcasting system 10 configured as described above. The viewer presses the sticky button 3 2 a of the remote controller 32 when he or she finds a favorite product while watching the program (S 1). In response to this operation, the broadcast receiving device 31a stores the time when the sticky button 32a is pressed, and when the program ends or is interrupted, it stores it. Specify the video corresponding to the time and the information (product data) related to the product that appeared in the video and present it to the viewer to narrow down the objects and request transmission confirmation (S12) ). On the other hand, if the viewer confirms the content, narrows down the objects, or specifies the destination after inputting his own message, etc., the broadcast receiving device 31a transmits the product data and the transmission message. Then, the video and audio in which the product appears are transmitted to the specified destination via the network (S13). At this time, the broadcast receiving device 31a limits the type of information to be transmitted, such as only video and text or only sound, according to the device attributes of the destination device. For example, for a broadcast receiver 31b that can receive multimedia data such as video and audio text, video, audio, product information, URL (Uniform Resource Locator) and sender For fax 33, which can send messages and receive video data excluding audio and text data, send video, product information, URL, and text-type sender messages to receive multimedia data. For mobile terminals 40a capable of transmitting video, audio, product information and voice type sender messages, and for mobile terminals 4Ob capable of receiving video-text data excluding audio For example, video, URL, and text-type sender messages are sent, and for stationary phones 50 that can receive only audio, product information and sender messages are sent as audio. To.

Also, the broadcast receiving device 31a accumulates such a transmission history, and transmits the transmission history to the broadcast station 20 when a certain period of time has elapsed. Thus, the broadcast station 20 can totalize the advertising effect by totalizing the frequency of sticky notes attached to the programs. As described above, according to the broadcasting system 10 in the present embodiment, when a viewer finds an article to introduce to a third party or a favorite product while watching a program, he or she can take notes. Instead of having to memorize it in one corner of the head, simply press the sticky button 3 2a on the remote controller 32 to attach the sticky note to a specific page of the book, or It is possible to mark specific images, scenes, etc. in the program, such as sandwiching Shiori J. After the program ends or is interrupted, the viewer can use the broadcast receiver 3 1 Just give a simple instruction to a, and the video that has been marked so far, the sound accompanying the video, A UR indicating the information about the product that appeared in the image and the website related to the video can be sent to the specified destination as transmission data, such as a message to be transmitted to the other party.

Hereinafter, a detailed structure of the broadcast data transmitted from the broadcast station 20 and a detailed process of the broadcast receiving device 31a will be described.

FIG. 4 is a diagram showing a data structure of broadcast data of a program with program additional information broadcasted from the broadcast station 20. Broadcast data is broadly composed of an image-audio data stream 21 and program additional information 22. Image ■ The audio data stream 21 is the main information that constitutes a program or commercial, and is composed of a set of scenes 21b corresponding to scenes. Each scene 21b is a camera camera. Each shot 21a is composed of a group of frame images that are cut off for each motion. The program additional information 22 is a data stream that is multiplexed with the image / audio stream 21. In the present embodiment, the content information that collects product information, which is information on products appearing in a program, is included. The individual product information 1 to m included in the content information is one of the information transmitted from the broadcast receiving device 31a to other devices via the network, and includes scenes in which the product appears and Associated with the shot. This is to enable the viewer to specify the product that appeared in the scene shot from the scene shot where the viewer pasted the sticky note.

FIG. 5 is a data structure diagram showing the content of the content information included in the program additional information 22 transmitted from the broadcast station 20. The content information includes detailed information on each object (commodity) appearing in a program when the objects (products) are classified as objects 1 to n. Detailed information for each object includes product description indicating the name and manufacturer of the product, sales information indicating the selling price and the store, and information related to the product. URL indicating the address of the website (that is, the source address of the product), the start time position, which is the time position in the program in which the product appears, and the time displayed. It includes the duration time. The program additional information 22 also includes image information (lower right in FIG. 5) for specifying the spatial position in the frame images of the individual objects 1 to n specified as described above. This image information is used to distinguish a plurality of products displayed at the same time position in a program. Note that the coordinates, shape, movement trajectory, and the like in the frame image are used as information for specifying the spatial position of the object.

FIG. 6 is a diagram showing a specific example of the program additional information 22 shown in FIG. Here, various tags conforming to MPEG 7 are used to declare a plurality of objects appearing in the program as shown in the first part 221 or individual objects as shown in the second part 222. It shows an example that describes the product description and time position of the object. Specifically, in the first half, 221, four objects were declared as clothes for actor A appearing in the program: outerwear B, pants C, shoes D, and hat E. In the latter part, the description of “Outerwear B” is Γ F brand winter jacket J, start time position 1 force Γ T 00: 0 2: 45 : 0 F 0 0 ”, duration 1 is ΓP 3 4 2 D”, start time position 2 is “T 0 0: 3 4: 2 3: 0 F 2 0 J, and continue It is described that the time length 2 is Γ P 1825 DJ.

FIG. 7 is a functional block diagram showing a detailed configuration of the broadcast receiving apparatus 100, which is an example of the broadcast receiving apparatus 31a shown in FIG. The broadcast receiving apparatus 100 is a television broadcast receiver capable of attaching a tag to a received video by a viewer and transmitting various information corresponding to the tag to the outside, a broadcast receiving unit 101, Control section 102, time selection input section 103, image table Display section 104, sound output section 105, information selection section 106, transmission information storage section 107, transmission section 108, destination database 109, and destination input section 110. You.

The broadcast receiving unit 101 is a receiving circuit for receiving broadcast data broadcast from the broadcast station 20 or a TS (Transport Stream) decoder, etc., and transmits received broadcast data from a video / audio stream. It is demultiplexed into the following program contents and additional program information and sent to the control unit 102.

The image display section 104 is a display for displaying program contents, an operation screen for the viewer to talk with the broadcast receiving apparatus 100, and the like, or a display screen 3 2 provided in the remote controller 32. and c. The sound output unit 105 is a speaker or the like that outputs sound or sound that constitutes the contents of the program. The time selection input section 103 is a sticky button 32 a or the like provided on the remote controller 32, and issues an instruction to the broadcast receiving apparatus 100 that the viewer wants to attach a sticky note. Input means for the viewer, that is, an input means for the viewer to select a time position or the like while watching the program.

The control unit 102 temporarily stores the program contents (video / sound stream) received by the broadcast receiving unit 101, and a time position instruction is issued from the time selection input unit 103. At that time, from the program being watched at that time, image shots or scenes including that time position and audio or sound units are extracted, and each component is controlled to interact with the viewer. CPU, storage device, etc.

The information selection unit 106 includes the image shots extracted by the control unit 102 or the program additional information corresponding to the scene and sound or sound unit (in the present embodiment, the extracted image shots and the like). Appearance and all objects described in the program additional information) are selected from the program additional information stored in the control unit 102, and the selected program additional information is selected by the control unit 1. 0 according to 2 It is stored in the transmission information storage unit 107 together with the image shot or scene and the audio or sound unit extracted by the above. The transmission information storage unit 107 is a memory or the like that temporarily stores the transmission information sent from the information selection unit 106. The destination database 109 is, as shown in FIG. 8, a memory card or the like that stores information of a destination that is a destination of transmission information. FIG. 8 shows an example of a destination database 109 including items such as “name”, address Z number, and “attribute” of the destination. In the item “Attribute”, “Type” specifies the type of the destination device (such as PCZT eIFaX), and “Video”, “Sound”, and “Text” specify the type of data that can be transmitted. Column.

The destination input unit 110 is a remote controller 32, etc., which allows the viewer to select the destination of the transmission information from the destination database 109 and directly input the destination of the transmission information by button or voice. Or input means for doing so. The transmission unit 108 reads out the transmission information stored in the transmission information storage unit 107 according to the instruction from the control unit 102, and selects the destination or destination selected by the viewer from the destination database 109. It is a communication interface such as a modem for transmitting via a network to a destination directly input by the input unit 110.

Next, the operation of the broadcast receiving apparatus 100 configured as described above will be described.

FIG. 9 is a flowchart showing the operation procedure of broadcast receiving apparatus 100. FIG. 10 is a diagram showing a dialogue between the viewer and the broadcast receiving apparatus 100. Now, suppose that the viewer has selected a time position using the time selection input section 103 while viewing the program as shown in FIG. 10 (a) (S100). For example, a viewer who was watching the scene where A actor appeared appeared to like the outerwear worn by A actor, so he would like to tell his friend by all means. 2 Suppose you press a. On the other hand, the control unit 102, which has received the signal for selecting the time position from the time selection input unit 103, records the time as time information (time stamp), and was watching at that time. From the program, an image shot or scene including the time position and a voice or sound unit are extracted (S'lO1). Then, the time information, the extracted image shot or scene, and the sound or sound unit are sent to the information selection unit 106.

The information selection unit 106 transmits the program shot information related to the image shot or scene and the sound or sound unit sent from the control unit 102 to the broadcast data stored in the control unit 102. (S102), and the selected program additional information is stored in the transmission information storage unit 107 together with the image shot or scene and audio or sound unit (S103). ).

For example, the information selection unit 106 specifies all objects pointing to the scene extracted by the control unit 102 by the start time position and the duration from the program additional information, and The product description, sales information, related URL, etc. of the object are extracted and stored in the transmission information storage unit 107 together with the scene and sound unit as product information. Alternatively, the information selecting unit 106 refers to the start time position and the duration of each object described in the program additional information, so that the time information notified from the control unit 102 can be obtained. A time section that goes back a certain time in the past from the time shown I Identifies all objects that appear, extracts the product description, sales information, related URLs, etc. of those objects from the program additional information, and Then, it is stored in the transmission information storage unit 107 together with the scene and the sound unit. Then, after the viewing of the program ends or is interrupted, the control unit 102 reads the transmission information stored in the transmission information storage unit 107 as in the screen display example shown in FIG. 10B. By reading it out and displaying it on the image display unit 104, it is possible to select the extracted image shot or scene and voice or sound unit. The program additional information (that is, product information) is presented to the viewer (S104). At this time, if information on a plurality of sticky notes is stored in the transmission information storage unit 107, the control unit 102 sends a confirmation video and product information to the viewer for each of the plurality of sticky notes. Present and ask for instructions to send or not.

In response to this presentation, when the viewer confirms the video or product information on which the user has attached a sticky note and gives an instruction to transmit, the transmitting unit 108 displays the screen shown in FIG. 10 (c). As shown in the display example, the destinations registered in the destination database 109 are read out, displayed as a list of destinations on the image display section 104, and the destination input section 111 is input from the viewer. Selection of a destination or input by 0 is accepted (S105). When confirming the transmission information and specifying the destination, the viewer can use the destination input section 110 or the like to attach a message (sender message) to be attached to the transmission information and send it. Can be entered at

When the destination is determined in this way, the transmission unit 108 reads out the transmission information stored in the transmission information storage unit 107, and sends it to the determined destination together with the input sender message. And transmits it via the network (S106). At this time, the transmission unit 108 selects and transmits only transmittable information by referring to the “device attributes” of the destination database 109, and transmits data that can transmit transmission information. It is transmitted after being converted to the type. For example, if the destination is “Yamamoto-san J” in the destination database 109 in FIG. 8, the transmission unit 108 will output information (video, product information, transmission (Sender message) as data, and in the case of Mr. Saito J, the sending unit 108 converts the product information and sender message in the sent information to voice and sends it over the phone. As described above, according to the present embodiment, when a viewer finds an article to be introduced to a third party, a favorite product, or the like while watching a program, the viewer can view the program. By simply pressing the sticker button 3 2a on the controller 32, after the end or interruption of the program, the information on the product can be automatically transmitted to the desired destination together with the related video scene. it can. Therefore, it is free from troublesome work such as taking a memo while watching the program and storing it in one corner of the head, which obstructs the viewing of the program. Since the information with the sticky note is transmitted to the other party by communication via the network, the content to be transmitted is more reliably transmitted to the other party than by verbal communication by telephone or the like. . In addition, the other party receiving such sticky information does not only include information for identifying the product but also detailed information such as the price of the product, the store, and the video scene in which the product appeared. If you are interested in the product, ask the sender for various information about the product or obtain various information about the product using the Internet, etc. It is possible to make a purchase decision without having to do any troublesome work such as

Further, according to the present embodiment, the other party receiving the tag information is not limited to an intelligent terminal device such as a PC as a receiving device, but may be a simple terminal device such as a facsimile receiver. You only need to own it. This is because it is possible to receive various kinds of information on products, video scenes, and the like by using the image text.

(Embodiment 2)

Next, a broadcast receiving apparatus according to Embodiment 2 of the present invention will be described. The broadcast receiving device according to the present embodiment allows the viewer to specify not only the time position of the program but also the spatial position on the display screen, and transmit the narrowed down product information for each object. The feature is that it can be. Note that the overall configuration of the broadcasting system 10 shown in FIG. 1 is also common in the present embodiment. FIG. 11 is a diagram showing a detailed configuration of the broadcast receiving apparatus 200 according to the present embodiment, that is, the broadcast receiving apparatus 200 which is an example of the broadcast receiving apparatus 31 a shown in FIG. It is a block diagram. The broadcast receiving apparatus 200 is capable of attaching a tag to a received video by a viewer and transmitting various information corresponding to the tag to an external device in units of objects (here, products appearing in a program). TV broadcast receiver, broadcast receiving unit 101, control unit 102a, time selection input unit 103, image display unit 104, sound output unit 10

5.Information selection unit 106a, transmission unit 108, destination database 109, destination input unit 110, time information storage unit 201, and spatial position selection input unit 202 .

The broadcast receiving apparatus 200 has almost the same configuration as the broadcast receiving apparatus 100 in the first embodiment. However, instead of the transmission information storing section 107 in the first embodiment, the time information storing section 2 0 1 and a spatial position selection input unit 202, and a control unit 102 a and a function added in place of the control unit 102 and the information selection unit 106 in the first embodiment. Information selector 1 0

Embodiment 6 is different from Embodiment 1 in including 6a. Hereinafter, the same components as those in the first embodiment will be denoted by the same reference numerals, and the description thereof will be omitted.

The control unit 102a determines the time by referring to a built-in timer or the like when the time position instruction is issued from the time selection input unit 103, and determines the timing when the tag is attached. Is stored in the time information storage unit 201 as a time stamp (time information) indicating the time stamp. The time information storage unit 201 is a memory for temporarily storing time information sent from the control unit 102a. The spatial position selection input unit 202 is an arrow key or button provided on the remote controller 32, a pointing device, a touch panel, or the like. Individual objects This is an input means for designating the spatial position of the mouse.

The information selection unit 106a is configured to provide a video stream, an audio stream, and a video stream before and after including the time indicated by the time information stored in the time information storage unit 201 after the end of the program viewing or after the viewing is stopped. The program additional information corresponding to the time is acquired from the control unit 102a, and the video stream and the audio stream are presented and output to the image display unit 104 and the audio output unit 105. Then, based on a spatial position instruction by the viewer using the spatial position selection input unit 202 for the presentation, an object in the video (such as a product that the viewer is interested in) is specified and specified. An image shot containing the selected object is cut out from the video stream, product information corresponding to the object is extracted from the program additional information, and the image shot and the product information are extracted. The selected information is sent to the transmission unit 108.

FIGS. 12 and 13 show content information in which details and time positions of objects appearing in a program are described in program additional information 22 transmitted from broadcast station 20 in the present embodiment. It is a figure showing the example of. Here, in Fig. 12, the objects "Jacket BJ and" Pants CJ etc. "are declared as the clothes of the A actor appearing in the program. , “Release size”, “Price” for each release size, “Release color”, “Release pattern”, “Manufacturer (name and URL)”, “Sales company (name and UR)”, etc. Information is described, and the start time position, duration, etc., are described as the time position of those objects in the video stream.

FIG. 14 is a diagram showing an example of content information in which the spatial position of an object appearing in a program is described in the program additional information 22 transmitted from the broadcast station 20 in the present embodiment. is there. Here, the product that appears in the program ΓJacket BJ The shape type (“length Square)) and the positions of the vertices are specified.

Next, the operation of the broadcast receiving apparatus 200 according to the present embodiment that has received the program with the program additional information described above will be described.

FIG. 15 is a flowchart illustrating the operation procedure of the broadcast receiving apparatus 200. FIG. 16 is a diagram showing a state of a dialogue between the viewer and the broadcast receiving device 200.

Now, suppose that the viewer selects a time position using the time selection input unit 103 while viewing the program as shown in FIG. 16 (a) (S200). For example, a viewer who was watching the scene where A actor appeared appeared to like the outerwear worn by A actor, so he wanted to tell his friend by all means. 2 Suppose you press a.

On the other hand, the control unit 102a receiving the signal for selecting the time position from the time selection input unit 103 specifies the time and stores it in the time information storage unit 201 as time information. Yes (S201).

When the viewer stops or stops watching the program, the information selection unit 106a sets the video stream and audio stream of a certain section including the time indicated by the time information stored in the time information storage unit 201. And the program additional information corresponding to the time are acquired from the control unit 102a, and the video stream and the audio stream are presented and output to the image display unit 104 and the audio output unit 105. (S202).

Then, as shown in FIG. 16 (b), the information selection unit 106a, based on the spatial position instruction by the viewer using the spatial position selection input unit 202 for the presentation ( S203), the object in the video stream (such as a product that the viewer is interested in) is specified, and the product information corresponding to the object is extracted from the program additional information (S203). Along with the image shot and audio stream containing the object, as the selected information, Send to sending section 108. For example, as shown in FIG. 16 (b), when the viewer specifies a rectangular frame including an object using the spatial position selection input section 202, the information selection section 106a sets the program addition By determining whether the spatial position of each object described in the information is within the area of the rectangular frame, all the objects included in the rectangular frame are specified.

Then, the transmission unit 108 reads out the destinations registered in the destination database 109 as shown in the screen display example shown in FIG. 16 (c) and sets the image display unit as a transmission destination list. A list is displayed in 104, and selection or input of a destination by the destination input unit 110 is received from the viewer (S205). When the destination is determined, the transmission unit 108 sends the image shot, the audio stream, and the program additional information extracted by the information selection unit 106a to the determined destination, and sends them to the network. Transmission via the network (S206).

FIG. 17 is a more detailed flowchart of FIG. 15 relating to the dialog processing between the viewer and the broadcast receiving device 200. On the left side of the figure, the operation flow of the broadcast receiving device 200 is shown, and on the right side of the figure, the operation flow of the viewer is shown correspondingly.

When the viewer finds an article to introduce to a third party or a favorite product while watching the program, the viewer presses the sticky button 3 2a of the remote controller 32 (S22, S21) 0). Then, the control unit 102a specifies the time and records it as a time position in the time information storage unit 201 (S211). When the viewer stops or stops watching the program (S221), the information selection unit 106a refers to the time position recorded in the time information storage unit 201, and the time position is determined. The surrounding images are acquired from the control unit 102a and presented to the viewer via the image display unit 104 (S212). For example, an image of a section that goes back 30 seconds in the past from the time the tag was attached is played back slowly and presented to the viewer for confirmation. In response to this presentation, the viewer watches the video (S2222) and checks whether there is an object to be introduced to a third party in the video (S2223). , if it finds what you want to introduce a third person using a Y e _s :), the remote one ipecac Toro one la 3 2 Potan or arrow keys Chief with (S 2 2 3, introduction in the image Specify what you want with a pointer (S2224).

The information selection unit 106 a monitors the confirmation video slowly while monitoring whether or not the viewer has specified the object in the video (S 2 13). If an instruction is given by (Yes in S213), a more detailed time position and spatial position are specified based on the instruction (S214). For example, when the information selection unit 106a obtains an instruction of “stop playback” by the remote controller 32 from the viewer while the confirmation video is being played, the video time corresponding to the timing is obtained. While recording the position, the playback of the confirmation image is stopped and a still image is displayed. Subsequently, when the viewer obtains the designation of the spatial position on the display screen by the remote controller 32, the The spatial position is recorded, and the recorded time position and spatial position are updated and stored as more accurate spatiotemporal arrangement information.

Subsequently, the information selection unit 106a obtains, from the spatio-temporal arrangement information, the time position information described in the content information of the program additional information shown in FIG. 13, and the content shown in FIG. By referring to the spatial position information described in the information, the object corresponding to the time position and the spatial position specified by the viewer is specified (S215), and the object is determined from the video stream of the program. The section in which the character appears is cut out (S2 16). Then, the cut-out video stream is combined with the content information of the object finally corrected and selected based on the spatiotemporal arrangement information (S2117), and the transmission section 10 is transmitted as transmission information. Send to 8.

Figure 18 shows the video of the program. ■ Until transmission information is generated from the audio stream. FIG. As shown in Fig. 18 (a), when a viewer attaches a sticky note in the video stream of a program, as shown in Fig. 18 (b), after the end of the program, etc. In, the video stream of a certain section including the video with the tag attached (for example, a section that goes back 30 seconds in the past from the time when the tag was attached) is played back to the viewer for confirmation. On the other hand, when the viewer finds something he wants to introduce to a third party, the viewer stops playback and, as shown in Fig. 18 (c), moves the intended object from the still image. When a point is specified, as shown in Fig. 18 (d), a video stream of a certain section (for example, an image shot) including the still image is cut out, and the image stream corresponding to the object is extracted. Sent to third parties along with product information.

As described above, according to the present embodiment, when a viewer finds an article to be introduced to a third party, a favorite product, or the like while watching a program, a sticky note button 32 of the remote controller 32 is used. By simply pressing a, the time position can be temporarily stored. Then, after the program ends or is interrupted, the intended object is individually and specifically specified by designating the spatial position in the video with the tag attached thereto, and the detailed information of the object is given together with the detailed information of the object. It is possible to send an image shot or the like containing a to a third party. Therefore, compared to the first embodiment, the information to be transmitted to the third party can be narrowed down to only information on the article to be introduced, and a smaller amount of information can be sent to the third party more accurately. Can be transmitted.

(Embodiment 3)

Next, a broadcast receiving apparatus according to Embodiment 3 of the present invention will be described. In the broadcast receiving apparatus according to the present embodiment, the viewer selects not only the time position of the program but also a desired item from a list of items appearing in the video at the time position. In addition, it is characterized in that it is possible to transmit narrowed-down product information on an object-by-object basis. The overall configuration of broadcast system 10 shown in FIG. 1 is common to the present embodiment.

FIG. 19 is a diagram showing a detailed configuration of the broadcast receiving apparatus 300 in the present embodiment, that is, the broadcast receiving apparatus 300 which is an example of the broadcast receiving apparatus 31 a shown in FIG. It is a block diagram. The broadcast receiving apparatus 300 is capable of attaching a tag to a received video by a viewer and transmitting various information corresponding to the tag to an external device in units of objects (here, products appearing in a program). TV broadcast receiver, broadcast receiver 101, control unit 102a, time selection input unit 103, image display unit 104, sound output unit 105, information selection unit 106b , A transmission unit 108, a destination database 109, a destination input unit 110, a time information storage unit 201, and a selection input unit 301.

The broadcast receiving apparatus 300 has substantially the same configuration as the broadcast receiving apparatus 200 in the second embodiment, but includes an information selection unit 106a and a spatial position selection input unit 202 in the second embodiment. Embodiment 2 is different from Embodiment 2 in that an information selection unit 106 b and a selection input unit 301 are provided instead of the above. Hereinafter, points different from the second embodiment will be mainly described.

The selection input section 301 is an operation button 3 2b such as an arrow key provided on the remote controller 32, and is used by the viewer to select a desired object from the list of objects displayed on the image display section 104. It is an input means for selecting an object.

The information selection unit 106b stores the video stream, the audio stream before and after the time including the time indicated by the time information stored in the time information storage The program additional information corresponding to the time is acquired from the control unit 102a, and the video stream and the audio stream are displayed as images. In addition to presenting and outputting the information to the unit 104 and the sound output unit 105, the product information described in the program additional information is analyzed and presented to the image display unit 104 as a list. Then, based on the selection by the viewer using the selection input unit 301 for the presentation, an object (such as a product that the viewer is interested in) is specified, and an image shot including the specified object is specified. The transmitting unit 108 cuts out the video stream, extracts the product information corresponding to the object from the program ancillary information, and uses those image shots and product information as selected information. Send to

Next, the operation of broadcast receiving apparatus 300 according to the present embodiment configured as described above will be described.

FIG. 20 is a flowchart showing the operation procedure of the broadcast receiving apparatus 300. FIG. 21 is a diagram illustrating a state of a dialogue between the viewer and the broadcast receiving device 300.

Assume that the viewer selects a time position using the time selection input unit 103 while viewing a program as shown in FIG. 21 (a) (S300). For example, a viewer watching the scene in which A actor appeared appears to like the outerwear worn by A actor. Suppose you press.

On the other hand, the control unit 102a receiving the signal for selecting the time position from the time selection input unit 103 specifies the time and stores it in the time information storage unit 201 as time information. Yes (S301).

When the viewer stops or stops watching the program, the information selection unit 106b sets the video stream and audio stream of a certain section including the time indicated by the time information stored in the time information storage unit 201. The stream and the program additional information corresponding to the time are acquired from the control unit 102a, and the video stream and the audio stream are presented and output to the image display unit 104 and the audio output unit 105. At the same time, it analyzes the product information described in the program additional information and presents it to the image display unit 104 as a list of objects as shown in the screen display example shown in Fig. 21 (b). Output (S302). For example, if the program additional information corresponding to the time at which the tag was attached is the content information shown in FIGS. 12 and 13, the information selection unit 106b will select the A actor's clothes appearing in the video. As a result, detailed information (such as “Material”, “Release size”, “Price”, “Release color”, “Release color”) Product features such as pattern, “manufacturing company”, “sales company”, and position on the screen) are displayed in a list. Further, when the program additional information corresponding to the time when the tag is attached is the content information shown in FIGS. 22 and 23, the service corresponding to the contents of the dialog (in this example, “Overseas travel package” )) Is similarly displayed as a list of objects, and if the additional program information corresponding to the time when the tag was attached is the content information shown in FIGS. 24 and 25, the tag is displayed. Works such as music (ΓBGMJ in this example) corresponding to the pasted time are similarly listed as objects.

Then, based on a selection instruction by the viewer using the selection input unit 301 for the presentation (S303), the information selection unit 106b selects one or more objects from the object list. (Products that interest the viewer, etc.), extract the product information corresponding to the specified object from the program additional information, and select it along with the image shot and audio stream containing the object. The information is sent to the transmission unit 108 as the information.

The transmission unit 108 reads the destinations registered in the destination database 109 as shown in the screen display example shown in FIG. 21 (c), and sets the image display unit 100 as a destination list. 4 and a selection or input of a transmission destination by the destination input unit 110 is received from the viewer (S304). When the destination is determined, the transmission unit 108 is extracted by the information selection unit 106 b. The image shot, the audio stream, and the program additional information are transmitted to the determined destination via the network (S305).

As described above, according to the present embodiment, the viewer can use the sticky button of the remote controller 32 when he or she finds an article to be introduced to a third party or a favorite product while watching the program. By simply pressing 3 2 a, the time position can be temporarily stored. Then, after the program ends or is interrupted, a list of objects appearing on the sticky video is displayed.The viewer can specify the intended objects individually and specifically from the list. Along with the detailed information of the object, an image shot or the like including the object can be transmitted to a third party. Therefore, compared to the first embodiment, the information to be transmitted to the third party can be narrowed down to only the information on the article to be introduced from the list of objects, and the information amount can be reduced with a smaller size. The message can be accurately transmitted to the third party.

(Embodiment 4)

Next, a broadcast receiving apparatus according to Embodiment 4 of the present invention will be described. In the broadcast receiving apparatus according to the present embodiment, the viewer selects not only the time position of the program but also articles appearing in the video at the time position using a character string, and narrows down the objects in units of objects. It is unique in that it can send product information. The overall configuration of the broadcasting system 10 shown in FIG. 1 is common to the present embodiment.

FIG. 26 is a diagram illustrating a detailed configuration of the broadcast receiving apparatus 400 according to the present embodiment, that is, a broadcast receiving apparatus 400 that is an example of the broadcast receiving apparatus 31 a shown in FIG. It is a block diagram. The broadcast receiving apparatus 400 uses an object (here, a commercial appearing in a program) to attach a tag to a received video and transmit various kinds of information corresponding to the tag to the outside. TV receiver that can be used in units. Broadcast receiver 101, control unit 102a, time selection input unit 103, image display unit 104, sound output unit 10

5. It is composed of an information selection unit _106C , a transmission unit 108, a destination database 109, a destination input unit 110, a time information storage unit 201, and a character input unit 4101.

The broadcast receiving apparatus 400 has substantially the same configuration as the broadcast receiving apparatus 200 in the second embodiment, but has an information selection unit 100 in the second embodiment.

Embodiment 6 is different from Embodiment 2 in that an information selection unit 106 c and a character input unit 401 are provided in place of 6 a and the spatial position selection input unit 202. Hereinafter, points different from the second embodiment will be mainly described.

The character input section 401 is an operation button 32b, such as an arrow key, provided on the remote controller 32, a keyboard, a handwritten character recognition device, and the like. This is an input means for specifying an object with a character string for. For example, a virtual keyboard for inputting characters using the arrow keys and buttons of the remote controller 32 with respect to the keyboard displayed on the image display unit 104 is included.

The information selection unit 106c sets the video stream, the audio stream, and the time before and after the time including the time indicated by the time information stored in the time information storage unit 201 after the end of the program viewing or after the viewing is stopped. From the control unit 102a, the video stream and the audio stream are presented and output to the image display unit 104 and the audio output unit 105, and characters are input from the viewer. By accepting character input via the input unit 401, performing language processing and semantic analysis on the received character string, and collating it with the product information described in the program additional information, the object corresponding to the character string (viewing Products that the user is interested in), an image shot containing the identified object is cut out from the video stream, and product information corresponding to the object is attached to the program. The information is extracted from the additional information, and the image shot and the product information are transmitted to the transmission unit 108 as the selected information.

Next, the operation of broadcast receiving apparatus 400 according to the present embodiment configured as described above will be described.

FIG. 27 is a flowchart showing the operation procedure of broadcast receiving apparatus 400. FIG. 28 is a diagram illustrating a dialogue between the viewer and the broadcast receiving device 400.

Now, suppose that the viewer has selected a time position using the time selection input section 103 during program viewing as shown in FIG. 28 (a) (S400). For example, a viewer who was watching the scene where A actor appeared appeared to like the outerwear worn by A actor, so he wanted to tell his friend by all means. 2 Suppose you press a.

On the other hand, the control unit 102a receiving the signal for selecting the time position from the time selection input unit 103 specifies the time and stores it in the time information storage unit 201 as time information. Yes (S401).

When the viewer finishes or stops watching the program, the information selection unit 106c sets the video stream and audio for a certain section including the time indicated by the time information stored in the time information storage unit 201. The stream and the program additional information corresponding to the time are acquired from the control unit 102a, and the video stream and the audio stream are presented and output to the image display unit 104 and the audio output unit 105. At the same time, the viewer is prompted to input a character string specifying the object (S402).

On the other hand, as shown in the screen display example shown in FIG. 28 (b), when the viewer inputs a character string specifying an object using the character input section 401 (S403) The information selection unit 106c performs linguistic processing and semantic analysis of the character string input from the character input unit 401, and extracts the relevant program additional information. Then, the extracted information is sent to the transmission unit 108 as transmission information (S404). For example, if the program additional information corresponding to the time when the tag was attached is the content information shown in FIGS. 12 and 13, and the viewer inputs ΓJacket of actor A, The information selection unit 106c decomposes the input character string into ^ elements, and compares the character string between each noun and the product name etc. described in the program additional information to obtain an "actor". And Γ 視聴 ”and“ jacket ”match, that is, the viewer understands that 指定 F jacket”, which is a product of “jacket Β” in Α Αactor's clothing ” Then, the product information relating to “F jacket” is extracted from the program additional information and sent to the transmitting unit 108.

Then, as shown in a screen display example shown in FIG. 28 (c), the transmission unit 108 reads out the destinations registered in the destination database 109 and sets the image display unit as a transmission destination list. A list is displayed in 104, and selection or input of a transmission destination by the destination input unit 110 is received from the viewer (S405). When the destination is determined, the transmission unit 108 sends the image shot, the audio stream, and the program additional information extracted by the information selection unit 106c to the determined destination, and sends the network to the determined destination. Transmission via the network (S406).

As described above, according to the present embodiment, when a viewer finds an article to be introduced to a third party, a favorite product, or the like while watching a program, the tag button 3 2 of the remote controller 3 2 By simply pressing a, the time position can be temporarily stored. Then, after the program ends or is interrupted, the object appearing in the video with the tag attached is specified by a character string, so that the viewer can obtain detailed information of the object along with the image show including the object. Can be sent to a third party. Therefore, compared to the first embodiment, the information to be transmitted to the third party can be narrowed down to only the information about the article to be introduced by inputting a character string, and the information amount of a smaller size can be reduced. More accurately communicating messages to third parties it can.

(Embodiment 5)

Next, a broadcast receiving apparatus according to Embodiment 5 of the present invention will be described. In the broadcast receiving apparatus according to the present embodiment, the viewer specifies not only the time position of the program but also the articles appearing in the video at the time position by voice, and the product information narrowed down in units of objects is specified. The feature is that it can be transmitted. The overall configuration of the broadcasting system 10 shown in FIG. 1 is common to the present embodiment.

FIG. 29 is a diagram illustrating a detailed configuration of the broadcast receiving device 500 according to the present embodiment, that is, a broadcast receiving device 500 that is an example of the broadcast receiving device 31 a shown in FIG. It is a block diagram. The broadcast receiving apparatus 500 is capable of attaching a tag to a received video by a viewer and transmitting various information corresponding to the tag to an external device in units of objects (here, products appearing in a program). TV broadcast receiver, broadcast receiving unit 101, control unit 102a, time selection input unit 103, image display unit 104, sound output unit 10

5, Information selection unit 106 d, transmission unit 108, destination database 109, destination input unit 110, time information storage unit 201, microphone 501, and speech recognition unit 502 Be composed.

The broadcast receiving apparatus 500 has almost the same configuration as the broadcast receiving apparatus 200 in the second embodiment, but the information selecting section 100 in the second embodiment.

Embodiment 6 differs from Embodiment 2 in that an information selection unit 106 d, a microphone phone 501, and a speech recognition unit 502 are provided instead of 6a and the spatial position selection input unit 202. Hereinafter, points different from the second embodiment will be mainly described. The microphone 501 is a microphone 32 d or the like provided in the remote controller 32, and sends the voice uttered by the viewer to the voice recognition unit 502. The voice recognition unit 502 is a voice recognition device or the like that recognizes the voice of the viewer input to the microphone-mouth phone 501, performs voice recognition of the viewer, performs language processing and semantic analysis. The result is sent to the information selection unit 106 d.

The information selection unit 106 d calculates the video stream, the audio stream, and the time before and after the time indicated by the time information stored in the time information storage unit 201 after the end of program viewing or after viewing interruption. From the control unit 102a, and presents and outputs the video stream and the audio stream to the image display unit 104 and the audio output unit 105, as well as the audio recognition unit. By matching the recognition result of the viewer's voice sent from 502 with the product information described in the program additional information, an object corresponding to the voice uttered by the viewer (interested by the viewer) Products, etc.), and cut out image shots containing the specified objects from the video stream, extract product information corresponding to the objects from the program additional information, and extract those image shots. Kit and product information Are transmitted to the transmitting unit 108 as the selected information.

Next, the operation of broadcast receiving apparatus 500 according to the present embodiment configured as described above will be described.

FIG. 30 is a flowchart showing the operation procedure of broadcast receiving apparatus 500. FIG. 31 is a diagram showing a state of a dialogue between the viewer and the broadcast receiving device 500.

Now, suppose that the viewer has selected a time position using the time selection input section 103 during program viewing, as shown in FIG. 31 (a) (S500). For example, a viewer watching the scene in which A actor appeared appears to like the outerwear worn by A actor, and wants to tell a friend by all means. Sticky button 3 2a on remote controller 32 Suppose you press.

On the other hand, the signal for selecting the time position is input from the time selection input section 103. The control unit 102a that has received the time specifies the time, and stores it in the time information storage unit 201 as time information (S501).

When the viewer finishes or interrupts the viewing of the program, the information selection unit 106 d sets the video stream and audio of a certain section including the 0Φ increment indicated by the time information stored in the time information storage unit 201. The stream and the program additional information corresponding to the time are acquired from the control unit 102a, and the video stream and the audio stream are presented to the image display unit 104 and the audio output unit 105. In addition to the output, the viewer is prompted to input a voice for designating the object (S502).

On the other hand, as shown in the screen display example shown in FIG. 31 (b), when the viewer utters a voice specifying the object toward the microphone 501 (S503), the voice recognition unit 502 performs recognition, language processing, and semantic analysis of the voice input to the microphone 501, and based on the recognition result, the information selection unit 106d extracts the corresponding program additional information ( S504), the extracted information is sent to the transmission unit 108 as transmission information. For example, the program additional information corresponding to the time when the tag was attached is the content information shown in FIGS. 12 and 13, and when the viewer utters "Jacket J of actor A, the voice recognition The unit 502 recognizes the input speech, breaks it down into morphemes, and compares each noun with the product name etc. described in the additional information of the program, so that “actors j and ΓA” and Γ It is understood that the viewer has specified the object that matches the “jacket”, that is, “the jacket of the outerwear BJ Γ F jacket” in ΓA actor's clothing, and に関するThe product information is extracted from the program additional information and sent to the transmission unit 108.

Then, the transmission unit 108 reads out the destinations registered in the destination database 109 as shown in a screen display example shown in FIG. 31 (c), and sets the image display unit as a transmission destination list. Listed in 104, and from viewers, The selection or input of the transmission destination by the destination input unit 110 is accepted (S550). When the destination is determined, the transmission unit 108 directs the image shot, audio stream, and program additional information extracted by the information selection unit 106 d to the determined destination. And sends it via the network (S506).

As described above, according to the present embodiment, when a viewer finds an article to be introduced to a third party, a favorite product, or the like while watching a program, a sticky note button 32 of the remote controller 32 is used. By simply pressing a, the time position can be temporarily stored. Then, after the program ends or is interrupted, the object appearing in the video with the sticky note is specified by audio, so that the viewer can obtain detailed information of the object and an image shot including the object. Can be sent to a third party. Therefore, as compared with the first embodiment, the information to be transmitted to the third party can be narrowed down to only the information on the article to be introduced by simply giving a simple utterance toward the broadcast receiving apparatus 500, and the processing is simple. Thus, the message can be more accurately transmitted to a third party.

(Embodiment 6)

Next, a broadcast receiving apparatus according to Embodiment 6 of the present invention will be described. In the broadcast receiving apparatus according to the present embodiment, the viewer designates the time position of the program and the article appearing in the video at the time position at the same time by his / her own sound, and the product is narrowed down on an object basis. The feature is that information can be transmitted. The overall configuration of broadcast system 10 shown in FIG. 1 is common to the present embodiment.

FIG. 32 is a diagram illustrating a detailed configuration of the broadcast receiving apparatus 600 according to the present embodiment, that is, a broadcast receiving apparatus 600 that is an example of the broadcast receiving apparatus 31 a shown in FIG. It is a block diagram. This broadcast receiving apparatus 600 corresponds to the attachment of a tag to a received video by a viewer and the tag. It is a television broadcast receiver that can transmit various types of information to the outside on an object (in this case, a product that appears in a program) unit. Broadcast receiver 101, controller 102b, image display 1 04, sound output section 105, information selection section 106 e, transmission section 108, destination database 109, destination input section 110a, microphone / mouthphone 611, voice recognition section 6 0 2 and time 'recognition result table storage section 63.

The broadcast receiving apparatus 600 has substantially the same configuration as the broadcast receiving apparatus 100 in the first embodiment, but has a time selection input section 103 and a transmission information storage section 107 in the first embodiment. Instead, a microphone 61, a voice recognition unit 602 and time ■ a point including a recognition result table storage unit 603, and a control unit 102, an information selection unit 106 in the first embodiment, Instead of the destination input unit 110, a simplified control unit 102b, an information selection unit 106e with added functions, and a destination input unit 110a with added functions It differs from the first embodiment in that it is provided. Hereinafter, the same components as those of the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted.

The control unit 102 b corresponds to the function of the control unit 102 according to the first embodiment except for the processing for the time selection input unit 103. In other words, the program contents (video / audio stream) received by the broadcast receiving unit 101 are temporarily stored, and the program contents and the stored program contents are requested in response to a request from the information selecting unit 106 e. It sends program ancillary information to the information selection unit 106 e and controls each component to interact with the viewer.

The microphone 601 is a microphone microphone 3 2d or the like provided in the remote controller 32, and sends the voice uttered by the viewer to the voice recognition unit 602. When the voice of the viewer is transmitted from the microphone 601, the voice recognition unit 602 records the time (time stamp) at that time and transmits the voice. A speech recognition device or the like that recognizes the received speech, recognizes the viewer's speech, performs language processing and semantic analysis, and pairs recognition result information indicating the recognition result with time information indicating the recorded time. The time is stored in the recognition result table storage unit 603.

The time and recognition result table storage unit 603 is a memory or the like for temporarily storing the recognition result information and the time information sent from the speech recognition unit 602, for example, as shown in FIG. It has a data structure in which recognition result information and time information are stored in pairs.

The information selection unit 106 e reads the time information and the recognition result information stored in the recognition result table storage unit 603 after the end of program viewing or after the viewing is stopped, and sets the time indicated by the read time information. The program additional information before and after that is obtained from the control unit 102b. Then, from the acquired program additional information, product information corresponding to the recognition result information is extracted, and the extracted product information is presented and output to the image display unit 104, thereby prompting the viewer to confirm, and obtaining the confirmation. In this case, the image shot and the sound including the product information are read from the control unit 102b, and the product information, the image shot, and the sound are sent to the transmission unit 108.

The destination input section 11 Oa is an input means for the viewer to select a destination of transmission information from the destination database 109 and directly input a destination of transmission information. Not only the buttons of the remote controller 32, etc., but also the microphone 32d provided in the remote controller 32 and a recognition processing device for the voice inputted to the microphone mouthphone 32d. Is also included. Next, the operation of broadcast receiving apparatus 600 thus configured according to the present embodiment will be described.

FIG. 34 is a flowchart showing the operation procedure of broadcast receiving apparatus 600. FIG. 35 shows a dialogue between the viewer and the broadcast receiver 600. is there.

Now, suppose that the viewer utters a sound including the name of the object that appeared in the program while watching the program as shown in FIG. 35 (a) (S600). For example, a viewer watching the scene where A actor appeared appeared to like the red jacket worn by A actor, so I really wanted to tell a friend, and near the remote control controller 32, Suppose you say "nice jacket".

Then, the voice is input to the voice recognition unit 602 via the microphone 601, and the voice recognition unit 602 records the time at which the voice was input, and performs the voice recognition process. Then, the recognition result information indicating the recognition result and the time information indicating the recording time are paired and stored in the recognition result table storage unit 603 (S 602). ).

When the viewing of the program by the viewer ends or is interrupted, the information selection unit 106 e reads out the time information and the recognition result information stored in the recognition result table storage unit 603. After acquiring the additional information before and after the program including the indicated time from the control unit 102b, it performs linguistic processing and semantic analysis of the recognition result information, and from the acquired program additional information, the product information corresponding to the recognition result information Is extracted (S603). Then, the information selection unit 106 e presents and outputs the extracted product information to the image display unit 104 as shown in the screen display example shown in FIG. Prompts the utterance of the destination.

On the other hand, when the viewer confirms that the product of interest is displayed, and then selects or inputs a destination using the destination input unit 110a (S604), the transmitting unit 1 The information selection unit 106 e, which has received the notification from 08, reads the image shot and sound including the presented product information from the control unit 102b, and transmits And send it to the sending unit 108. Soshi Then, the transmitting unit 108 transmits the transmission information to the destination specified by the viewer via the network (S 605).

For example, when the viewer speaks, "Send it to Mr. B", the speech is recognized by the destination input unit 110a, and then the destination database 109 is referred to by the transmission unit 108. Then, the destination of “Mr. B” is specified, and the product information and the like are transmitted to the “Mr.

FIG. 36 shows the flowchart of FIG. 34 in more detail with respect to the interaction processing between the viewer and the broadcast receiving device 600. On the left side of the figure, the operation flow of the broadcast receiving device 600 is shown, and on the right side of the figure, the operation flow of the viewer is shown correspondingly.

When the viewer finds an article to introduce to a third party or a favorite product while watching the program, the viewer goes to the microphone 3 2d (601) provided in the remote controller 32 or the like. Then, an utterance for specifying the target product is made (S620). On the other hand, the speech recognition unit 602 identifies the uttered time, performs recognition processing on the uttered speech, and uses the time and the recognition result as time information and recognition result information. Time ■ Stored in the recognition result table storage unit 603 (S610).

When the viewing of the program by the viewer ends or is interrupted (S 6 21), the information selection unit 106 e reads the time information and the recognition result information stored in the recognition result table storage unit 603. After acquiring from the control unit 102b the program additional information before and after including the time indicated by the read time information, the recognition result information is subjected to language processing and semantic analysis, and the recognition result is obtained from the acquired program additional information. The object (product information) corresponding to the information is extracted (S611), presented and output to the image display unit 104, and the viewer is urged to confirm and utter the destination (S61). 2).

In response to this presentation, viewers see a confirmation screen of the object they uttered. Watch the image (S622), check whether there is something you want to introduce to the third person in the video (S622), and if you find something you want to introduce to the third party (Yes in S623), send to a third party, such as "Send it to Mr. B", to the destination input section 110a such as a microphone and a microphone provided in the remote controller 32. (S 6 2 4).

On the other hand, the transmission unit 108 monitors whether or not the viewer has given an instruction to specify the transmission destination (S613), and if the transmission destination is specified by the viewer (S61). (Yes in 3), and notifies the information selection unit 106 e of this. Upon receiving the notification, the information selection unit 106 e reads out the video ■ sound stream from the control unit 102 b, cuts out a section including the object (S 614), and cuts out the video. The stream (image shot, etc.) and the numerical value of the space-time layout of the object are corrected, and the content information of the finally selected object is combined (S615), and the transmission information and And sends it to the transmission unit 108.

FIG. 37 is a diagram illustrating the principle of specifying an object in the present embodiment. When a viewer finds an object to be transmitted to a third party while watching a program, the viewer emits a sound identifying the object, thereby attaching a sticky note to the video stream of the program and displaying the object. Can be specified at the same time. In other words, while watching a program, the time position in the video stream is specified in real time by the time of speech (by time stamp processing), and after the program is over, the time position of the speech spoken during program viewing is determined. Speech recognition enables further narrowing down to specific objects. Thus, the designation of the time position and the designation of the spatial position (identification of the object) are performed simultaneously with only one utterance.

As described above, according to the present embodiment, the viewer, while watching the program, When you find an article you want to introduce to a third party or find a product you like, just say a utterance that identifies the product, and put the time position and the product on a sticky note on the program. It can be stored temporarily. After the end or interruption of the program, after checking the video on which the user has attached a sticky note, by specifying the destination by utterance, etc., the image of the product appears along with the product information. Shots can be sent to a third party. Therefore, as compared with the first embodiment, the time position on the program and the object of the object to be transmitted to the third party by simply uttering the broadcast receiving apparatus 600 at the same time are specified at the same time. The message can be transmitted to a third party more accurately with simple operations. As described above, the program receiving apparatus according to the present invention has been described based on Embodiments 1 to 6, but the present invention is not limited to these embodiments.

For example, by arbitrarily combining the functions of the broadcast receiving apparatuses according to the first to sixth embodiments, a multi-functional broadcast receiving apparatus capable of attaching a tag by a plurality of methods may be configured. Specific examples are described below.

FIG. 38 is a diagram illustrating one broadcast receiving device 700 having functions of the broadcast receiving devices according to the first to sixth embodiments. The broadcast receiving device 700 has a broadcast receiving unit 701, a broadcast data storage unit 702, a button input unit 703, an audio input unit 704, a pointing device 705, and an image display unit 7. 06, sound output unit 707, control unit 710, video / audio signal processing unit 711, tag processing unit 712, voice recognition unit 713, transmission unit 714, destination database 711 5 and a destination determination unit 7 16.

The broadcast receiving unit 701 corresponds to the broadcast receiving unit 101 in the above embodiment, and the broadcast data storage unit 702 is the control unit 10 in the above embodiment. 2, 102 a and 102 b correspond to a built-in storage unit, and the button input unit 703 and the pointing device 705 are the time selection input unit 103 and the destination input unit in the above embodiment. 110, the voice input unit 704 corresponds to the microphone microphones 501, 601 in the above embodiment, and the image display unit 706 corresponds to the image display in the above embodiment. The sound output unit 707 corresponds to the sound output unit 105 in the above embodiment, and the control unit 710 and the video / audio signal processing unit 711 correspond to the above embodiment. Control unit 102, 1022a, 102b and its signal processing function in the embodiment. In the tag processing section 7 12, the tag information storage section 7 12 a stores the time information storage section 201, the transmission information storage section 107, and the time-recognition result table storage section 60 3 in the above embodiment. Correspondingly, the information selection unit 712 b is a processing unit having the functions of the information selection units 106, 106b, 106c, 106d, and 106e in the above embodiment. The voice recognition unit 711 corresponds to the voice recognition function of the voice recognition unit 502, the voice recognition unit 602, and the destination input unit 110a in the above embodiment, and the transmission unit 714 Corresponds to the transmitting section 108 in the above embodiment, the destination database 715 corresponds to the destination database 109 in the above embodiment, and the destination determining section 716 corresponds to the above embodiment. Correspond to the destination input sections 110 and 110a. The tag processing unit 712 of the broadcast receiving device 700 specifies an object appearing in the program (sticking process of a tag) according to a preset operation mode. For example, as shown in the table of FIG. 39, when the operation mode “1” is set, the time position of the sticky note is determined by the button input section 703, the voice input section 704, and the like.決定 Determined by a predetermined input from one of the pointing devices 705, and the object in the image at that time position is specified by automatically searching for all objects registered in the program additional information. In operation mode Γ2, The position is specified by the button input unit 703 and the pointing device 705, and in the operation mode “3”, a list of objects included in the video at the specified time position is displayed, and the button input unit An object is specified by the input device 703 and the pointing device 705. In the operation mode “4”, the object is specified by inputting a character string using the button input unit 703 and the pointing device 705. In the operation mode “5”, an object is specified by the sound input to the audio input unit 704, and in the operation mode “6”, the time is determined by the sound input to the audio input unit 704. The position and the spatial position (object) are specified at the same time.

According to the broadcast receiving apparatus 700 having such a configuration, the viewer selects a desired mode from six types of user interfaces (operation modes) in advance with respect to the method of attaching the tag. With this setting, you can attach a tag while viewing a program and send that information to a third party in a way that suits you.

Further, in the above-described embodiment, a tag is attached in real time to the broadcast data transmitted from the broadcasting station 20, but the data to be attached with the tag is a broadcast receiving device. The broadcast data may be broadcast data stored in advance. That is, the present invention can be realized not only as a broadcast receiving device, but also as a recording / playback device for playing back stored broadcast data.

For example, a program display device that acquires and displays program data including a video stream and additional information associated with an object appearing in a video indicated by the video stream, and acquires the program data Display means for receiving and displaying predetermined input processing by the operator; recording means for recording time information indicating the time at which the input processing was performed; and time information recorded by the recording means. Displayed by the display means at the time corresponding to the time Target specifying means for specifying a target appearing in the video indicated by the indicated video stream; extracting means for extracting information on the specified target from the additional information obtained by the display means; The present invention can also be realized as a program display device including transmission means for transmitting information about an object to a designated destination via a communication path. This makes it possible to attach the tag according to the present invention to storage-type broadcast data or playback data of a previously recorded program.

In the sixth embodiment, the time position and the spatial position (object) of the product appearing in the program based on the utterance of the viewer during the viewing of the program are specified. Although the transmission destination was specified by the utterance of, these three types of specification may be performed simultaneously. For example, if the viewer utters, "Let's look good on that jacket, Mr. B" while watching the program, the time position is specified from the utterance time by voice recognition or the like of the broadcast receiver, and the voice Γ The destination may be specified from the “Jacket”, and the object is specified, and the voice “to the person”. Thus, the viewer can complete the attachment of the tag and the designation of the transmission destination for each object by one utterance during the viewing of the program.

Further, the program receiving apparatus of the present invention can be applied not only to television broadcasting using terrestrial waves, satellites, and CATV, but also to video distribution systems using the Internet using a data communication network. That is, the present invention can be applied to any communication system that distributes the program contents and the program additional information in the above embodiment.

Further, in the above embodiment, the related URL transmitted from the broadcast receiving device 31a to the third party is a web site that provides information related to the object (product) transmitted to the third party. URL, but instead, or in addition, the product is registered as a URL to be sent to a third party. The URL may be a Web site that distributes the program itself on demand. As a result, a third party who receives the product information including the URL on a PC or the like receives the URL on the PC when he / she does not see the program on which the product appeared and wishes to view the program. Click to view the program.

In addition, in the above embodiment, the additional information is described in conformity with MPEG7, but a format for electronic commerce such as c XML, x CB, eb XML or CIIZX ML is used to describe product information and the like. It may be described according to.

In addition, information that is not included in the e-commerce format may be described according to the format that describes the detailed information attached to the product.

In addition, in the above embodiment, the additional information is described in conformity with MPEG7. However, in order to describe copyrighted information such as music, the format as shown in FIGS. It may be described according to the description format.

Further, in the above embodiment, the additional information is described in conformity with MPEG7, but may be described in accordance with a voice data format such as VoiceXML in order to describe voice information and the like. Industrial potential

The present invention is directed to a program receiving apparatus or the like for receiving and displaying program data distributed in a terrestrial broadcast, satellite broadcast, CATV, or other television broadcast, or in a video distribution system over the Internet using a data communication network. In particular, it can be used as a program receiving device or the like that can mark targets appearing in a program.

Claims

The scope of the claims

1. A program receiving apparatus for receiving program data including a video stream and additional information associated with an object appearing in a video indicated by the video stream,

Receiving means for receiving and storing the program data;

Input means for receiving predetermined input processing by the operator;

Recording means for recording time information indicating the time at which the input processing was performed; and by referring to the program data re-received by the reception means, the time indicated by the time information recorded in the recording means Target specifying means for specifying a target appearing in the video indicated by the video stream received by the receiving means at a corresponding time;

Extracting means for extracting information on the specified object from among the additional information received by the receiving means;

Transmitting means for transmitting the extracted information on the target to a designated destination via a communication path;

A program receiving apparatus comprising:

2. The additional information includes information for identifying a target appearing in the video and information on the target in association with each other,

The information for identifying the target includes a time position of the frame image including the target image in the video stream and a spatial position of the target image in the frame image,

The target specifying unit specifies the target by referring to at least one of the time position and the spatial position included in the additional information, and the extraction unit determines the association included in the additional information. Extract information about the object by reference 2. The program receiving apparatus according to claim 1, wherein:

3. The program data further includes an audio stream and an audio stream,

The additional information is further associated with an object appearing in the audio stream and the audio stream.

2. The program receiving apparatus according to claim 1, wherein:

4. The subject includes not only objects but also works and services that include music.

2. The program receiving apparatus according to claim 1, wherein:

5. The target specifying means presents, to the operator, the video indicated by the video stream received by the receiving means at a time corresponding to the time, and sets the target according to the operator's instruction for the presentation. Identify

2. The program receiving apparatus according to claim 1, wherein:

6. The target specifying means specifies the target in accordance with the designation of the spatial position of the video with respect to the presentation by the operator.

6. The program receiving device according to claim 5, wherein:

7. The target specifying means presents to the operator a list of targets appearing in the video together with the video, and specifies the target according to a selection instruction by the operator for the presentation

6. The program receiving device according to claim 5, wherein:

8. The target specifying means obtains a character string from an operator and specifies the target according to the obtained character string.

6. The program receiving device according to claim 5, wherein: 9. The target specifying means obtains an operator's voice, and specifies the target according to the obtained voice.

6. The program receiving device according to claim 5, wherein:

10. The input unit according to claim 1, wherein the input unit receives an utterance by an operator as input processing, and the recording unit records time information indicating a time at which the utterance was performed. Program receiving device.

11. The target specifying unit specifies the target by performing voice recognition on the utterance accepted by the input unit.

10. The program receiving device according to claim 10, wherein:

12. The extraction unit further extracts video data indicating a video in which the target appears from the video stream received by the reception unit, and the transmission unit outputs the video data together with information on the target. Transmitting the video data to the destination

2. The program receiving apparatus according to claim 1, wherein:

1 3. The program data includes an audio stream,

The extracting means further extracts audio data corresponding to the video data from the audio stream received by the receiving means,

The transmitting means, together with information about the object and the video data, Sending the audio data to the destination

13. The program receiving apparatus according to claim 12, wherein:

14. The transmission / reception device further includes transmission message acquisition means for acquiring a transmission message from an operator,

The transmission unit transmits the transmission message acquired by the transmission message acquisition unit to the destination together with the information on the target, the video data and the audio data.

13. The program receiving apparatus according to claim 13, wherein:

15. The transmitting unit transmits only information selected from the information on the target, the video data, the audio data, and the transmission message to the destination according to an attribute of a reception function of the destination. Do

15. The program receiving apparatus according to claim 14, wherein:

16. The additional information includes product information indicating the names and characteristics of the objects appearing in the video,

The extracting means extracts product information of the target specified by the target specifying means,

The transmitting means transmits the extracted product information.

2. The program receiving apparatus according to claim 1, wherein:

17. The additional information includes an information source address indicating a location of an information source in which information on an object appearing in the video is placed,

The extracting means extracts an information source address of the target specified by the target specifying means, The transmitting means transmits the extracted information source address

2. The program receiving apparatus according to claim 1, wherein:

18. A program receiving method for receiving program data including a video stream and additional information associated with an object appearing in a video indicated by the video stream,

A receiving step of receiving and storing the program data; an input step of receiving a predetermined input process by an operator; a recording step of recording time information indicating a time at which the input process was performed;

By referring to the program data received in the receiving step, the target appearing in the video indicated by the video stream received at the time corresponding to the time indicated by the time information recorded in the recording step is recorded. What to identify

An extracting step of extracting information on the identified object from the additional information received in the receiving step;

A transmitting step of transmitting the extracted information on the target to a designated destination via a communication path;

A program receiving method, comprising:

19. A program for a program receiving apparatus for receiving program data including a video stream and additional information associated with an object appearing in a video indicated by the video stream,

Making a computer execute the steps included in the program receiving method described in claim 18

A program characterized by the following.

20. A program display device for acquiring and displaying program data including a video stream and additional information associated with an object appearing in a video indicated by the video stream,

Display means for acquiring and displaying the program data,

Input means for receiving predetermined input processing by the operator;

Recording means for recording time information indicating the time at which the input processing was performed; and a video stream displayed by the display means at a time corresponding to the time indicated by the time information recorded by the recording means. An object identification means for identifying an object appearing in the video shown by

Extracting means for extracting information on the specified object from the additional information obtained by the display means;

A program display device comprising:

21. A program data display method for acquiring and displaying program data including a video stream and additional information associated with an object appearing in a video indicated by the video stream,

A display step of acquiring and displaying the program data;

An input step of receiving a predetermined input process by an operator; and a recording step of recording time information indicating a time at which the input process is performed;

A target specifying step of specifying a target appearing in the video indicated by the video stream displayed at a time corresponding to the time indicated by the time information recorded in the recording step; An extracting step of extracting information about the specified target from the additional information obtained in the displaying step;

A program data display method comprising:

22. A program for a program display device for acquiring and displaying program data including a video stream and additional information associated with an object appearing in a video indicated by the video stream,

Making a computer execute the steps included in the program data display method described in claim 21

A program characterized by the following.