JP3884016B2 - Information processing apparatus, information processing method, program, and information processing system - Google Patents

Description

  The present invention relates to an information processing device, an information processing method, a program, and an information processing system, and is particularly suitable for searching for a recorded broadcast program using caption information included in a broadcast signal. The present invention relates to an information processing device, an information processing method, a program, and an information processing system.

  Broadcast program data includes video data and audio data. In addition to the so-called captions (introduction of program titles and casts, or Japanese captions in overseas works) that are always displayed as video data, the program data can be selected to be displayed or not. Contains data. Such selectable subtitle data is generally referred to as closed captioning, and is mainly developed for hearing-impaired people. Like Japanese subtitles in overseas works, not only the conversation of performers, for example, Explanation of BGM and sound effects is also included.

  For example, in NTSC analog terrestrial broadcasting, 525 scanning lines are used for video signals. Of these 525 lines, the first 21 lines in each field (one field consists of two fields) And VBI (Vertical Blanking Interval), which is called an interval for starting scanning. Closed captions are transmitted by multiplexing a 7-bit character code in the 21st VBI of the VBIs in each field, and each field is used to transmit two types of character sets to approximately 60 characters per second. It can be transmitted.

  As for the transmission of caption information for digital television broadcasting, as defined in the BS digital broadcasting operation regulations and technical materials (ARIB TR-B15), which are domestic regulations, video using a transport stream for caption information is used. Caption information can be transmitted simultaneously with information transmission. Then, in the digital television broadcast receiver, the code corresponding to the caption information is decoded, characters and figures constituting the caption are generated, and displayed superimposed on the video.

  There are two main types of closed caption creation methods. One is when subtitles are added later to a program that has been completed in advance, such as a drama (referred to as offline subtitles), and the other is, for example, in live broadcasts such as news and sports broadcasts. This is a case where subtitles are added simultaneously with broadcasting (referred to as online subtitles). When subtitles are added later, the text data corresponding to the subtitle data created based on the broadcast program is displayed in the broadcast signal so that it is displayed at the optimal time according to the video and audio to be broadcast. Synthesized. And when subtitles are given at the same time as broadcasting, for example, multiple specializations cooperate to input text at high speed with a special word processor while referring to the program currently being broadcast, or an automatic speech recognition device The text data corresponding to the subtitle data to be displayed in the currently broadcast program is generated by converting the voice broadcast using the text data into text data, and is synthesized with the broadcast program.

  In digital television broadcasting, text information transmitted simultaneously with video information transmission using a transport stream for subtitle information can be stored internally, and the text information stored internally can be displayed and viewed on a TV monitor at any time. By making it possible, there is a technique that allows a user to utilize subtitle information without taking a note of the displayed subtitle (for example, Patent Document 1).

JP 2003-78889 A

  Also, the CM program, text information, or communication data is automatically saved by the viewer's operation or received subtitle broadcast, and the broadcast station or CM provider uses the saved information by the viewer. There is a technique that enables the purchase of CM merchandise by communicating with (for example, Patent Document 2).

JP 2002-77772 A

  In addition, the video data and the audio data in the broadcast signal are, for example, not to be watched in real time at the time of broadcasting, for example, so that the time axis is not shifted when recorded and reproduced, for example, Have corresponding link information or have a time stamp of relative time. On the other hand, caption data does not have link data for video data or audio data, a time stamp of relative time, or the like.

  As described above, the caption data to be broadcast has begun to be used for various services.

  However, when subtitle data that is broadcast such as closed captions is used to search for recorded programs, subtitle data and video data or audio data are either analog broadcast or digital broadcast. Since a time stamp that matches the two is not added, after separating the text data corresponding to the closed caption from the video data, it is impossible to take a correspondence between the separated text and the video data. Therefore, the text obtained from the closed caption cannot be used for searching the recorded data.

  Further, when the broadcast program is a live broadcast rather than a recorded one, as described above, a plurality of specializations cooperate to input text at a high speed with a special word processor while referring to the currently broadcast program. Alternatively, text data corresponding to subtitle data to be displayed in a currently broadcast program is generated by converting voice broadcast using an automatic voice recognition device into text data, and so on. The text data combined with the program is delayed by the time required for generating the text data, compared to the actual video and audio.

  Therefore, when the text acquired from closed captions can be used to search for recorded data, subtitle text data corresponding to live broadcasting is required for text data generation compared to actual video and audio. Since it is delayed by the time, there is a possibility that a part that is delayed in time is searched as a part corresponding to the text with respect to the broadcast data that the user really needs.

  The present invention has been made in view of such a situation. When subtitle data such as so-called closed captions is used to search recorded data, the subtitle data of actual broadcast data is, for example, live broadcasting. This makes it possible to perform a search process correctly even when the user is late with respect to the voice.

The information processing system of the present invention, configured as a search key text information, the third information processing apparatus for generating meta data used for the search processing executed by the second information processing apparatus for searching the recorded data In the information processing system, the second information processing apparatus uniquely distinguishes between the first time information and the broadcast signal program acquired and processed by the first information processing apparatus that acquires and processes the broadcast signal. Recorded data storage control means for controlling storage of recorded data to which possible distinction information is added, metadata acquisition means for acquiring encrypted metadata, and used for decrypting encrypted metadata A decryption key obtaining unit for obtaining the decryption key to be obtained, and decrypting the encrypted metadata obtained by the metadata obtaining unit using the decryption key obtained by the decryption key obtaining unit Decoding processing means, discrimination information for distinguishing recorded data programs decoded by the decoding processing means, text data relating to the recording data, and metadata including second time information corresponding to the text data are stored. A metadata storage means, an operation input means for receiving a user's operation input, information for designating a program to be searched and text information used as a search key input from the user by the operation input means, and a metadata storage means Matching processing means for executing matching processing with stored metadata to detect second time information corresponding to text information as a search key, and recorded data whose storage is controlled by the recorded data storage control means To search for a recording position corresponding to the second time information detected by the matching processing means, It is provided with a search unit for reading the recorded data starting from the recording position, the third information processing apparatus, the second broadcast signal acquisition means for acquiring a broadcast signal, acquired by the second broadcast signal acquisition means Second information for uniquely distinguishing the broadcast signal program from the audio signal decoding means for decoding the audio signal included in the broadcast signal and the broadcast signal acquired by the second broadcast signal acquisition means. A subtitle data decoding unit that extracts and decodes subtitle data that can be selected by the user from the broadcast signal acquired by the second broadcast signal acquisition unit; Start of each of the audio data decoded by the data decoding means and the text data corresponding to the caption data decoded by the caption data decoding means Based on the comparison result, the time code adding means for adding the time code to the text data and the text data to which the time code is added by the time code adding means are acquired by the second distinction information acquiring means. And a metadata generation unit that generates metadata by adding the identification information, and an encryption unit that encrypts the metadata generated by the metadata generation unit.
Another information processing system of the present invention includes a first information processing apparatus that acquires and processes a broadcast signal, a second information processing apparatus that searches recorded data using text information as a search key, and a second information processing apparatus. In the information processing system configured with the third information processing apparatus that generates metadata used for the search processing executed by the information processing apparatus, the first information processing apparatus obtains the broadcast signal. Broadcast signal acquisition means, first distinction information acquisition means for acquiring distinction information capable of uniquely distinguishing a broadcast signal program from the broadcast signal acquired by the first broadcast signal acquisition means, and first broadcast An information adding means for generating recorded data by adding the first time information and the discrimination information acquired by the first discrimination information acquisition means to the broadcast signal acquired by the signal acquisition means; Information office The apparatus includes: a recording data storage control unit that controls storage of recording data to which the first time information and the discrimination information are added; a metadata acquisition unit that acquires encrypted metadata; and an encrypted metadata Decryption key acquisition means for acquiring a decryption key used for decrypting data, and decryption of the encrypted metadata acquired by the metadata acquisition means using the decryption key acquired by the decryption key acquisition means Decoding processing means, discrimination information for distinguishing recorded data programs decoded by the decoding processing means, text data relating to the recording data, and metadata including second time information corresponding to the text data are stored. A metadata storage means, an operation input means for receiving a user's operation input, and a program to be searched, which is input from the user by the operation input means. Matching processing means for detecting second time information corresponding to the text information serving as the search key by executing matching processing between the information to be performed and the text information serving as the search key and the metadata stored by the metadata storage means And the recording data corresponding to the second time information detected by the matching processing means from the recording data whose storage is controlled by the recording data storage control means, and the recording data started from the searched recording position The third information processing apparatus decodes the audio signal included in the broadcast signal acquired by the second broadcast signal acquisition means and the second broadcast signal acquisition means for acquiring the broadcast signal. The broadcast signal program can be uniquely distinguished from the broadcast signal acquired by the audio data decoding means and the second broadcast signal acquisition means. Extract and decode subtitle data that can be selected by the user as to whether or not to display from the second distinction information acquisition means for acquiring different information and the broadcast signal acquired by the second broadcast signal acquisition means Subtitle data decoding means, and the audio data decoded by the audio data decoding means and the text data corresponding to the subtitle data decoded by the subtitle data decoding means are compared with each other, and the text data is based on the comparison result. A time code adding means for adding a time code to the text data, and adding the discrimination information acquired by the second discrimination information acquiring means to the text data to which the time code is added by the time code adding means to generate metadata. Metadata generating means and encryption for encrypting metadata generated by the metadata generating means Characterized in that it comprises a means.
Still another information processing system according to the present invention includes a first information processing device that acquires and processes broadcast signals, a second information processing device that searches recorded data using text information as a search key, and a first information processing device. A third information processing device that generates metadata used for search processing executed by the second information processing device, and decoding that decodes metadata used for search processing executed by the second information processing device A fourth information processing device for supplying a key, and the first information processing device acquires a first broadcast signal acquisition unit for acquiring a broadcast signal, and a broadcast signal acquired by the first broadcast signal acquisition unit. From the first distinction information acquisition means for acquiring the distinction information that can uniquely distinguish the program of the broadcast signal, the first time information and the first time information in the broadcast signal acquired by the first broadcast signal acquisition means Differentiated information acquisition means And an information adding unit that generates recorded data by adding the acquired discrimination information, and the second information processing apparatus controls storage of the recorded data to which the first time information and the discrimination information are added. Recording data storage control means, metadata acquisition means for acquiring encrypted metadata, decryption key acquisition means for acquiring a decryption key used for decrypting the encrypted metadata, and metadata acquisition means The decryption processing unit that decrypts the encrypted metadata acquired by the decryption key acquisition unit using the decryption key acquired from the decryption key acquisition unit, and the discrimination for distinguishing the program of the recorded data decrypted by the decryption processing unit Metadata storage means for storing information, text data relating to recorded data, and metadata including second time information corresponding to the text data, and user operation input Performs a matching process between the received operation input means, information specifying a program to be searched and text information serving as a search key input from the user by the operation input means, and the metadata stored in the metadata storage means Then, the matching processing means for detecting the second time information corresponding to the text information serving as the search key and the recorded data whose storage is controlled by the recorded data storage control means are detected by the matching processing means. Search means for searching for a recording position corresponding to the time information, and reading means for reading out recording data starting from the searched recording position, wherein the third information processing apparatus acquires a second broadcast signal. Means, audio data decoding means for decoding the audio signal included in the broadcast signal acquired by the second broadcast signal acquisition means, Obtained from the broadcast signal obtained by the second broadcast signal obtaining means by second distinction information obtaining means for obtaining distinction information capable of uniquely distinguishing the program of the broadcast signal, and obtained by the second broadcast signal obtaining means. Subtitle data decoding means that extracts and decodes subtitle data that can be selected by the user from the broadcast signal, and the audio data decoded by the audio data decoding means and the subtitle data decoding means. The text data corresponding to the subtitle data is compared with each other, and based on the comparison result, the time code adding means for adding the time code to the text data, and the text data with the time code added by the time code adding means To generate the metadata by adding the identification information acquired by the second identification information acquisition means Metadata generation means and encryption means for encrypting the metadata generated by the metadata generation means, and the fourth information processing apparatus receives information related to user authentication from the second information processing apparatus. Authentication information acquisition means to be acquired, registration information storage control means for controlling storage of user registration information, user authentication information acquired by the authentication information acquisition means, and storage is controlled by the registration information storage control means Authentication processing means for executing authentication processing based on registered user information, and supply of a decryption key for decrypting metadata to the second information processing apparatus when the user is correctly authenticated by the authentication processing means And a decryption key supply control means for controlling.

  According to the first aspect of the present invention, a time code can be added to metadata, and in particular, a time when text data as a basis of metadata is added to video data and a time of corresponding audio data are determined. When they are different from each other, it is possible to add a time code in which the time difference is corrected to the metadata.

  According to the second aspect of the present invention, recorded data can be searched using metadata, and in particular, recorded data having time information corresponding to text data and discriminating information for distinguishing a program is generated. Even when the time when the text data to be added to the video data is different from the time of the corresponding audio data, metadata with a time code with corrected time deviation is generated Therefore, it is possible to accurately search a portion desired by the user in the recorded data.

  Embodiments of the present invention will be described below. The correspondence relationship between the invention described in this specification and the embodiments of the invention is exemplified as follows. This description is intended to confirm that the embodiments supporting the invention described in this specification are described in this specification. Therefore, even if there is an embodiment that is described in the embodiment of the invention but is not described here as corresponding to the invention, the fact that the embodiment is not It does not mean that it does not correspond to the invention. Conversely, even if an embodiment is described herein as corresponding to an invention, that means that the embodiment does not correspond to an invention other than the invention. Absent.

  Further, this description does not mean all the inventions described in this specification. In other words, this description is for the invention described in the present specification, which is not claimed in this application, that is, for the invention that will be applied for in the future or that will appear and be added by amendment. It does not deny existence.

As a reference example, the following information processing apparatus (for example, the metadata creation server 6 in FIGS. 5 and 6, the display selection subtitle decoder 351 in FIG. 21, or the display selection subtitle decoder 401 in FIG. 25) acquires a broadcast signal. Broadcast signal acquisition means (for example, the broadcast data acquisition unit 141 in FIG. 6 or the input terminal 21 in FIG. 21 or FIG. 25) and audio for decoding the audio signal included in the broadcast signal acquired by the broadcast signal acquisition means Whether to display by the user from the data decoding means (for example, the decoder 142 in FIG. 6 or the audio signal decoder 34 in FIG. 21 or FIG. 25) and the broadcast signal acquired by the broadcast signal acquisition means Subtitle data decoding means (for example, display selection subtitle data 17 in FIG. 2) that can be extracted and decoded 6, the display selection subtitle data decoder 145 of FIG. 6 or the display selection subtitle data decoder 35 of FIG. 21 or FIG. 25, and the audio data decoded by the audio data decoding means and the subtitle data decoded by the subtitle data decoding means. Time code adding means for comparing the start times of the corresponding text data and adding a time code to the text data based on the comparison result (for example, the time code addition processing unit 147 of FIG. 6 or FIG. 21 or FIG. 25 time code addition processing units 372).

  Differentiation information acquisition means (for example, the program ID information extraction unit 143 in FIG. 6) that acquires identification information (for example, program ID) that can uniquely distinguish the program of the broadcast signal from the broadcast signal acquired by the broadcast signal acquisition means. Alternatively, the discrimination information adding means (the program ID information extracting section 39 in FIG. 21 or FIG. 25) and the discrimination information adding means for adding the discrimination information acquired by the discrimination information acquiring means to the text data to which the time code is added For example, the metadata generation unit 144 in FIG. 6 or the metadata generation unit 374 in FIG. 21 or FIG. 25 can be further provided.

  An encryption unit (for example, the encryption processing unit 149 in FIG. 6 or the encryption processing unit 412 in FIG. 25) for encrypting the text data to which the time code is added by the time code adding unit can be further provided.

The following information processing method as a reference example is an information processing device that generates metadata used for search processing executed by another device (for example, the metadata creation server 6 in FIGS. It is an information processing method of the display selection subtitle decoder 351 or the display selection subtitle decoder 401 of FIG. 25, and is a broadcast signal acquisition step of acquiring a broadcast signal (for example, step S61 of FIG. 13 or step S241 of FIG. 22). And subtitle data decoding step (for example, display subtitle data 17 that can be selected by the user from the broadcast signal) (for example, display selection subtitle data 17 in FIG. Step S63 in FIG. 13, step S262 in FIG. 23, or step S302 in FIG. Text corresponding to the caption data based on the comparison result and comparing the start times of the caption data decoded by the processing of the audio signal and the audio signal included in the broadcast signal acquired by the processing of the broadcast signal acquisition step. A time code adding step (for example, step S65 in FIG. 13, step S264 in FIG. 23, or step S304 in FIG. 26) for adding a time code to the data.

Moreover, also in the program shown below as a reference example, the embodiment (however, an example) to which each step corresponds is the same as the information processing method described above .

The information processing system shown below as a reference example searches for recorded data using a first information processing apparatus (for example, the display selection subtitle decoder 3 in FIG. 3) that acquires and processes a broadcast signal, and text information as a search key. An information processing system configured with a second information processing apparatus (for example, the home server 4 in FIG. 3), wherein the first information processing apparatus obtains a first broadcast signal acquisition unit ( For example, the identification information (for example, program ID) that can uniquely distinguish the program of the broadcast signal from the input signals 21-1 and 21-2 in FIG. 3 and the broadcast signal acquired by the first broadcast signal acquisition means. The first time information (for example, FIG. 4) is added to the broadcast signal acquired by the first distinction information acquisition unit (for example, the program ID information extraction unit 39 in FIG. 3) and the first broadcast signal acquisition unit. Open recording Information adding means (for example, the output signal generating unit 33 in FIG. 3) for generating recording data by adding the time information 95) and the discriminating information acquired by the first discriminating information acquiring means, The information processing apparatus corresponds to discrimination information (for example, program ID 167 in FIG. 8) for distinguishing a program of recorded data, text data related to the recorded data (for example, text data 165 in FIG. 8), and text data. Metadata storage means (for example, the metadata storage unit 78 of FIG. 3) for storing metadata (for example, the metadata 161 of FIG. 8) including the second time information (for example, the time code 166 of FIG. 8); Recording data storage control means (for example, the recording data storage unit 72 in FIG. 3) for controlling storage of the recording data to which the first time information and the discrimination information are added. And butterflies.
An operation input means (for example, the operation input unit 71 in FIG. 3) that receives user's operation input, information that is input from the user by the operation input means to specify a program to be searched, and text information that serves as a search key; Matching processing means (for example, matching processing section 79 in FIG. 3) that executes matching processing with the metadata stored in the metadata storage means and detects second time information corresponding to the text information that is the search key. And the recording data corresponding to the second time information detected by the matching processing means from the recording data whose storage is controlled by the recording data storage control means, and the recording data started from the searched recording position Can be further provided with search means (for example, recorded data search output unit 80 in FIG. 3).
The information processing system shown below as a reference example searches for recorded data using a first information processing apparatus (for example, the display selection subtitle decoder 3 in FIG. 3) that acquires and processes a broadcast signal, and text information as a search key. An information processing system configured with a second information processing apparatus (for example, the home server 4 in FIG. 3), wherein the first information processing apparatus obtains a first broadcast signal acquisition unit ( For example, the identification information (for example, program ID) that can uniquely distinguish the program of the broadcast signal from the input signals 21-1 and 21-2 in FIG. 3 and the broadcast signal acquired by the first broadcast signal acquisition means. The first time information (for example, FIG. 4) is added to the broadcast signal acquired by the first distinction information acquisition unit (for example, the program ID information extraction unit 39 in FIG. 3) and the first broadcast signal acquisition unit. Open recording Information adding means (for example, the output signal generating unit 33 in FIG. 3) for generating recording data by adding the time information 95) and the discriminating information acquired by the first discriminating information acquiring means, The information processing apparatus includes a recording data storage control unit (for example, the recording data storage unit 72 in FIG. 3) that controls storage of the recording data to which the first time information and the discrimination information are added, and an encrypted meta data. Metadata acquisition means for acquiring data (for example, the network interface 73 in FIG. 3) and decryption key acquisition means for acquiring a decryption key used for decrypting the encrypted metadata (for example, the network interface in FIG. 3) 73) and decryption processing means for decrypting the encrypted metadata acquired by the metadata acquisition means using the decryption key acquired by the decryption key acquisition means For example, the decoding processing unit 77 in FIG. 3, the discrimination information (for example, the program ID 167 in FIG. 8) that is decoded by the decoding processing means, and the text data related to the recording data (for example, FIG. Metadata storage means for storing metadata (for example, metadata 161 in FIG. 8) including second text data 165) and second time information corresponding to the text data (for example, time code 166 in FIG. 8). (For example, the metadata storage unit 78 in FIG. 3), an operation input unit (for example, the operation input unit 71 in FIG. 3) that receives the user's operation input, and a search input from the user by the operation input unit is executed. A matching process between information specifying a program and text information serving as a search key and metadata stored by the metadata storage means is executed. From the matching processing means (for example, the matching processing section 79 in FIG. 3) for detecting the second time information corresponding to the text information as the search key and the recorded data whose storage is controlled by the recorded data storage control means. Search means for searching for a recording position corresponding to the second time information detected by the processing means, and reading recorded data starting from the searched recording position (for example, the recording data search output unit 80 in FIG. 3); It is characterized by providing.
The information processing system according to claim 1 is a third information processing apparatus that generates metadata used in a search process executed by the second information processing apparatus that searches recorded data (for example, in FIGS. 5 and 6). An information processing system configured by the metadata creation server 6), wherein the second information processing apparatus records recording data storage control means for controlling storage of recording data to which the first time information and the discrimination information are added. (For example, the recorded data storage unit 72 in FIG. 3), metadata acquisition means for acquiring encrypted metadata (for example, the network interface 73 in FIG. 3), and decryption of the encrypted metadata The decryption key acquisition means (for example, the network interface 73 in FIG. 3) for acquiring the decryption key to be used, and the encrypted memory acquired by the metadata acquisition means. In order to distinguish the decryption processing means (for example, the decryption processing unit 77 in FIG. 3) that decrypts the data using the decryption key obtained by the decryption key obtaining means and the program of the recorded data decrypted by the decryption processing means. Discriminating information (for example, program ID 167 in FIG. 8), text data related to the recorded data (for example, text data 165 in FIG. 8), and second time information corresponding to the text data (for example, time code 166 in FIG. 8). ) Including metadata (for example, metadata 161 in FIG. 8) and operation input means for receiving user operation input (for example, FIG. 3). The operation input unit 71) and information input from the user by the operation input means for specifying a program to be searched and text information as a search key Matching processing means (for example, the matching processing unit 79 in FIG. 3) that executes matching processing with the metadata stored in the metadata storage means and detects second time information corresponding to the text information serving as the search key. ) And the recording data whose storage is controlled by the recording data storage control means, the recording position corresponding to the second time information detected by the matching processing means is retrieved, and the recording that starts from the retrieved recording position The third information processing apparatus includes a second broadcast signal acquisition unit (for example, broadcast data of FIG. 6) that acquires a broadcast signal, and includes a search unit for reading data (for example, the recorded data search output unit 80 of FIG. 3). Acquisition unit 141) and audio data decoding means (for example, FIG. 5) for decoding an audio signal included in the broadcast signal acquired by the second broadcast signal acquisition means. 6) and second discrimination information acquisition means for acquiring discrimination information (for example, program ID) that can uniquely distinguish a program of the broadcast signal from the broadcast signal acquired by the second broadcast signal acquisition means. (For example, the program ID information extracting unit 143 in FIG. 6) and subtitle data (for example, FIG. 6) that can be selected by the user from the broadcast signal acquired by the second broadcast signal acquisition unit. 2 subtitle data decoding means (for example, display selection subtitle data decoder 145 in FIG. 6), and the audio data decoded by the audio data decoding means and the subtitle data decoding means. Compare the start times of the text data corresponding to the subtitle data, and based on the comparison results, The time code adding means to be added (for example, the time code addition processing unit 147 in FIG. 6) and the text information to which the time code is added by the time code adding means, the discrimination information acquired by the second discrimination information acquiring means. In addition, metadata generation means (for example, the metadata generation unit 144 in FIG. 6) for generating metadata, and encryption means (for example, in FIG. 6) for encrypting the metadata generated by the metadata generation means. And an encryption processing unit 149).
The information processing system shown below as a reference example uses a text information as a search key to supply a decryption key for decrypting metadata used in a search process executed by a second information processing apparatus that searches recorded data. 4 is an information processing system configured by four information processing apparatuses (for example, the accounting server 7 in FIGS. 9 and 10), and the fourth information processing apparatus receives information related to user authentication from the second information processing apparatus. Authentication information acquisition means (for example, the operation input information acquisition unit 204 in FIG. 10), registration information storage control means (for example, the user information database 206 in FIG. 10) for controlling storage of user registration information, authentication Based on the information about user authentication acquired by the information acquisition means, and the registration information of the user whose storage is controlled by the registration information storage control means, Authentication processing means (for example, the authentication processing unit 207 in FIG. 10) that executes the authentication process, and when the user is correctly authenticated by the authentication processing means, the decryption key for decrypting the metadata to the second information processing apparatus A decryption key supply control unit (for example, the key supply processing unit 208 in FIG. 10) for controlling supply is provided.
The information processing system according to claim 2 is a first information processing apparatus (for example, the display selection subtitle decoder 3 in FIG. 3) that acquires and processes a broadcast signal, and a first that searches recorded data using text information as a search key. 2 information processing apparatus (for example, home server 4 in FIG. 3) and a third information processing apparatus (for example, FIG. 5 and FIG. 5) that generates metadata used for search processing executed by the second information processing apparatus. 6 is an information processing system configured with the metadata creation server 6) in FIG. 6, and the first information processing apparatus is a first broadcast signal acquisition unit that acquires a broadcast signal (for example, the input terminal 21 in FIG. 3). -1 and 21-2) and first distinction information for obtaining distinction information (for example, program ID) that can uniquely distinguish a broadcast signal program from the broadcast signal obtained by the first broadcast signal obtaining means. Acquisition means ( For example, the program ID information extraction unit 39) in FIG. 3 and the broadcast signal acquired by the first broadcast signal acquisition means include first time information (for example, recording start time information 95 in FIG. 4), first information And information addition means (for example, the output signal generation unit 33 in FIG. 3) for adding the distinction information acquired by the distinction information acquisition means to generate recorded data. The second information processing apparatus includes: Recording data storage control means (for example, the recording data storage section 72 in FIG. 3) for controlling the recording of the recording data to which the time information and the distinction information are added, and the metadata acquisition means for acquiring the encrypted metadata (For example, the network interface 73 of FIG. 3) and a decryption key acquisition means for acquiring a decryption key used for decrypting the encrypted metadata (for example, the network interface 73 of FIG. 3). And decryption processing means (for example, the decryption processing unit 77 in FIG. 3) for decrypting the encrypted metadata acquired by the metadata acquisition means using the decryption key acquired by the decryption key acquisition means, Corresponding to the discrimination information (for example, program ID 167 in FIG. 8), text data related to the recording data (for example, text data 165 in FIG. 8), and text data decoded by the processing means for distinguishing the program of the recording data Metadata storage means (for example, the metadata storage unit 78 of FIG. 3) for storing metadata (for example, the metadata 161 of FIG. 8) including the second time information (for example, the time code 166 of FIG. 8). An operation input means (for example, the operation input unit 71 in FIG. 3) that receives the user's operation input, and a search input from the user by the operation input means The second time information corresponding to the text information serving as the search key is detected by executing matching processing between the information specifying the program to be searched and the text information serving as the search key and the metadata stored by the metadata storage means The recording position corresponding to the second time information detected by the matching processing means from the matching processing means (for example, the matching processing section 79 in FIG. 3) and the recorded data whose storage is controlled by the recorded data storage control means. Search means (for example, the recorded data search output unit 80 in FIG. 3) for reading the recorded data starting from the searched recording position, and the third information processing apparatus obtains a broadcast signal. 2 broadcast signal acquisition means (for example, the broadcast data acquisition unit 141 in FIG. 6) and the sound included in the broadcast signal acquired by the second broadcast signal acquisition means. Discrimination information (for example, a program) that can uniquely distinguish a broadcast signal program from the audio signal decoding means (for example, the decoder 142 in FIG. 6) for decoding the signal and the broadcast signal acquired by the second broadcast signal acquisition means. Whether to display by the user from the second distinction information acquisition means (for example, the program ID information extraction unit 143 of FIG. 6) and the broadcast signal acquired by the second broadcast signal acquisition means. Subtitle data decoding means (for example, display selected subtitle data decoder 145 in FIG. 6) that extracts and decodes selectable subtitle data (for example, display selection subtitle data 17 in FIG. 2) and audio data decoding means The start time of each of the decoded audio data and the text data corresponding to the caption data decoded by the caption data decoding means Based on the comparison result, the time code adding means (for example, the time code adding processing unit 147 in FIG. 6) for adding the time code to the text data and the text data to which the time code is added by the time code adding means. The metadata generation unit (for example, the metadata generation unit 144 in FIG. 6) that generates the metadata by adding the identification information acquired by the second identification information acquisition unit and the metadata generation unit An encryption unit (for example, an encryption processing unit 149 in FIG. 6) for encrypting metadata is provided.
The information processing system according to claim 3 is a first information processing apparatus that acquires and processes a broadcast signal (for example, the display selection subtitle decoder 3 in FIG. 3), and a first search for recorded data using text information as a search key. 2 information processing apparatus (for example, home server 4 in FIG. 3) and a third information processing apparatus (for example, FIG. 5 and FIG. 5) that generates metadata used for search processing executed by the second information processing apparatus. The metadata creation server 6 in FIG. 6 and a fourth information processing apparatus (for example, FIG. 9 and FIG. 9) that supplies a decryption key for decrypting metadata used for search processing executed in the second information processing apparatus. 10 billing servers 7), the first information processing apparatus includes first broadcast signal acquisition means (for example, input terminal 21-1 and FIG. 3) for acquiring broadcast signals. 21-2) First discrimination information acquisition means (for example, FIG. 3) that acquires discrimination information (for example, program ID) that can uniquely distinguish a program of the broadcast signal from the broadcast signal acquired by the first broadcast signal acquisition means. The broadcast signal acquired by the program ID information extraction unit 39) and the first broadcast signal acquisition means includes first time information (for example, recording start time information 95 in FIG. 4) and first distinction information acquisition means. Information adding means (for example, the output signal generating unit 33 in FIG. 3) that adds the discriminating information acquired by the above-described information to generate recording data, and the second information processing device discriminates from the first time information. Recording data storage control means (for example, the recording data storage section 72 in FIG. 3) for controlling the storage of the recording data to which the information is added, and metadata acquisition means (for example, FIG. 3) for acquiring the encrypted metadata. Network Interface 73), decryption key acquisition means (for example, network interface 73 in FIG. 3) for acquiring a decryption key used for decrypting the encrypted metadata, and encryption acquired by the metadata acquisition means The decrypted metadata is decrypted using the decryption key obtained by the decryption key obtaining means (for example, the decryption processing unit 77 in FIG. 3), and the program of the recorded data decrypted by the decryption processing means is displayed. Discrimination information (eg, program ID 167 in FIG. 8) for discrimination, text data related to recorded data (eg, text data 165 in FIG. 8), and second time information corresponding to the text data (eg, FIG. 8) Metadata storage means (for example, FIG. 3) that stores metadata including the time code 166) (for example, the metadata 161 in FIG. 8). Metadata storage section 78), operation input means for receiving user operation input (for example, operation input section 71 in FIG. 3), information for specifying a program to be searched, which is input from the user by the operation input means, and Matching processing means (for example, for detecting second time information corresponding to the text information serving as the search key by executing matching processing between the text information serving as the search key and the metadata stored in the metadata storage means) The recording position corresponding to the second time information detected by the matching processing means is searched from the matching processing section 79) of FIG. 3 and the recording data whose storage is controlled by the recording data storage control means. Search means (for example, the recorded data search output unit 80 in FIG. 3) for reading the recorded data starting from the recording position, and a third information processing The apparatus decodes the audio signal included in the broadcast signal acquired by the second broadcast signal acquisition unit (for example, the broadcast data acquisition unit 141 in FIG. 6) for acquiring the broadcast signal and the second broadcast signal acquisition unit. Acquire distinction information (for example, program ID) that can uniquely distinguish the program of the broadcast signal from the broadcast signal acquired by the audio data decoding means (for example, the decoder 142 in FIG. 6) and the second broadcast signal acquisition means. The user can select whether or not to display from the second distinction information acquisition means (for example, the program ID information extraction unit 143 in FIG. 6) and the broadcast signal acquired by the second broadcast signal acquisition means. Subtitle data decoding means (for example, display selection subtitle data decoder 145 in FIG. 6) for extracting and decoding possible subtitle data (for example, display selection subtitle data 17 in FIG. 2); Time to add the time code to the text data based on the comparison result by comparing the start time of the audio data decoded by the voice data decoding means and the text data corresponding to the subtitle data decoded by the subtitle data decoding means The discrimination information acquired by the second discrimination information acquisition unit is added to the text data to which the time code is added by the code addition unit (for example, the time code addition processing unit 147 in FIG. 6) and the time code addition unit. , Metadata generation means for generating metadata (for example, the metadata generation unit 144 in FIG. 6), and encryption means for encrypting the metadata generated by the metadata generation means (for example, encryption processing in FIG. 6) 149), and the fourth information processing apparatus is related to user authentication from the second information processing apparatus. Authentication information acquisition means (for example, the operation input information acquisition unit 204 in FIG. 10), and registration information storage control means (for example, the user information database 206 in FIG. 10) that controls storage of user registration information; Authentication processing means (for example, FIG. 10) that executes authentication processing based on the user authentication information acquired by the authentication information acquisition means and the user registration information whose storage is controlled by the registration information storage control means. When the user is correctly authenticated by the authentication processing unit 207) and the authentication processing means, a decryption key supply control means for controlling the supply of the decryption key for decrypting the metadata to the second information processing apparatus (for example, FIG. 10 key supply processing unit 208).

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a system diagram for explaining the configuration of an information processing system to which the present invention is applied.

  The broadcasting station 1 broadcasts a program using terrestrial waves or satellite waves. Broadcast program data includes video data and audio data. In addition to the so-called captions (introduction of program titles and casts, or Japanese captions in overseas works) that are always displayed as video data, the program data can be selected to be displayed or not. Contains data.

  For example, in NTSC analog terrestrial broadcasting, 525 scanning lines are used for video signals. Of these 525 lines, the first 21 lines in each field (one field consists of two fields) And VBI (Vertical Blanking Interval), which is called an interval for starting scanning. Closed captions are transmitted by multiplexing a 7-bit character code in the 21st VBI of the VBIs in each field, and each field is used to transmit two types of character sets to approximately 60 characters per second. It can be transmitted. Hereinafter, subtitle data typified by closed captions and capable of selecting display and non-display will be referred to as display selection subtitle data.

  Specific examples of video data, audio data, and display selection subtitle data will be described with reference to FIG.

  The video data 15 is moving image data, and in FIG. 2, frame image data at several timings is extracted from the moving image data. The audio data 16 is audio data to be reproduced simultaneously with the video data 15. The display selection subtitle data 17 may be, for example, text data corresponding to the audio data 17, and the speaker is described when the audio data other than the text data corresponding to the audio data is, for example, conversation. For example, text data may be included. The video data 15 and the audio data 16 are recorded and reproduced, for example, in addition to being viewed in real time at the time of broadcasting, for example, by having corresponding link information or having a relative time stamp. Even in such a case, the time axis is not shifted. On the other hand, since the display selection subtitle data 17 is assumed to be treated in the same way as the video data until it is decoded at the time of reproduction, the link data for the video data 15 or the audio data 16 or the time of the relative time is assumed. Does not have stamps.

  Also, for example, in live broadcasting such as news and sports broadcasts, display selection subtitle data 17 is created at the same time as broadcasting and is added to a broadcast signal. Therefore, display selection subtitle data 17 combined with a broadcast program is Compared with actual video and audio, the time required for generating text data is delayed.

  Returning again to the description of FIG.

  Using the television receiver 2, the user receives a broadcast signal composed of the video data 15 including the display selection subtitle data 17 described with reference to FIG. 2 and the audio data 16. The user who does not need to display the display selection subtitle data and does not perform the search processing described later using the display selection subtitle data can use the broadcast selected by the tuner 11 without using the display selection subtitle decoder 3. The video and audio signal processing unit 12 demodulates the signal, and the video signal is displayed on the display of the output unit 13, and the audio signal is output to the speaker of the output unit 13 to view the program.

  The display selection subtitle decoder 3 receives the broadcast signal selected by the tuner 11 of the television receiver 2, decodes the video signal and the audio signal, and displays the display selection subtitle data based on the user's operation input. It can be extracted and decoded, and output to the output unit 13 for display and audio output. Further, the display selection subtitle decoder 3 receives the input of the broadcast signal selected by the tuner 11 of the television receiver 2 and processes the broadcast signal, so that the home server 4 transmits the metadata creation server via the Internet 5. Recording data with a time stamp capable of executing a search process using the metadata acquired from 6 can be generated and supplied to the home server 4. Further, the display selection subtitle decoder 3 receives the supply of the recording data recorded by the home server and designated by the search position by the search process, decodes the display selection subtitle as necessary, and outputs the decoded subtitle to the output unit 13. Display and audio output can be performed.

  The home server 4 receives the recording data with a time stamp generated by the display selection subtitle decoder 3 based on the operation input of the user, and records (that is, records) on the internal recording medium. In addition, the home server 4 receives supply of metadata including text data corresponding to display selection subtitle data and a time code corresponding to the text data from the metadata creation server 6 via the Internet 5. The supply of key data for decrypting the metadata is received from the accounting server 7, the metadata is decrypted, and the matching process between the text input by the user and the metadata is executed using the decrypted metadata. As a result of the matching process, a time code corresponding to the text input by the user is detected, and the recorded data is searched based on the time code and supplied to the display selection subtitle decoder 3. Details of the search process will be described later. Here, the searched “program” is, for example, a whole program such as a two-hour drama, or a plurality of units even when each program is divided by a commercial or the like. Even a program may be included, or a commercial may be included or only a commercial may be indicated.

  The metadata creation server 6 obtains a broadcast signal with display selection subtitle data created by the broadcast station 1 by receiving it via the Internet 5, via a predetermined medium, or from an antenna (not shown), Based on that, metadata is created and the created metadata is encrypted. Further, the metadata creation server 6 publishes a web page for distributing encrypted metadata to users via the Internet 5 on the Internet 5, for example, the home server 4 or a personal computer (not shown). In response to access from the used user, the encrypted metadata used for searching for the program desired by the user is downloaded via the Internet 5.

  The accounting server 7 publishes on the Internet 5 a web page for distributing the decryption key for decrypting the metadata created by the metadata creation server 6 and encrypted and distributed to the user to the user via the Internet 5. For example, after receiving access from the user using the home server 4 or a personal computer (not shown), the user pays for the decryption key of the metadata desired by the user, and then distributes the key to the user. In addition, the accounting server 7 executes an accounting process for paying the broadcasting station 1 a fee for the broadcasting station 1 that has created the display selection subtitle data.

  FIG. 3 is a block diagram showing a configuration of the display selection subtitle decoder 3 and the home server 4 of FIG.

  Of the broadcast signals selected by the tuner 11 of the television receiver 2, a video signal including display selection caption data is supplied to the video signal decoder 31 from the input terminal 21-1, and an audio signal is input to the input terminal 21-. 2 is input to the audio signal decoder 34.

  The video signal decoder 31 decodes the supplied video signal and supplies the decoded video data to the memory 32. The memory 32 is a frame memory that temporarily holds the supplied video signal. The audio signal decoder 34 decodes the supplied audio signal and outputs the decoded audio data.

  When an instruction to output the received broadcast signal in real time by the user's operation input by the operation input unit 41, that is, to view a program currently being broadcast, the display selection subtitle data decoder 35 stores the memory Video data is acquired from 32. When the display selection subtitle data is instructed by the user's operation input from the operation input unit 41, the display selection subtitle data decoder 35 decodes the display selection subtitle data included in the acquired video data. The corresponding text data is supplied to the OSD (On Screen Display) 36 and the video data is supplied to the composition processing unit 37.

  The OSD 36 converts the supplied text data into OSD data, which is image data to be displayed superimposed on the display screen, and supplies the OSD data to the composition processing unit 37. The composition processing unit 37 superimposes the supplied OSD data on the supplied video data, and outputs it from the output terminal 22-1 to the display of the output unit 13 of the television receiver 2. At this time, the audio output processing unit 38 acquires the audio data decoded by the audio signal decoder 34 and outputs the audio data to the speaker of the output unit 13 of the television receiver 2 from the output terminal 22-2.

  Based on a user operation input from the operation input unit 41 or based on a control signal supplied from the home server 4 via the data terminal 61-3, the supplied video signal and audio signal are converted into the home server. 4, the output signal generation unit 33 causes the program ID information extraction unit 39 to extract the program ID included in the program management data from the video data held in the memory 32. To control. The program ID information extraction unit 39 indicates a unit to be searched from the program management data included in the video data decoded by the video signal decoder 31 (here, “program” is a unit to be searched, for example, a 2-hour drama) Even if it is the whole program, even if one program is divided by commercials, etc., each unit divided, or those that contain multiple programs, and those that contain commercials or only commercials The program ID information that can be uniquely distinguished is extracted and supplied to the output signal generation unit 33.

  The output signal generation unit 33 refers to the timer 40 to acquire the time (absolute time) when the recording was started, and the video data supplied from the memory 32 or the audio data supplied from the audio signal decoder 34 The acquired time information is added to at least one of them, and the program ID supplied from the program ID information extraction unit 39 is added to the video data and audio data to generate an output signal to be recorded. And supplied to the home server 4 from the output terminals 23-1 and 23-2. The added time information is used as a time stamp in a search process to be described later.

  The output signal to be recorded will be described with reference to FIG.

  In the output signal generation unit 33, the recording start time information 95 is added to at least one of the video data 15 and the audio data 16 among the recorded output signals. The video data 15 includes display selection subtitle data 17. Then, program ID information is associated with these data, and an output signal for recording is generated.

  Returning to FIG. 3, the configuration of the home server 4 will be described.

  The operation input unit 71 includes, for example, input devices such as buttons, keys, a touch panel, a touch pad, and a lever, and receives user operation inputs. The recorded data storage unit 72 stores video data and audio data to which a program ID and a time stamp are added supplied from the input terminal 61-1 and the input terminal 61-2. For example, the recorded data storage unit 72 may be configured by a large-capacity recording medium such as a hard disk, or may be configured by a removable recording medium such as a DVD (Digital Versatile Disk) or a video tape.

  When the user instructs the operation input unit 71 to record a broadcast program, the recording control unit 81 can record the video signal and the audio signal supplied to the display selection subtitle decoder 3 as searchable information. In order to be able to do so, a program ID and a time stamp are added to generate a control signal for output to the home server 4 and output from the display selection subtitle decoder 3 via the data terminal 61-3 and the data terminal 23-2. The signal is supplied to the signal generator 33.

  The network interface 73 acquires information on a web page published on the Internet 5 and displays the information on the display unit 74, or based on an operation input to the operation input unit 71 by a user who refers to the display unit 74. The predetermined information is transmitted to the metadata creation server 6 or the billing server 7, or the metadata is downloaded from the metadata creation server 6 and output to the encrypted metadata storage unit 75 for storage. The decryption key acquired from the accounting server 7 is output to the key information storage unit 76 and stored. In addition, the network interface 73 receives encrypted metadata, a decryption key, and the like acquired by using a personal computer (not shown) owned by the user from a personal computer (not shown) by wired or wireless communication. It is also possible to do.

  The display unit 74 is configured by, for example, an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and information on a web page published on the Internet 5 acquired via the network interface 73 and an operation input unit. 71 displays information input by the user.

  The encrypted metadata storage unit 75 stores the acquired encrypted metadata. The key information storage unit 76 stores the acquired decryption key. The decryption processing unit 77 decrypts the encrypted metadata stored in the encrypted metadata 75 using the decryption key stored in the key information storage unit 76 and outputs the decrypted metadata to the metadata storage unit 78. To remember. The metadata storage unit 78 receives the supplied metadata and stores it.

  The matching processing unit 79 receives from the operation input unit 71 information specifying the program ID of the recorded data to be searched and text serving as a search key, and refers to the metadata stored in the metadata storage unit 78. Then, the matching process is executed, and the program ID and the time code as the matching result are supplied to the recorded data search output unit 80. The recorded data search output unit 80 searches the recorded data storage unit 72 based on the program ID and time code that are the matching results supplied from the matching processing unit 79, and reads the recorded data starting from the corresponding position. The display selection subtitle decoder 3 is supplied via the output terminal 62-2 and the output terminal 62-2.

  Next, FIG. 5 is a block diagram showing the configuration of the metadata creation server 6.

  A CPU (Central Processing Unit) 101 executes various processes according to a program stored in a ROM (Read Only Memory) 102 or a program loaded from a storage unit 108 to a RAM (Random Access Memory) 103. The RAM 103 also appropriately stores data necessary for the CPU 101 to execute various processes.

  The CPU 101, ROM 102, and RAM 103 are connected to each other via a bus 104. An input / output interface 105 is also connected to the bus 104.

  The input / output interface 105 includes an input unit 106 including a keyboard and a mouse, an output unit 107 including a display and a speaker, a storage unit 108 including a hard disk, and a communication unit 109 including a modem and a terminal adapter. It is connected. The communication unit 109 performs communication processing via a network including the Internet 5.

  A drive 110 is connected to the input / output interface 105 as necessary, and a magnetic disk 121, an optical disk 122, a magneto-optical disk 123, a semiconductor memory 124, or the like is appropriately mounted, and a computer program read from them is loaded. These are installed in the storage unit 108 as necessary.

  FIG. 6 is a functional block diagram for explaining functions executed by the metadata creation server 6 described with reference to FIG. 5 (including functions executed by software executed by the CPU 101).

  The broadcast data acquisition unit 141 corresponds to the communication unit 109 in FIG. 5, acquires broadcast data via the Internet 5 or via an antenna (not shown), and supplies the broadcast data to the decoder 142.

  The decoder 142 decodes the supplied broadcast data, supplies video data including program management information including program ID information and display selection subtitle data to the program ID information extraction unit 143, and converts the audio data to time This is supplied to the code addition processing unit 147.

  The program ID information extraction unit 143 indicates a unit to be searched for from the program management data included in the video data decoded by the decoder 142 (here, “program” is a unit to be searched for, such as a two-hour drama). Even if it is the whole program, even if one program is divided by commercials, etc., each unit divided, including multiple programs, only those containing commercials or only commercials The program ID information that can be uniquely distinguished is extracted and supplied to the metadata generation unit 144, and the supplied video data is supplied to the display selection subtitle data decoder 145.

  The display selection subtitle data decoder 145 decodes the display selection subtitle data included in the acquired video data and supplies the corresponding text data to the display selection subtitle data analysis unit 146. The display selection subtitle data analysis unit 146 divides the text data corresponding to the display selection subtitle data supplied from the display selection subtitle data decoder 145 into a text group of an appropriate length (for example, the text displayed at one time). Are divided as one text group), and the divided text group is supplied to the time code addition processing unit 147.

  The time code addition processing unit 147 refers to the audio data supplied from the decoder 142 and the timer 148, and sets the time code corresponding to the start position and end position of the text for each of the supplied text groups. Append.

Specifically, the time code addition processing unit 147 receives the display selection subtitle data and the audio data, receives the audio waveform corresponding to the audio data, and the text corresponding to the display selection subtitle data added to the image data. Compare the start time and end time. For example, as shown in FIG. 7, a display selection subtitle composed of text “7 o'clock news” at the time t ₁ when the voice of “7 o'clock news” is started in actual broadcasting. The start time t ₂ of the image data including the data is delayed by the time Δt ₁ required for generating the text data. Here, the range that the delay time Δt can take is limited in advance by the method of adding display selection subtitle data. For example, when the possible range of the delay time Δt is 5 to 15 seconds, the time code addition processing unit 147 starts the start position of the speech waveform of the speech data supplied 5 to 15 seconds earlier than the start position of the text data. Then, the start position and end position of the text data are compared with each other, the delay times of the start position and end position of the corresponding display selection subtitle data are calculated based on the comparison result, and supplied from the timer 148. Based on the current time, the time when the display selection subtitle data is given to the broadcast signal is corrected to obtain a time code.

For example, in the case shown in FIG. 7, when the start time of the voice waveform of the voice data supplied 5 to 15 seconds earlier than the start time t _{2 of} the text “It is 7 o'clock news” is t ₁ . The corrected time Δt ₁ is calculated by t ₂ −t ₁ . In addition, the end time of the speech waveform of the speech data supplied 5 to 15 seconds earlier than the start time t _{2 of} the text “It is 7 o'clock news” is t ₃ , and the end time of the text data is t _4. , The corrected time Δt ₂ is calculated as t ₄ −t ₃ . Similarly, when the start time of the voice waveform of the voice data supplied 5 to 15 seconds earlier than the start time t _{6 of} the next text “Today's topic is about a wheelchair” is t ₅ , The corrected time Δt ₃ is calculated by t ₅ −t ₄ . Further, the end time of the speech waveform of the speech data supplied 5 to 15 seconds earlier than the start time t _{2 of} the text “Today's topic is about the wheelchair” is t ₇ , and the end time of the text data Is t ₈ , the corrected time Δt ₄ is calculated as t ₈ −t ₇ .

  Here, the reference for the time difference between the speech waveform and the text data has been described as 5 to 15 seconds. However, the reference time may be set and changed by a method for creating display selection subtitle data.

  The program ID information extraction unit 143, the display selection subtitle data decoder 145, and the display selection subtitle data analysis unit 146 perform processing related to display selection subtitles on the audio data supplied from the decoder 142. Needless to say, the delay time of the text data supply to be generated is appropriately considered.

  When the broadcast data acquisition unit 141 acquires a broadcast signal in real time (ie, at the broadcast time of the program), the time code addition processing unit 147 indicates that the current time indicated by the timer 148 is the same as when the user acquires broadcast data. A time code is added to the text data based on the corrected time information based on the calculated delay time based on the time. Further, the time code addition processing unit 147, when the broadcast data acquisition unit 141 acquires a broadcast signal with a delay from the broadcast time of the program, or the time taken by the decoder 142 to the display selection subtitle data analysis unit 146, When it becomes longer than the output processing of a broadcast signal using a general television receiver, the current time indicated by the timer 148 and the delay time for acquiring the broadcast signal, or the delay time due to the time required for processing, Based on the calculated delay time, a time code corresponding to the broadcast time of the program is calculated and added to the text data.

  The metadata generation unit 144 adds the program ID information supplied from the program ID information extraction unit 143 to the text data to which the time code supplied from the time code addition processing unit 147 is added, and generates metadata. The data is supplied to the encryption processing unit 249.

  The metadata will be described with reference to FIG.

  For the text data 165 divided into text 1, text 2,..., Which is a text group of an appropriate length by the display selection subtitle data analysis unit 146, each time text group is processed by the time code addition processing unit 147. A time code 166 in which the start time and the end time after the correction is described is added. For example, when the text of ““ This is the news at 7 o'clock ”and“ Today's first topic is ... ”” is divided as text 1, the display selection subtitle of this portion is displayed in the broadcast of the program. The start time and the end time corrected based on the audio corresponding to the display selected subtitles are described in the time code 166, not the time to be displayed, and the program ID supplied from the program ID information extraction unit 143 is further described. Information 161 is added to generate metadata 161.

  Returning to the description of FIG.

  The encryption processing unit 149 encrypts the metadata supplied from the metadata creation unit 144 with the encryption key corresponding to the program ID stored in advance in the key information storage unit 150 and supplies the encrypted metadata to the metadata storage unit 151. To do. The metadata supply control unit 152 searches the metadata storage unit 151 for encrypted metadata corresponding to a program desired by the user based on a signal for requesting metadata supplied from the communication unit 153, and The data is supplied to the home server 4 held by the user or a personal computer (not shown) via the Internet 5.

  The page information storage unit 155 stores information necessary for downloading and using metadata such as a list of metadata that can be downloaded and a method of obtaining a decryption key necessary for using the metadata. Information corresponding to the web page to be provided is stored. The web page publication processing unit 154 publishes the web page stored in the page information storage unit to the Internet 5.

  The communication unit 153 corresponds to the communication unit 109 of FIG. 5, and exchanges information with the home server 4 held by the user or a personal computer (not shown) via the Internet 5.

  Next, FIG. 9 is a block diagram showing the configuration of the accounting server 7.

  A CPU (Central Processing Unit) 171 executes various processes according to a program stored in a ROM (Read Only Memory) 172 or a program loaded from a storage unit 178 to a RAM (Random Access Memory) 173. The RAM 173 also appropriately stores data necessary for the CPU 171 to execute various processes.

  The CPU 171, ROM 172, and RAM 173 are connected to each other via a bus 174. An input / output interface 175 is also connected to the bus 174.

  The input / output interface 175 includes an input unit 176 including a keyboard and a mouse, an output unit 177 including a display and a speaker, a storage unit 178 including a hard disk, and a communication unit 179 including a modem and a terminal adapter. It is connected. The communication unit 179 performs communication processing via a network including the Internet 5.

  A drive 180 is connected to the input / output interface 175 as necessary, and a magnetic disk 121, an optical disk 122, a magneto-optical disk 123, a semiconductor memory 124, or the like is appropriately mounted, and a computer program read from them is loaded. The storage unit 178 is installed as necessary.

  Next, FIG. 10 is a functional block diagram for explaining functions executed by the accounting server 7 of FIG. 9 (including functions executed by software executed by the CPU 171).

  The page information storage unit 202 includes, for example, input of user information and billing information for user registration, a method of obtaining a decryption key necessary for using the metadata, and transmission of a decryption key purchase request. A decryption key necessary for decrypting data is provided, and information corresponding to a web page for charging the data is stored. The web page publication processing unit 201 publishes the web page stored in the page information storage unit to the Internet 5.

  The communication unit 203 corresponds to the communication unit 179 in FIG. 9, and exchanges information with the home server 4 held by the user or a personal computer (not shown) via the Internet 5.

  The operation input information acquisition unit 204 acquires the operation input information transmitted by the user via the communication unit 203. When the operation input information relates to the operation of the web page, the operation input information acquisition unit 204 In the case of personal information for user registration, in the user information registration processing unit 205, in the case of information necessary for authentication processing, in the case of information that requests authentication processing unit 207 to purchase a key, When the information is related to the charging process to the supply processing unit 208, the information is supplied to the charging processing unit 210.

  The user information registration processing unit 205 receives supply of personal information for user registration from the operation input information acquisition unit 204 and supplies it to the user information database 206. The authentication processing unit 207 issues a user ID that can uniquely identify a user to a newly registered user, registers the user ID in the user information database 206, and sends the issued user ID via the communication unit 203. The data is sent to the home server 4 owned by the user or a personal computer (not shown). The authentication processing unit 207 receives supply of information necessary for the authentication process from the operation input information acquisition unit 204, executes the authentication process with reference to the user information registered in the user information database 206, and performs the authentication process. The result is output to the key supply processing unit 208.

  The key supply processing unit 208 receives supply of information requesting key purchase from the operation input information acquisition unit 204, and receives an input of an authentication result indicating that the user authentication processing has been correctly completed from the authentication processing unit 207. In this case, the corresponding decryption key is read from the key information database 209 and supplied to the home server 4 held by the user or a personal computer (not shown) via the communication unit 203, and the charge processing unit 210 receives the key. Output information about supply.

  The key information database 209 stores a decryption key for decrypting encrypted metadata for each program ID. That is, the key information database 209 is stored in advance in the key information storage unit 150 described with reference to FIG. 6, and the key information for each program ID used when the encryption processing unit 149 encrypts the metadata. The decryption key corresponding to is stored.

  The billing processing unit 210 performs billing processing based on the information related to billing supplied from the operation input information acquisition unit 204 and the key information processing unit 208, registers information necessary for billing in the billing information database 211, Based on the contents registered in the information database 206 and the billing information database 211, a process for paying the price of the supplied decryption key to the user, a process for paying the price for providing the display selection subtitle to the broadcast station 1, etc. are executed. . Information necessary for the accounting process is registered in the accounting information database 211.

  Next, with reference to the flowchart of FIG. 11, the process 1 of the display selection subtitle decoder which is the process which the display selection subtitle decoder 3 performed using FIG. 3 is demonstrated.

  In step S1, the video signal decoder 31 and the audio signal decoder 34 receive the program broadcast signal (video signal and audio signal) and decode it. The video signal decoder 31 supplies the decoded video data to the memory 32.

  In step S <b> 2, the display selection subtitle data decoder 35 and the audio output processing unit 38 determine whether viewing of the program is instructed based on the user's operation input supplied from the operation input unit 41.

  If it is determined in step S2 that viewing of the program is instructed, in step S3, the display selection subtitle data decoder 35 determines the display selection subtitle based on the user's operation input supplied from the operation input unit 41. Determine whether display is commanded.

  If it is determined in step S3 that display of the display selection subtitle is instructed, in step S4, the display selection subtitle data decoder 35 decodes the display selection subtitle data and supplies it to the OSD 36, and also the video data. This is supplied to the synthesis processing unit 37. The OSD 36 converts the supplied text data into video data and outputs it to the composition processing unit 37. The composition processing unit 37 synthesizes the supplied OSD data with video data, and outputs it to the television receiver 2 via the output terminal 22-1. The audio output processing unit 38 also acquires the audio data decoded by the audio signal decoder 34 and outputs it to the television receiver 2 via the output terminal 22-2.

  If it is determined in step S3 that the display selection subtitle display is not instructed, in step S5, the display selection subtitle data decoder 35 does not decode the display selection subtitle data, and the video data is combined with the synthesis processing unit 37 and The data is output to the television receiver 2 via the output terminal 22-1. The audio output processing unit 38 also acquires the audio data decoded by the audio signal decoder 34 and outputs it to the television receiver 2 via the output terminal 22-2.

  In step S2, if it is determined that viewing of the program is not instructed, or after the processing of step S4 or step S5 is completed, the output signal generation unit 33 is supplied from the operation input unit 41 in step S6. Based on a user operation input or a control signal supplied from the recording control unit 81 of the home server 4 supplied via the data terminal 23-3, it is determined whether or not a program recording is instructed. If it is determined in step S6 that recording of a program has not been instructed, the process ends.

  If it is determined in step S6 that the recording of the program has been instructed, in step S7, recorded data creation processing described later with reference to FIG. 12 is executed.

  In step S8, the output signal generation unit 33 supplies the recording data created by the process of step S6 to the home server 4 via the output terminal 23-1 and the output terminal 23-2, and the process ends. .

  By such processing, the display selection subtitle decoder 3 decodes the display selection subtitle and superimposes it on the video when viewing the received broadcast signal based on the user's operation input, or displays the display selection. Recording data that can use text data corresponding to subtitles for search processing can be generated and supplied to the home server 4 for recording.

  Next, the recording data creation process executed in step S7 in FIG. 11 will be described with reference to the flowchart in FIG.

  In step S21, the program ID information extraction unit 39 extracts program ID information that can individually identify the recorded program from the program management data included in the decoded video data held in the memory 32. To the output signal generator 33.

  In step S22, the output signal generation unit 33 refers to the timer 40 to at least one of the video data supplied from the memory 32 or the audio data supplied from the audio signal decoder 34, for example, A time stamp based on absolute time such as information indicating the recording start time is added.

  In step S23, the output signal generation unit 33 further adds a program ID to the video data or audio data to which the time stamp is added, and generates the recording output signal described with reference to FIG. Advances to step S8 in FIG.

  By such processing, recorded data to which a program ID and a time stamp are added, which can use text data corresponding to the display selection subtitles for search processing, is generated.

  Next, the metadata creation process 1 executed by the metadata creation server 6 described with reference to FIGS. 5 and 6 will be described with reference to the flowchart of FIG.

  In step S <b> 61, the broadcast data acquisition unit 141 receives a program broadcast signal and supplies it to the decoder 142. The decoder 142 decodes the supplied video signal and audio signal, and supplies the decoded video data to the program ID information extraction unit 143 and the decoded audio data to the time code addition processing unit 147, respectively.

  In step S62, the program ID information extraction unit 143 extracts a program ID, which is program-specific information for recognizing the program, from the program management data included in the supplied video data, and generates the program ID as metadata. And the decoded video data is supplied to the display selection subtitle data decoder 145.

  In step S <b> 63, the display selection subtitle data decoder 145 extracts and decodes the display selection subtitle data from the supplied video data, and supplies the extracted data to the display selection subtitle data analysis unit 146.

  In step S64, the display selection subtitle data analysis unit 146 analyzes the text data corresponding to the display selection subtitle data, and determines a predetermined length (for example, a predetermined number of characters displayed at a time when display is selected, It is divided into a text group of such a length that can be read by the user for a predetermined time and supplied to the time code addition processing unit 147.

  In step S65, the time code addition processing unit 147 compares the audio data supplied from the decoder 142 with each text group as described with reference to FIG. A speech waveform whose start position is deviated within a predetermined range such as 5 to 15 seconds is detected, and a delay time of the text with respect to the speech data is calculated. Then, based on the calculated delay time, the time code adding unit 147 corrects the start time and end time of the text with reference to the timer 148, and sets the corrected time code for the supplied text group. These are added and supplied to the metadata generation unit 144.

  In step S66, the metadata generation unit 144 adds the program ID supplied from the program ID information extraction unit 143 to the text data group with the time code supplied from the time code addition processing unit 147, and the process shown in FIG. The metadata 161 described above is created and supplied to the encryption processing unit 149.

  In step S <b> 67, the encryption processing unit 149 encrypts the supplied metadata 161 using a key corresponding to the program ID stored in the key information storage unit 150 and supplies the encrypted metadata 161 to the metadata storage unit 151. .

  In step S68, the metadata storage unit 151 stores the encrypted metadata, and the process ends.

  Through such processing, text data corresponding to the display selection subtitle data, time code corrected to the time of the actual audio signal corresponding to the text data, and metadata including the program ID are generated and encrypted. Is remembered. The encrypted and stored metadata is downloaded to the home server 4 owned by the user by a process described later.

  Next, user registration processing executed by the accounting server 7 described with reference to FIGS. 9 and 10 will be described with reference to the flowchart of FIG.

  In step S <b> 81, the web page publication processing unit 201 publishes the web page for user registration stored in the page information storage unit 202 to the Internet 5.

  In step S82, the operation input information acquisition unit 204 determines whether a user registration request is received from the home server 4 owned by the user or a personal computer (not shown) via the communication unit 203. If it is determined in step S82 that a user registration request has not been received, the process returns to step S81, and the subsequent processes are repeated.

  If it is determined in step S82 that a user registration request has been received, the operation input information acquisition unit 204 notifies the web page publication processing unit 201 that the user registration request has been received. The unit 201 sends data corresponding to the user registration screen to the home server 4 owned by the user or a personal computer (not shown) via the communication unit 203 and the Internet 5.

  In step S84, the operation input information acquisition unit 204 is supplied with user registration data including, for example, information related to a charging method such as a payment method and personal information such as a user's name and email address, and receives a user information registration processing unit. 205.

  In step S85, the user information registration processing unit 205 supplies the user registration data to the user information database 206 to be stored. The user information database 206 stores the supplied user registration data.

  In step S86, the authentication processing unit 207 issues a user ID that can uniquely identify the user to the newly registered user, registers the user ID in the user information database 206, and sends the issued user ID to the communication unit. The data is sent to the home server 4 owned by the user or a personal computer (not shown) via the Internet 203 and the Internet 5, and the process is terminated.

  By such processing, user information is registered in the accounting server 7. The registered user information is used at the time of supplying key information, which will be described later, and at the time of billing processing.

  Next, the metadata supply process executed by the metadata creation server 6 described with reference to FIGS. 5 and 6 will be described with reference to the flowchart of FIG.

  In step S <b> 101, the web page publication processing unit 154 publishes a web page for receiving a metadata request stored in the page information storage unit 155 to the Internet 5.

  In step S102, the metadata supply control unit 152, via the communication unit 153, metadata corresponding to programs identified by a predetermined program ID from the home server 4 held by the user or a personal computer (not shown). It is determined whether or not an input of a signal indicating an operation input requesting is received. If it is determined in step S102 that a signal indicating an operation input requesting metadata is not received, the process returns to step S101, and the subsequent processes are repeated.

  If it is determined in step S102 that a signal indicating an operation input requesting metadata has been received, in step S103, the metadata supply control unit 152 encrypts metadata corresponding to the requested program. Is transmitted from the metadata storage unit 151 to the home server 4 owned by the user or a personal computer (not shown) via the communication unit 153 and the Internet 5, and the process is terminated.

  Through such processing, the encrypted metadata is sent to the home server 4 owned by the user or a personal computer (not shown). The sent metadata is stored in the home server 4, decrypted by processing to be described later, and used for search processing.

  Next, the decryption key supply control process executed by the accounting server 7 described with reference to FIGS. 9 and 10 will be described with reference to the flowchart of FIG.

  In step S <b> 121, the web page publication processing unit 201 publishes a web page for receiving a purchase request for a decryption key for decrypting metadata stored in the page information storage unit 202 to the Internet 5.

  In step S122, the operation input information acquisition unit 204 determines whether an operation input requesting a decryption key has been received from the home server 4 held by the user or a personal computer (not shown) via the communication unit 203. To do. If it is determined in step S122 that an operation input requesting a decryption key has not been received, the process returns to step S121, and the subsequent processes are repeated.

  If it is determined in step S122 that an operation input requesting a decryption key has been received, the operation input information acquisition unit 204 notifies the authentication processing unit 207 that an operation input requesting a decryption key has been received. The authentication processing unit 207 requests the home server 4 owned by the user or a personal computer (not shown) to send a user ID via the communication unit 205, and is registered in the user information database 206. The authentication process is executed by inquiring the current user ID.

  In step S124, the key supply processing unit 208 requests a decryption key using the home server 4 held by the user or a personal computer (not shown) based on the result of the authentication processing supplied from the authentication processing unit 207. The user who has performed the operation input determines whether or not the user has been correctly authenticated.

  If it is determined in step S124 that the authentication has been correctly performed, in step S125, the key supply processing unit 208 controls the charging processing unit 210 to input information input from the user, or the user information database 206 or the charging information database. Based on the information registered in 211, the settlement processing is executed. Payment processing includes, for example, credit card payment and electronic money payment. The billing processing unit 210 executes settlement processing using these general settlement methods.

  In step S <b> 126, the key supply processing unit 208 determines whether or not the settlement is correctly completed based on the signal supplied from the charging processing unit 210.

  If it is determined in step S126 that the payment has been correctly completed, in step S127, the key supply processing unit 208 receives a request from the signal indicating the request for the decryption key from the user supplied from the operation input information acquisition unit 204. The program ID of metadata corresponding to the decrypted key is acquired.

  In step S128, the key supply processing unit 208 reads the decryption key corresponding to the program ID from the key information database 209, and the home server 4 held by the user or a personal computer (not shown) via the communication unit 203 and the Internet 5. To send to.

  In step S129, the charging processing unit 210 registers the payment method, amount, or payment result selected by the user in the charging information database 211. The billing information database 211 stores the registered billing information, and the process ends.

  If it is determined in step S124 that the authentication has not been correctly performed, or if it is determined in step S125 that the payment has not been correctly completed, in step S130, the authentication processing unit 207 or the billing processing unit 210 determines that the communication unit 203 An error message for notifying the user that the process has not been completed correctly is output to the home server 4 owned by the user or a personal computer (not shown) via the Internet 5 and the process is terminated. The

  Through such processing, a decryption key for decrypting the metadata is purchased by the user and transmitted to the home server 4 owned by the user or a personal computer (not shown). This decryption key is used for decrypting metadata by a process described later. Further, since at least a part of the consideration obtained from the user by purchasing the decryption key is paid to the broadcasting station 1 that created the display selection subtitle data, the ratio of the program with the display selection subtitle added increases. Is predicted, and hearing-impaired persons can enjoy more programs.

  Next, referring to the flowchart of FIG. 17, the home server 4 owned by the user, described with reference to FIG. 3, in parallel with the metadata supply process of FIG. 15 and the decryption key supply control process of FIG. 16. The metadata storage process 1 executed in FIG.

  In step S141, a metadata acquisition process described later with reference to FIG. 18 is executed. Here, the metadata acquisition processing is executed in step S141 here, but may be executed at any timing as long as step S149 described later is executed.

  In step S <b> 142, the network interface 73 accesses a web page that is disclosed on the Internet 5 and accepts a purchase request for a decryption key for decrypting metadata, and displays the web page on the display unit 74. Since the user refers to the web page displayed on the display unit 74 and uses the operation input unit 71 to specify a program for which metadata is desired, the network interface 73 is supplied from the operation input unit 71. A signal for requesting the purchase of a decryption key for decrypting the encrypted metadata designated by the program ID, that is, the information designating the program for which the metadata desired to be used is transmitted via the Internet 5 Transmit to billing server 7.

  The network interface 73 receives data corresponding to a web page that requests input of information necessary for authentication processing from the accounting server 7 and causes the display unit 74 to display the web page. The user refers to a web page that is displayed on the display unit 74 and requests input of information necessary for the authentication process, and uses the operation input unit 71, for example, information necessary for the authentication process, such as a user ID. Therefore, in step S 143, the network interface 73 transmits information necessary for the authentication process supplied from the operation input unit 71 to the accounting server 7 via the Internet 5.

  In step S144, the network interface 73 determines whether or not the authentication has been correctly performed based on the signal supplied from the billing server 7.

  If it is determined in step S144 that the authentication has been correctly performed, the network interface 73 receives data corresponding to the web page requesting input of information necessary for the settlement process from the billing server 7, and displays the web page on the display unit 74. To display. The user refers to the web page that is displayed on the display unit 74 and requests input of information necessary for the settlement process, and inputs information necessary for the settlement process using the operation input unit 71. Therefore, step S145 is performed. The network interface 73 is necessary for the payment process supplied from the operation input unit 71 such as the user ID and password set in the contract with the financial institution for the payment method and the payment method, for example. Information is transmitted to the accounting server 7 via the Internet 5.

  In step S146, the network interface 73 determines whether or not the payment is correctly completed based on the signal supplied from the billing server 7.

  If it is determined in step S146 that the payment has been correctly completed, in step S147, the network interface 73 receives the decryption key corresponding to the designated program ID from the charging server 7 via the Internet 5, and the key The information is supplied to the information storage unit 76.

  In step S148, the key information storage unit 76 stores the supplied decryption key in association with the program ID.

  In step S 149, the decryption processing unit 77 decrypts the encrypted metadata stored in the encrypted metadata storage unit 75 using the decryption key stored in the key information storage unit 76, and generates metadata. The data is supplied to the storage unit 78.

  In step S150, the metadata storage unit 78 stores the decrypted metadata, and the process ends.

  If it is determined in step S144 that the authentication has not been correctly performed, or if it is determined in step S147 that the payment has not been correctly completed, in step S151, the network interface 73 is connected to the accounting server 7 via the Internet 5. Then, an error message indicating that the process has not been terminated properly is received, output and displayed on the display unit 74, and the process is terminated.

  Through such processing, the encrypted metadata is downloaded from the metadata creation server 6, the processing for purchasing the decryption key for decrypting the metadata is executed, and the decryption key is obtained from the billing server 7. Therefore, a decryption key for decrypting the metadata and using it for the search process is stored in the home server 4.

  Next, the metadata acquisition process executed in step S141 in FIG. 17 will be described with reference to the flowchart in FIG.

  In step S <b> 161, the network interface 73 accesses a web page published on the Internet 5 for receiving a metadata request, and displays the web page on the display unit 74. Since the user refers to the web page displayed on the display unit 74 and uses the operation input unit 71 to specify a program for which metadata is desired, the network interface 73 is supplied from the operation input unit 71. The program name or program ID corresponding to the program designated by the user's operation input is supplied to the metadata creation server 6 via the Internet 5.

  In step S <b> 162, the network interface 73 determines whether or not encrypted metadata has been received from the metadata creation server 6 via the Internet 5. If it is determined in step S162 that metadata has not been received, the process returns to step S161, and the subsequent processes are repeated.

  If it is determined in step S162 that metadata has been received, the network interface 73 supplies the received encrypted metadata to the encrypted metadata storage unit 75 in step S163. The encrypted metadata storage unit 75 stores the supplied encrypted metadata, and the process ends.

  Through such processing, the encrypted metadata can be downloaded from the metadata creation server 6.

  Next, with reference to the flowchart of FIG. 19, the search process performed in the home server 4 which a user owns demonstrated using FIG. 3 is demonstrated.

  In step S181, the operation input unit 71 receives an input designating a program to be searched from the user and supplies the input to the matching processing unit 97. In step S182, the operation input unit 71 stores text data serving as a search key for searching for the reproduction start position. The input is received and supplied to the matching processing unit 97. For example, when the broadcast program described with reference to FIG. 2 is recorded and the user tries to perform a search process for reproducing a portion of interest in the “7 o'clock news”, the operation input unit 71 receives an operation input for designating a program of “7 o'clock news”, and receives an input of a text “an innovative wheelchair” of “7 o'clock news”, and receives it in the matching processing unit 97. Supply.

  In step S183, the matching processing unit 97 is stored in the metadata storage unit 78 using the program ID corresponding to the program designated by the user in step S181 and the text designated by the user in step S182 as search keys. The time code corresponding to the text data that is the search key is detected and supplied to the recorded data search output unit 80. For example, when the metadata described with reference to FIG. 8 is stored in the metadata storage unit 78, the text group including the text “Innovative wheelchair” is obtained by the matching processing executed by the matching processing unit 97. The start time “19: 01: 58: 55” corresponding to 2 is detected.

  At the start time “19: 01: 58: 55” corresponding to the text group 2, when the actual broadcast signal is received and viewed in real time and the display selection subtitle is displayed, the display of the text group 2 is started. The time when the output of the audio data corresponding to the text group 2 including the text “Innovative wheelchair” is started in broadcasting (specifically, the audio output “this time” is started). Time).

  If text data that is a search key is included in a plurality of text groups that are distinguished by the same program ID, the matching processing unit 97 detects a plurality of time codes that correspond to the text data that is the search key. In this case, for example, a plurality of text groups including text data as search keys are displayed on the display unit 74 so that the user can select them, or the user's operation Based on the input, the playback start position desired by the user among a plurality of detection results is obtained by making it possible to sequentially change the playback start position from the earliest time in the time code. It is preferable that the selection can be made by a simple operation.

  In step S184, the recorded data search output unit 80 searches the recorded data storage unit 72 for the reproduction start position indicated by the detected time code of the recorded data specified by the program ID, based on the detected time code. And it outputs to the display selection subtitle data decoder 3 via the output terminal 61-1 and the output terminal 61-2, and a process is complete | finished.

  By such processing, a time code corresponding to the text data input by the user is detected, and a recording / playback start position is searched based on the detected time code. Since this time code is corrected to correspond to the time of audio output in live broadcasts such as news and sports broadcasts where the actual audio and subtitles display are shifted, by applying the present invention The video and audio playback positions desired by the user can be accurately searched without delay from the playback start position desired by the user.

  Next, the charging process executed by the charging server 7 described with reference to FIGS. 9 and 10 will be described with reference to the flowchart of FIG.

  In step S <b> 201, the billing processing unit 210 refers to information registered in the billing information database 211 and generates billing information for the user who purchased the decryption key. Specifically, the billing processing unit 210 refers to the information registered in the billing information database 211, and provides financial institution (for example, a credit card company, an electronic money service provider, etc.) that settled accounts for each user. Each time, the charges generated by the purchase of the decryption key are totaled and charged.

  In step S202, the billing processing unit 210 executes billing processing for a predetermined financial institution or the like. Specifically, the billing processing unit 210 accesses, for example, a billing server (not shown) that executes a settlement process that is held by a financial institution such as a card company via the Internet 5 or a predetermined dedicated line, The user billing information generated in S201 is transmitted.

  In step S203, the billing processing unit 210 refers to the information registered in the billing information database 211 and calculates the number of decryption keys supplied to decrypt the metadata corresponding to the display-selected caption data for each program. .

  In step S204, the accounting processing unit 210 calculates the supply number of the decryption key for decrypting the metadata corresponding to the provided display selection subtitle data for each broadcasting station 1 based on the calculation result of step S203. .

  In step S205, the billing processing unit 210 calculates a payment amount for each broadcasting station based on the calculation result in step S204. Specifically, the billing processing unit 210 obtains the profits obtained by the service provider that owns the billing server 7 from the consideration of the decryption key obtained from the user (between the broadcast station 1 and the service provider that owns the billing server 7). It is determined by the contract, and even if it is a predetermined amount, it may be a fraction of the consideration of the decryption key), and the amount is calculated as a payment amount for each broadcasting station.

  In step S206, the billing processing unit 210 executes a process of paying consideration to each broadcasting station based on the payment amount calculated by the process of step S205, and the process is terminated. Specifically, the billing processing unit 210 accesses a billing server (not shown) owned by a financial institution (for example, a bank) designated by the broadcasting station 1 via the Internet 5 or a predetermined dedicated line. Then, information necessary for transferring the payment amount calculated in step S205 to the designated account is transmitted.

  With such a process, it is possible to perform a billing process for a fee for distributing a decryption key used for decrypting metadata. Further, since at least a part of the consideration obtained from the user by purchasing the decryption key is paid to the broadcasting station 1 that created the display selection subtitle data, the ratio of the program with the display selection subtitle added increases. Is predicted, and hearing-impaired persons can enjoy more programs.

  In the processing described above, the home server 4 owned by the user downloads the encrypted metadata generated by the metadata generation server 6 via the Internet 4 and receives the metadata from the accounting server 7. Although it has been explained that a decryption key for decryption is purchased and the metadata is decrypted and used for the search process, the metadata is generated based on the text data corresponding to the display selection subtitle data. The selected subtitle decoder may decode the display selected subtitle data and create metadata, and the home server may perform search processing using the metadata created by the display selected subtitle decoder.

  FIG. 21 shows a display selection subtitle decoder 351 capable of decoding display selection subtitle data and generating metadata, and a search process using the metadata generated by the display selection subtitle decoder 351. It is a functional block diagram which shows the function which can be implement | achieved with the home server 352 made | formed so that it can perform.

  Note that portions corresponding to those in FIG. 3 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the display selection subtitle decoder 351 in FIG. 21 has been described with reference to FIG. 8 using the display selection subtitle data decoded by the display selection subtitle data decoder 35 and the audio data decoded by the audio signal decoder 34. The display selection caption data analysis unit 371, the time code addition processing unit 372, the timer 373, the metadata generation unit 374, and the generated metadata necessary for creating the same metadata as the metadata are stored in the home server 352. 3 is basically the same as the display selection subtitle decoder 3 in FIG. 3 except that an output terminal 361 is newly provided, and the home server 352 An input terminal 381 that receives the selection and supplies it to the metadata generation unit 78 is newly provided. Click interface 73, except that the encrypted metadata storage unit 75, key information storage unit 76 and the decryption processing unit 77, is omitted are those having the home server 4 is basically the same configuration as in FIG.

  The display selection subtitle data analysis unit 371 divides the text data corresponding to the display selection subtitle data supplied from the display selection subtitle data decoder 35 into a text group of an appropriate length (for example, text displayed at a time). Are divided as one text group), and the divided text group is supplied to the time code addition processing unit 372.

  As described with reference to FIG. 7, the time code addition processing unit 372 compares the supplied text group with the audio data supplied from the audio signal decoder 34 and corresponds to the text (ie, 5 to 5 for example). A speech waveform whose start position has shifted within a predetermined range such as 15 seconds) is detected, a delay time of the text with respect to the speech data is calculated, and a timer 373 is referred to, for each of the supplied text groups, By correcting the start position and end position of the text, the corresponding time code is detected and added to the text group. When the broadcast signal is acquired in real time (that is, at the broadcast time of the program), the time code addition processing unit 372 corrects the time code based on the current time indicated by the timer 373 and adds it to the text data. To do.

  The metadata generation unit 374 adds the program ID information supplied from the program ID information extraction unit 39 to the text data added with the corrected time code supplied from the time code addition processing unit 372, and adds metadata. Is supplied to the home server 352 via the output terminal 361.

  Needless to say, the timer 373 may be the same as or different from the timer 40 as long as the absolute time can be counted.

  When the display selection subtitle decoder 351 and the home server 352 of FIG. 21 are used, the processing of the metadata creation server 6 and the accounting server 7 of FIG. 1 is omitted. Therefore, in the system in which the display selection subtitle decoder 351 and the home server 352 of FIG. 21 are used, the metadata creation process 1 described with reference to FIG. 13 and the user registration process 13 described with reference to FIG. The metadata supply process described with reference to FIG. 15 and the decryption key supply control process described with reference to FIG. 16 are omitted, and instead of the process 1 of the display selection subtitle decoder described with reference to FIG. The processing 2 of the display selection subtitle decoder described later is executed by using, and the metadata storage processing 2 described later using FIG. 24 is executed instead of the metadata storage processing 1 described using FIG.

  Further, in the home server 352, processing similar to the search processing described with reference to FIG. 19 is executed, and thus description thereof is omitted.

  Next, processing 2 of the display selection subtitle decoder executed by the display selection subtitle decoder 351 of FIG. 21 will be described with reference to the flowchart of FIG.

  In steps S241 through S246, the same processing as in steps S1 through S6 described with reference to FIG. 11 is executed.

  That is, the video signal decoder 31 and the audio signal decoder 34 receive the input of the program broadcast signal (video signal and audio signal), the input program broadcast signal is decoded, and whether or not the user is instructed to view the program. Is judged. When it is determined that viewing of the program is instructed, it is determined whether display subtitle display is instructed. When it is determined that display subtitle display is instructed, display subtitle data is displayed. The decoder 35 decodes the display selection subtitle data, superimposes it on the video data, and outputs it to the television receiver 2. When it is determined that the display selection subtitle display is not instructed, the display selection subtitle data is not decoded, and the decoded video data and audio data are output to the television receiver 2.

  Then, in step S246, it is determined whether or not recording of a program is instructed. If it is determined in step S246 that recording of a program has not been instructed, the process ends.

  If it is determined in step S246 that the recording of the program has been instructed, the above-described recording data creation process is executed in step S247.

  In step S248, the output signal generation unit 33 supplies the recording data created by the process of step S6 to the home server 4 via the output terminal 23-1 and the output terminal 23-2.

  In step S249, metadata creation processing 2 described later with reference to FIG. 23 is executed.

  In step S250, the metadata generation unit 374 outputs the metadata created by the process of step S246 to the home server 352 via the output terminal 361, and the process ends.

  Next, the metadata creation process 2 executed in step S249 in FIG. 22 will be described with reference to the flowchart in FIG.

  In step S261, the program ID information extraction unit 39 extracts a program ID, which is program-specific information for recognizing the program, from the program management data included in the video data stored in the memory 32, and sets the program ID. Supply to the metadata generation unit 374

  In step S262, the display selection subtitle data decoder 35 acquires the video data stored in the memory 32, extracts the display selection subtitle data from the acquired video data, decodes it, and supplies it to the display selection subtitle data analysis unit 371. To do.

  In step S263, the display selection subtitle data analysis unit 371 analyzes text data corresponding to the display selection subtitle data, and determines a predetermined length (for example, a predetermined number of characters displayed at a time when display is selected, It is divided into text groups of such a length that can be read by the user for a predetermined time, and supplied to the time code addition processing unit 372.

  In step S264, the time code addition processing unit 372 uses the audio data output from the audio decoder 34 to compare the audio waveform with the supplied text group as described with reference to FIG. (Ie, the start position is shifted within a predetermined range such as 5 to 15 seconds) is detected, and the delay time of the text with respect to the speech data is calculated. The time code addition processing unit 372 refers to the timer 373 based on the calculated delay time, corrects the start time and end time, and adds the corrected time code to the supplied text group. And supplied to the metadata generation unit 374.

  In step S265, the metadata generation unit 374 adds the program ID supplied from the program ID information extraction unit 39 to the text data group with the time code supplied from the time code addition processing unit 372, and FIG. The metadata 161 described above is created and supplied to the home server 352 via the output terminal 361, and the processing is terminated.

  By such processing, the display selection subtitle decoder 351 decodes the display selection subtitle and superimposes it on the video when viewing the received broadcast signal based on the user's operation input, or displays the display selection. Recording data that can use text data corresponding to subtitles for search processing is generated and supplied to the home server 352 for recording, as well as using text data corresponding to decoded display selection subtitles, It is possible to generate metadata in which the time code is corrected based on the audio data and supply the metadata to the home server 352.

  Next, with reference to FIG. 24, the metadata storage process 2 executed by the home server 352 will be described.

  In step S <b> 381, the input terminal 381 acquires the metadata generated by the display selection subtitle decoder 351 and supplies the metadata to the metadata storage unit 78.

  In step S382, the metadata storage unit 78 stores the supplied metadata, and the process ends.

  The metadata stored in the home server 352 in this way is used when the search process described with reference to FIG. 19 is executed in the home server 362.

  Further, by encrypting the metadata created in the display selection subtitle decoder and supplying it to the home server 402, it is possible to execute the distribution of the decryption key and the billing process by the billing server 7.

  FIG. 25 uses the display selection subtitle decoder 401 configured to decode the display selection subtitle data and generate and encrypt the metadata, and the metadata generated by the display selection subtitle decoder 401. It is a functional block diagram which shows the function which can be implement | achieved with the home server 402 made | formed so that a search process can be performed.

  Note that portions corresponding to those in FIG. 3 or FIG. 21 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the display selection subtitle decoder 401 in FIG. 25 generates an encryption key using the information supplied from the program ID information extraction unit 411, and encrypts the metadata created by the metadata generation unit 374. A section 412 is newly provided, and in place of the program ID information extraction section 39, program ID information that can uniquely distinguish a program is extracted from the program management data, and among the information included in the program management data, encryption is performed. Basically the same as the display selection subtitle decoder 351 in FIG. 21 except that a program ID information extraction unit 411 that extracts information used to generate a key and supplies it to the encryption processing unit 412 is provided. The home server 402 is configured so that the encrypted metadata supplied from the input terminal 381 is stored in the encrypted metadata storage unit 75. Those with the home server 4 and basically the same configuration in FIG.

  When the display selection subtitle decoder 401 and the home server 402 in FIG. 25 are used, the processing of the metadata creation server 6 in FIG. 1 is omitted. Therefore, in the system in which the display selection subtitle decoder 401 and the home server 402 in FIG. 25 are used, the metadata creation process 1 described with reference to FIG. 13 and the metadata supply described with reference to FIG. The processing is omitted, and the processing 2 of the display selection subtitle decoder described with reference to FIG. 22 is executed. Instead of the metadata generation processing 2 executed in step S249, metadata described later with reference to FIG. Creation processing 3 is executed, and metadata storage processing 3 described later with reference to FIG. 27 is executed instead of the metadata storage processing described with reference to FIG. 17 or FIG.

  Further, the charging server 7 executes the user registration process 13 described with reference to FIG. 14 and the decryption key supply control process described with reference to FIG. 16, and the home server 352 describes with reference to FIG. Since the same processing as the above search processing is executed, the description thereof is omitted.

  The metadata creation process 3 executed in step S249 in FIG. 22 will be described with reference to the flowchart in FIG.

  In step S301, the program ID information extraction unit 411 creates a program ID, which is program-specific information for recognizing a program, and an encryption key from the program management data included in the video data stored in the memory 32. Information (if the information can be generated by distinguishing the corresponding decryption key stored in the key information database 209 of the accounting server 7 for each program, the program ID may be used), and the program ID is generated as metadata. The information used for encryption is supplied to the encryption processing unit 412 to the unit 374

  In step S302, the display selection subtitle data decoder 35 acquires the video data stored in the memory 32, extracts the display selection subtitle data from the acquired video data, decodes it, and supplies it to the display selection subtitle data analysis unit 371. To do.

  In step S303, the display selection subtitle data analysis unit 371 analyzes text data corresponding to the display selection subtitle data, and determines a predetermined length (for example, a predetermined number of characters displayed at one time when display is selected, It is divided into text groups of such a length that the user can read and understand in a predetermined time, and is supplied to the time code addition processing unit 372.

  In step S304, the time code addition processing unit 372 compares the audio data supplied from the audio signal decoder 34 with the respective text groups as described with reference to FIG. For example, a voice waveform whose start position is deviated within a predetermined range such as 5 to 15 seconds is detected, and a delay time of the text with respect to the voice data is calculated. The time code addition processing unit 372 corrects the start time and the end time with reference to the timer 373 based on the calculated delay time, and adds the corrected time code to the supplied text group. And supplied to the metadata generation unit 374.

  In step S305, the metadata generation unit 374 adds the program ID supplied from the program ID information extraction unit 39 to the text data group with the time code supplied from the time code addition processing unit 372, and displays FIG. The metadata 161 described above is created and supplied to the encryption processing unit 412.

  In step S306, the encryption processing unit 412 uses the encryption key corresponding to the decryption key stored in the key information database 209 of the accounting server 7 based on the information used for encryption supplied from the program ID information extraction unit 411. Create

  In step S306, the encryption processing unit 412 encrypts the metadata 161 supplied from the metadata generation unit 374 with the encryption key generated by the processing in step S306, and sends it to the home server 352 via the output terminal 361. Then, the process is terminated.

  By such processing, the display selection subtitle decoder 401 decodes the display selection subtitle and superimposes it on the video when viewing the received broadcast signal based on the user's operation input, or displays selection. Recording data that can use text data corresponding to subtitles for search processing is generated and supplied to the home server 401 for recording as well as using text data corresponding to decoded display selection subtitles, It is possible to generate metadata in which the time code is corrected based on the audio data, perform encryption, and supply the metadata to the home server 402.

  Next, the metadata storage process 3 executed in the home server 402 in FIG. 25 will be described with reference to the flowchart in FIG.

  In step S321, the input terminal 381 acquires the metadata generated by the display selection subtitle decoder 401 and supplies it to the encrypted metadata storage unit 75. Note that the processing in step S321 may be executed at any timing as long as step S329 described later is executed.

  In steps S322 to S311, processing similar to that in steps S142 to S151 described with reference to FIG. 17 is executed, and the processing ends.

  That is, access to a web page that is available on the Internet 5 and accepts a request for purchasing a decryption key for decrypting metadata, and is designated by information that designates a program for which metadata is desired, that is, designated by a program ID. The signal requesting the purchase of the decryption key for decrypting the encrypted metadata and the information necessary for the authentication process such as the user ID are transmitted to the accounting server 7 via the Internet 5. Based on the signal supplied from the accounting server 7, it is determined whether or not the authentication has been correctly performed. When it is determined that the authentication has been correctly performed, information necessary for the settlement process is transmitted to the billing server 7, and it is determined whether or not the settlement has been correctly completed. When it is determined that the payment has been correctly completed, the decryption key corresponding to the designated program ID is transmitted from the accounting server 7 and stored in the key information storage unit 76, and this decryption key is used to encrypt the metadata. The encrypted metadata stored in the storage unit 75 is decrypted, and the decrypted metadata is stored in the metadata storage unit 78. When it is determined that the authentication has not been correctly performed or when it has been determined that the payment has not been correctly completed, an error message indicating that the process has not been correctly completed is received and displayed on the display unit 74. Processing is terminated.

  Through such processing, encrypted metadata is supplied from the display selection subtitle decoder 401, processing for purchasing a decryption key for decrypting the metadata is executed, and a decryption key is obtained from the accounting server 7. Therefore, the decryption key can be stored in the home server 402 in order to decrypt the metadata and use it for the search process.

  Through the processing described above, when searching for recorded data using text data input by a user using display selection subtitle data, for example, by applying the present invention to live broadcasts such as news and sports broadcasts, It is possible to prevent the search position from shifting. In addition, a fee for decrypting the metadata used for the search processing is distributed to the user for a fee by the billing server 7, thereby paying the broadcasting station for the creation of the display selection subtitle data. Therefore, not only can it contribute to the development of the industry, but it also leads to an improvement in the ratio of subtitle data attached to the broadcast signal, which is very beneficial for the hearing impaired.

  The series of processes described above can also be executed by software. The software is a computer in which a program constituting the software is incorporated in dedicated hardware, or a various personal computer capable of executing various functions by installing various programs. For example, it is installed from a recording medium.

  As shown in FIG. 5 or FIG. 8, this recording medium includes a magnetic disk 121 (including a flexible disk) on which a program is recorded and an optical disk 122 distributed to provide a program to a user separately from the computer. Package media including CD-ROM (compact disk-read only memory), DVD (digital versatile disk), magneto-optical disk 123 (including MD (mini-disk) (trademark)), or semiconductor memory 124 Etc.

  Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but may be performed in parallel or It also includes processes that are executed individually.

  In the present specification, the term “system” represents the entire apparatus constituted by a plurality of apparatuses.

  Further, it goes without saying that the present invention is applicable even when processing executed by a part or all of a system constituted by a plurality of devices is realized by processing of the same information processing device. Yes.

It is a figure for demonstrating the structure of the information processing system to which this invention is applied. It is a figure for demonstrating the broadcast signal broadcast from the broadcasting station of FIG. It is a block diagram for demonstrating the display selection subtitle decoder and home server of FIG. It is a figure for demonstrating the video recording data produced | generated by the display selection subtitle decoder of FIG. It is a block diagram for demonstrating the structure of the metadata production server of FIG. It is a functional block diagram for demonstrating the process which the metadata production server of FIG. 5 performs. It is a figure for demonstrating the deviation | shift between display selection subtitle data and audio | voice data. It is a block diagram for demonstrating the metadata produced by a metadata production server. It is a block diagram for demonstrating the structure of the accounting server of FIG. It is a functional block diagram for demonstrating the process which the accounting server of FIG. 9 performs. It is a flowchart for demonstrating the process 1 of a display selection subtitle decoder. It is a flowchart for demonstrating recording data creation processing. 10 is a flowchart for explaining metadata creation processing 1; It is a flowchart for demonstrating a user registration process. It is a flowchart for demonstrating a metadata supply process. It is a flowchart for demonstrating a decryption key supply control process. 5 is a flowchart for explaining metadata storage processing 1; It is a flowchart for demonstrating a metadata acquisition process. It is a flowchart for demonstrating a search process. It is a flowchart for demonstrating an accounting process. It is a block diagram for demonstrating the structure from which a display selection subtitle decoder and a home server differ. It is a flowchart for demonstrating the process 2 of a display selection subtitle decoder. 10 is a flowchart for explaining metadata creation processing 2; 10 is a flowchart for explaining metadata storage processing 2; It is a block diagram for demonstrating the structure from which a display selection subtitle decoder and a home server differ. 10 is a flowchart for explaining metadata creation processing 3; 10 is a flowchart for explaining metadata storage processing 3;

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Broadcasting station 2 Television receiver 3 Display selection subtitle decoder 4 Home server 5 Internet 6 Metadata production server 7 Billing server 15 Video data 16 Audio data 17 Display selection subtitle data 21 Input terminal 33 Output signal generation part 35 Display selection subtitle data Decoder 36 OSD
37 Compositing processing section 39 Program ID information extracting section 40 Timer 41 Operation input section 71 Operation input section 72 Recording data storage section 73 Network interface 77 Decoding processing section 78 Metadata storage section 79 Matching processing section 80 Recording data detection output section 95 Recording start Time information 141 Broadcast data acquisition unit 143 Program ID information extraction unit 144 Metadata generation unit 145 Display selected caption data decoder 147 Time code addition processing unit 149 Encryption processing unit 152 Metadata supply control unit 161 Metadata 165 Text data 166 Time code 167 Program ID
204 Operation Input Information Acquisition Unit 205 User Information Registration Processing Unit 206 User Information Database 207 Authentication Processing Unit 208 Key Supply Processing Unit 210 Charging Processing Unit 211 Charging Information Database 351 Display Selection Caption Decoder 352 Home Server 372 Time Code Addition Processing Unit 374 Metadata Generation unit 401 Display selection subtitle decoder 402 Home server 412 Encryption processing unit

Claims (3)

In an information processing system configured by a third information processing device that generates metadata used for search processing executed by a second information processing device that searches recorded data using text information as a search key,
The second information processing apparatus
Storage of the recorded data to which first time information and discrimination information capable of uniquely distinguishing a program of a broadcast signal acquired and processed by a first information processing apparatus that acquires and processes a broadcast signal is added. Recording data storage control means to control;
Metadata acquisition means for acquiring the encrypted metadata;
Decryption key obtaining means for obtaining a decryption key used for decrypting the encrypted metadata;
Decryption processing means for decrypting the encrypted metadata acquired by the metadata acquisition means using the decryption key acquired by the decryption key acquisition means;
The metadata including the discrimination information for discriminating the program of the recorded data, the text data related to the recorded data, and the second time information corresponding to the text data, which is decoded by the decoding processing means, is stored. Metadata storage means for
Operation input means for receiving user operation input;
A matching process is executed between the information input from the user by the operation input means for designating a program to be searched and the text information as a search key and the metadata stored by the metadata storage means. Matching processing means for detecting the second time information corresponding to the text information serving as the search key;
A recording position corresponding to the second time information detected by the matching processing means is searched from the recording data whose storage is controlled by the recording data storage control means, and the recording position is started from the searched recording position. Search means for reading the recorded data, and
The third information processing apparatus
Second broadcast signal acquisition means for acquiring the broadcast signal;
Audio data decoding means for decoding an audio signal included in the broadcast signal acquired by the second broadcast signal acquisition means;
Second discrimination information acquisition means for acquiring the discrimination information capable of uniquely distinguishing the program of the broadcast signal from the broadcast signal acquired by the second broadcast signal acquisition means;
Subtitle data decoding means for extracting and decoding subtitle data that can be selected by the user from the broadcast signal acquired by the second broadcast signal acquisition means;
The audio data decoded by the audio data decoding unit and the text data corresponding to the subtitle data decoded by the subtitle data decoding unit are compared with each other, and based on the comparison result, a time code is added to the text data. A time code adding means for adding
Metadata generation means for generating the metadata by adding the discrimination information acquired by the second discrimination information acquisition means to the text data to which the time code is added by the time code addition means;
An information processing system comprising: encryption means for encrypting the metadata generated by the metadata generation means. A first information processing apparatus for acquiring and processing a broadcast signal;
A second information processing apparatus for searching recorded data using text information as a search key;
In an information processing system configured by a third information processing device that generates metadata used for search processing executed by the second information processing device,
The first information processing apparatus includes:
First broadcast signal acquisition means for acquiring the broadcast signal;
First discrimination information acquisition means for acquiring discrimination information capable of uniquely distinguishing the program of the broadcast signal from the broadcast signal acquired by the first broadcast signal acquisition means;
The recording data is generated by adding the first time information and the discrimination information acquired by the first discrimination information acquisition unit to the broadcast signal acquired by the first broadcast signal acquisition unit. Information adding means, and
The second information processing apparatus
Recording data storage control means for controlling storage of the recording data to which the first time information and the discrimination information are added;
Metadata acquisition means for acquiring the encrypted metadata;
Decryption key obtaining means for obtaining a decryption key used for decrypting the encrypted metadata;
Decryption processing means for decrypting the encrypted metadata acquired by the metadata acquisition means using the decryption key acquired by the decryption key acquisition means;
The metadata including the discrimination information for discriminating the program of the recorded data, the text data related to the recorded data, and the second time information corresponding to the text data, which is decoded by the decoding processing means, is stored. Metadata storage means for
Operation input means for receiving user operation input;
A matching process is executed between the information input from the user by the operation input means for designating a program to be searched and the text information as a search key and the metadata stored by the metadata storage means. Matching processing means for detecting the second time information corresponding to the text information serving as the search key;
A recording position corresponding to the second time information detected by the matching processing means is searched from the recording data whose storage is controlled by the recording data storage control means, and the recording position is started from the searched recording position. Search means for reading the recorded data, and
The third information processing apparatus
Second broadcast signal acquisition means for acquiring the broadcast signal;
Audio data decoding means for decoding an audio signal included in the broadcast signal acquired by the second broadcast signal acquisition means;
Second discrimination information acquisition means for acquiring the discrimination information capable of uniquely distinguishing the program of the broadcast signal from the broadcast signal acquired by the second broadcast signal acquisition means;
Subtitle data decoding means for extracting and decoding subtitle data that can be selected by the user from the broadcast signal acquired by the second broadcast signal acquisition means;
The audio data decoded by the audio data decoding unit and the text data corresponding to the subtitle data decoded by the subtitle data decoding unit are compared with each other, and based on the comparison result, a time code is added to the text data. A time code adding means for adding
Metadata generation means for generating the metadata by adding the discrimination information acquired by the second discrimination information acquisition means to the text data to which the time code is added by the time code addition means;
An information processing system comprising: encryption means for encrypting the metadata generated by the metadata generation means. A first information processing apparatus for acquiring and processing a broadcast signal;
A second information processing apparatus for searching recorded data using text information as a search key;
A third information processing device that generates metadata used for search processing executed by the second information processing device;
In an information processing system comprising: a fourth information processing device that supplies a decryption key for decrypting the metadata used for search processing executed by the second information processing device;
The first information processing apparatus includes:
First broadcast signal acquisition means for acquiring the broadcast signal;
First discrimination information acquisition means for acquiring discrimination information capable of uniquely distinguishing the program of the broadcast signal from the broadcast signal acquired by the first broadcast signal acquisition means;
The recording data is generated by adding the first time information and the discrimination information acquired by the first discrimination information acquisition unit to the broadcast signal acquired by the first broadcast signal acquisition unit. Information adding means, and
The second information processing apparatus
Recording data storage control means for controlling storage of the recording data to which the first time information and the discrimination information are added;
Metadata acquisition means for acquiring the encrypted metadata;
Decryption key obtaining means for obtaining the decryption key used for decrypting the encrypted metadata;
Decryption processing means for decrypting the encrypted metadata acquired by the metadata acquisition means using the decryption key acquired by the decryption key acquisition means;
The metadata including the discrimination information for discriminating the program of the recorded data, the text data related to the recorded data, and the second time information corresponding to the text data, which is decoded by the decoding processing means, is stored. Metadata storage means for
Operation input means for receiving user operation input;
A matching process is executed between the information input from the user by the operation input means for designating a program to be searched and the text information as a search key and the metadata stored by the metadata storage means. Matching processing means for detecting the second time information corresponding to the text information serving as the search key;
A recording position corresponding to the second time information detected by the matching processing means is searched from the recording data whose storage is controlled by the recording data storage control means, and the recording position is started from the searched recording position. Search means for reading the recorded data, and
The third information processing apparatus
Second broadcast signal acquisition means for acquiring the broadcast signal;
Audio data decoding means for decoding an audio signal included in the broadcast signal acquired by the second broadcast signal acquisition means;
Second discrimination information acquisition means for acquiring the discrimination information capable of uniquely distinguishing the program of the broadcast signal from the broadcast signal acquired by the second broadcast signal acquisition means;
Subtitle data decoding means for extracting and decoding subtitle data that can be selected by the user from the broadcast signal acquired by the second broadcast signal acquisition means;
The audio data decoded by the audio data decoding unit and the text data corresponding to the subtitle data decoded by the subtitle data decoding unit are compared with each other, and based on the comparison result, a time code is added to the text data. A time code adding means for adding
Metadata generation means for generating the metadata by adding the discrimination information acquired by the second discrimination information acquisition means to the text data to which the time code is added by the time code addition means;
And encryption means for encrypting the metadata generated by the metadata generation means,
The fourth information processing apparatus
Authentication information acquisition means for acquiring information related to authentication of the user from the second information processing apparatus;
Registration information storage control means for controlling storage of the registration information of the user;
Authentication processing means for executing authentication processing based on information on authentication of the user acquired by the authentication information acquisition means, and registration information of the user whose storage is controlled by the registration information storage control means;
And a decryption key supply control means for controlling supply of the decryption key for decrypting the metadata to the second information processing apparatus when the user is correctly authenticated by the authentication processing means. Information processing system.

Images