JP2011065405A - Display device and display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique which extracts text data included in a video to link the extracted text data with the video. <P>SOLUTION: A reproducing part 50 includes a telop processing part 60 as a function for using a phrase or a text of a telop for search processing and editing processing. The telop processing part 60 includes a phrase search part 62, a telop amount search part 64, and a telop amount editing part 66. The phrase search part 62 takes a phrase of telop information which is recorded in a data storage part 70 by a recording part 30, as a key to perform processing of searching the head of a recorded moving image (search processing). The telop amount search part 64 takes a text amount associated in time series out of the telop information, as a key to perform processing of searching the head of a moving image. The telop amount editing part 66 uses the text amount to generate a moving image resulting from collecting highlight scenes. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a display device and a display method, and more particularly to a display device and a display method for reproducing an image including characters such as telops.

  In recent TV programs, the use of telops is diversified, and not only movie subtitles and recipes for cooking programs, but also many telops are displayed in phrases that remain in impressions on variety programs. Yes.

  Conventionally, various techniques have been proposed for using broadcasts that include text information such as telops in video. For example, there is a technique for recognizing a telop part from a television broadcast and a recorded video and storing the text information (see Patent Document 1). Further, although different from telop, there is a technique for storing a recording medium (IC card) on which character information of teletext, particularly TV program guide information is recorded, in association with another recording medium (video tape) on which the program is recorded. (See Patent Document 2).

JP 2001-111910 A JP 2007-332977 A

  By the way, the technique disclosed in Patent Document 1 aims to construct a database with a small amount of data by extracting and storing character information such as telops from video. However, the cooperation between the extracted text data and the video has not been considered. Further, the technique disclosed in Patent Document 2 is limited to character information such as teletext received as a separate video, and no consideration is given to the use of telop. Furthermore, the linkage with the recorded program is very limited, and another technique is required.

  In view of the above problems, an object of the present invention is to provide a technique for extracting text data included in a video and linking the extracted text data and the video.

The device according to the present invention relates to a display device. The display device relates to a text extraction unit that extracts text data of a telop included in a moving image, and a related processing unit that associates the extracted text data with an extraction position of the text data in the moving image and records it in a storage unit. And a search processing means for searching for the moving image based on the extracted text data.
The text extraction unit extracts a phrase included in the text data, and the related processing unit records the phrase and the position of the moving image in which the phrase is included in association with each other, and performs the search. The processing means may determine the playback position of the moving image based on the phrase.
Further, the search processing means receives a specification of a search target phrase from a user, specifies a position of the moving image including the specified phrase, and determines a position of the specified moving image as a reproduction position. Also good.
Further, when there are a plurality of positions including a phrase specified by the user, the search processing means displays a thumbnail image corresponding to the position including the phrase so that the user can specify the thumbnail, and the thumbnail specified by the user The moving image may be reproduced from a position corresponding to the image.
Further, the search processing means extracts the amount of the text data in a time series, displays the reproduction position of the moving image in association with the position of the moving image so as to be designated by the user, and is designated by the user. You may perform the reproduction | regeneration processing of the said moving image from a position.
Further, the search processing means may extract the amount of the text data in time series, and generate a video of a peak portion of the amount of the text data as a search image.
And a receiving unit that receives the moving image as a broadcast wave, and a content storage unit that records the received moving image, and the related processing unit is configured to record the extracted text when recording the moving image. Data and the extraction position of text data in the moving image may be recorded in association with each other.
Another embodiment of the present invention relates to a display method. This display method includes a text extraction step of extracting text data of a telop included in a moving image, a related processing step of associating the extracted text data with an extraction position of the text data in the moving image and storing them in a storage means. And a search processing step for searching for the moving image based on the extracted text data.
Further, the text extraction step extracts a phrase included in the text data, and the related processing step records the phrase in association with the position of the moving image in which the phrase is included, and the search The processing step may determine a reproduction position of the moving image based on the phrase.
Further, the search processing step receives a specification of a phrase to be searched from a user, specifies a position of the moving image including the specified phrase, and reproduces the position of the specified moving image as the moving image. The position may be determined.
In addition, when there are a plurality of positions including the phrase specified by the user, the search processing step displays a thumbnail image corresponding to the position including the phrase so that the user can specify the thumbnail, and the thumbnail specified by the user The content may be reproduced from a position corresponding to the image.
In addition, the search processing step extracts the amount of the text data in time series, displays the reproduction position of the moving image in association with the position of the moving image so as to be designated by the user, and is designated by the user. You may perform the reproduction | regeneration processing of the said moving image from a position.
Further, the search processing step may extract the amount of the text data in time series and generate a video of a peak portion of the amount of the text data as a search image.
A receiving step for receiving the moving image as a broadcast wave; and a content storing step for recording the received moving image, wherein the related processing step is performed when the moving image is recorded. The text data and the extraction position of the text data in the moving image may be recorded in association with each other.

  According to the present invention, it is possible to provide a technique for extracting text data included in a video and linking the extracted text data and the video.

It is a functional block diagram which shows schematic structure of the recorder based on embodiment of this invention. It is a functional block diagram which shows the structure of the recording part based on embodiment of this invention. It is the figure which showed the content of the data which are related with the time stamp, content ID of a program, and the extracted phrase based on embodiment of this invention, and are recorded on a data storage part. It is a functional block diagram which shows the structure of the reproducing part based on embodiment of this invention. It is a figure explaining the process of the mode which a user inputs the phrase to search based on embodiment of this invention. It is a figure explaining the process of the mode which a user selects the phrase to search based on embodiment of this invention. It is the figure which showed the example of a search screen when searching based on the amount of telops based on embodiment of this invention. It is the figure which showed the example of an edit setting screen when producing | generating the highlight moving image based on the amount of telop based on embodiment of this invention. It is the figure which showed typically the relationship of the highlight moving image produced | generated, the telop amount used for the production | generation, and the peak image based on embodiment of this invention.

Next, a mode for carrying out the present invention (hereinafter referred to as “embodiment”) will be specifically described with reference to the drawings. In the following embodiment, telop information included in video such as broadcast is extracted, the text information is stored, and is used for a search function at the time of reproduction. The outline of the main technologies is as follows 1) to 4).
1) Associating (tagging) and storing video data and text-formatted telop information.
2) When searching for recorded data, search from the telop information.
3) Monitor the telop amount (text amount) on the time axis, and edit and play back only the highlighted part of the program.
4) Search for the playback position using the amount of telop as a key.

  FIG. 1 is a functional block diagram showing a schematic configuration of a recorder 10 according to the present embodiment. The recorder 10 is exemplified as a single product, but may be in a form incorporated in a television. As illustrated, the recorder 10 includes a recording / playback processing unit 20, a main control unit 12, an operation acquisition unit 14, and an output unit 16.

  The main control unit 12 comprehensively controls each component of the recorder 10. The operation acquisition unit 14 is an element that receives a user operation, and is provided in the recorder 10 to acquire a user's direct operation or to acquire a wireless operation from the controller (RC) 80. Based on an instruction from the user acquired by the operation acquisition unit 14 and according to a predetermined setting, the main control unit 12 controls each component. Further, the output unit 16 converts the reproduction output of the reproduction unit 50 of the recording / reproduction processing unit 20 into a signal of a desired standard, for example, HDMI standard or DVI standard, and outputs the signal to the display unit 90.

  The recording / playback processing unit 20 includes a tuner 21, an external input unit 22, a disk unit 23, and a source selection unit 24 as video input sources. The tuner 21 is a general digital tuner that receives and demodulates a digital broadcast, and performs a demodulation process, a DeMUX process, and the like on a digital broadcast wave signal received by an antenna (ATT), thereby providing a digital broadcast wave. TS is taken out from the video, and a video stream and an audio stream are taken out from the TS. The external input unit 22 acquires external content. Further, the disc unit 23 is a drive that performs reproduction and recording processing of a Blu-ray disc (hereinafter referred to as “BD”) and a DVD (Digital Versatile Disc). The recording / playback processing unit 20 includes a recording unit 30, a playback unit 50, and a data storage unit 70 that is a recording medium such as an HDD (Hard Disk Drive) or a flash memory as a built-in recording medium.

  FIG. 2A is a functional block diagram showing the configuration of the recording unit 30. As shown in FIG. The recording unit 30 decodes the video stream and audio stream acquired from the tuner 21 via the disk unit 23, performs desired content conversion, for example, conversion processing such as size and resolution, and then encodes again. Processing is performed and recording is performed on a predetermined recording medium such as the data storage unit 70 or the disk unit 23. In order to realize such processing, the recording unit 30 includes a decoding processing unit 32 and an encoding processing unit 34. An example of the recorder 10 that performs such a recording process is a DVD recorder. Note that the recorder 10 that records the TS as it is without performing the decoding process is a BD recorder, and the recording unit 30 can be configured as shown in FIG. In that case, a TS selection unit 46 for selecting a desired TS is provided, and the selected TS is recorded as it is, and as a function for analyzing the telop, as in FIG. A text conversion unit 40, a telop tag processing unit 42, and a telop amount calculation unit 44 are provided. Below, it demonstrates based on the structure of Fig.2 (a).

  The recording unit 30 includes a telop text conversion unit 40, a telop tag processing unit 42, and a telop amount calculation unit 44 as a configuration for recognizing and recording a telop in order to realize a search function based on the telop. Note that a technique in which the telop text converting unit 40 recognizes a telop from an image and converts it into a text can be a known technique (for example, the technique disclosed in Patent Document 1). When the video stream of digital broadcasting is based on the MPEG standard, the video stream is composed of three types of frames: I picture, P picture, and B picture. The I picture is a reference frame, the P picture is predicted and generated from the I picture, and the B picture is predicted and generated from the I picture and the P picture. Therefore, from the viewpoint of reducing the load of recognition processing, only I pictures may be targeted for telop recognition processing. For example, the above-described known technique can be used as a method for identifying the telop area in the frame.

  The telop tag processing unit 42 associates the text extracted by the telop text conversion unit 40 with the frame in which the text was included. Normally, a TS stream includes a time stamp (PTS) for synchronization processing and an ID for specifying a channel or a program (hereinafter simply referred to as “program ID”). For example, the event ID is described in an EIT (Event Information Table) as an ID for identifying a program. In addition, there is a service ID as an ID for specifying a channel.

  Therefore, the telop tag processing unit 42 records the time stamp (time information generated based on the time stamp), the program ID, and the extracted phrase (text) in the data storage unit 70 in association with each other. Hereinafter, the information regarding the phrase extracted from the telop and recorded in the data storage unit 70 is referred to as “telop information”. FIG. 3 is a table showing an example of telop information recorded in the data storage unit 70. The telop information includes a program ID, time information, and a phrase. For example, the telop information at the top of the table is a program ID “0X1234”, time information “00:03:00”, and the phrase “Hawaii, beach”. As time information, information corresponding to the recording time (content length) is recorded, but the PTS included in the TS may be recorded as it is, and is recorded with a correspondence relationship that can specify the position where the phrase is included. As long as it is, it may be recorded in any manner. Further, the phrase may indicate a phrase included at a certain point in time, or may be a phrase included within a predetermined time of, for example, 15 seconds. The data storage unit 70 is illustrated as a means for recording content and telop information. However, the present invention is not limited to this, and the disk unit 23 may be used, and the location where the content and telop information are recorded is different. Also good.

  Then, by using the phrase recorded in the data storage unit 70 as a search key, it is possible to perform a reproduction position search based on telop information including a phrase or the like left in an impression in an actual video. . Note that the telop area extraction unit 36 may perform text extraction processing by specifying the telop area by analyzing all types of frames. However, if a small processing load or speedy processing is required, the telop area extraction unit 36 may specify the telop area. More specifically, only an I picture may be selected as a processing target.

  The telop amount calculation unit 44 calculates the amount of telop (number of characters or number of phrases) in time series for each program, that is, for each program ID, and records it in the data storage unit 70. By referring to the amount of telops recorded in time series in the data storage unit 70, it is possible to specify a scene in which many telops are displayed in the program. A search example of program contents based on the amount of telop will be described later with reference to FIG. The telop information can be recorded not only at the time of recording the program, but also for a recorded program.

Next, the playback function will be described mainly focusing on search processing.
FIG. 4 is a functional block diagram showing a schematic configuration of the playback unit 50. The playback unit 50 includes a decoding processing unit 52 and a presentation processing unit 54 as general playback processing functions. The decoding processing unit 52 decodes a signal encoded according to the MPEG standard for video and audio. In addition, the decoding processing unit 52 decodes a signal encoded according to a multimedia encoding standard using, for example, the BML language for text broadcasting and the like. The presentation processing unit 54 performs video / audio / data presentation processing. The presented screen is configured by superimposing a plurality of data broadcasting screens on a screen (plane) on which a video signal is displayed as necessary. The presentation processing unit 54 performs the configuration process and outputs it to the output unit 16.

  Furthermore, the playback unit 50 includes a telop processing unit 60 as a function for using a telop phrase or text for search processing and editing processing. The telop processing unit 60 includes a phrase search unit 62, a telop amount search unit 64, and a telop amount editing unit 66.

  The phrase search unit 62 performs a cueing process (search process) of the recorded moving image using the phrase of the telop information recorded in the data storage unit 70 by the recording unit 30 as a key. The telop amount search unit 64 performs a cueing process of a moving image using the text amount associated with the time series in the telop information as a key. The telop amount editing unit 66 uses the amount of text included in the telop, that is, the number of characters to generate a moving image that is collected by editing the highlight scene.

  A cueing process using a phrase will be described based on the search screen examples of FIGS. 5 and 6. The process shown here is mainly performed by the phrase search unit 62. FIG. 5 is a diagram illustrating processing in a mode in which a user inputs a phrase to be searched. The user operates the operation acquisition unit 14 directly or via the controller 80 to display the search screen A10 shown in FIG. 5 from the menu screen or the like. The search screen A10 includes an upper phrase input area A20 and a lower search result display area A30.

  The phrase input area A20 includes a program designation area A21, a program name selection area A22, a search type designation area A23, a search phrase input area A24, and a search execution button A25. In the program designation area A21, the user selects whether or not to designate a program as a phrase search target. In this case, “Yes” indicating the designation is selected. When a program is designated, the recorded content is displayed in the program name selection area A22 so that the user can designate it. Here, the program name “ABCD Journey” is selected. When “none” is selected in the program designation area A21, the entire program recorded in the data storage unit 70 is the target of phrase search. However, the target is limited to the content for which the telop has been analyzed. In the program name selection area A22, for example, “entire” is displayed.

  The search type designation area A23 accepts designation of a phrase search method from the user. Specifically, the user selects either the “input” type or the “selection” type. Here, the “input” type is selected. When the “input” type is selected, the search phrase input area A24 is displayed, and the user inputs a desired phrase in the search phrase input area A24. Then, when the search execution button A25 arranged under the search phrase input area A24 is pressed, the search is executed. Here, “Hawaii” is entered as a search target phrase.

  By pressing the search execution button A25, the phrase search unit 62 of the telop processing unit 60 refers to the telop information recorded in the data storage unit 70, searches for the input phrase, and if a phrase exists, Identify the frame associated with the phrase. The search result is displayed in the search result display area A30.

  The search result display area A30 includes a time series axis A31, a thumbnail image area A32, and a selected frame display area A33. The time series axis A31 displays the time series position of the searched phrase with a predetermined mark. Here, five positions are displayed. The thumbnail image area A32 displays a frame associated with the searched phrase as a thumbnail image. At this time, the thumbnail image area A32 is associated with the display of the time-series axis A31. The user can select a desired thumbnail image displayed in the thumbnail image area A32 by operating the controller 80 or the like. The selected thumbnail image and the time-series position corresponding to the thumbnail image are highlighted and displayed. Here, the third thumbnail image is selected. Then, the selected thumbnail image is displayed in the selected frame display area A33 in an easily viewable manner. When the highlighted thumbnail image is selected, content playback is started from the position of the frame associated with the selected thumbnail image and output to the display unit 90.

  Next, based on FIG. 6, a display mode when a search for selecting a phrase is designated will be described. Similar to FIG. 5, the search screen A10 includes an upper phrase input area A20 and a lower search result display area A30. Here, in the search type designation area A23, the “selection” type is designated by the user. At this time, the phrase search unit 62 refers to the telop information recorded in the data storage unit 70 and displays the extracted phrase in the search phrase selection area A26. At the time of this display, for example, the numbers are displayed so that the number of phrases included can be understood in descending order. In the figure, five types of phrases are displayed so as to be selectable. For example, the phrase “Hawaii” is extracted and recorded 21 times. Here, the second phrase “Honolulu” is selected as the search phrase. A plurality of selectable phrases may be used. When the search button A25 is pressed after selection, the search result is displayed in the search result display area A30 as in FIG.

  As described above, the character information displayed in the telop can be extracted, recorded as telop information in association with the extraction source frame, and the telop information can be used as a program search function. As a result, it is possible to perform a program search from a phrase or the like that remains impressive to the user. In other words, it is possible to search for a desired place by a more intuitive search method rather than a search from program name, genre, and performer information. Further, since the data storage unit 70 is recorded as text data or a format conforming thereto, the amount of data required is very small, and when compressed, it can be further reduced without affecting the content recording. .

  Next, a search function based on the telop amount will be described. The processing shown here is mainly performed by the telop amount search unit 64. FIG. 7 shows a search screen B10 when performing a search based on the amount of telop. As shown in the figure, the search screen B10 is composed of a search designation area B20 and a search result display area B30. Similar to the processing shown in FIGS. 5 and 6, the user operates the operation acquisition unit 14 to display the search screen B10 shown in FIG. 7 from the menu screen or the like.

  Next, the user designates content to be searched in the program name selection area B22. At this time, the telop amount search unit 64 refers to the content recorded in the data storage unit 70 and displays the searchable content so that it can be designated by the user. When the user specifies desired content and presses the search button B25, the telop amount search unit 64 uses the telop information recorded in the data storage unit 70 as shown in the search result display area B30. The telop amount is displayed as a graph in time series. Specifically, the search result display area B30 includes a telop amount graph display area B31, a thumbnail image area B32, and a selected frame display area B33.

  The telop amount graph display area B31 displays the telop amount included in the content to be searched, that is, the amount of text as a graph B31a in time series. Furthermore, the telop amount graph display area B31 includes an operation bar B31b below the graph B31a. The operation bar B31b indicates the position displayed in the selected frame display area B33 by the instruction icon B31c, and the reproduction position can be designated by moving the position of the instruction icon B31c.

  A thumbnail image area B32 is provided above the telop amount graph display area B31, and a selection frame display area B33 is further provided thereon. In the thumbnail image area B32, a thumbnail image of a portion where the telop amount shows a peak in the telop amount graph display area B31 is displayed. Here, five peaks are shown, and five thumbnail images are shown correspondingly. The number of thumbnail images may be fixed, may be set by the user, or may be variable depending on the number of detected peaks.

  Then, the image at the position specified by the user with the instruction icon B31c of the operation bar B31b provided in the above-described telop amount graph display area B31 is displayed in the selected frame display area B33. For example, in a content such as a variety program, there may be a correlation between the content excitement scene and the amount of telop. When viewing such content, an effective cueing operation can be performed by performing a search based on the amount of telop.

  Next, a process for generating a highlight moving image using telop information, particularly a telop amount, will be described. The processing shown here is mainly performed by the telop amount editing unit 66. In order to display the highlight movie, for example, a button for selecting the highlight movie is provided on the controller 80. When the user presses the button, the telop amount editing unit 66 displays a highlight moving image for the content recorded in the data storage unit 70. Then, the user confirms the highlight moving image, selects desired content with the controller 80, and issues a playback instruction.

  FIGS. 8A and 8B show an edit setting screen C10 when a highlight moving image based on the amount of telop is generated. FIG. 9 schematically shows the relationship between the highlight movie to be generated, the amount of telop used to generate it, and the peak image. Conditions such as the generation time of the moving image are shown in FIG. It corresponds to. The peak image indicates an image at a position where the telop amount shows a peak.

  In order to set the highlight moving image generation, the user operates the operation acquisition unit 14 to display the edit setting screen C10 shown in FIGS. 8A and 8B from the menu screen or the like. After displaying the edit setting screen C10, the user first sets a target for generating a highlight moving image in the highlight moving image target setting area C21. As shown in the figure, either “all” for all contents, “designation” for designating the type (genre) of content, or “none” for designating that no highlight movie is generated is selected. . Now, “Specify” is selected, and in this condition, a desired genre is displayed so that it can be selected from a list. In the figure, five types of genres can be specified, and “Variety” is specified by the user. Has been.

  Next, the user designates how to determine the length (time) of the highlight movie in the movie length designation area C22. Here, either the full length of the highlight movie or the length of the peak image constituting the highlight movie is designated.

  FIG. 8A shows a case where the mode for specifying the “full length” that determines the total length of the highlight video is selected. The user further inputs a desired time in the moving image time designation area C23. Here, “20 seconds” is input as the time of the highlight moving image. Subsequently, the user inputs the maximum number of images in the image number designation area C24. Here, “5” is input as the maximum number of peak images. Therefore, when there are five or more peaks in the telop amount, images of portions corresponding to the five peaks having a large telop amount are extracted and become a highlight moving image. In the example in the figure, since the highlight moving image is 20 seconds, the length of each extracted image is 4 seconds. When the input of the conditions is completed, the user presses the setting button C26 to set a desired condition regarding the generation of the highlight moving image, and the telop amount editing unit 66 generates a highlight image every time recording is performed.

  FIG. 8B shows a case where a mode for specifying the number of peak images is selected. FIG. 9 schematically shows the relationship between the generated highlight moving image, the telop amount used for the generation, and the peak image. In this case, the user inputs the maximum number of images in the image number designation area C24, and further inputs the length of each peak image in the time designation area C25. Here, the number of images is “5”, and the length of each peak image is 6 seconds, 3 seconds before and after the peak center. Therefore, the length of the generated highlight moving image is 30 seconds.

  As described above, it is possible to generate an effective search image by generating a highlight moving image based on the amount of telop. In particular, when there is a correlation between the amount of telop and the rising part of the content, a highlight image in which the rising part is effectively extracted can be generated and used as an image for search.

  In the above description, the mode in which the content is automatically generated every time content is recorded has been described. However, the present invention can also be applied to the mode in which the user designates the content for creating the highlight video.

  The present invention has been described based on the embodiments. This embodiment is an exemplification, and it will be understood by those skilled in the art that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are also within the scope of the present invention. .

10 recorder 12 main control unit 14 operation acquisition unit 20 recording / playback processing unit 30 recording unit 32 decoding processing unit 34 encoding processing unit 40 telop text conversion unit 42 telop tag processing unit 44 telop amount calculation unit 50 playback unit 52 decoding processing unit 54 Presentation processing unit 60 Telop processing unit 62 Phrase search unit 64 Telop amount search unit 66 Telop amount editing unit 70 Data storage unit

Claims (14)

Text extraction means for extracting text data of the telop included in the moving image;
Associated processing means for associating the extracted text data with the extracted position of the text data in the moving image and recording it in a storage means;
Search processing means for performing search processing of the moving image based on the extracted text data;
A display device comprising: The text extraction means extracts a phrase included in the text data,
The related processing means records the phrase in association with the position of the moving image in which the phrase was included,
The display device according to claim 1, wherein the search processing unit determines a playback position of the moving image based on the phrase.   The search processing means receives a specification of a search target phrase from a user, specifies a position of the moving image including the specified phrase, and determines the specified position of the moving image as a reproduction position. The display device according to claim 2.   When there are a plurality of positions including the phrase specified by the user, the search processing means displays a thumbnail image corresponding to the position including the phrase so that it can be specified by the user, and displays the thumbnail image specified by the user. The display device according to claim 3, wherein the moving image is reproduced from a corresponding position.   The search processing means extracts the amount of the text data in time series, displays the reproduction position of the moving image in association with the position of the moving image so that it can be designated by the user, and starts from the position designated by the user. The display device according to claim 3, wherein the moving image reproduction process is performed.   6. The search processing unit according to claim 3, wherein the search processing unit extracts the amount of the text data in time series, and generates an image of a peak portion of the amount of the text data as a search image. The display device described. Receiving means for receiving the moving image as a broadcast wave;
Content storage means for recording the received moving image;
With
7. The related processing unit according to claim 1, wherein when the moving image is recorded, the extracted text data and the extracted position of the text data in the moving image are recorded in association with each other. The display device described. A text extraction step of extracting text data of the telop included in the moving image;
An associated processing step of associating the extracted text data with an extraction position of the text data in the moving image and recording it in a storage means;
A search processing step of performing search processing of the moving image based on the extracted text data;
A display method comprising: The text extraction step extracts a phrase included in the text data,
The related processing step records the phrase and the position of the moving image in which the phrase is included in association with each other,
The display method according to claim 8, wherein the search processing step determines a playback position of the moving image based on the phrase.   The search processing step receives a specification of a search target phrase from a user, specifies a position of the moving image including the specified phrase, and uses the specified position of the moving image as a reproduction position of the moving image. The display method according to claim 9, wherein the display method is determined.   In the case where there are a plurality of positions including a phrase specified by the user, the search processing step displays a thumbnail image corresponding to the position including the phrase so as to be specified by the user, and displays the thumbnail image specified by the user. The display method according to claim 10, wherein the content is reproduced from a corresponding position.   The search processing step extracts the amount of the text data in time series, displays the reproduction position of the moving image in association with the position of the moving image so that the user can specify the reproduction position, and starts from the position specified by the user. The display method according to claim 10, wherein the moving image reproduction process is performed.   13. The search processing step of extracting the amount of the text data in time series and generating an image of a peak portion of the amount of the text data as a search image. Display method of description. A receiving step of receiving the moving image as a broadcast wave;
A content storage step for recording the received moving image;
With
14. The related processing step, when recording the moving image, records the extracted text data and the extracted position of the text data in the moving image in association with each other. Display method described in.

Images