JP2008216397A - Apparatus and method for presenting information and apparatus and method for creating presentation information - Google Patents

Abstract

To enable both a normal hearing person and a hearing-impaired person to grasp information contents easily, quickly and accurately.
When text data is received by an input control unit 102, a keyword is extracted by morphological analysis of the text data by a keyword extraction unit 103, and from the bulleted text storage unit 110 based on the extracted keyword. The corresponding bulleted text data is acquired, and the corresponding fragment sign language video data is acquired from the fragment sign language data storage unit 120. Then, the obtained bulleted text data and fragment sign language video data are synthesized according to the layout of the presentation template obtained from the presentation template storage unit 130 to create presentation information content, and this presentation information content is displayed by the output control unit 105. It is displayed on the device 106.
[Selection] Figure 1

Description

  The present invention relates to an apparatus and method for visually presenting emergency information, for example, and an apparatus and method for creating the presentation information.

  For example, in the event of a disaster such as a large-scale earthquake or a failure in transportation, emergency information such as disaster or failure status and evacuation methods should be notified to users quickly and accurately in a public space to minimize damage. It has become an important social issue to keep down. As a means for notifying emergency information in a public space, one using voice announcement is generally used. However, the notification means using the voice announcement cannot inform the hearing-impaired person such as the deaf and deaf, and it is difficult to hear the information even in a normal hearing person in an environment where the surrounding noise is large. Low effectiveness.

  Therefore, conventionally, information notifying means using a visual display device is often used. As this visual information presentation means, for example, a telop is displayed on an electronic bulletin board, or a text document is displayed on a graphic display. In addition, as information presentation means for hearing impaired persons, a technique for producing and displaying subtitles for input voice by using voice processing and natural language processing (for example, see Non-Patent Document 1), three-dimensional computer graphics A technique for synthesizing and displaying a sign language animation in real time by using a technology (see, for example, Non-Patent Document 2) is known.

"Automatic production system of captioned TV programs for hearing impaired persons" IEICE Transactions D-II Vol.J84-D-II No.6 pp.888-897 June 2001

"Synthesis Method of Real-Time Sign Language Animation" IEICE Transactions D-II Vol.J79-D-II No.2 pp.182-190 February 1996

  However, in the conventional information presenting means, subtitles tend to be long depending on the input voice, and the displayed text must be read from the beginning to the end in order to grasp the information content. It takes. In particular, it is not easy for a hearing-impaired person who loses hearing before 9 years old and speaks sign language as a native language to quickly read down a long sentence displayed in telop and understand the contents.

  On the other hand, the number of phrases that can be directly expressed in sign language is generally small. For this reason, it is difficult to accurately convey the contents of emergency information by means of synthesizing and displaying a sign language animation in real time. In addition, there is a problem that a normal hearing person who has not acquired sign language cannot understand sign language.

  The present invention has been made paying attention to the above circumstances, and the object thereof is to provide an information presentation apparatus and method that enable both a normal hearing person and a hearing-impaired person to grasp information contents easily, quickly and accurately. And an apparatus and method for creating the presentation information.

  In order to achieve the above object, an information presentation apparatus and method according to the present invention comprise the following means or processes. That is, first, text data is received by the input interface, and a keyword included in the text data is extracted by analyzing the text data. Next, the bulleted text data corresponding to the extracted keyword is retrieved by accessing the first storage device storing the bulleted text data corresponding to the keyword in association with the preset keyword. The fragment sign language data corresponding to the extracted keyword is accessed by accessing a second storage device that stores fragment sign language data that expresses the content of the keyword in fragmented sign language video in association with the keyword. Search for. Then, the searched itemized text data and the fragment sign language data are associated with each other and synthesized to generate information presentation content, and the generated information presentation content is output for visual presentation. Is.

That is, the bulleted text data corresponding to the keyword extracted from the input sentence data and the fragment sign language data expressing the content of the keyword by the fragment sign language video are respectively read from the storage device. Then, these are combined in a state of being associated with each other, and the information presentation content created by this combining process is visually presented to the user.
Therefore, the hearing-impaired person can easily and quickly grasp the content of the presentation information by using the fragment sign language video and the itemized text presented in association therewith. Moreover, since the bulleted text is presented together with the fragment sign language video, the normal hearing person can easily and quickly grasp the content of the presentation information.

On the other hand, the presentation information creating apparatus and method according to the present invention comprises the following means or processes. That is, first, text data is received by the input interface, and a keyword included in the text data is extracted by analyzing the text data. Next, the bulleted text data corresponding to the extracted keyword is retrieved by accessing the first storage device storing the bulleted text data corresponding to the keyword in association with the preset keyword. The fragment sign language data corresponding to the extracted keyword is accessed by accessing a second storage device that stores fragment sign language data that expresses the content of the keyword in fragmented sign language video in association with the keyword. Search for. Then, the searched itemized text data and the fragment sign language data are associated with each other and synthesized to generate information presentation content.
Therefore, it is possible to generate a presentation information content that enables a hearing-impaired person to grasp information content easily and quickly, and for a normal hearing person to grasp the information content.

  In short, according to the present invention, there are provided an information presentation device and method, and a device and method for creating the presentation information, which enable both the normal hearing person and the hearing-impaired person to grasp information contents easily, quickly and accurately. can do.

Embodiments according to the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing an embodiment of an information presentation apparatus according to the present invention. The information presentation apparatus 100 includes an input control unit 102, a keyword extraction unit 103, a main control unit 104, and an output control unit 105. Among these, the input control part 102, the keyword extraction part 103, and the main control part 104 comprise a presentation information creation apparatus.

  The input control unit 102 takes in the text data output from the information input device 101 and gives it to the keyword extraction unit 103. The information input device 101 includes a device that recognizes a voice signal announced by a speaker, for example, and converts it into text data composed of text. The information input device 101 may be a device that optically reads a handwritten sentence by a scanner and converts it into sentence data composed of text, or a personal computer having a sentence creation function.

  The keyword extraction unit 103 is composed of, for example, a DSP (Digital Signal Processor) and a buffer memory. After the text data sent from the input control unit 102 is temporarily stored in the buffer memory, the DSP uses a text analysis method such as morphological analysis. Then, the document data is analyzed and a keyword included in the sentence data is extracted. The keyword data extracted by the keyword extraction unit 103 is temporarily stored in a buffer memory in the main control unit 104.

  The main control unit 104 is configured by a computer, for example, and includes an information itemized text storage unit 110, an itemized text acquisition unit 111, a fragment sign language data storage unit 120, a fragment sign language data acquisition unit 121, and a presentation template storage unit 130. The presentation template acquisition unit 131 and the list sign language synthesis unit 140 are provided. Among these, the information itemized text storage unit 110, the fragment sign language data storage unit 120, and the presentation template storage unit 130 are configured by a storage device using a hard disk or a flash memory as a storage medium.

  On the other hand, the bulleted text acquisition unit 111, the fragment sign language data acquisition unit 121, the presentation template acquisition unit 131, and the list sign language synthesis unit 140 all execute application programs stored in a program memory (not shown) as a central processing unit (CPU; It is realized by executing it in the Central Processing Unit.

  The information itemized text storage unit 110 stores itemized text data in association with preset item categories. For example, when presenting information on the train operation status, it is divided into “event”, “cause”, “route”, “section”, “recovery time” and “alternative transport” as shown in FIG. The itemized text data 202 is stored in association with each item 201. This bulleted text data is text data that summarizes only the main points in a short sentence.

  The fragment sign language data storage unit 120 includes a fragment sign language index storage unit and a fragment sign language video storage unit. The fragment sign language index storage unit stores itemized text in association with preset item categories, and index data for associating the itemized text with fragmented sign language video data. For example, as described above, when presenting information on the train operation status, as shown in FIG. 3, “event”, “cause”, “route”, “section”, “recovery time” and “alternative” Bulleted text data 202 and index data 303 are stored in association with each item 301 classified as “transportation”.

  For example, as shown in FIG. 4, the fragment sign language video storage unit stores fragment sign language video data 304 and fragment sign language expression data 305 in association with the index data 303. The fragment sign language video data 304 is an image of the appearance of the content represented by the corresponding bulleted text by the sign language interpreter expressed in sign language by a demonstration. The fragment sign language expression data 305 is composed of code data necessary to create a three-dimensional computer graphics fragment sign language animation image corresponding to the bulleted text.

  The presentation template storage unit 130 stores a plurality of types of presentation template image data corresponding to types of presentation information used when a list sign language synthesis unit 140 (to be described later) synthesizes list sign language data. The presentation template acquisition unit 131 reads out the image data of the presentation template corresponding to the type of presentation information from the presentation template storage unit 130 according to the instruction of the list sign language synthesis unit 140 and gives it to the list sign language synthesis unit 140.

  The bulleted text acquisition unit 111 receives the keyword extracted from the keyword extracting unit 103, searches the bulleted text storage unit 110 based on the keyword, and sets the item classification and the bulleted text corresponding to the keyword. Read data selectively. Then, an information set including the read item category and itemized text data is sent to the list sign language synthesis unit 140.

  The fragment sign language data acquisition unit 121 receives the keyword extracted from the keyword extraction unit 103, first searches the fragment sign language index storage unit of the fragment sign language data storage unit 120 based on this keyword, and corresponds to the keyword. To selectively read item classification, bulleted text data and index data. Next, the fragment sign language image storage unit of the fragment sign language data storage unit 120 is searched based on the read index data, and the fragment sign language image data corresponding to the index data is read out. If the corresponding fragment sign language video data is not stored, the corresponding fragment sign language expression data is read instead. Then, an information set including the read item category, itemized text data, and fragment sign language video data or fragment sign language expression data is sent to the list sign language synthesis unit 140.

  The list sign language synthesis unit 140 synthesizes the information set sent from the bulleted text acquisition unit 111 and the fragment sign language data acquisition unit 121 according to the layout specified by the presentation template sent from the exhibition template acquisition unit 131. Create presentation content data. If the information set sent from the fragment sign language data acquisition unit 121 includes fragment sign language expression data, a fragment sign language animation image by 3D computer graphics is generated based on the fragment sign language expression data, Instead of the fragment sign language video data, the three-dimensional computer graphics fragment sign language animation image is synthesized.

  The output control unit 105 includes a display driver that drives the display device 106 using, for example, an LED (Light Emitting Diode) matrix, and supplies the information presentation content data created by the list sign language synthesis unit 140 to the display device 106. To display. As the display device 106, a television monitor using a liquid crystal display, a plasma display, or a CRT (Cathode Lay Tube) can be used. In this case, a driver for the television monitor is used for the output control unit 10. It is done.

Next, the operation of the information presentation apparatus 100 configured as described above will be described. 5 and 6 are flowcharts showing the control procedure and control contents.
The information presenting apparatus 100 monitors the input of text data in step S51 in the standby state. In this state, in the information input device 101, for example,
“The XX line has been suspended from Tokyo-Yokohama due to a traffic light failure that occurred around 13:10.”
Is input. Then, the voice signal of the announcement is recognized by the information input device 101 and converted into text data composed of text, and input to the input control unit 102. When the input control unit 102 receives the text data corresponding to the input voice announcement, the input control unit 102 transfers the received text data to the keyword extraction unit 103.

  In step S52, the keyword extraction unit 103 performs, for example, morphological analysis on the transferred text data, and extracts keywords included in the input text data in step S53 based on the analysis result. FIG. 7 shows an example of the processing. First, morphological analysis is performed on the input text data in (1) to separate the text data into a plurality of morphemes as shown in (2). Next, in (3), keywords are extracted from the morphemes. In this keyword extraction process, words and phrases having meaning only by themselves such as proper nouns are extracted. For example, as shown in FIG. 7 (4), “XX line”, “around 13:10”, “traffic signal failure”, “Tokyo”, “Yokohama”, “train operation”, and “stop” are extracted. The

  Next, the information presentation apparatus 100 proceeds to step S54, and the itemized text storage unit 110 is searched by the itemized text acquisition unit 111, and the item set corresponding to the extracted keyword and the information set of the itemized text data are obtained. Read ((5) shown in FIG. 7). For example, for the keyword shown in (4) of FIG. 7, the item text and the bulleted text data surrounded by the broken line in FIG. 2 are read. Then, the information set composed of the read item classification and itemized text data is transferred to the list sign language synthesis unit 140.

  Subsequently, the information presentation apparatus 100 proceeds to step S55, and the fragment sign language data acquisition unit 121 executes a search process of the fragment sign language data storage unit 120 as follows. That is, first in step S551, the fragment sign language index storage unit of the fragment sign language data storage unit 120 is searched based on the keyword, and the item classification, itemized text data, and index data corresponding to the keyword are selectively read out. As a result, for example, as shown in FIG. 3, “A002” is read as index data if the keyword is “no operation”, and “B001” is read if it is “traffic signal failure”.

  Next, in step S552, the fragment sign language data acquisition unit 121 of the information presentation device 100 searches the fragment sign language data storage unit of the fragment sign language data storage unit 120 based on the read index data, and corresponds to the index data. To read fragmented sign language video data. As a result, for example, as shown in FIG. 4, if the index data is “A002”, the fragment sign language video data “Pa002” is read, and if the index data is “B001”, the fragment sign language video data “Pb001” is read.

At this time, it is determined in step S553 whether or not the corresponding fragment sign language video data is stored in the fragment sign language image storage unit. If not stored, in step S554, the fragment sign language video storage unit is searched again to read fragment sign language expression data corresponding to the index data. For example, in the example shown in FIG. 4, since the fragment sign language video data corresponding to the index data “B002” is not stored, the fragment sign language expression data “Gb002” corresponding to the index data “B002” is read in this case. Similarly, in the case of index data “D001”, fragment sign language expression data “Gd001” is read in place of fragment sign language video data.
The information set composed of the item classification, the bulleted text data, the fragment sign language video data, or the fragment sign language expression data read from the fragment sign language data storage unit 120 is sent to the list sign language synthesis unit 140.

  The information presenting apparatus 100 repeatedly executes the search processing for the itemized text data corresponding to all the extracted keywords and the fragment sign language video data or the fragment sign language expression data. When it is detected in step S56 that the search processing corresponding to all the keywords has been completed, the information presentation apparatus 100 proceeds to step S57, and the presentation template acquisition unit 131 searches the presentation template storage unit 130, and A presentation template corresponding to the extracted keyword is acquired. For example, as shown in FIG. 7, if the extracted keyword is related to the driving situation of the transportation facility, a presentation template for transportation facility is read from the presentation template storage unit 130.

  Next, in the list sign language synthesis unit 140, the information presentation apparatus 100 uses the presentation template acquired by the exhibition template acquisition unit 131 for the information set sent from the bulleted text acquisition unit 111 and the fragment sign language data acquisition unit 121. A process of creating presentation content data by combining in accordance with a designated layout is executed as follows.

  That is, first, in step S61, it is determined whether the data included in the information set sent from the fragment sign language data acquisition unit 121 is fragment sign language video data or fragment sign language expression data. If the result of this determination is fragment sign language expression data, a fragment sign language animation image by three-dimensional computer graphics is generated based on the fragment sign language expression data in step S62. Next, in step S63, according to the layout specified by the presentation template, the bulleted text data of each item category is combined with the fragment sign language video data or the fragment sign language animation image data.

  For example, if the presentation template is the one shown in FIG. 8, in the bulleted text presentation area 401 on the left half side of the template, “operation resumed”, “alternative transportation”, “cause”, “route”, “section” The bulleted text data is arranged in association with the item "". In the fragment sign language presentation area 402 on the right half side of the template, the fragment sign language video data or the fragment sign language animation image of the three-dimensional computer graphics is arranged. FIG. 9 shows an example of an information presentation content image by list sign language created by the above synthesis process. In the figure, a case where three-dimensional computer graphics fragment sign language animation image data is combined with the fragment sign language presentation area 402 is illustrated.

  Finally, the information presentation apparatus 100 proceeds to step S64, and the output control unit 105 transmits the information presentation content image created by the list sign language synthesis unit 140 to the display device 106 and causes the display device 106 to display the information presentation content image. This display process may be performed only once, but may be repeated a plurality of times at regular time intervals.

  As described above, in the information presentation apparatus 100 according to this embodiment, when the text data is received by the input control unit 102, the keyword extraction unit 103 extracts the keyword by performing morphological analysis on the text data, and the extracted keyword is used. Originally, the bulleted text acquisition unit 111 searches the bulleted text storage unit 110 to acquire the corresponding bulleted text data, and the fragmented sign language data acquisition unit 121 searches the fragmented sign language data storage unit 120 to cope with it. Get fragment sign language video data. Then, the obtained itemized text data and fragmented sign language video data are synthesized according to the layout of the presentation template acquired from the presentation template storage unit 130 by the presentation template acquisition unit 131 to create the presentation information content. The output control unit 105 displays on the display device 106.

  Therefore, the hearing-impaired person can grasp the content of the presentation information simply and quickly and accurately with the fragmented sign language video and the bulleted text presented in association therewith. Moreover, since the bulleted text is presented together with the fragment sign language video, the normal hearing person can easily and quickly grasp the content of the presented information.

  Further, when obtaining the fragment sign language video data from the fragment sign language data storage unit 120, it is determined whether or not the fragment sign language image data is stored in the fragment sign language image storage unit. The video storage unit is searched again to read the corresponding fragment sign language expression data. Then, when creating the information presentation content, a 3D computer graphics fragment sign language animation image is generated based on the fragment sign language expression data, and the fragment sign language animation image data is synthesized instead of the fragment sign language video data. Like to do. Therefore, for example, a sign language image can be displayed even when no fragment sign language video data is stored.

  FIG. 10 shows a conventional information presentation method in which a long sentence is displayed as a telop as a result of evaluation of a hearing impaired person and a sign language interpreter with respect to a list sign language method in which bulleted text data and fragment sign language video data according to the present invention are displayed side by side. It is shown in comparison with. As is clear from the figure, the list sign language method according to the present invention is evaluated to be superior to the conventional method in terms of effectiveness, understandability, quickness, and accuracy (significance level of 1%) / N = 17)) was obtained.

  The present invention is not limited to the above embodiment. For example, in the above-described embodiment, the case where the fragment sign language data storage unit 120 of the information presentation apparatus 100 includes the fragment sign language index storage unit and the fragment sign language video storage unit has been described as an example. However, the present invention is not limited to this. For example, as shown in FIG. 11, the bulleted text data 302, the fragment sign language video data 304, and the fragment sign language expression data 305 are respectively associated with the divided items 301. It may be memorized.

  Further, it is not always necessary to store both the fragment sign language video data 304 and the fragment sign language expression data 305. When the fragment sign language animation image by the three-dimensional computer graphics is not displayed, the fragment sign language image data 304 captured by the sign language translator is displayed. Only the fragment sign language expression data 305 may be stored when the fragment sign language video data 304 obtained by imaging the sign language translator cannot be prepared.

  Furthermore, in the above-described embodiment, the case where the bulleted text storage unit 110 and the fragment sign language data storage unit 120 are provided in the information presentation apparatus has been described as an example. However, the present invention is not limited to this, and the bulleted text storage unit 110 and the fragment sign language data storage unit 120 are provided in a storage server provided separately from the information presentation device, respectively, and the information presentation device and the bulleted text storage unit described above are provided. 110 and the fragment sign language data storage unit 120 may be connected via a network such as a LAN (Local Area Network) or an IP (Internet Protocol) network to acquire an information set.

  Furthermore, the item categories are not limited to those shown in FIGS. 2 and 3 and can be flexibly set according to the application target. Further, as shown in FIG. 8, the layout of the presentation template is not limited to that in which the bulleted text presentation area 401 is set on the left side of the screen and the fragment sign language presentation area 402 is set on the right side of the screen. You may change suitably according to. Furthermore, as the information presentation template, a predetermined template may always be used. For example, a different template may be selected and used according to the type of presentation information and the number of item categories.

  Furthermore, the fragment sign language video or the fragment sign language animation image displayed in the fragment sign language presentation area 402 of the presentation template may be a moving image, a quasi moving image, or a still image, and when combining a plurality of fragment sign language video data. For example, if the position of the last hand of the fragment sign language image to be displayed first is different from the position of the first hand of the fragment sign language image to be displayed next, the positions of these hands are continuously natural. The video may be added or processed as necessary so that the image changes.

  Furthermore, the type of information presented may be information on natural disasters such as earthquakes, typhoons, heavy rains, floods, etc., information on politics, economy, entertainment, sports, etc. The apparatus configuration, the presentation information creation control procedure and control contents, the presentation information layout, and the like can be variously modified and implemented without departing from the gist of the present invention.

  In short, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

It is a block diagram which shows the structure of the information presentation apparatus concerning one Embodiment of this invention. It is a figure which shows an example of the itemized text memorize | stored in the itemized text memory | storage part of the information presentation apparatus shown in FIG. It is a figure which shows an example of the index data memorize | stored in a fragment sign language index memory | storage part among the fragment sign language index memory | storage part and the fragment sign language image memory | storage part which comprise the fragment sign language data memory | storage part of the information presentation apparatus shown in FIG. Of the fragment sign language index storage unit and the fragment sign language video storage unit constituting the fragment sign language data storage unit of the information presentation apparatus shown in FIG. 1, the fragment sign language video data and the fragment sign language expression data stored in the fragment sign language image storage unit It is a figure which shows an example. It is a flowchart which shows the first half part of the procedure and content of presentation information preparation and display control by the information presentation apparatus shown in FIG. It is a flowchart which shows the latter half part of the procedure and content of presentation information preparation and display control by the information presentation apparatus shown in FIG. It is a figure which shows the procedure and content of the keyword extraction process by the keyword extraction part of the information presentation apparatus shown in FIG. It is a figure which shows an example of the presentation template produced | generated in the presentation template acquisition part of the information presentation apparatus shown in FIG. It is a figure which shows an example of the presentation information produced in the list sign language synthetic | combination part of the information presentation apparatus shown in FIG. It is a graph for demonstrating the effect of this invention. It is a figure which shows an example of the data memorize | stored in the fragment sign language data storage part in other embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Information presentation apparatus, 101 ... Information input device, 102 ... Input control part, 103 ... Keyword extraction part, 104 ... Main control part, 105 ... Output control part, 106 ... Display apparatus, 110 ... Bullet text storage part, 111 ... bulleted text acquisition unit, 120 ... fragment sign language data storage unit, 121 ... fragment sign language data acquisition unit, 130 ... presentation template storage unit, 131 ... presentation template acquisition unit, 140 ... list sign language synthesis unit.

Claims (4)

A first storage device storing itemized text data corresponding to the keyword in association with a preset keyword, and fragmented sign language data representing the content of the keyword in fragmented sign language video in association with the keyword Each of the information storage devices connectable to the second storage device,
Input interface means for receiving input of text data;
A keyword extracting means for analyzing the input sentence data and extracting a keyword included in the document data;
First search means for searching the itemized text data corresponding to the extracted keyword from the first storage device;
Second search means for searching for fragment sign language data corresponding to the extracted keyword from the second storage device;
A content generating means for generating information presenting content by combining the searched itemized text data and the searched fragment sign language data in association with each other;
And an output interface means for outputting the generated information presentation content for visual presentation. The process of accepting input of text data;
Analyzing the input sentence data and extracting keywords included in the document data;
Accessing the first storage device storing the bulleted text data corresponding to the keyword in association with the preset keyword, and searching the bulleted text data corresponding to the extracted keyword;
Accessing a second storage device storing fragmented sign language data representing the content of the keyword in fragmented sign language video in association with the keyword and retrieving fragmented sign language data corresponding to the extracted keyword; ,
A process of generating information presentation content by combining the retrieved bulleted text data and the retrieved fragment sign language data in association with each other;
And a step of outputting the generated information presentation content for visual presentation. A first storage device storing itemized text data corresponding to the keyword in association with a preset keyword, and fragmented sign language data representing the content of the keyword in fragmented sign language video in association with the keyword A presentation information creation device connectable to each of the second storage devices,
Input interface means for receiving input of text data;
A keyword extracting means for analyzing the input sentence data and extracting a keyword included in the document data;
First search means for searching the itemized text data corresponding to the extracted keyword from the first storage device;
Second search means for searching for fragment sign language data corresponding to the extracted keyword from the second storage device;
A presentation information creation device comprising: content generation means for generating information presentation content by combining the retrieved bulleted text data and the retrieved fragment sign language data in association with each other. The process of accepting input of text data;
Analyzing the input sentence data and extracting keywords included in the document data;
Accessing the first storage device storing the bulleted text data corresponding to the keyword in association with the preset keyword, and searching the bulleted text data corresponding to the extracted keyword;
Access to a second storage device that stores fragment sign language data that expresses the content of the keyword in a fragmented sign language video in association with a preset keyword, and retrieves fragment sign language data corresponding to the extracted keyword The process of
A method for creating presentation information, comprising: a step of generating information presentation content by combining the searched itemized text data and the searched fragment sign language data in association with each other.

Images