JP4636842B2 - Information processing apparatus and document display method thereof - Google Patents

Description

  The present invention relates to an information processing apparatus and its document display method, and more particularly, to an information processing apparatus and its document display method that can output not only text data stored in advance as character information but also voice. For example, the present invention relates to information processing devices such as a language learning device, a translation device, an electronic dictionary, and a hearing learning device.

In a conventional electronic dictionary or translation device, when a user selects sentence data stored in advance, the sentence data is displayed, and further, a voice corresponding to the sentence data is displayed.
Also, a language information output device has been proposed in which, when listening, when a sound corresponding to a selected phrase is being produced from a speaker, the phrase is not displayed until a predetermined key is pressed. (See Patent Document 1).

Also, when sound information is pronounced from the speaker, if the user operates a specific key because the sound cannot be heard, the character information stored in association with the sound information is displayed, In addition, there has been proposed an information reproducing apparatus capable of confirming voice information that could not be heard with character information by moving the cursor by a specific key operation and displaying the meaning of the selected word ( Patent Document 2).
JP-A-9-114361 JP 2001-6295 A

However, in the thing of patent document 1, since the phrase is not displayed during the pronunciation of the voice and the user presses a predetermined key, the learning effect in the hearing practice is enhanced. I could, but I couldn't confirm the meaning or correct pronunciation of each word in the phrase.
Moreover, in the thing of patent document 2, when a user cannot hear a voice, by operating a specific key, a sentence corresponding to the voice is displayed, and a desired word among the displayed words The meaning of the word can be displayed by moving the cursor on the screen, but if the displayed sentence is a long sentence, the cursor movement operation for selecting the desired word is cumbersome and the operability is good. There wasn't. In addition, it was necessary to visually find out which word was not heard.

On the other hand, there is a high possibility that the words that have not been heard are less frequently used words or difficult words rather than frequently used words.
Therefore, the present invention has been made in consideration of the above circumstances, and in the case where there are words that could not be heard in the voice output sentence when the user conducted hearing learning, etc. An object of the present invention is to provide an information processing device that improves user operability by displaying words with high difficulty in a sentence in a special form when the user instructs to display the sentence. To do.

The present invention relates to data storage means for storing a plurality of text data composed of a plurality of words and voice data of the text data in association with each other, a headword, and detailed information including at least the meaning and level of the headword A dictionary data storage means for storing the data in association with each other, a voice output means for outputting the voice data as voice, a display means for displaying the text data, and a key input when voice output from the voice output means is performed. If there is, the text data corresponding to the voice data output from the voice output means is read from the data storage means and displayed on the display means, and the text data is displayed by the display means. Sometimes, if there is further key input, a word in the text data is extracted and a headword that matches the extracted word And該見out word level and a retrieval means for retrieving from said dictionary data storing means, said display control means, a word in said text data retrieved by said retrieval means, at the level order entry word, the there is provided an information processing apparatus according to claim and this to be displayed on the display unit.
Here, the voice output means sequentially outputs the voice data of the plurality of text data, and the display control means outputs the voice data of the plurality of text data from the voice output means. When there is a key input, the text data corresponding to the voice data that has been voiced and the text data that was voiced prior to the text data are read from the data storage means and are played in the order in which the voices are played back. characterized Rukoto is displayed on the display means.
Further, the display control means distinguishes the displayed plurality of text data so as to be instructed and displays the displayed text data on the display means, and the search means displays at least any one of the plurality of text data. A word in the data is extracted, and a headword that matches the extracted word and a level of the headword are retrieved from the dictionary data storage means.
Further, the retrieval means designates an arbitrary word from a plurality of words in the text data retrieved from the dictionary data storage means, and the dictionary data storage coincides with the word designated by the designation means. Extraction means for extracting the meaning of the headword of the means, and the display control means controls to display the meaning extracted by the extraction means on the display means.
The present invention also includes data storage means for storing a plurality of text data composed of a plurality of words and voice data of the text data in association with each other, a headword, and details including at least the meaning and level of the headword Dictionary data storage means for storing information in association with each other, voice output means for voice output of the voice data, display means for displaying the text data, and when voice output is performed from the voice output means, An information processing apparatus comprising: a display control unit that reads out text data corresponding to voice data output from the voice output unit and displays the data on the display unit when there is an input; and a search unit in document display method, when the text data is displayed by the display means if, there is further key input, the Search means searches after extracting the words in the text data displayed on the display means, consistent with the extracted words the level of the entry word and該見out words from the dictionary data storage unit, the display A control means displays a word in the extracted text data on the display means in the order of the level of the searched headword, and provides a document display method of an information processing apparatus, is there.

Further, the present invention provides a text data storage means for storing text data of sentence data composed of a plurality of words, a voice synthesis means for reading out the text data and synthesizing voice information corresponding to the text data, and the synthesis A voice output means for outputting voice information; a display means for displaying text data; and voice information is output from the voice output means, and text data corresponding to the voice information is not displayed on the display means. Instruction means for inputting an instruction from, difficulty storage means for storing the difficulty for each word ,
The text data corresponding to the audio information that is output when a more instructions displayed on the display means is read out from said text data storage means to the instruction unit, the words of high difficulty distinguishably other words An information processing apparatus comprising a display control means for displaying is provided. According to this, it is possible for the user's intention to display the voice output text and display the most difficult word in a visually easy-to-understand form, so that the convenience and operability of the user who performs hearing learning etc. Can be improved.

Further, the present invention provides a text data storage means for storing text data of sentence data composed of a plurality of words, a voice synthesis means for reading out the text data and synthesizing voice information corresponding to the text data, and the synthesis Voice output means for outputting voice information, display means for displaying text data from which voice information is output from the voice output means, text data corresponding to the voice information from which voice information is output from the voice output means In the state displayed on the display means, instruction means for inputting instructions from the user, difficulty storage means for storing the difficulty for each word, and text data corresponding to the output voice information The text data displayed when instructed by the instruction means while being displayed on the display means Further comprising a display control means for displaying on distinguishably said display means a high word of difficulty and the other word included is to provide an information processing apparatus according to claim.
Here, the voice information stored in the voice data storage means has separation information between two pieces of text data.

Further, the apparatus further comprises separation information detection means for detecting separation information between the two sentence data when the voice information is output, and the display control means includes the separation information detected by the separation information detection means. Separation information immediately before the time point when the instruction by the instruction means is input is extracted, and text data corresponding to one sentence data stored behind the extracted separation information is read from the text data storage means. It is characterized by being displayed on a display means.
According to this, it is possible to display a sentence that is intentionally instructed by the user in a visually comprehensible form.

Here, the text data displayed on the display means may be two text data corresponding to sentence data immediately before and immediately after the extracted separation information.
According to this, even when the instruction timing of the user is delayed, it is possible to more reliably display the text that the user has intentionally instructed.

Further, for each word, word storage means for storing a plurality of information in the first language and the second language in association with each other, and when the text data instructed by the instruction means is displayed in the first language, the text data A word designating unit for designating an arbitrary word therein, wherein the information in the first language includes notation of each word, and the information in the second language includes information on the meaning of the second language of each word, The display control means displays information on the second language of the word designated by the word designation means on the display means.
According to this, it is possible to display the information of the second language with a simple operation for a desired word in the sentence instructed to be displayed by the user.

In the present invention, the instruction means is a part for inputting data intended by the user and an instruction for executing a function intended by the user, and corresponds to an input means such as a keyboard. In particular, instructing means for instructing to display text data corresponding to voice information corresponds to a search key in the following embodiments.
The display control means corresponds to the control unit in the embodiment. The difficulty level storage means is a memory in which words and difficulty levels are associated with each other and stored in advance, and an independent storage means may be provided, but information on the difficulty level is included in a dictionary data storage unit such as an electronic dictionary. You may remember. In this case, the dictionary data storage unit corresponds to the difficulty level storage means.

The word storage means of the present invention corresponds to an electronic dictionary, and for each word, any one of notation in the first language, pronunciation information in the first language, meaning in the second language, examples written in the first language, etc. One or more pieces of information are stored, and the difficulty level information is also stored in the present invention. Further, when the display control means displays the second language information of the word designated by the word designating means, the first language pronunciation information and examples are displayed together with the second language information or instead of the second language information. You may do it.
The word designating means of this invention corresponds to the determination key of the embodiment.

  According to this invention, when displaying a sentence including a word that could not be heard according to a user's instruction, a difficult word included in the sentence is displayed so as to be distinguishable from other words. Words with high possibility can be displayed to the user in a visually easy-to-understand format, and convenience and operability in hearing learning can be significantly improved.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, this invention is not limited by description of the following examples.
<Configuration of information processing apparatus of the present invention>
FIG. 1 is a block diagram showing a configuration of an embodiment of an information processing apparatus according to the present invention.
The information processing apparatus according to the present invention mainly includes a control unit 1, an input unit 2, a separation information detection unit 3, a display unit 4, an audio output unit 5, and a storage unit (11 to 15).
The control unit 1 is a part that operates hardware based on a program and executes the function of each functional block. The control unit 1 is realized by a microcomputer including a CPU, a ROM, a RAM, an I / O controller, a timer, and the like, for example.

The input unit 2 is a part for a user to input data and a specific function execution instruction. A keyboard composed of alphabet keys, numeric keys, specific function keys, and the like is used, and a pointing device such as a mouse, a trackball, and a pen is provided. May be.
The specific function key is a dedicated key for executing a predetermined specific function. For example, a search key 21, a determination key 22, a menu key 23, a left / right key 24, an up / down key as shown in FIG. 25 etc. are provided. As will be described later, the search key 21 corresponds to a key for executing a display instruction function for causing the display unit 4 to display a text sentence corresponding to the voice being output, when pressed down during the voice output.

  The decision key 22 corresponds to a key for executing a word instruction function for selecting a word where the cursor is located from the displayed text sentence and displaying the meaning of the word. The menu key 23 is a key for selecting text or voice in a field desired by the user. The left / right key 24 and the up / down key 25 are keys for moving the position of the cursor on the screen up / down / left / right. The specific function key is not limited to these, and may be provided as necessary. Alternatively, two or more functions may be assigned to one key, and another specific function may be executed for each combination of key presses.

The separation information detection unit 3 is a functional block that detects separation information. As will be described later, the separation information detection unit 3 detects separation information that is provided at a section of previously stored text data or audio data. As the separation information, continuous data having a specific pattern or data of a specific pattern that does not appear in text data or audio data is used.
The display unit 4 is a part that visually presents various information such as text data and menus to the user. The display unit 41 generates display data based on an instruction from the control unit 1, and an LCD 42 having a display screen. Consists of As the display screen, an EL element or the like may be used in addition to the LCD.

The audio output unit 5 is a part that aurally outputs information requested by the user, and includes an audio decoder 51 that decodes audio data and performs D / A conversion, and a speaker 52.
As shown in FIG. 1, the storage unit mainly includes a control data storage unit 11, a program storage unit 12, a dictionary data storage unit 13, a text data storage unit 14, and a voice data storage unit 15.

Here, the control data storage unit 11 is data used by the control unit 1 during operation, and a rewritable memory is used. For example, RAM, flash memory, hard disk, etc. are used. The data stored in the control data storage unit 11 includes, for example, a separation number counter X, a word number counter Y, a difficulty level Z _Y , a maximum difficulty level Z _MAX , and a count value Y _{MAX of} words having the maximum difficulty level. . These will be described with reference to a flowchart such as FIG.

The program storage unit 12 stores a program for executing the function of the information processing apparatus of the present invention, and the control unit 1 organically operates various hardware based on the program. The program storage unit 12 uses a read-only memory (ROM) that cannot be rewritten. However, the program may be provided by being stored in a non-volatile memory such as a flash memory or a storage device such as a hard disk in addition to the ROM. Further, the program may be provided by being stored in a portable storage medium such as a CD-ROM, a CD-R, or an IC memory card.
Furthermore, when the communication function (not shown) is provided, the program can be downloaded from a remote server or another personal computer to a storage unit such as a hard disk via a LAN or the Internet.

The dictionary data storage unit 13 stores a so-called electronic dictionary, and a ROM, a CD-ROM, an IC memory card, or the like is used. In the present invention, unlike a normal electronic dictionary, it is assumed that a difficulty level is assigned to each word as shown in FIG. FIG. 9 shows an example of words stored in the dictionary data storage unit 13 of the present invention.
For each word, the dictionary is usually composed of a headword in a first language (for example, English), a semantic content of a corresponding second language (for example, Japanese), an example, etc. In the present invention, FIG. Thus, each word has a difficulty level (1, 2,...) In advance.
As shown in FIG. 9, for example, the word “and” has a difficulty level of “1”, indicating that it is relatively easy, and the word “odometer” has a difficulty level of “7”, which is a relatively difficult word. It is shown that.

  This difficulty level can be given in advance based on the learning level of the curriculum. For example, a relatively low level of difficulty (1 or 2) is assigned to words learned at junior high school, and a higher difficulty level (3 to 5) is assigned to words learned at high school. A higher difficulty level (6 or 7) is assigned to difficult-to-learn words.

When there are a large number of words specific to a specific field, a difficulty level may be given to each of those words. Further, the difficulty level may be flexibly changed in consideration of the level of the person who learns, the frequency of use, etc., instead of giving the difficulty level in a fixed manner.
The text data storage unit 14 is a part that stores sentence data described by characters, symbols, numbers, and the like as text, and is a part that stores characters and the like as codes such as JIS and ASCII. The text data storage unit 14 is also a fixed storage memory such as a ROM or a CD-ROM. However, a rewritable memory such as a RAM or a flash memory may be used so that addition, deletion, and change can be performed.

  The voice data storage unit 15 is a part that stores sentence data described in characters or the like as voice information in advance, and is stored as digital voice information in addition to analog voice. There are various standard data formats (for example, MP3) as digital audio information, and arbitrary information can be used. The audio data storage unit 15 is also a fixed storage memory such as a ROM or a CD-ROM.

<Data structure used in the present invention>
FIG. 3 shows an explanatory diagram of an embodiment of the data structure of the voice data stored in the voice data storage unit 15 and the text data stored in the text data storage unit 14.
FIG. 3A shows the data structure of audio data. Here, it is composed of four pieces of sentence data (A, B, C, D) converted into voice information, three pieces of separation information indicating a break of the sentence data, and end information indicating the end of the voice data. . The text data (A, B, C, D) is information that can be converted into speech, and when given to the speech decoder 51, a predetermined decoding process is executed, and further D / A conversion is performed. Is output.
Here, as “separation information”, as described above, specific pattern information or pattern information that never appears in the text data (A, B, C, D) is used. For example, continuous zero data such as “0, 0, 0,..., 0” is used.

  As the end information, specific pattern information different from the separation information is used. However, when the header information includes data such as the number of sentences and the data length, the end information is not essential information.

FIG. 3B shows the data structure of text data. Although it is almost the same as the data structure shown in FIG. 3A, here, four sentence data (A, B, C, D) are stored as text data. Further, as the separation information, the same specific pattern information as the voice data may be used, but a specific text code may be used. Information that does not appear in the text data, for example, information composed of a plurality of periods can also be used.
Similarly, the end information can use a specific text code, and is not essential information when there is header information such as the number of sentences. FIG. 10 is an explanatory diagram of an example of four sentence data (A, B, C, D).
In the case of FIG. 3A, voice data corresponding to these sentence data is stored in the voice data storage unit 15, and in the case of FIG. 3B, the text data corresponding to these sentence data is text. It is stored in the data storage unit 14. Also, voice data and text data are associated with one sentence and stored in each storage unit.

<Outline of characteristic functions of the present invention>
In the present invention, when voice data is being outputted, when the search key 21 is pressed, text data corresponding to the voice data is displayed on the LCD 42, and the displayed text data is further configured. Among the words, the word having the highest difficulty level is highlighted (for example, highlighted).
As shown in FIG. 3A, when the voice corresponding to the sentence C is being output, if the search key 21 is pressed, the text data corresponding to the sentence C shown in FIG. Is displayed. The search key 21 is depressed when, for example, the sentence that the user is listening to cannot be heard and to visually confirm the sentence that has not been heard.

Moreover, there is a possibility that a highly difficult word is included in the sentence that could not be heard, and it is highly possible that a word with a high difficulty level could not be heard, depending on the learning level of the user. Therefore, if the preset display form of the word with the highest difficulty level is displayed on the LCD 42 differently from other words, it is considered that there is a high possibility of saving the trouble of searching for a word that could not be heard. In particular, in the case of a long sentence, there is a high possibility of saving the trouble, and the effect of improving the convenience for the user is great.
In addition to changing the display form, the word having the highest difficulty level may be temporarily displayed in another display area so as to be distinguishable from other words.

  In addition, if there are multiple words with the highest difficulty level in the displayed text data, they are highlighted in reverse order from the first word at regular intervals, or all of the multiple words are displayed. It may be highlighted at the same time. By highlighting such a difficult word differently from other words, the convenience and operability of the user can be improved in usage forms such as hearing learning.

In addition, it is considered that the user may depress the search key 21 immediately after listening to one sentence or after the voice output of the next sentence has started a little later. Therefore, it may be preferable not only to display the text data of the sentence itself when the search key is pressed down, but also to display the text data of the previous sentence when the search key is pressed down at the same time. .
The contents of processing in the above functions and usage modes will be described below using flowcharts.

<Example 1: Output and display processing of audio data>
FIG. 4 shows a flowchart of audio data output and display processing according to the first embodiment of the present invention. The processing of this flowchart is executed by the control unit 1 using other functional blocks. By the way, when using this information processing apparatus, the user needs to select a desired sentence to be heard for the purpose of hearing learning and the like.
In the case of hearing learning, in order to output a voice without displaying the desired sentence, an operation for selecting a field showing a use situation such as “daily conversation” or “travel” is performed. For example, a menu screen consisting of a plurality of fields is displayed on the LCD 42, and when the user selects a desired field and presses the menu key 23, the process of FIG. 4 is started.

  In step S1, the control unit 1 confirms whether or not there has been a menu selection input as described above. If there is no menu selection input, the process loops. If the menu key 23 is depressed, the process proceeds to step S2.

In step S2, a separation number counter X for counting the number of separation information is initialized to zero.
In step S 2, audio data corresponding to the menu selected in step S 1 is read from the audio data storage unit 15 and output from the speaker 52. Here, when a plurality of text data are included in the voice data, they are read in order from the top. For example, in the case of voice data as shown in FIG. 3A, first the voice data of the first sentence A is read out, decoded and D / A converted by the voice decoder 51, and the sentence A is read from the speaker 52. Output audio. While the voice is output from the speaker 52, it is preferable to display as shown in FIG. 14 so that the user does not see the content of the sentence. When the search key 21 is not depressed, the sentence A, the separation information, the sentence B, the separation information, the sentence C, the separation information, the sentence D, and the end information are read in this order, and voices corresponding to the four sentences are sequentially output. Is done. This series of processing corresponds to the processing of steps S3 to S7.

In step S3, the control unit 1 checks whether or not the search key 21 has been input. If the search key 21 is pressed, the process proceeds to step S8, and if not, the process proceeds to step S4.
In step S4, the separation information detection unit 3 checks whether separation information is detected. Here, the separation information detection unit 3 monitors where the voice data of the currently output voice is located. For example, the output of the voice data of the sentence A is finished, and the separation information immediately after the sentence A is output. Is read, it is determined that separation information has been detected. That is, when separation information is detected, it is determined that the audio output of one sentence has been completed, and the process proceeds to step S5. On the other hand, if the separation information has not been detected yet, the process returns to step S3.

In step S5, it is checked whether or not the voice output corresponding to all sentences has been completed.
Here, whether or not all of the audio output has ended may be confirmed by checking whether or not the end information shown in FIG. 3A has been detected. Alternatively, the current separation number counter X may be compared with the sentence number data previously included in the header information to confirm whether or not they match. If the end information is detected or the counter X coincides with the text count data, the process ends. If not, the process proceeds to step S6.

If the voice output has not been completed yet, the separation number counter X is incremented (step S6), voice data corresponding to the next sentence is output (step S7), and the process returns to step S3.
By repeating the above steps S3 to S7, the sound of the text selected from the menu is sequentially output. If the search key 21 is pressed during the voice output, the processing from step S8 onward is executed to display the corresponding text data.

  In step S8, 1 is set in the word number counter Y. Here, the word number counter Y indicates the number of words counted from the beginning in a certain sentence. Further, the X + 1-th text data in the text data selected from the menu is read (step S8). Here, the read text data corresponds to a sentence associated with the voice data that has been output as voice. In addition, the (X + 1) th means the number of text data located immediately behind the separation information immediately before the search key is pressed among the detected separation information.

Here, for one sentence, the voice data shown in FIG. 3A and the text data shown in FIG. 3B are stored in association with each other. For example, X = 0 In this case, X + 1 = 1st text data is read out.
Next, in step S9, the difficulty level of the Y-th word from the beginning of the read text data is retrieved from the dictionary data storage unit 13 and set to the difficulty level flag _ZY . For example, when Y = 1, if the leading word is “The”, the difficulty level “1” stored together with the word “The” in the dictionary data storage unit 13 is extracted, and the difficulty level flag Z _Y is set. Set 1

In step S10, Z _Y set in step S9 is input as an initial value to the flag Z _MAX indicating the maximum difficulty level. Also, the current Y is set as an initial value in the word number counter Y _MAX corresponding to Z _MAX .
In step S11, the word number counter Y is incremented. In step S12, paying attention to the Yth word of the read text data, the difficulty level of the word is extracted from the dictionary data storage unit 13 and set to the difficulty level flag _ZY . In step S13, the set has been difficulty flag Z _Y now compares the maximum difficulty flag Z _MAX, the process proceeds to Z _Y> For Z _MAX step S14, the process proceeds to if step S15 is not the case.

If Z _Y > Z _MAX , the difficulty level of the currently focused word is higher, so the maximum difficulty level flag (Z _MAX , Y _MAX ) is updated in step S14.
If Z _Y ≦ Z _{MAX in} step S13, the maximum difficulty level flag is not updated. At this time, if there are a plurality of words having the same maximum difficulty level, only the first found word is stored as the maximum difficulty level. However, when there are a plurality of words having the same maximum difficulty level (Z _Y = Z _MAX ), all of those words may be stored. In this case, a plurality of maximum difficulty flags may be provided, and Z _MAX and Y _MAX may be set for all words having the maximum difficulty.

In step S15, it is checked whether or not the current word number counter Y indicates the last word of the text data. Here, for example, the total number of words included in certain text data may be stored in the text data as header information in advance, and it may be confirmed whether or not the counter Y matches the total number of words.
If the check is completed up to the last word, the process proceeds to step S16. If not, the process returns to step S11, and the next word is repeatedly checked.

In step S16, the X + 1-th text data read in step S8 is displayed on the LCD 42, and the Y _MAX- th word having the highest difficulty in the displayed text data is displayed in reverse video.
FIG. 12 shows an embodiment in which the word “odometer” having the highest difficulty level is highlighted in the sentence C shown in FIG.
Here, the display form of the word having the highest difficulty level is not limited to the reverse display, and the display form may be different from other words. For example, the word having the highest difficulty level is visually conspicuous. , Blinking display, color display, bold display or underline display.
Moreover, you may display a word with high difficulty so that distinction from other words is possible. For example, another window may be provided so that only words having a high degree of difficulty are temporarily displayed in the other window.

In step S17, for the read text data, the difficulty level of all the words included in the text data is extracted, and a difficulty level order list in which words are arranged in descending order of the difficulty level is created and stored in the control data storage. Store in unit 11.
FIG. 11 shows an embodiment of a list in order of difficulty of the sentence C shown in FIG. Here, words with higher difficulty are arranged in order from the top.
Further, when a specific key (for example, the search key 21) is pressed while the display in step S16 is displayed, the display as shown in FIG. 12 is turned off or the lower side of the display in FIG. The list shown in FIG. 11 is displayed. As a result, words are displayed in descending order of difficulty for sentences that the user has not been able to hear, and the word meaning display operation described later can be facilitated.
In addition, as shown in FIG. 11, when the target sentence is a long sentence and there are many words, not all the words having a low difficulty level are displayed, but some relatively high difficulty levels are considered in consideration of the display space. You may just display the word.
The above is the audio output and display processing of the first embodiment.

<Word Meaning Search and Display Processing in Example 1>
Next, after the display process of FIG. 4, a process in which the user searches for the meaning of a desired word and displays the meaning will be described.
After the processing of FIG. 4, for example, a sentence as shown in FIG. 12 is displayed as described above. Here, the highlighted word is “odometer”, and this word “odometer” is the word having the greatest difficulty in the displayed sentence. If this word is a word that the user has not heard, the user can immediately confirm the word that he / she could not hear while looking at the highlighted display of this word.

  However, since there are cases where the word that the user cannot hear is not the word having the maximum difficulty level, it is easy to determine which word he / she could not hear when looking at the reverse display in FIG. It may not be confirmed. For example, in the display state of FIG. 12, if the word that the user could not hear is “indicate”, the user reads the displayed sentence as shown in FIG. It is necessary to find out whether or not the word was found, and it may take several seconds or more to determine that this “indicate” is a word that was not heard.

  In addition, the words that were not heard may be words that you have seen for the first time, or words that you have seen but do not know the meaning of, or have forgotten, and the user wants to know the meaning of the word. There is. Therefore, here, a process of selecting a word for which the user wants to know the meaning and displaying the meaning will be described.

FIG. 5 shows a flowchart of the word meaning search and display process of the first embodiment of the present invention.
Assume that the sentence as shown in FIG. 12 is displayed by the process of FIG. 4 in the start state of FIG. 5, and the cursor is on the highlighted word. In this state, when the word whose user wants to know the meaning is not the currently highlighted word, the cursor is moved to the word whose user wants to know the meaning using the left / right key 24.
Thereafter, when the enter key 22 is depressed, the meaning search of the word at the cursor position is performed, and the meaning of the word is displayed.
Referring to the flowchart of FIG. 5, first, in step S21, it is checked whether or not the left / right key 24 is pressed, and in step S23, it is checked whether or not the enter key 22 is pressed.
If neither key is depressed, the process returns to step S21 and loops. On the other hand, if it is detected in step S21 that the left / right key 24 has been pressed, the process proceeds to step S22.

  In step S22, the cursor is moved and the word at the cursor position is highlighted. For example, when the key for moving left is pressed, the cursor is moved to the left word and the word where the cursor is newly positioned is highlighted. At this time, the word before the cursor movement is returned to the normal display. After step S22, the process returns to step S21, and the input of the left / right key 24 is monitored. Here, when the user moves the cursor to a desired word using the left / right key 24, the word at the cursor position is highlighted. Then, the user presses the enter key 22 in a state where a desired word whose meaning is to be understood is highlighted.

If it is detected in step S23 that the enter key 22 has been pressed, the process proceeds to step S24, and the control unit 1 searches for the meaning of the highlighted word. Here, the dictionary data storage unit 13 is searched, and the meaning associated with the word is read out.
Next, in step S25, the read meaning content is displayed on the LCD. Although the display screen may be switched to only the display of semantic content, it may be displayed so that the meaning of sentences and words can be seen simultaneously as a multi-window screen by partially overlapping the display of FIG.
If the word that is initially highlighted on the screen shown in FIG. 12 is the word whose meaning you want to know, you do not need to enter the left and right keys. The meaning can be displayed.

  As described above, the words that the user could not hear or the words that are likely not to be heard are presented in a preferentially emphasized display so that the convenience and operability of the user in hearing learning etc. Can be improved. Furthermore, even if the highlighted word is not a word that could not be heard, it is possible to highlight the desired word prominently and display its meaning content by simply performing a simple input operation. Can do.

<Example 2: Output of synthesized speech>
Synthetic voice data may be generated from text data prepared in advance, and this synthesized voice may be output from the speaker 52. In the second embodiment, a case where speech synthesis processing is included will be described.
FIG. 2 is a block diagram showing the configuration of the information processing apparatus according to the second embodiment of the present invention. 2 is different from FIG. 1 in that there is no voice data storage unit 15 and that a voice synthesis unit 53 is provided instead of the voice decoder 51. The speech synthesizer 53 can be realized by a commonly used LSI for generating synthesized speech. Various existing synthesis methods can be used for the speech synthesis process.

The speech synthesizer 53 converts the text data read from the text data storage unit 14 into synthesized speech data, and further performs D / A conversion. Thereafter, the synthesized voice data subjected to D / A conversion is output from the speaker 52.
The separation information detection unit 3 detects sentence data breaks as in FIG. 1, but in the second embodiment, the separation information detection unit 3 detects separation information that is a sentence break of the text data in FIG. That is, specific pattern information (for example, information including a period) of text data is detected instead of specific pattern information of voice data. The other input unit 2, display unit 4, storage unit and the like are the same as those in FIG.

FIG. 6 shows a flowchart of the synthesized speech output and display process according to the second embodiment of the present invention.
In the flow of FIG. 6, steps S32, S33 and S38 are different from the flow of FIG. Only the different parts will be described below.
In step S32, the first text data is read from the text data storage unit 14 together with the initialization of the separation number counter X. For example, when text data as shown in FIG. 3B is selected from the menu, the text data corresponding to the sentence A is first read.
In step S <b> 33, the read text data is given to the speech synthesizer 53, and the text data is converted into synthesized speech and output from the speaker 52.

In step S38, the next text data, for example, the text data corresponding to the sentence B next to the sentence A is read, and the synthesized voice of the read text data is generated and output from the speaker 52 in the same manner as in step S33. Even during the output of the synthesized speech, it is preferable to display as shown in FIG. Other processes are the same as those described in the flowchart of FIG.
Also in the second embodiment, when the user presses the search key 21 during the output of the synthesized speech, the text data corresponding to the synthesized speech is displayed on the LCD 42, and the most difficult word in the text data is visually recognized. Is displayed in an easily understandable form.
Therefore, since there is a high possibility that words that could not be heard by the user are highlighted, it is possible to improve the convenience and operability of the user in hearing learning and the like.

<Example 3: Display of two text data>
Here, when the user presses down the search key 21 during the voice output, the text data (X-1th) of the sentence corresponding to the voice output at the timing of the press and the previous one. An embodiment in which both text data (Xth) corresponding to a sentence are displayed on the LCD screen at the same time will be described. As described above, this is in consideration of the case where the timing when the user presses the search key is delayed.
In this embodiment, for example, when the search key is pressed at the timing shown in FIG. 3A, the text data of the text C and the text B immediately before the text C are displayed on the same screen. That is, text data of two sentences (B, C) is displayed as shown in FIG.

FIG. 7 shows a flowchart of audio output and display processing according to Embodiment 3 of the present invention.
In FIG. 7, steps S51 to S57 are the same processes as steps S1 to S7 in FIG.
Steps S58 and S62 correspond to step S8 in FIG. 4, steps S60 and S64 correspond to step S16 in FIG. 4, and steps S61 and S65 correspond to step S17 in FIG.
Further, steps S59 and S63 collectively describe the processes of steps S9 to S15 in FIG. 4, and a process for finding the word having the highest difficulty in the read text data. It is.
Steps S58 to S61 in FIG. 7 are processes for reading and displaying the (X-1) th text data, and inverting and displaying the word having the highest difficulty.
Here, the X-1th means a sentence immediately before the sentence that has been voice-output when the search key 21 is pressed down.

Further, steps S62 to S65 are processes for reading out and displaying the Xth text data and inverting and displaying the word having the highest difficulty in the Xth text data. Here, the Xth means a sentence that was output as a voice when the search key 21 was pressed.
By the display processing of these two groups (steps S58 to S61 and steps S62 to S65), the two text data as shown in FIG. 13 are displayed, and the word having the highest difficulty level is inverted for each text data. Is displayed.
According to this, even if the timing when the user presses the search key 21 is delayed, the text data intended by the user can be reliably displayed, and the convenience and operability for the user can be improved.
The processing content of each step in FIG. 7 is substantially the same as the processing in FIG.

<Meaning Display Processing in Example 3>
FIG. 8 shows a flowchart of processing for displaying the meaning of a word in the third embodiment of the present invention. Assume that text data of a sentence as shown in FIG. 13 is displayed in the START state of FIG. Further, it is assumed that the cursor is displayed on either of the sentence numbers on the display screen of FIG.
In the flow of FIG. 8, steps S72 to S76 are the same as steps S21 to S25 of FIG. 5, and are different from FIG. 5 in that step S71 is added.
Step S71 is a process of checking which sentence is selected from the displayed two text data. That is, when an input for selecting a sentence containing a word whose meaning is to be known is detected, it is detected which selection input has been made.
For example, the user selects a sentence by performing an operation of moving a cursor indicating a sentence number using the up / down key 25. At this time, in order to clearly indicate the selected sentence, the sentence number on which the cursor is positioned may be highlighted.

Thereafter, when the left and right keys are input in step S72, the cursor position of the word of the sentence selected in step S73 is moved, and the word at the cursor position is highlighted. Subsequent processing such as word meaning display is the same as that described with reference to FIG.
According to this, the meaning of the word that the user wants to know in the sentence intended by the user can be displayed with an easy operation, and the convenience and operability for the user can be improved.
Note that the number of texts to be displayed is not limited to two as in the third embodiment, and three or more may be displayed in consideration of the size of the display screen. Further, text data of sentences stored before and after the operation of the up and down keys may be displayed.

1 is a configuration block diagram of an embodiment of an information processing apparatus of the present invention. It is a structure block diagram of Example 2 of the information processing apparatus of this invention. It is explanatory drawing of one Example of the data structure of the data used by this invention. It is a flowchart of the audio | voice data output and display process of Example 1 of this invention. It is a flowchart of the display process of the meaning of the word in Example 1 of this invention. It is a flowchart of the audio | voice data output and display process of Example 2 of this invention. It is a flowchart of the audio | voice data output and display process of Example 3 of this invention. It is a flowchart of the display process of the meaning of the word in Example 3 of this invention. It is explanatory drawing of one Example of the word stored in the dictionary data storage part of this invention. It is explanatory drawing of one Example of the text data of this invention. In this invention, it is explanatory drawing of one Example of the difficulty order list list which arranged the word contained in sentence data in order of difficulty. It is explanatory drawing of one Example of the text data displayed on the screen in this invention. It is explanatory drawing of the text data displayed on the screen in Example 3 of this invention. In this invention, it is explanatory drawing of one Example of the screen display during audio | voice output.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Control part 2 Input part 3 Separation information detection part 4 Display part 5 Audio | voice output part 11 Control data memory | storage part 12 Program memory | storage part 13 Dictionary data memory | storage part 14 Text data memory | storage part 15 Voice data memory | storage part 21 Search key 22 Decision key 23 Menu Key 24 Left / right key 25 Up / down key 41 Display controller 42 LCD
51 Voice Decoder 52 Speaker 53 Voice Synthesizer

Claims (5)

Data storage means for storing a plurality of text data composed of a plurality of words and voice data of the text data in association with each other;
Dictionary data storage means for storing a headword and detailed information including at least the meaning and level of the headword in association with each other;
Voice output means for outputting the voice data as voice;
Display means for displaying the text data;
When there is a key input when the voice is output from the voice output unit, text data corresponding to the voice data output by the voice output unit is read from the data storage unit and displayed on the display unit . Display control means ;
When text data is displayed by the display means, if there is further key input, a word in the text data is extracted, and a headword that matches the extracted word and a level of the headword are displayed in the dictionary data. Search means for searching from the storage means ,
Wherein the display control means, a word in said text data retrieved by said retrieval means, at the level order entry word, the information processing apparatus, wherein the this to be displayed on said display means. The audio output means is
The voice data of the plurality of text data is output in voice in order,
The display control means includes
When there is a key input when audio data of a plurality of text data is being output from the audio output means, the text data corresponding to the audio data being output and the audio output before the text data by the text data has been read out from said data storage means, the information processing apparatus according to claim 1, characterized in Rukoto is displayed on the display unit in the order in which they are audio playback. The display control means includes
The plurality of displayed text data are displayed on the display means so as to be distinguishable so as to be instructed,
The search means includes
A word in at least one of the plurality of text data is extracted, and a headword that matches the extracted word and a level of the headword are searched from the dictionary data storage means; The information processing apparatus according to claim 2. Designating means for designating an arbitrary word from a plurality of words in the text data retrieved from the dictionary data storage means by the retrieval means;
Extracting means for extracting the meaning of the headword of the dictionary data storage means that matches the word specified by the specifying means;
The display control means includes
The information processing apparatus according to claim 1, wherein the information extracted by the extracting unit is controlled to be displayed on the display unit. Data storage means for storing a plurality of text data composed of a plurality of words and voice data of the text data in association with each other;
Dictionary data storage means for storing a headword and detailed information including at least the meaning and level of the headword in association with each other;
Voice output means for outputting the voice data as voice;
Display means for displaying the text data;
When there is a key input when the voice is output from the voice output unit, text data corresponding to the voice data output by the voice output unit is read from the data storage unit and displayed on the display unit . In a document display method for an information processing apparatus including display control means and search means ,
When text data is displayed by the display means, if there is further key input, the search means matches the extracted words after extracting the words in the text data displayed on the display means Searching the dictionary data storage means for the headword to be performed and the level of the headword;
Wherein the display control means, a word in the extracted said text data, in order of level of the retrieved entry word, document display method of an information processing apparatus, characterized in that to be displayed on the display means.

Images