JP3884970B2 - Information processing apparatus and information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a convenient and portable information terminal the manufacturing cost of which does not increase as the number of parts such as an operation button increases for various information processing. <P>SOLUTION: When a user gives an instruction for performing various operation for 'playback', 'stop', 'temporary stop', 'fast forward', 'rewind', etc., during an operation for 'playback of sound-recorded data', 'read-aloud of stored document', 'read-aloud of new information', etc., the indication is detected and processing based upon the user's instruction is carried out without increasing the number of components such as an operation button. Consequently, the manufacturing cost can be suppressed. <P>COPYRIGHT: (C)2003,JPO

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an information processing apparatus, an information processing method, a control program, and a computer-readable storage medium, and more particularly to an information processing apparatus, information processing method, control program, and computer-readable storage medium using speech synthesis.
[0002]
[Prior art]
Currently, for example, a portable information terminal as shown in FIG. 20 is put into practical use, and various information processing is performed using this information terminal. Some portable information terminals include, for example, a communication unit, a storage unit, a voice output unit, and a voice synthesis unit. In each of these units, for example, the following “recorded data reproduction”, “read stored document reading”, Functions such as “Read New Information” are implemented.
1) “Recorded data playback” function
Sound data such as music and language teaching materials downloaded through the communication unit is stored in the storage unit and played back at any time and place.
2) “Reading stored document” function
By reading out text data such as novels stored in the data storage unit using speech synthesis (text-to-speech conversion), information can be browsed anywhere.
3) “Read new information” function
Connect to the Internet using a communication unit to obtain real-time information (text data) such as e-mails and news. Furthermore, the obtained information is read out using speech synthesis (text-to-speech conversion).
[0003]
Further, it is possible to use the following functions in combination with the functions of “recorded data reproduction”, “accumulated document reading”, and “new arrival information reading”.
4) “Reading document with recorded data as BGM” function
While playing back the recorded data, the stored documents and new arrival information (text data) are read out using speech synthesis (text-to-speech conversion).
5) "New information interrupt notification" function
When an email or new news arrives, it is read out using speech synthesis (text-to-speech conversion). Because it is audio, it is hard to get in the way even during other work. It is also possible to superimpose synthesized speech while playing music or the like.
[0004]
[Problems to be solved by the invention]
However, the conventional method described above has the following two problems.
[0005]
The first problem is that there are many operation buttons.
[0006]
For any of “Recorded data playback”, “Read out stored document”, and “Read out newly arrived information”, the user gives instructions for operations such as “Play”, “Stop”, “Fast forward”, “Rewind” during the operation. Can be performed together. However, operation buttons such as “Play”, “Stop”, “Fast forward”, and “Rewind” are provided separately for the operation buttons of “Recorded data playback”, “Read stored document”, “Read new information”, for example. In such a case, the installation location becomes large, resulting in an increase in the size of the entire information terminal, an increase in the number of parts, and an increase in manufacturing cost.
[0007]
The second problem is that when reading out using speech synthesis (text-to-speech conversion), if the “fast forward” and “rewind” processing is performed in the same way as the playback of the recorded data, “fast forward”, “rewind” "Is not convenient because the user cannot hear the content read out using speech synthesis (text-to-speech conversion).
[0008]
The present invention is to solve the above-mentioned problems of the prior art, and its purpose is, for example, “playback” during the operations of “recorded data playback”, “stored document read-out”, and “new arrival information read-out”. Provided is a portable information processing apparatus and information processing method capable of performing various operations such as “stop”, “fast forward”, “rewind” and the like, and the number of parts such as operation buttons is increased and the manufacturing cost is not increased. That is.
[0009]
Another object of the present invention is that, for example, when reading out using speech synthesis (text-to-speech conversion), even when the “fast forward” and “rewind” processing similar to the reproduction of the recorded data is performed, the user It is to provide a convenient portable information processing apparatus and information processing method that can listen to the contents read out using speech synthesis.
[0010]
[Means for Solving the Problems]
In order to achieve the above object, an information processing apparatus according to an embodiment of the present invention has the following arrangement. That is, a first control unit that causes a speech synthesizer that synthesizes text data based on a user instruction to execute at least one of output, stop, fast forward, rewind, and pause of synthesized speech, and a user instruction Based on the second control means for causing the sound reproduction means for reproducing sound from the sound data to execute at least one of output, stop, fast forward, rewind, and pause of the reproduced sound, and detection for detecting a user instruction And an instruction of the user detected by the detecting means is an output, Text data to be read out and synthesized by the speech synthesizer Determining means for determining the presence or absence of the Text data to be read out And setting means for setting first data to be released when a user instruction to stop the output of the synthesized speech is detected, and the detection means detects the user instruction. When the first data is set, the user's instruction is issued to the first control means, and when the first data is released, the reproduced sound is output. The user instruction is set in response to second data that is set when a user instruction is detected and is canceled when a user instruction to stop the output of the reproduced sound is detected. And 2 indicating means for outputting to the control means.
[0014]
Here, for example, Detected by the detection means The user instruction is fast forward, By setting the first data The indicating means is the User's When an instruction is given to the first control means, the first control means creates a summary data by extracting a predetermined portion of data from each sentence of the text data to be read out, and synthesizes the summary data by speech synthesis. It is preferable to control the voice synthesizing means so as to output the output.
[0015]
Here, for example, Detected by the detection means The user instruction is fast forward, By setting the first data The indicating means is the User When the instruction is issued to the first control means, the first control means extracts the first phrase from each sentence of the text data to be read out and sequentially synthesizes and outputs the extracted phrases. It is preferable to control the speech synthesis means.
[0016]
Here, for example, Detected by the detection means The user instruction is rewind, By setting the first data The indicating means is the User's When the instruction is given to the first control means, the first control means extracts the first phrase from each sentence of the text data to be read out and displays the extracted phrases in the reverse order to the sentence order of the text data. It is preferable to control the voice synthesizing means so as to synthesize and output the voice.
[0019]
Here, for example, the control means controls the voice synthesis means so as to output a predetermined sound corresponding to the data omitted from the text data without being synthesized by the voice synthesis means. It is preferable to do.
[0027]
In order to achieve the above object, an information processing method according to an embodiment of the present invention has the following arrangement. That is, when a detection step for detecting a user instruction and a user instruction detected by the detection step are outputs, Text data to be read out that is synthesized by speech synthesis means that synthesizes text data based on the user's instruction A determination step of determining the presence or absence of the Text data to be read out When the user's instruction to stop the output of the synthesized speech is detected, a setting process for setting first data to be canceled when the user's instruction to stop the output of the synthesized speech is detected, and the user's instruction is detected by the detection process If the first data is set, the user's instruction is Above When the first data is released to the first control means for causing the voice synthesis means to execute at least one of output, stop, fast forward, rewind and pause of the synthesized voice, In response to the second data that is set when the user's instruction for instructing the output is detected and the user's instruction for instructing the stop of the output of the reproduced sound is detected, the user's instruction is given. An instruction to be issued to the second control means for causing the sound reproduction means for reproducing sound from the sound data based on the user's instruction to execute at least one of output, stop, fast forward, rewind, and pause of the reproduced sound. And a process.
[0029]
In order to achieve the above object, a control program according to an embodiment of the present invention has the following arrangement. That is, On the computer, Detection process for detecting user instructions When When the user instruction detected by the detection step is output, Text data to be read out that is synthesized by speech synthesis means that synthesizes text data based on the user's instruction Judgment process to determine the presence or absence of When In the determination step Text data to be read out A setting step of setting first data to be canceled when a user instruction to stop the output of the synthesized speech is detected When If the first data is set when a user instruction is detected by the detection step, the user instruction is Above When the first data is released to the first control means for causing the voice synthesis means to execute at least one of output, stop, fast forward, rewind and pause of the synthesized voice, In response to the second data that is set when the user's instruction for instructing the output is detected and the user's instruction for instructing the stop of the output of the reproduced sound is detected, the user's instruction is given. An instruction to be issued to the second control means for causing the sound reproduction means for reproducing sound from the sound data based on the user's instruction to execute at least one of output, stop, fast forward, rewind, and pause of the reproduced sound. Process When The Execute It is characterized by that.
[0030]
In order to achieve the above object, a computer-readable storage medium according to an embodiment of the present invention has the following arrangement. That is, On the computer, Detection process for detecting user instructions When When the user instruction detected by the detection step is output, Text data to be read out that is synthesized by speech synthesis means that synthesizes text data based on the user's instruction Judgment process to determine the presence or absence of When In the determination step Text data to be read out A setting step of setting first data to be canceled when a user instruction to stop the output of the synthesized speech is detected When When the first data is set when a user instruction is detected by the detection step, the user instruction is output to the speech synthesizer, and the synthesized speech is output, stopped, fast-forwarded, wound. When the first data is released to the first control means for executing at least one of return and pause, and when the first data is released, it is set when the user's instruction for instructing the output of the reproduced sound is detected. The user's instruction corresponding to the second data released when the user's instruction for instructing to stop the output of the reproduced sound is detected, and the sound for reproducing the sound from the sound data based on the user's instruction Instructing step to be issued to second control means for causing reproduction means to execute at least one of output, stop, fast forward, rewind, and pause of reproduction sound When The Stored the control program to be executed It is characterized by that.
[0038]
DETAILED DESCRIPTION OF THE INVENTION
An information processing apparatus according to an embodiment of the present invention will be described below with reference to the drawings. In the present embodiment, a portable information terminal is used as an example of the information processing apparatus. However, the scope of the present invention is not limited to the description example.
[0039]
<First Embodiment>
[Hardware configuration: Fig. 1]
FIG. 1 is a diagram illustrating a hardware configuration of a portable information terminal H1000 according to the first embodiment.
[0040]
H1 is a central processing unit that performs processing such as numerical calculation and control, and performs calculation according to a control program that describes the processing procedure of the present invention. H2 is an output unit that presents information to the user. The output unit H2 includes an audio output unit H201 such as a speaker / headphone and a screen display unit H202 such as a liquid crystal.
[0041]
H3 is an input unit for the user to give an operation instruction to the information terminal H1000 or to input information. The input unit H3 includes general-purpose input units such as a play button H301, a stop button H302, a pause button H303, a fast forward button H304, a rewind button H305, and a touch panel H306.
[0042]
H4 is a data communication unit such as a LAN card or a PHS card, and is used for acquiring data such as new mail. H5 is a storage unit such as a hard disk or a nonvolatile memory, and holds recorded data and stored information. H6 is a read-only storage unit that stores control data indicating the procedure of the present invention and fixed data such as a speech synthesis dictionary.
[0043]
H7 is a storage unit that holds temporary information such as RAM, and holds temporary data, various flags, and the like. H8 is an interval timer unit that works to interrupt the central processing unit H1 after a predetermined time elapses after the timer is started. The central processing unit H1 to the timer unit H8 described above are connected by a bus.
[0044]
[Appearance of hardware configuration of information terminal: FIG. 20]
FIG. 20 is a sketch diagram showing an example of an external appearance image of the hardware configuration of the portable information terminal H1000 described in FIG.
[0045]
[Outline of each event process: Fig. 2]
The event processing in the information terminal H1000 described above will be described using the flowcharts shown in FIGS. The following processing is executed by the central processing unit H1 using the storage unit H7 that holds temporary information such as a RAM based on an event-driven control program stored in the read-only storage unit H6. Is. An input process from the input unit H3, a data request from the output unit H2, and an interrupt such as a timer interrupt are processed as the start of each event in the control program.
[0046]
In FIG. 2, first, in event acquisition step S1, a new event is acquired.
[0047]
Next, in the playback button press determination step S2, it is determined whether or not the event acquired in the event acquisition step S1 is “play button press”, and if the acquired event is “play button press”, The process moves to step S101 shown in FIG. 3, and if it is not “pressing the reproduction button”, the process moves to stop button press determination step S3.
[0048]
Next, in the stop button press determination step S3, it is determined whether or not the event acquired in the event acquisition step S1 is “stop button press”, and if the acquired event is “stop button press”, The process moves to step S201 shown in FIG. 4, and if it is not “pressing the stop button”, the process moves to pause button press determination step S4.
[0049]
Next, in the pause button pressing determination step S4, it is determined whether or not the event acquired in the event acquisition step S1 is “pressing the pause button”. The process moves to step S301, and if it is not “pressing the pause button”, the process moves to a fast-forward button pressing determination step S5.
[0050]
Next, in the fast-forward button pressing determination step S5, it is determined whether or not the event acquired in the event acquisition step S1 is “pressing the fast-forward button”. The process moves to step S401, and if it is not “pressing the fast-forward button”, the process moves to fast-forward button release determination step S6.
[0051]
Next, in the fast forward button release determination step S6, it is determined whether or not the event acquired in the event acquisition step S1 is “release of the fast forward button (operation to release the pressed button)”, and “release of the fast forward button”. If there is, the process moves to step S501 shown in FIG. 7, and if it is not “cancel fast-forward button”, the process moves to rewind button press determination step S7.
[0052]
Next, in the rewind button pressing determination step S7, it is determined whether or not the event acquired in the event acquisition step S1 is “pressing the rewind button”. The process moves to step S601 shown in FIG. 8, and if it is not “pressing the rewind button”, the process moves to rewind button release determination step S8.
[0053]
Next, in rewind button release determination step S8, it is determined whether or not the event acquired in event acquisition step S1 is “release of rewind button”. The process proceeds to step S701 shown in FIG. 9, and if it is not “cancel rewind button”, the process proceeds to new information arrival determination step S9.
[0054]
Next, in the new information arrival determination step S9, it is determined whether or not the event acquired in the event acquisition step S1 indicates that “new arrival information” has arrived. Then, the process moves to step S801 shown in FIG. 10, and if the arrival of “new arrival information” is not reached, the process moves to accumulated information reading instruction determination step S10.
[0055]
Next, in the accumulated information reading instruction determination step S10, it is determined whether or not the event acquired in the event acquisition step S1 is “an instruction to read the stored information by the user”, and is “an instruction to read the stored information by the user”. If so, the process proceeds to step S901 shown in FIG. 11, and if it is not “an instruction to read out stored information by the user”, the process proceeds to speech synthesis data request determination step S11.
[0056]
Next, in the speech synthesis data request determination step S11, it is determined whether or not the event acquired in the event acquisition step S1 is “data request from the synthesized speech output device”, and “data request from the synthesized speech output device”. If so, the process proceeds to step S1001 shown in FIG. 12, and if it is not “data request from synthesized speech output device”, the process proceeds to recording / playback data request determination step S12.
[0057]
Next, in recording / playback data request determination step S12, it is determined whether or not the event acquired in event acquisition step S1 is “data request from recording data output device”, and “data request from recording data output device”. If so, the process proceeds to step S1101 shown in FIG. 13. If it is not “data request from recording data output device”, the process proceeds to timer event determination step S13.
[0058]
Next, in the timer event determination step S13, it is determined whether or not the event acquired in the event acquisition step S1 is a notification indicating that a predetermined time has elapsed from the timer start from the timer unit H8, and the timer unit H8. If not, the process proceeds to step S1201 shown in FIG. 14. If not, the process returns to event acquisition step S1.
[0059]
["Play button press" processing: Fig. 3]
Next, the processing of each event described above will be described in detail below. First, the “play button push” process will be described with reference to FIG.
[0060]
[Reading pointer]
Reading Pointer Setting Determination (Playback) In Step S101, it is determined whether or not “Reading Pointer” is set. If “Reading Pointer” is set, the speech synthesis pause flag is released (playback) and the process proceeds to Step S106. If the “reading pointer” is not set, the priority reading sentence existence determination (reproduction) is transferred to step S102. Note that the “speech pointer” is an area that holds a position where speech synthesis is started next and speech reading is started in the middle of a priority text (text data) shown in FIG. 18, for example. The position of the “read pointer” is set as a value.
[0061]
Next, in the priority reading sentence existence determination (reproduction) step S102, it is determined whether or not “priority reading sentence exists”. If “priority reading sentence exists”, the process proceeds to the priority reading sentence initial pointer setting step S108. If no “priority reading sentence exists”, the process moves to the accumulated reading sentence existence determination step S103.
[0062]
Next, in accumulated read-out sentence existence determination step S103, it is determined whether or not “stored read-out sentence exists”. If “accumulated read-out sentence exists”, the process proceeds to accumulated read-out sentence initial pointer setting step S109. If there is no stored read-out sentence ”, reproduction pointer setting determination (reproduction) proceeds to step S104.
[0063]
[Playback pointer]
Next, in playback pointer setting determination (playback) step S104, it is determined whether or not “playback pointer is set”. If “playback pointer is set”, playback pause flag release (playback) is processed in step S111. If “playback pointer is not set”, the process moves to the recording data existence determination step S105. The “reproduction pointer” is an area for holding the position to be reproduced next, and is not set or the position of the “reproduction pointer” in the recorded data is set as a value.
[0064]
Next, in the recording data existence determination step S105, it is determined whether or not “recording data exists”. If “recording data exists”, the process proceeds to a recording data reproduction initial pointer setting step S113. If it does not exist, the process proceeds to the event acquisition step S1 in FIG.
[0065]
Next, the speech synthesis pause flag is released (reproduction). In step S106, the speech synthesis pause flag is released. The speech synthesis pause flag is a flag indicating whether speech synthesis is in a temporary state, and takes a value of “true” when it is set and “false” when it is released.
[0066]
Next, in the speech synthesis restart (playback) step S107, the speech synthesis that was temporarily stopped in step S304 in FIG. 5 is resumed, and then the process proceeds to the event acquisition step S1 in FIG. The processing in each routine of “speech synthesis start”, “speech synthesis stop”, “speech synthesis pause”, and “speech synthesis restart” will be described later with reference to FIG.
[0067]
Next, in the preferential reading sentence initial pointer setting step S108, the reading pointer is set at the head of the preferential reading sentence, and the process proceeds to the speech synthesis start step S110.
[0068]
Next, in the stored read-out sentence initial pointer setting step S109, the read-out pointer is set at the head of the stored read-out sentence, and the process proceeds to the speech synthesis start step S110.
[0069]
Next, after setting the reading pointer in the priority reading sentence initial pointer setting step S108 or the accumulated reading sentence initial pointer setting step S109, the voice synthesis is started in the voice synthesis start step S110, and then the process proceeds to the event acquisition step S1 in FIG. Move.
[0070]
Next, the reproduction pause flag is released (reproduction). In step S111, the reproduction pause flag is released. The reproduction pause flag is a flag indicating whether or not the recording data reproduction is in a temporary state.
[0071]
Next, the reproduction of the recorded data is resumed (reproduced). In step S112, the reproduction of the recorded data suspended in step S308 is resumed, and the process proceeds to the event acquisition step S1. Processes in the routines of “recorded data reproduction start”, “recorded data reproduction stop”, “recorded data reproduction pause”, and “recorded data reproduction restart” will be described later with reference to FIG.
[0072]
Next, in the recording data reproduction initial pointer setting step S113, the reproduction pointer is set to the head of the recording data, and the process proceeds to the recording data reproduction start step S114. In the recorded data reproduction start step S114, the reproduction of the recorded data is started, and then the process proceeds to the event acquisition step S1 in FIG.
[0073]
["Stop button press" processing: Fig. 4]
Next, the “stop button pressing” process will be described with reference to FIG.
[0074]
Reading Pointer Setting Determination (Stop) In Step S201, it is determined whether or not “Reading Pointer” has been set. If “Reading Pointer” has been set, the speech synthesis pause flag is released (Stop) and the process proceeds to Step S203. If the “reading pointer” is not set, the reproduction pointer setting determination (stop) is transferred to step S202.
[0075]
Next, playback pointer setting determination (stop) In step S202, it is determined whether or not "playback pointer" is set. If "playback pointer" is set, playback pause flag release (stop) is processed in step S206. If “playback pointer” is not set, the process moves to event acquisition step S1.
[0076]
Release voice synthesis pause flag (stop) In step S203, the voice synthesis pause flag is released. Next, the reading pointer is released (stopped). In step S204, the reading pointer is released (not set). Next, after speech synthesis is stopped in speech synthesis stop step S205, the process proceeds to event acquisition step S1 in FIG.
[0077]
Next, the playback pause flag is released (stopped) In step S206, the playback pause flag is released. Next, the playback pointer is released (stopped). In step S207, the playback pointer is released (not set). Next, after the reproduction of the recording data is stopped in the recording data reproduction stop step S208, the processing is shifted to the event acquisition step S1 in FIG.
[0078]
["Press the pause button" processing: Fig. 5]
Next, the process of “pressing the pause button” will be described with reference to FIG.
[0079]
First, reading pointer setting determination (pause) In step S301, it is determined whether or not “reading pointer” is set. If “reading pointer” is set, the process proceeds to speech synthesis pause flag setting determination step S302. If the “readout pointer” is not set, the reproduction pointer setting determination (pause) is transferred to step S305.
[0080]
Next, in the speech synthesis pause flag setting determination step S302, it is determined whether or not the speech synthesis pause flag is set, that is, whether or not the speech synthesis is paused. If the speech synthesis pause flag is set, The reading pointer setting determination (reproduction) of FIG. 3 is shifted to step S101. If the voice synthesis pause flag is not set, the process is shifted to voice synthesis pause flag setting step S303.
[0081]
Next, in a speech synthesis pause flag setting step S303, a speech synthesis pause flag is set (value is set to “true”). Next, after the speech synthesis is paused in the speech synthesis pause step S304, the process proceeds to the event acquisition step S1 in FIG.
[0082]
Next, playback pointer setting determination (pause) In step S305, it is determined whether or not “playback pointer” is set. If “playback pointer” is set, the process proceeds to playback pause flag setting determination step S306. If the “playback pointer” is not set, the process moves to the event acquisition step S1 in FIG.
[0083]
Next, in the playback pause flag setting determination step S306, it is determined whether or not the “playback pause flag” is set, that is, whether or not the playback of the recorded data is paused, and the “playback pause flag” is set. If so, the process proceeds to reading pointer setting determination (reproduction) step S101 in FIG. 3, and if the “reproduction pause flag” is not set, the process proceeds to reproduction pause flag setting step S307.
[0084]
Next, in a reproduction pause flag setting step S307, a reproduction pause flag is set (value is set to “true”). Next, the reproduction of the recording data is paused in the recording data reproduction pause step S308, and the processing is shifted to the event acquisition step S1 in FIG.
[0085]
["Fast-forward button pressed" processing: Fig. 6]
Next, the “pressing fast-forward button” process will be described with reference to FIG.
[0086]
Reading Pointer Setting Determination (Fast-forwarding) In step S401, it is determined whether or not “Reading Pointer” is set. If “pointer” is not set, playback pointer setting determination (fast-forward) moves to step S405.
[0087]
Next, in fast forward reading timer mode setting step S402, the timer mode is set to “fast forward reading”, and the process proceeds to fast forward event mask setting step S403. The timer mode indicates the usage of the timer.
[0088]
Next, in the fast forward event mask setting step S403, the event mask is set for fast forward processing, and the events acquired in the event acquisition step S1 are hereinafter referred to as “fast forward button release”, “voice synthesis data request”, “recording / playback”. Limited to “data request” and “timer event” only.
[0089]
Next, timer start (fast forward) In step S404, the timer is started so that a timer event occurs after a predetermined time. Then, the process proceeds to the event acquisition step S1 in FIG.
[0090]
Playback pointer setting determination (fast forward) In step S405, it is determined whether or not the playback pointer is set. If the playback pointer is set, the process proceeds to fast forward playback timer mode setting step S406, where the playback pointer is set. If not, the process proceeds to the event acquisition step S1 in FIG.
[0091]
In fast forward playback timer mode setting step S406, the timer mode is set to “fast forward playback”, and the process proceeds to fast forward event mask setting step S403.
[0092]
["Cancel fast-forward button" processing: Fig. 7]
Next, the “fast forward button release” process will be described with reference to FIG.
[0093]
First, in the event mask cancellation (fast forward) step S501, the event mask is canceled, and all events are acquired in the subsequent event acquisition step S1.
[0094]
Next, timer mode initialization / timer stop (fast forward) After the timer mode is initialized in step S502, the timer is stopped.
[0095]
Next, reading pointer setting determination (fast forward cancellation) In step S503, it is determined whether or not “reading pointer” is set. If “reading pointer” is set, reading mode determination (fast forward) processing is performed in step S504. If the “readout pointer” is not set, the process proceeds to the reproduction pointer setting determination (fast forward release) step S511.
[0096]
Reading mode determination (fast forward) In step S504, it is determined whether or not the reading mode is "fast forward". If it is "fast forward", the process proceeds to step S505 for reading mode initialization (fast forward). If not, speech synthesis is stopped (fast forward). The process proceeds to step S508.
[0097]
Next, read-out mode initialization (fast forward) In step S505, the read-out mode is returned to the initial state. Next, reading pointer return (fast forward) In step S506, the reading pointer set in the summary sentence created in step S1207 in FIG. 14 is set to a corresponding position in the original document.
[0098]
Next, after the summary sentence is discarded in the summary sentence discarding step S507, the process proceeds to the event acquisition step S1 in FIG.
[0099]
Next, speech synthesis is stopped (fast forward). In step S508, speech synthesis is stopped. Next, in the reading pointer forward skip step S509, the reading pointer is moved to the head of the sentence next to the sentence currently being read out. Next, speech synthesis is started (fast forward). In step S510, speech synthesis is started, and the process proceeds to event acquisition step S1.
[0100]
On the other hand, playback pointer setting determination (fast forward release) In step S511, it is determined whether or not “playback pointer” is set. If “playback pointer” is set, recording playback mode determination (fast forward) is processed in step S512. If “playback pointer” is not set, the process moves to the event acquisition step S1 in FIG.
[0101]
Recording / playback mode determination (fast forward) In step S512, it is determined whether or not the recording / playback mode is “fast forward”. If it is “fast forward”, the recording / playback mode initialization (fast forward) is shifted to step S513. If it is not “fast forward”, the recorded data reproduction is stopped (fast forward). The process proceeds to step S514.
[0102]
Next, in recording / playback mode initialization (fast forward), in step S513, the recording / playback mode is returned to the initial state, and then the process proceeds to event acquisition step S1 in FIG. Next, recording data reproduction stop (fast forward) In step S514, reproduction of the recording data is stopped. Next, in the reproduction pointer forward skip step S515, the reproduction pointer is advanced by one index. For example, if the recorded data is music data, the playback pointer moves to the beginning of the next song.
[0103]
Next, recording data reproduction start (fast forward) After reproduction of recording data is started in step S516, the process proceeds to event acquisition step S1 in FIG.
[0104]
["Rewind button press" processing: Fig. 8]
Next, the process of “pressing the rewind button” will be described with reference to FIG.
[0105]
First, in the reading pointer setting determination (rewinding) step S601, it is determined whether or not “the reading pointer is set”. If “the reading pointer is set”, the process proceeds to the rewind reading timer mode setting step S602. If “read pointer is not set”, the reproduction pointer setting determination (rewind) is transferred to step S605.
[0106]
Next, in rewind reading timer mode setting step S602, the timer mode is set to “rewind reading aloud”, and the process proceeds to rewind event mask setting step S603.
[0107]
Next, in the rewind event mask setting step S603, the event mask is set for rewind processing, and then the event acquired in the event acquisition step S1 in FIG. 2 is referred to as “rewind button release”, “speech synthesis”. Limited to “data request”, “recording / playback data request”, and “timer event”.
[0108]
Next, a timer is started (rewinding) in step S604, a timer event is generated after a predetermined time, and the process proceeds to event acquisition step S1 in FIG.
[0109]
Next, in playback pointer setting determination (rewind) step S605, it is determined whether or not “playback pointer” is set. If “playback pointer” is set, the process proceeds to rewind playback timer mode setting step S606. If “playback pointer” is not set, the process moves to the event acquisition step S1 in FIG.
[0110]
Next, in rewind playback timer mode setting step S606, the timer mode is set to “rewind playback”, and the process proceeds to rewind event mask setting step S603.
[0111]
["Rewind button release" processing: FIG. 9]
Next, the “cancel rewind button” process will be described with reference to FIG.
[0112]
First, in the event mask release (rewind) step S701, the event mask is released, and all events are acquired in the subsequent event acquisition step S1.
[0113]
Next, timer mode initialization / timer stop (rewind) After the timer mode is initialized in step S702, the timer is stopped.
[0114]
Next, reading pointer setting determination (rewind release) In step S703, it is determined whether or not “reading pointer” is set. If “reading pointer” is set, reading mode determination (rewinding) proceeds to step S704. If the “readout pointer” is not set, the playback pointer setting determination (rewind release) is transferred to step S711.
[0115]
Next, in the reading mode determination (rewinding) step S704, it is determined whether or not the reading mode is “rewinding”. If it is “rewinding”, the reading mode initialization (rewinding) is processed in step S705. If it is not “rewinding”, speech synthesis is stopped (rewinding). The process moves to step S708.
[0116]
Next, reading mode initialization (rewinding) In step S705, the reading mode is returned to the initial state. Next, reading pointer return (rewinding) In step S706, the reading pointer set in the first phrase list created in step S1204 in FIG. 14 is set to a corresponding position in the original document. (The information created in step S1205 is used.)
Next, after the first phrase list is discarded in the first phrase list discarding step S707, the process proceeds to the event acquisition step S1 in FIG.
[0117]
Next, speech synthesis is stopped (rewinding) In step S708, speech synthesis is stopped. Next, in the reading pointer backward skip step S709, the reading pointer is moved to the head of the sentence before the sentence currently being read out.
[0118]
Next, speech synthesis is started (rewinding). After speech synthesis is started in step S710, the process proceeds to event acquisition step S1 in FIG.
[0119]
Next, playback pointer setting determination (rewind release) In step S711, it is determined whether or not “playback pointer” is set. If “playback pointer” is set, recording / playback mode determination (rewind) step. The processing moves to S712, and if the “playback pointer” is not set, the processing moves to event acquisition step S1.
[0120]
Next, in recording / reproducing mode determination (rewinding) step S712, it is determined whether or not the recording / reproducing mode is “rewinding”. If it is “rewinding”, a recording / reproducing mode initialization (rewinding) step is performed. The process moves to S713. If it is not “rewind”, the recorded data reproduction is stopped (rewind). The process moves to step S714.
[0121]
Next, recording / reproducing mode initialization (rewinding) In step S713, the recording / reproducing mode is returned to the initial state, and the process proceeds to event acquisition step S1.
[0122]
Next, recording data reproduction stop (rewinding) In step S714, reproduction of the recording data is stopped. Next, in the reproduction pointer backward skip step S715, the reproduction pointer is returned by one index. For example, if the recorded data is music data and the playback pointer does not overlap the index, the playback pointer moves to the beginning of the current song.
[0123]
Next, recording data reproduction start (rewinding) The reproduction of the recording data is started in step S716, and then the process proceeds to the event acquisition step S1 in FIG.
[0124]
["New information arrival" processing: FIG. 10]
Next, the “new information arrival” process will be described with reference to FIG.
[0125]
First, a priority reading sentence existence determination (new arrival) In step S801, it is determined whether or not a priority reading sentence exists. If a priority reading sentence exists, the process proceeds to a new reading sentence addition step S807, and a priority reading sentence exists. If not, the process proceeds to new arrival notification message copy step S802.
[0126]
Next, in a new arrival notification message copy step S802, the new arrival notification message is copied to the head of the preferential reading sentence. An example of a new arrival notification message is shown in FIG.
[0127]
Next, in a newly read-out sentence copy step S803, the newly arrived read-out sentence is copied after the new arrival notification message in the preferential reading sentence.
[0128]
Next, reading pointer setting determination (new arrival) It is determined whether or not a reading pointer is set in step S804. If the reading pointer is set, the reading pointer backup is created (new arrival). If is not set, the process proceeds to step S101.
[0129]
Next, reading pointer backup creation (new arrival) In step S805, the current reading pointer value is held as supplementary information for the priority reading sentence.
[0130]
Next, in the newly read aloud text reading pointer setting step S806, the reading pointer is set at the head of the priority reading text, and the process proceeds to the event acquisition step S1.
[0131]
Next, in a newly read aloud sentence adding step S807, the newly read aloud sentence is copied to the end of the priority read aloud sentence, and then the process proceeds to the event acquisition step S1 in FIG.
[0132]
["Reading instruction for stored information" processing: FIG. 11]
Next, the “stored information reading instruction” process will be described with reference to FIG.
[0133]
Reading Pointer Setting Determination (Accumulation Information Reading) In step S901, it is determined whether or not “reading pointer is set”. If “reading pointer is set”, the process proceeds to reading warning display step S905. If the reading pointer is not set, the process proceeds to the accumulated reading sentence copy step S902.
[0134]
Next, in the accumulated reading sentence copy step S902, the information instructed in the accumulated information reading instruction determining step S10 is copied from the accumulated information stored in the external storage unit H5 to the accumulated reading sentence.
[0135]
Next, it is determined whether or not “priority reading sentence exists” in step S903. If “priority reading sentence exists”, the process proceeds to reading pointer backup setting step S904. If “a preferential reading sentence does not exist”, the process proceeds to the event acquisition step S1.
[0136]
Next, in reading pointer backup setting step S904, the head of the accumulated reading sentence is set as supplementary information for the priority reading sentence, and then the process proceeds to event acquisition step S1 in FIG.
[0137]
Next, in a reading warning display step S905, a warning indicating that reading is currently being performed is output, and then the process proceeds to the event acquisition step S1 in FIG.
[0138]
["Speech synthesis request instruction" processing: FIG. 12]
Next, the “speech synthesis request instruction” process will be described with reference to FIG.
[0139]
First, in synthesized speech data existence determination step S1001, it is determined whether or not “waveform data” converted from text into a speech waveform already exists. If “waveform data” does not exist, the reading pointer setting determination (voice output) moves to step S1002.
[0140]
Reading pointer setting determination (voice output) In step S1002, it is determined whether or not “reading pointer is set”. If “reading pointer is set”, the process proceeds to document data end determination step S1003. If the pointer is not set, the process proceeds to event acquisition step S1 in FIG.
[0141]
Next, in the document data end determination step S1003, it is determined whether or not “the reading pointer has reached the end of the document data”. If “the reading pointer has reached the end of the document data”, the reading pointer backup existence determination step S1008 is determined. If the “read-out pointer has not reached the end of the document data”, the process proceeds to document data extraction step S1004.
[0142]
In document data cutout step S1004, a predetermined amount (for example, one sentence) of data is cut out from the document data. Next, in synthesized speech data generation step S1005, speech synthesis processing is performed on the extracted data to obtain synthesized speech data.
[0143]
Next, in the reading pointer moving step S1006, the reading pointer is moved by the amount cut out in the document data cutting out step S1004, and the processing is shifted to the synthesized voice data copying step S1007.
[0144]
In the synthesized voice data copy step S1007, a predetermined amount of data (buffer size of the synthesized voice output device) is output from the synthesized voice data to the synthesized voice output device, and the process proceeds to the event acquisition step S1.
[0145]
In the reading pointer backup existence determination step S1008, it is determined whether or not “a reading pointer backup exists” as supplementary information of the document data. If “a reading pointer backup exists”, the reading pointer backup return step S1009 is performed. If the processing is shifted and “a backup of the reading pointer does not exist”, the processing shifts to reading pointer release step S1010.
[0146]
In reading pointer backup return step S1009, the reading pointer backup attached to the document data is set as the reading pointer, and the process proceeds to the document data end determination step S1003.
[0147]
Next, in a reading pointer release step S1010, the reading pointer is released (not set). Then, the process proceeds to the event acquisition step S1.
[0148]
Next, playback pointer setting determination (recording / playback) In step S1101, it is determined whether or not “playback pointer is set”. If “playback pointer is set”, recording / playback mode determination (rewind 2) step. The process moves to S1102, and if “reproduction pointer is not set”, the process moves to event acquisition step S1.
[0149]
["Recording / playback request instruction" processing: FIG. 13]
Next, the “recording / playback request instruction” process will be described with reference to FIG.
[0150]
First, recording / playback mode determination (rewind 2) In step S1102, it is determined whether or not the recording / playback mode is “rewind”. If it is “rewind”, the process proceeds to playback pointer head determination step S1109. If it is not “rewind”, the process proceeds to reproduction pointer end determination step S1103.
[0151]
Next, in the reproduction pointer end determination step S1103, whether or not the “reproduction pointer is the end of the recorded data (last)” is stabilized, and if “the reproduction pointer is the end of the recorded data”, the processing is performed in the reproduction pointer release step S1104. If the “playback pointer is not the end of the recorded data”, the process proceeds to the recorded data copy step S1105.
[0152]
Next, in playback pointer release step S1104, the processing is moved to event acquisition step S1 after the playback pointer is released.
[0153]
Next, in a recorded data copy step S1105, a predetermined amount of data (buffer size of the recorded data output device) is output from the recorded data to the recorded data output device, and the process proceeds to step S1106 for recording / playback mode determination (fast forward 2).
[0154]
Next, recording / playback mode determination (fast-forward 2) In step S1106, it is determined whether or not “recording / playback mode is fast-forward”. If “recording / playback mode is fast-forward”, processing proceeds to playback pointer fast-forward movement step S1107. If the “recording / playback mode is not fast forward”, the process moves to a playback pointer moving step S1108.
[0155]
Next, in the reproduction pointer fast-forward movement step S1107, the process proceeds to the event acquisition step S1 in FIG. 2 after the reproduction pointer is advanced more than the reproduction pointer output in the recording data copy step S1105 (for example, 10 times the predetermined amount).
[0156]
Next, in the reproduction pointer moving step S1108, the reproduction pointer is advanced by the amount output in the recording data copying step S1105, and the processing is moved to the event acquisition step S1.
[0157]
Next, in a reproduction pointer head determination step S1109, it is determined whether or not “the reproduction pointer points to the beginning of the recorded data”. If the “playback pointer is not the beginning of the recorded data”, the process advances to the recorded data reverse order copy step S1110.
[0158]
In the recording data reverse order copy step S1110, a predetermined amount of data (buffer size of the recording data output device) is output to the recording data output device as in the recording data copy step S1105, but the data order is output in reverse.
[0159]
Next, in the reproduction pointer rewind movement step S1111, the reproduction pointer is moved in the reverse direction at the time of reproduction, and then the processing is shifted to the event acquisition step S1 in FIG.
[0160]
["Timer event" processing: FIG. 14]
Next, the “timer event” process will be described with reference to FIG.
[0161]
First, in timer stop step S1201, the timer is stopped.
[0162]
Next, in timer mode determination (fast forward reading), it is determined in step S1202 whether or not the timer mode is “fast forward reading”. If it is “fast forward reading”, the process proceeds to summary sentence creating step S1207. If not, the timer mode determination (rewind reading) is shifted to step S1203.
[0163]
Next, in the timer mode determination (rewind reading) step S1203, it is determined whether or not the timer mode is “rewind reading”. If it is “rewind reading”, the process proceeds to the first phrase list creation step S1204. If it is not “rewind reading”, the process proceeds to timer mode determination (fast forward reproduction) step S1210.
[0164]
In a first phrase list creation step S1204, a list of the first phrase of each sentence existing from the beginning of the document indicated by the reading pointer to the reading pointer is created. An example is shown in FIG. In FIG. 18, (a) is the original document, and (b) is an image of the created phrase list. The position of the reading pointer is set so that the reading pointer is positioned at the end of the read-out document. When the document is read out, the position of the reading-out pointer moves in synchronization with the reading-out.
[0165]
Next, in the rewind reading pointer backup creation step S1205, a corresponding point to which the reading pointer is moved when returning from the rewind mode is created. In FIG. 18, the relationship between the arrow connecting the first phrase list and the original document is the corresponding point.
[0166]
Next, in rewind reading mode setting step S1206, the reading mode is set to rewind, and then the process proceeds to event acquisition step S1 in FIG.
[0167]
Next, in a summary sentence creation step S1207, a summary sentence from the location indicated by the reading pointer to the end of the document is created. An example is shown in FIG. In FIG. 19, (a) is an original document and (b) is an image of a summary sentence created. The position of the reading pointer is set so that the position of the reading pointer comes to the end of the read-out document (that is, the head of the unread portion). When the document is read out, the position of the reading pointer is synchronized with the reading-out. Moving.
[0168]
Next, in the fast forward reading pointer backup creation step S1208, a corresponding point to which the reading pointer is moved when returning from the fast forward mode is created. In FIG. 19, the relationship between the arrows connecting the summary sentence and the original document is the corresponding point. However, in FIG. 19, not all are shown in order to avoid complexity.
[0169]
Next, in fast forward reading mode setting step S1209, the reading mode is set to fast forward, and then the process proceeds to event acquisition step S1 in FIG.
[0170]
Next, in the timer mode determination (fast forward playback) step S1210, it is determined whether or not the timer mode is “fast forward playback”. If it is “fast forward playback”, the process proceeds to the fast forward recording / playback mode setting step S1211. If it is not “fast forward playback”, the process proceeds to rewind recording / playback mode setting step S1212.
[0171]
Next, in fast-forward recording / playback mode setting step S1211, the recording / playback mode is set to fast-forward, and the process proceeds to event acquisition step S1.
[0172]
Next, in rewind recording / playback mode setting step S1212, the recording / playback mode is set to rewind, and then the process proceeds to event acquisition step S1 in FIG.
[0173]
[Each process of “speech synthesis”: FIGS. 15A to 15D]
Next, each process of “speech synthesis” will be described with reference to FIGS.
[0174]
FIGS. 15A to 15D show processing in each routine of “speech synthesis start”, “speech synthesis stop”, “speech synthesis pause”, and “speech synthesis restart”.
[0175]
First, in the synthesized voice output device setting step S1301, the synthesized voice output device is initially set up such as setting the sampling rate.
[0176]
Next, in the synthesized speech output device activation step S1302, the synthesized speech output device is activated and the synthesized speech output operation is started.
[0177]
Next, in the synthesized voice data clear step S1303, the synthesized voice data generated and held in the synthesized voice data generating step S1005 is deleted.
[0178]
Next, in the synthesized speech output device stop step S1304, the synthesized speech output device is stopped.
[0179]
Next, in the synthesized voice output device pause step S1305, the synthesized voice output device is paused.
[0180]
Next, in the synthesized voice output device restart step S1306, the operation of the synthesized voice output device suspended in the synthesized voice output device pause step S1305 is resumed.
[0181]
[Each process of “recorded data reproduction”: FIGS. 16A to 16D]
Next, each process of “recorded data reproduction” will be described with reference to FIGS. FIGS. 16A to 16D show processing in each routine of “recorded data playback start”, “recorded data playback stop”, “recorded data playback pause”, and “recorded data playback restart”.
[0182]
First, in a recording data output device setting step S1401, initial setting of the recording data output device such as setting of a sampling rate is performed.
[0183]
Next, in a recording data output device activation step S1402, the recording data output device is activated and the recording data output operation is started.
[0184]
Next, in the recording data output device stop step S1403, the recording data output device is stopped.
[0185]
Next, in a recording data output device pause step S1404, the recording data output device is paused.
[0186]
Next, in the recording data output device restart step S1405, the operation of the recording data output device suspended in the recording data output device pause step S1404 is resumed.
[0187]
The first embodiment described above is an example. For example, in the first phrase list creation step S1204, the first phrase list is a list composed only of the first phrase, but this is not necessarily the first phrase. There may be, for example, a plurality of clauses set by the user.
[0188]
The example of the summary sentence shown in the summary sentence creation step S1207 is an example in which the main part of each sentence is extracted, but it is not always necessary to summarize each sentence. For example, all sentences with little information are omitted. You may do it.
[0189]
Also, instead of the summary sentence creation step S1207, in the case of fast-forwarding, a head phrase list is created as shown in FIG. 28, and from the beginning “below” to “H4” is read sequentially from the head of the created head phrase list. You may do it.
[0190]
In the case of using a summary in the case of rewinding, the summary shown in FIG. 29 may be used.
[0191]
In addition, an acoustic output such as a beep sound indicating that a portion of the text data that has not been read out by speech synthesis is omitted may be output.
[0192]
Further, both the first phrase list creation step S1204 and the summary sentence creation step S1207 are executed after the rewind / fast forward button release event is acquired, but the newly read aloud sentence copy step S803, the newly read aloud sentence addition step S807, and It may be executed after each step of accumulated read-out sentence copy step S902. This shortens the response time from release of the rewind / fast forward button.
[0193]
<Second Embodiment>
Next, a second embodiment will be described.
[0194]
[Hardware configuration: Fig. 21]
FIG. 21 is a diagram illustrating a hardware configuration of a portable information terminal H1200 according to the second embodiment.
[0195]
H11 is a central processing unit that performs processing such as numerical calculation and control, and performs calculation according to a control program that describes the processing procedure of the present invention. H12 is an output unit that presents information to the user. The output unit H12 includes an audio output unit H1201 such as a speaker / headphone and a screen display unit H1202 such as a liquid crystal.
[0196]
H13 is an input unit in which a user gives an operation instruction to the information terminal H1200 or inputs information. H14 is a data communication unit such as a LAN card or a PHS card, and is used to acquire data such as new mail. H15 is a storage unit such as a hard disk or a non-volatile memory, and holds recorded data and stored information.
[0197]
H16 is a read-only storage unit, and stores fixed data such as a control program indicating the procedure of the present invention and a dictionary for speech synthesis. H17 is a storage unit for holding temporary information such as RAM, and holds temporary data, various flags, and the like.
[0198]
H18 is an angle detection unit that outputs a value corresponding to the angle, and detects an operation amount of the dial unit H19. H19 is a dial section that can be operated by the user, and is connected to the angle detection section H18. The central processing unit H1 to the angle detection unit H18 are connected by a bus.
[0199]
[Appearance of information terminal hardware configuration: FIG. 27]
FIG. 27 is a sketch diagram showing an example of an external appearance image of the hardware configuration of the portable information terminal H1200 described in FIG.
[0200]
[Outline of event processing: FIG. 22]
The event processing in the information terminal H1200 according to the second embodiment described above will be described with reference to the flowcharts shown in FIGS. The following processing is executed by the central processing unit H11 using a storage unit H17 that holds temporary information such as a RAM, based on an event-driven control program stored in a read-only storage unit H16 or the like. Is. An input process from the input unit H13, a data request from the output unit H12, and an interrupt such as a timer interrupt are processed as the start of each event in the control program.
[0201]
First, in variable initial setting step S1501 in FIG. 22, each variable is set to an initial value.
[0202]
Next, in step S1502, the voice synthesis device is paused in a voice synthesis device start / pause step S1502.
[0203]
Next, in event acquisition step S1503, a new event is acquired.
[0204]
Next, in the dial angle change determination step S1504, it is determined whether or not the event acquired in the event acquisition step S1503 is due to “dial angle change”. If it is “dial angle change”, the process proceeds to step S1601. If it is not “change dial angle”, the process proceeds to speech synthesis data request determination step S1505.
[0205]
Next, in speech synthesis request determination step S1505, it is determined whether or not the event acquired in event acquisition step S1503 is “data request from synthesized speech output device”, and “data request from synthesized speech output device”. If there is, the process moves to step S1701, and if it is not “data request from synthesized speech output device”, the process returns to event acquisition step S1503.
[0206]
["Dial angle change" processing: FIG. 23]
Next, the processing of each event described above will be described in detail below.
[0207]
First, the “dial angle change” process will be described with reference to FIG.
[0208]
In the new dial angle determination step S1601, it is determined whether or not the new dial angle is “0”. If it is “0”, the process proceeds to the synthesized speech output device pause step S1605, and the new dial angle is determined. If it is not “0”, the process proceeds to dial angle variable determination step S1602.
[0209]
In the dial angle variable determination step S1602, it is determined whether or not the previous dial angle held in the dial angle variable is “0”. If the previous dial angle held in the dial angle variable is “0”, a synthesized voice is output. The process moves to device restart step S1606, and if the previous dial angle held in the dial angle variable is not “0”, the process moves to dial angle variable update step S1603.
[0210]
In the dial angle variable update step S1603, a new dial angle is substituted for the dial angle variable.
[0211]
Next, in a reading skip number setting step S1604, a reading skip number is set according to the value of the dial angle variable. The reading skip number is set so that the larger the absolute value of the dial angle, the larger the absolute value of the skip number, and the same sign of the dial angle and the number of skip numbers. FIG. 25 shows an example of a correspondence table between the dial angle (unit angle is θ) and the number of skips. After setting the skip number, the process proceeds to event acquisition step S1503.
[0212]
Next, in the synthesized speech output device pause step S1605, the speech synthesized output device is paused, and the process proceeds to the event acquisition step S1503.
[0213]
Next, in the synthesized voice output device restart step S1606, the synthesized voice output device paused in the synthesized voice output device pause step S1605 is resumed, and the process proceeds to the dial angle variable update step S1603.
[0214]
[“Speech synthesis instruction” processing: FIG. 24]
Next, the “speech synthesis instruction” process will be described with reference to FIG.
[0215]
First, in synthesized speech data end determination step S1701, it is determined whether or not “the phrase counter is equal to the number of phrases”. If “the phrase counter is equal to the number of phrases”, the process proceeds to document data extraction step S1709. If the counter is not equal to the number of phrases, the process proceeds to dial angle absolute value determination step S1702. The number of phrases is the number of phrases included in the sentence subjected to the immediately preceding synthesized speech data generation step S1710. The state in which the phrase counter is equal to the number of phrases is obtained by combining the synthesized speech data obtained in step S1710. Indicates that all output has been completed.
[0216]
Next, in the dial angle absolute value determination step S1702, it is determined whether the absolute value of the dial angle held in the dial angle variable is larger than “1”. If the absolute value of the dial angle is larger than “1”, the text to be read out is read. The processing moves to update step S1717, and if the absolute value of the dial angle is not larger than “1”, the processing moves to reading pointer determination step S1703.
[0217]
Next, in a reading pointer determination step S1703, it is determined whether or not “the reading pointer is equal to the reading target sentence”. If “the reading pointer is equal to the reading target sentence”, the process proceeds to the phrase counter determination step S1704. If “the reading pointer is not equal to the reading target sentence”, the process proceeds to the speech synthesis device stop step S1705.
[0218]
Next, in the phrase counter determination step S1704, it is determined whether the phrase counter is “0”. If the phrase counter is “0”, the process proceeds to the reading target sentence update step S1717. If the phrase counter is not “0”, speech synthesis is performed. The processing moves to device stop step S1705.
[0219]
Next, in the speech synthesis device stop step S1705, the speech synthesis device is stopped. Next, a beep sound is output in a beep sound output step S1706. Next, speech synthesis device start (2) In step S1707, the speech synthesis device is started.
[0220]
Next, “1” is added to the phrase counter in the phrase counter update step S1708, and the process proceeds to the event acquisition step S1503.
[0221]
Next, in document data cutout step S1709, one sentence of data is cut out from the reading target document with the reading pointer at the head.
[0222]
Next, in synthesized speech data generation step S1710, speech synthesis is performed on the sentence extracted in document data extraction step S1709 to obtain synthesized speech data.
[0223]
Next, in the phrase number calculation step S1711, the number of phrases included in the sentence extracted in the document data extraction step S1709 is calculated.
[0224]
Next, in a synchronization point generation step S1712, the correspondence between the synthesized speech generated in the synthesized speech data generation step S1710 and each phrase included in the sentence extracted in the document data extraction step S1709 is obtained and held as a synchronization point. An example of the synchronization point is shown in FIG.
[0225]
Next, in the phrase counter initialization step S1713, the phrase counter is set to “0”.
[0226]
Next, in the dial angle positive / negative determination step S1714, it is determined whether or not the dial angle held in the dial angle variable is “positive”. If “positive”, the process proceeds to the reading pointer increment step S1715, and is not “positive”. If so, the process proceeds to reading pointer decrement step S1716.
[0227]
Next, in a reading pointer increment step S1715, 1 is added to the reading pointer, and the process proceeds to the dial angle absolute value determination step S1702.
[0228]
Next, in the reading pointer decrement step S1716, 1 is subtracted from the reading pointer, and the process proceeds to the dial angle absolute value determination step S1702.
[0229]
Next, in the reading target sentence update step S1717, the reading target sentence is set to the sum of the reading pointer and the skip count set in the read skip count setting step S1604.
[0230]
Next, in the synthesized speech data copy step S1718, the synthesized speech generated in the synthesized speech data generation step S1005 is copied to the buffer of the one-speech speech synthesizer device. The range to be copied is one phrase from the synchronization point corresponding to the current phrase counter. After data copying, the process proceeds to clause counter update step S1708.
[0231]
Note that the second embodiment described above is an example. For example, in the reading skip number setting step S1604, the reading skip number is set to a fixed number of sentences according to the value of the dial angle variable, but when the dial angle is large. It is also possible to skip to the next paragraph. This can be realized by counting the number of sentences from the reading pointer to the first sentence of the next paragraph. It is also possible to skip one or more phrases when the dial angle is small.
[0232]
Furthermore, in the second embodiment, the number of beeps during fast forward / rewind is the same as the number of skipped phrases, but it is not necessarily the same. In the second embodiment, fast forward / rewind is represented by a single beep sound, but different beep sounds or different signals may be produced according to the type of fast forward / rewind or the dial angle.
[0233]
Furthermore, it is also possible to apply fast-forwarding based on the summary used in the first embodiment to the second embodiment. In this case, the compression ratio of the summary can be changed in accordance with the skip number set in the reading skip number setting step S1604.
[0234]
[Other Embodiments]
Note that the present invention can be applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, and a printer), and a device (for example, a copying machine and a facsimile device) including a single device. You may apply to.
[0235]
Another object of the present invention is to supply a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded to a system or apparatus, and the computer (or CPU or CPU) of the system or apparatus. Needless to say, this can also be achieved by the MPU) reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an operating system (OS) running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.
[0236]
Furthermore, after the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion card or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.
[0237]
When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the flowcharts described above (shown in FIGS. 2 to 16 and 22 to 24).
[0238]
As described above, according to the present invention, it becomes possible for a user to give an instruction with few operation buttons, and as a result, the size of the entire terminal is reduced. In addition, the number of parts is reduced, resulting in a manufacturing cost. In addition, it is possible to provide information required by the user during fast forward / rewind, and convenience is improved.
[0239]
【The invention's effect】
As described above, according to the present invention, when various information processing is performed, an increase in manufacturing cost due to an increase in the number of parts such as operation buttons is suppressed. Multiple information processing targets can be transferred to each other using the operation buttons. It is possible to provide a portable information terminal that can perform the above-described various types of information processing with convenience.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a hardware configuration according to a first embodiment of the present invention.
FIG. 2 is a flowchart illustrating an entire event process according to the first embodiment of the present invention.
FIG. 3 is a flowchart illustrating processing when a playback button is pressed.
FIG. 4 is a flowchart illustrating processing when a stop button is pressed.
FIG. 5 is a flowchart for explaining processing when a pause button is pressed.
FIG. 6 is a flowchart illustrating processing when a fast-forward button is pressed.
FIG. 7 is a flowchart for explaining processing when a fast-forward button is released.
FIG. 8 is a flowchart for explaining processing when a rewind button is pressed.
FIG. 9 is a flowchart illustrating processing when a rewind button is released.
FIG. 10 is a flowchart illustrating processing when new information arrives.
FIG. 11 is a flowchart for explaining processing when an instruction to read out stored information is given.
FIG. 12 is a flowchart for explaining processing when speech synthesis is instructed.
FIG. 13 is a flowchart for explaining processing when recording / reproduction is instructed.
FIG. 14 is a flowchart illustrating timer event processing.
FIG. 15A is a flowchart for describing speech synthesis start processing;
FIG. 15B is a flowchart for explaining speech synthesis stop processing;
FIG. 15C is a flowchart illustrating speech synthesis pause processing.
FIG. 15D is a flowchart illustrating speech synthesis resumption processing.
FIG. 16A is a flowchart illustrating a recorded data reproduction start process.
FIG. 16B is a flowchart illustrating a recorded data reproduction stop process.
FIG. 16C is a flowchart illustrating a recorded data reproduction pause process.
FIG. 16D is a flowchart for explaining a recording data reproduction restart process;
FIG. 17 is a diagram illustrating an example of a new arrival notification message.
FIG. 18 is a diagram illustrating an example of an image of a head phrase list.
FIG. 19 is a diagram for explaining an example of an image of a summary sentence.
FIG. 20 is a sketch diagram showing an image of a hardware configuration according to the first embodiment of the present invention.
FIG. 21 is a block diagram showing a hardware configuration according to a second embodiment of the present invention.
FIG. 22 is a flowchart illustrating an entire event process according to the second embodiment of the present invention.
FIG. 23 is a flowchart illustrating processing when a dial angle is changed.
FIG. 24 is a flowchart illustrating processing when speech synthesis is requested.
FIG. 25 is a diagram for explaining the correspondence between the dial angle and the number of reading skips.
FIG. 26 is a diagram illustrating an example of a synchronization point.
FIG. 27 is a sketch diagram showing an image of the hardware configuration of the second embodiment according to the present invention;
FIG. 28 is a diagram illustrating an example of an image of a head phrase list in the case of fast forward.
FIG. 29 is a diagram illustrating an example of a summary during rewinding.
[Explanation of symbols]
H1 Central processing unit for numerical computation and control processing
Output unit for presenting information to H2 users
H201 Audio output unit (speakers, headphones, etc.)
H202 Screen display (liquid crystal etc.)
H3 input unit (operation instruction / information input by user)
H301 Playback button (input unit)
H302 Stop button (input unit)
H303 Pause button (input section)
H304 Fast forward button (input part)
H305 Rewind button (input unit)
H306 touch panel
H4 data communication unit (acquisition of LAN card, PHS card, new mail, etc.)
H5 storage (Hard disk, non-volatile memory, recording data retention)
H6 read-only memory (holding ROM, program, speech synthesis dictionary, etc.)
H7 Storage unit for holding temporary information (RAM and other temporary data)
H8 interval timer section (interrupt processing to central processing section)

Claims (8)

First control means for causing speech synthesis means for synthesizing text data based on a user's instruction to execute at least one of output, stop, fast forward, rewind, and pause of synthesized speech;
Second control means for causing a sound reproduction means for reproducing sound from sound data to execute at least one of reproduction sound output, stop, fast forward, rewind, and pause based on a user instruction;
Detecting means for detecting a user instruction;
A determination unit that determines whether or not there is text data to be read out to be synthesized by the speech synthesis unit when the user instruction detected by the detection unit is an output;
Setting means for setting first data to be canceled when an instruction of a user instructing to stop the output of the synthesized speech is detected when it is determined by the determination means that there is text data to be read out ;
If the first data is set when a user instruction is detected by the detection means, the user instruction is issued to the first control means, and the first data is released. Corresponding to the second data that is set when the user's instruction for instructing the output of the reproduced sound is detected and is canceled when the user's instruction for instructing the stop of the output of the reproduced sound is detected. And an instruction means for issuing an instruction of the user to the second control means. When the user instruction detected by the detection means is fast forward and the first data is set, the instruction means issues the user instruction to the first control means. 1 control means extracts the data of a predetermined part from each sentence of the text data to be read out, creates summary data, and controls the speech synthesis means to synthesize and output the summary data. The information processing apparatus according to claim 1. When the user instruction detected by the detection means is fast forward and the first data is set, the instruction means issues the user instruction to the first control means. 2. The control unit according to claim 1, wherein the control unit controls the speech synthesis unit so as to extract the first phrase from each sentence of the text data to be read out and sequentially synthesize and output the extracted phrase. The information processing apparatus described. When the user instruction detected by the detection means is rewind and the instruction means issues the user instruction to the first control means because the first data is set , The first control means is configured to extract the first phrase from each sentence of the text data to be read out and output the extracted phrase by synthesizing and outputting the extracted phrase in the reverse order of the sentence sequence of the text data. The information processing apparatus according to claim 2, wherein the information processing apparatus is controlled.   The first control means controls the voice synthesizing means so as to output a predetermined sound corresponding to data omitted from the text data without being synthesized by the voice synthesizing means. The information processing apparatus according to any one of claims 1 to 4, wherein the information processing apparatus is characterized. A detection step of detecting a user instruction;
A determination step of determining whether or not there is text data to be read out by a speech synthesizer that performs speech synthesis of text data based on the user instruction when the user instruction detected by the detection step is an output. When,
A setting step of setting first data to be canceled when a user instruction to stop the output of the synthesized speech is detected when it is determined by the determination step that text data to be read out exists;
If the first data is set when a user instruction is detected in the detection step, the user instruction is output to the speech synthesizer to output, stop, fast forward, and rewind the synthesized speech. When the first data is released to the first control means for executing at least one of the pauses, and the first data is released, it is set when the user's instruction for instructing the output of the reproduction sound is detected. Audio reproduction that reproduces audio from audio data based on the user instruction corresponding to the second data to be released when a user instruction to stop the output of reproduced audio is detected. An instruction step to be issued to the second control means for causing the means to execute at least one of output, stop, fast forward, rewind, and pause of the reproduced sound;
An information processing method characterized by comprising: On the computer,
A detection step of detecting a user's instruction,
A determination step of determining whether or not there is text data to be read out by a speech synthesizer that performs speech synthesis of text data based on the user instruction when the user instruction detected by the detection step is an output. And
When the text data of the object read by said determining step is determined to exist, a setting step of instructing the user to instruct the stop of output of the synthesized speech is to set the first data to be released when it is detected,
If the first data is set when a user instruction is detected by the detection step, the user instruction is output to the speech synthesizer to output, stop, fast forward, and rewind the synthesized speech. When the first data is released to the first control means for executing at least one of the pauses, and the first data is released, it is set when the user's instruction for instructing the output of the reproduction sound is detected. Audio reproduction that reproduces audio from audio data based on the user instruction corresponding to the second data to be released when a user instruction to stop the output of reproduced audio is detected. the means, and an instruction step of issuing the playback audio output, stop, fast forward, rewind, second control means for performing at least one of pause,
A control program to execute . On the computer,
A detection step of detecting a user's instruction,
A determination step of determining whether or not there is text data to be read out by a speech synthesizer that performs speech synthesis of text data based on the user instruction when the user instruction detected by the detection step is an output. And
When the text data of the object read by said determining step is determined to exist, a setting step of instructing the user to instruct the stop of output of the synthesized speech is to set the first data to be released when it is detected,
If the first data is set when a user instruction is detected by the detection step, the user instruction is output to the speech synthesizer to output, stop, fast forward, and rewind the synthesized speech. When the first data is released to the first control means for executing at least one of the pauses, and the first data is released, it is set when the user's instruction for instructing the output of the reproduction sound is detected. Audio reproduction that reproduces audio from audio data based on the user instruction corresponding to the second data to be released when a user instruction to stop the output of reproduced audio is detected. the means, and an instruction step of issuing the playback audio output, stop, fast forward, rewind, second control means for performing at least one of pause,
The computer-readable storage medium which stored the control program for performing .

Images