JP2007318653A - Information processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile terminal device which has an effect of informing processing states or setting states of various functions at a timing when a user can reliably recognize a sound, when the processing states or the setting states are informed by the sound. <P>SOLUTION: When a determination key press detector 101 detects a press of a determination key, a various event detector 102 detects state information of an information processing device 100, e.g. a battery remaining amount, an electric wave state, a missed call history, an incoming mail, and the like. A state notifying sound selector/generator 103 selects an arbitrary file from among prepared voice files according to state information detected by the various event detector 102, and generates a notification sound. An effect processor 104 performs processing of assigning an effect to the notification sound generated by the state notifying sound selector/generator 103, and an output portion 105 outputs the notification sound. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention includes status detection information such as remaining battery level and radio wave reception status, history information such as presence / absence of incoming calls / presence of unread e-mails, presence / absence of alarm function, on / off of manner mode, etc. The present invention relates to an information processing apparatus that notifies state information indicating a use state of a certain function such as setting information by sound.

Conventional mobile terminal devices notify the device user of these states by displaying on the display a mark indicating the remaining battery level of the battery provided in the device or a mark indicating the radio wave reception state of the device. Was almost. Currently, portable terminal devices have been proposed that notify device users of these states by sound (Patent Documents 1, 2, 3, and 4). In particular, in recent mobile terminal devices that are equipped with a music playback function and a video playback function, in a configuration in which the above-described state is notified by a mark displayed on the display, the user of the device displays a display during music playback. Since there is almost no period of watching the device, the above-mentioned state cannot be confirmed by the apparatus user, and since the mark is not displayed on the display during video playback, the above-mentioned state is made visible to the apparatus user. I can't. For this reason, attention is focused on portable terminal devices that inform the device user of the above-described state by sound.
Japanese Patent Laid-Open No. 9-083426 JP 2002-051122 A JP 2002-191128 A JP 2002-057619 A

  When the battery remaining power reporting device of Patent Document 1 is removed from the charger, it detects the remaining battery power provided in the remaining battery power reporting device, and notifies by a sound according to the remaining battery power. Further, the battery remaining amount notification device of Patent Document 2 periodically detects the battery remaining amount provided in the battery remaining amount notification device, and when performing notification after the remaining battery amount falls below a predetermined threshold, The notification sound is different from the notification sound when the battery remaining amount exceeds a predetermined threshold. In addition, the remaining amount notification method disclosed in Patent Document 3 detects a remaining battery level provided in the remaining battery level notification device when a call is received, and notifies the user by a sound according to the remaining battery level. Further, the mobile phone of Patent Document 4 periodically detects the electric field strength of the received radio wave, and according to the electric field strength, an alarm sound indicates whether the mobile phone is outside or within the service area where wireless communication is possible. This is a notification.

  However, the devices described in Patent Documents 1 to 4 are not always notified at a timing preferable for the device user. That is, in Patent Document 1, the device user has already recognized that the battery level of the device is low when the device is attached to the charger, and is notified that the battery level is low when the device is removed. Even if it is recognized that the remaining battery level is low, the effect is small. Further, in Patent Documents 2, 3, and 4, since the device may notify when the device user is not in a range where the notification sound from the device can be heard, the device user may miss the notification. There is. Also, when listening to music or the like with earphones attached to the mobile terminal device main body, the mobile terminal device main body is often used while being put in a bag or a pocket of clothes. In such a case, it is difficult to grasp the state of the terminal body or to operate a desired function.

  The present invention has been made in view of the above circumstances, and when a processing state or a setting state of various functions is notified by sound, it can be notified at a timing at which the user can surely recognize the sound. An object is to provide an information processing apparatus.

  The information processing terminal device of the present invention includes an operation unit, a sound output unit that outputs a sound, and a detection unit that detects one state of the apparatus main body as first state information, and the sound output unit includes the When an input operation is received by the operation unit, a sound is output as a first sound corresponding to the first state information detected by the detection unit.

  With this configuration, when the processing state or setting state of various functions is notified by sound, it can be notified at a timing at which the user can surely recognize the sound.

  The information processing terminal of the present invention includes the information processing terminal in which the sound output unit outputs a sound as the first sound that has been subjected to the effect processing corresponding to the first state information.

  With this configuration, it is possible to notify the state information by sound without the need to newly output a dedicated notification sound for notifying the state information.

  In the information processing apparatus of the present invention, the sound output unit outputs a second sound corresponding to the input operation received by the operation unit, and when the input operation is received by the operation unit, And outputting a sound as a second sound subjected to an effect process corresponding to the first state information detected by the detection unit.

  With this configuration, it is possible to notify the state information by a sound effect that is notified at the time of an input operation, so there is no need to newly output a dedicated notification sound for notifying the state information, and the state information is reliably used. The state information can be notified at a timing that can be recognized by a person.

  In the information processing terminal of the present invention, the sound output unit outputs a second sound corresponding to the input operation received by the operation unit, and when the input operation is received by the operation unit, And outputting a first sound corresponding to the second state information detected by the detection unit and a second sound corresponding to the input operation.

  With this configuration, it is possible to notify the state information at a timing at which the user can reliably recognize the state information.

  Further, in the information processing terminal according to the present invention, when the sound output unit accepts an input operation by the operation unit, the detection unit performs a third sound for notifying a corresponding function selected by the operation, and the detection unit. And outputting the first sound corresponding to the second state information.

  With this configuration, since the state information can be notified when an input operation with a high operation frequency is performed, the user can constantly and reliably notify the state information at a timing at which the user can recognize the state information. it can.

  Further, in the information processing apparatus of the present invention, when the sound output unit further receives an input operation by the operation unit, the detection unit detects a fourth sound for notifying an operation corresponding to the operation and the detection unit. And outputting the first sound corresponding to the second state information.

  With this configuration, since the state information can be notified when an input operation with a high operation frequency is performed, the user can constantly and reliably notify the state information at a timing at which the user can recognize the state information. it can.

  In the information processing apparatus of the present invention, when the sound output unit accepts an input operation by the operation unit, the first sound corresponding to the second state information detected by the detection unit and the input operation And outputting a second sound corresponding to the sound simultaneously.

  With this configuration, notification sounds corresponding to a plurality of state information can be output at a time.

  In the information processing apparatus of the present invention, when the sound output unit accepts an input operation by the operation unit, the first sound corresponding to the second state information detected by the detection unit and the input operation And the second sound corresponding to the sound output in succession.

  With this configuration, the user can easily identify the first sound and the second sound.

  The present invention provides a portable terminal device having an effect that when a processing state or setting state of various functions is notified by sound, the user can be notified at a timing at which the sound can be surely recognized. It is something that can be done.

Hereinafter, an information processing apparatus according to an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing a basic configuration of an information processing apparatus according to an embodiment of the present invention. FIG. 2 is a diagram illustrating an example of the determination key of the information processing apparatus. The outline of the present invention will be described below with reference to FIGS.

  When the user of the information processing apparatus 100 presses the enter key 201 of the operation unit shown in FIG. 2, the enter key press detection unit 101 detects that the enter key is pressed and notifies the various event detection units 102. Send a signal. When the various event detection units 102 receive the notification signal, the status information type of the information processing apparatus 100 (for example, remaining battery level, radio wave status, missed call history, incoming mail, etc.) and status information status (for example, If the status information type is the remaining battery level, what percentage of the total battery capacity remains, if the status information type is the radio wave status, how much the received electric field strength is, and the type of status information If there is a missed call history or an incoming mail, the presence or absence of a new incoming call that has not been presented yet is detected. The state notification sound selection / generation unit 103 selects an arbitrary file from the prepared audio files according to the type of state information detected by the various event detection units 102, and generates a notification sound. For example, when it is desired to notify the state of the remaining battery level, an audio file corresponding to the detected status type “remaining battery level” of the information processing apparatus 100 is selected. The effect processing unit 104 applies effects such as reverb, delay, chorus, 3D, equalizer, pitch shift, distortion, etc. according to the status information status to the audio file generated by the status notification sound selection / generation unit 103. The output unit 105 outputs a notification sound.

  As described above, when the determination key 201 of the information processing apparatus 100 is pressed, the state information is notified by the sound of the information processing apparatus 100. For example, if the remaining battery level of the information processing apparatus 100 is reduced, the status information is output for a sound indicating the status information type “remaining battery level” at the time when the determination key is operated, even if the user does not bother checking. Can be confirmed by the notification sound that has been subjected to the effect processing according to the status “low battery”. As a result, when processing states or setting states of various functions are notified by sound, it is possible to notify at a timing at which the user can surely recognize the sound. If the audio file corresponding to the status information type “remaining battery” is shared with the audio file indicating the button confirmation sound when the enter key is operated, the status information status “remaining battery” The remaining battery level of the information processing apparatus 100 can be confirmed by a button confirmation sound that has been subjected to effect processing according to the above.

  The type of status information here includes status detection information such as remaining battery level and radio wave reception status, history information such as presence / absence of incoming calls and unread emails, presence / absence of alarm function, and manner mode The function setting information such as ON / OFF of the mobile phone, the operation information on the operation such as outgoing / incoming call, reproduction, stop, search, connection, etc. can be considered.

  Hereinafter, as an example of the information processing apparatus 100, effect processing is performed on function notification sound and operation notification sound using a portable terminal having functions such as incoming and outgoing calls, transmission and reception of mail, Internet connection, and music playback. A first embodiment that expresses a state notification sound by performing, a second embodiment that outputs a function notification sound, a state notification sound, and an operation notification sound separately after being processed separately; A third embodiment will be described in which different notification sounds are assigned and output for each input operation when operations increase.

For example, the following notification sounds are used for the description of these embodiments.
Function notification sound: Selection sound that sounds when selecting a menu when selecting one application program from a list of various application programs such as mail, web, application, camera, library, etc. Status notification sound: remaining battery level, reception status, Sounds that sound when indicating the status of manner mode, missed call ants, mail incoming ants, message ants, etc. Operation notification sound: Various functions provided in the information processing apparatus 100 (for example, incoming / outgoing calls, playing / stopping music data, files Sound, to confirm that the device user has performed the operation when performing an operation to execute a search, connection to the Internet, etc.)

(First embodiment)
FIG. 3 is a diagram illustrating a configuration of the mobile terminal according to the first embodiment of this invention. The portable terminal according to the first embodiment of the present invention expresses a state notification sound by applying effect processing to the function notification sound and the operation notification sound.
In FIG. 3, the mobile terminal 300 includes a determination key press detection unit 301 that detects that the determination key of the mobile terminal 300 has been pressed, a launcher menu activation unit 302 that activates the launcher menu of the mobile terminal 300, and the user A scroll function selection start detection unit 303 that detects the start of selection using a scroll function, a function notification sound selection / generation unit 304 that selects and generates a selection sound such as menu selection, and the generated function notification sound An effect processing unit 305 that performs effect processing on the mobile phone 300, various event detection units 306 that detect the remaining battery level, radio wave status, missed call history, incoming mail, etc. of the mobile terminal 300, and statuses detected by the various event detection units 306 Select an arbitrary file from the prepared audio files and generate a notification sound. A generating unit 307, an effect processing unit 308 that performs effect processing on the generated operation notification sound, a processed function notification sound from the effect processing unit 305, and a processed operation notification sound from the effect processing unit 308. The configuration includes a mixing processing unit 309 that performs mixing processing and an output unit 310 that outputs the sound subjected to the mixing processing.

  The operation of the portable terminal 300 configured as described above will be described using the flowchart shown in FIG.

  First, the determination key press detection unit 301 detects whether the determination key of the portable terminal 300 is pressed (step S401). If it is not detected that the determination key is pressed, step S401 is repeatedly executed to determine the determination key. Wait for pressing.

  On the other hand, when it is detected in step S401 that the enter key has been pressed, the enter key press detecting unit 301 outputs a detection notification signal to the launcher menu starting unit 302 and various event detecting units 306, and the launcher menu starting unit 302 When the notification signal is received, the launcher menu is activated (step S402).

  The scroll function selection start detection unit 303 detects that the user has started selection using the scroll function (step S403), and the function notification sound selection / generation unit 304 corresponds to each application program of the selected launcher menu. An audio file is selected, a function notification sound is selected (step S404), and the process proceeds to step S405.

  On the other hand, when the various event detection unit 306 receives the notification signal from the determination key press detection unit 301, various events are detected (step S406), and status information to be added to the function notification sound and notified in the detected various events. Is included (step S407). Here, as a method of determining whether or not the state information to be notified by the various event detection units 306 added to the function notification sound is included, for example, the type of the detected state information is “remaining battery power”. In this case, the status information status indicates that the remaining battery level is less than a predetermined percentage of the total battery capacity. If the detected status information type is "Radio wave status", the received electric field strength is less than the specified value. If the detected status information type is "Missed call history" or "Email incoming", the status information status indicates that there is a new incoming call that has not yet been presented. As a condition, it is determined that state information to be notified in addition to the function notification sound is included. When it is determined that the detected various events include state information to be added and notified to the function notification sound, a notification signal is sent to the effect processing unit 305 (step S408).

  When the effect processing unit 305 receives notification signals from the various event detection units 306 (step S405, Y), the various event detection units 306 are processed in step S406 on the function notification sound generated in step S404. The effect processing corresponding to the status of the state information detected is performed (step S409), and the process proceeds to step S410. Here, when a state notification sound indicating a radio wave condition is added to a function notification sound such as a menu selection, an effect process that produces a distorted sound is performed when the radio wave state is bad, and a distortion effect according to the degree is added. If the effect processing unit 305 has not received a notification signal from the various event detection units 306 (step S405, N), the effect processing unit 305 proceeds to step S410 without performing the effect processing on the function notification sound.

  On the other hand, if it is determined in step S407 that the detected various events do not include state information to be added to the function notification sound (step S407, N), the operation notification sound selection / generation unit 307 displays information. It is determined whether or not there is an operation for executing various functions provided in the processing apparatus 100 (step S411). If the operation notification sound selection / generation unit 307 determines that there is an operation for executing various functions in the process of step S411 (step S411, Y), the operation notification sound selection / generation unit 307 selects an audio file corresponding to the operation and outputs an operation notification sound. Generate (step S412).

  The effect processing unit 308 performs effect processing according to the status information status detected by the various event detection units 306 in the process of step S406 on the operation notification sound generated in step S412 (step S413). The process proceeds to S410. As an example of the process in step S413, when a state notification sound indicating the remaining battery level is added to the definite sound of the operation for connecting to the Internet, an effect process is performed in which the pitch decreases as the battery is depleted.

  The mixing processing unit 309 performs mixing processing on the function notification sound processed in step S409 and the operation notification sound processed in step S413 (step S410), and the output unit 310 outputs the processed signal (step S410). Step S414).

  According to such a portable terminal of the first embodiment of the present invention, the state notification sound is expressed by performing effect processing on the function notification sound and the operation notification sound. Thereby, even if it is not necessary to newly output a dedicated notification sound for notifying the state information, the state information can be notified by sound. In addition, when the function notification sound and the operation notification sound are notified, it is highly possible that the user is in the vicinity of the mobile terminal, so that the state information can be notified at a timing at which the user can recognize the state information with certainty. .

(Second Embodiment)
FIG. 5 is a diagram illustrating the configuration of the mobile terminal according to the second embodiment of the present invention. The mobile terminal according to the second embodiment of the present invention processes and outputs a function notification sound, a state notification sound, and an operation notification sound separately after processing them separately.
A portable terminal 500 according to the second embodiment includes a state notification sound selection / generation unit 501 that selects and generates a notification sound from a file prepared according to a detected state in the configuration of the portable terminal 300 illustrated in FIG. The effect processing unit 502 that performs effect processing on the state notification sound is used. In addition, the same code | symbol is attached | subjected to the component same as the portable terminal 300 shown in FIG. 3, and the description is abbreviate | omitted.

FIG. 6 is a flowchart showing the operation of the mobile terminal 500.
In FIG. 6, the operation from the detection of pressing of the enter key to the selection and generation of the function notification sound, that is, the operations in steps S401 to 404 and S406 are the first embodiment shown in FIG. Since it is the same, description is abbreviate | omitted.

  When receiving the notification signal from the determination key press detection unit 301, the various event detection unit 306 detects various events (step S406). For the function notification sound generated by the function notification sound selection / generation unit 304 in step S404, the effect processing unit 305 performs effect processing according to the status information status detected by the various event detection units 306 in step S406. (Step S601), the process proceeds to step S607. Here, when a state notification sound indicating a radio wave condition is added to a function notification sound such as a menu selection, an effect process that produces a distorted sound is performed when the radio wave state is bad, and a distortion effect according to the degree is added.

  In addition, after the various event detection unit 306 detects various events (step S406), the operation notification sound selection / generation unit 307 detects an operation for executing various functions provided in the information processing apparatus 100 (step S602). Then, an audio file corresponding to the operation is selected, and an operation notification sound is generated (step S603). Further, the effect processing unit 308 performs effect processing according to the status information status detected by the various event detection units 306 in the process of step S406 on the operation notification sound generated in step S603 (step S604). The process proceeds to step S607. As an example of the process of step S604, when a state notification sound indicating the remaining battery level is added to the definite sound of the operation to connect to the Internet, an effect process is performed in which the pitch decreases as the battery is depleted.

  After various event detection units 306 detect various events (step S406), the state notification sound selection / generation unit 501 selects an audio file corresponding to the type of state information detected by the various event detection units 306. Then, a state notification sound is generated (step S605). The effect processing unit 502 performs effect processing according to the status information status detected by the various event detection units 306 in the process of step S406 on the status notification sound generated in step S605 (step S606). The process proceeds to S607.

  The mixing processing unit 309 performs a mixing process on the function notification sound processed in the effect in step S601, the operation notification sound processed in the effect in step S604, and the state notification sound processed in the effect in step S606 (step S607). The output unit 310 outputs the mixed signal (step S608).

  When the mixing processing unit 309 processes and outputs the function notification sound, the state notification sound, and the operation notification sound, various modes are conceivable.

FIG. 7 is a diagram illustrating how the notification sound of each aspect is output.
The notification sound shown in FIG. 7A simultaneously outputs a function notification sound, a state notification sound, and an operation notification sound. As a result, the user can listen to the status information in a short period of time.

  The notification sound shown in FIG. 7B outputs a function notification sound, a state notification sound, and an operation notification sound separately. Thereby, the notification sound corresponding to a plurality of state information can be output at a time.

  The notification sounds shown in FIGS. 7C to 7E output two notification sounds among the function notification sound, the state notification sound and the operation notification sound as the first sound and the second notification sound as the second sound. Is output as a sound. For example, in FIG. 7C, the state notification sound and the operation notification sound are output as the first sound, and the function notification sound is output as the second sound. As a result, the user can easily identify the first sound and the second sound.

  According to the portable terminal of the second embodiment of the present invention, the function notification sound, the state notification sound, and the operation notification sound are processed and synthesized and output. This makes it possible for the user to confirm each state reliably without enduring it.

(Third embodiment)
In this embodiment, when the number of input operations increases, a different notification sound is assigned and output for each input operation. Here, when selecting a function with the scroll key, first, when the determination key (waiting, returning from the sleep state) is pressed or when the determination key is pressed, a notification sound corresponding to the selected function is output. For example, when the mail function is selected, a notification sound indicating that the mail function is selected is output. That is, when the function notification sound selection / generation unit 304 of the mobile terminal 500 of the second embodiment generates a function notification sound, a different notification sound is generated and output for each input operation. As a result, the state of the terminal can be automatically confirmed when any functional operation is executed.

In the above description, the example in which the state information is notified by the notification sound when the determination key is pressed has been described, but the present invention is not limited to this, and other specific operations are designated, You may alert | report state information by alerting | reporting sound at the time of performing the designated specific operation | movement.
In addition, the operation unit of the present invention is not limited to the operation unit of the apparatus main body, but is also applied when inputting to the operation unit of the remote controller. When the operation key of the remote controller is pressed, the status information of the main unit is displayed. The structure of being notified may be sufficient.

  As described above, when the information processing apparatus according to the present invention notifies the processing state or setting state of various functions by sound, it can notify at a timing at which the user can surely recognize the sound. State detection information such as remaining battery level and radio wave reception status, history information such as presence / absence of incoming call / unread e-mail, presence / absence of alarm function, on / off of manner mode, etc. It is useful as a portable terminal device that informs state information such as function setting information by sound. Even when the earphone is attached to the portable terminal device body and the device body is left in a bag or a pocket of clothes, the state of the device body can be grasped or a blind operation can be performed for a desired function. it can.

The figure which shows the basic composition of the information processing apparatus of embodiment of this invention The figure which shows the example of the determination key of information processing apparatus The figure which shows the structure of the portable terminal of the 1st Embodiment of this invention. The flowchart figure for demonstrating operation | movement of the portable terminal of the 1st Embodiment of this invention. The figure which shows the structure of the portable terminal of the 2nd Embodiment of this invention. The flowchart figure for demonstrating operation | movement of the portable terminal of the 2nd Embodiment of this invention. The figure which shows the output state of the notification sound of each aspect

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Information processing apparatus 101, 301 Determination key press detection part 102, 306 Various event detection part 103 State notification sound selection / generation part 104, 305, 308, 502 Effect processing part 105, 310 Output part 201 Determination key 300, 500 Portable terminal 302 launcher menu activation unit 303 scroll function selection start detection unit 304 function notification sound selection / generation unit 307 operation notification sound selection / generation unit 309 mixing processing unit 501 status notification sound selection / generation unit

Claims (8)

An operation unit;
A sound output unit for outputting sound;
A detection unit that detects one state of the apparatus main body as first state information,
When the sound output unit receives an input operation by the operation unit, the sound output unit outputs a sound as a first sound corresponding to the first state information detected by the detection unit.
Information processing device. The information processing apparatus according to claim 1,
The sound output unit outputs a sound as the first sound that has been subjected to the effect processing corresponding to the first state information detected by the detection unit,
Information processing device. An information processing apparatus according to claim 2,
The sound output unit outputs a second sound corresponding to the input operation received by the operation unit. When the input operation is received by the operation unit, the first sound detected by the detection unit is detected. The sound is output as the second sound that has been subjected to the effect processing corresponding to the state information.
Information processing device. The information processing apparatus according to claim 1,
The sound output unit outputs a second sound corresponding to the input operation received by the operation unit. When the input operation is received by the operation unit, the sound output unit detects the second sound detected by the detection unit. Outputting a first sound corresponding to the state information and a second sound corresponding to the input operation,
Information processing device. An information processing apparatus according to claim 4,
When the sound output unit receives an input operation by the operation unit, the sound output unit corresponds to the third sound that notifies the corresponding function selected by the operation and the second state information detected by the detection unit. Outputting a sound of the first sound;
Information processing device. An information processing apparatus according to claim 4 or 5, wherein
When the sound output unit further accepts an input operation by the operation unit, the sound output unit notifies the operation corresponding to the operation, and the sound corresponding to the second state information detected by the detection unit. Outputting a first sound,
Information processing device. An information processing apparatus according to claim 4,
When the sound output unit receives an input operation by the operation unit, the sound output unit generates a first sound corresponding to the second state information detected by the detection unit and a second sound corresponding to the input operation. Output sound simultaneously,
Information processing device. An information processing apparatus according to claim 4,
When the sound output unit receives an input operation by the operation unit, the sound output unit generates a first sound corresponding to the second state information detected by the detection unit and a second sound corresponding to the input operation. Output sound continuously,
Information processing device.

Images