JP4211968B2 - Information processing device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention is suitable for use in a terminal device such as a mobile phone, a PHS phone (PHS: Personal Handyphone System), a PDA device having a communication function (PDA: Personal Digital Assistants), or a personal computer device having a communication function. The present invention relates to an information processing apparatus, and more particularly to an information processing apparatus that determines the current state based on a sensor and controls operation of a terminal device.
[0002]
[Prior art]
2. Description of the Related Art Nowadays, an application program (interaction program) that displays a predetermined character on a display screen of a terminal device such as a mobile phone or a personal computer device and displays the character in response to a user's key operation is known.
[0003]
For example, when the “1” key of a numeric keypad provided on a cellular phone is pressed, the interaction program performs display control of the character so that the character in the display screen raises the right hand. When the key is pressed, display control of the character is performed so that the character in the display screen raises the right foot.
[0004]
Thus, the user can interactively operate the characters displayed on the standby screen of the mobile phone or the desktop of the personal computer device via a desired key operation.
[0005]
In many cases, the standby screen or desktop of a mobile phone simply displays an image of a character or the like, but by enabling the operation of the character displayed in this way, the standby image is interesting and enjoyable. And desktop images.
[0006]
[Problems to be solved by the invention]
However, in the conventional interaction program, “character motion” is assigned to “operation keys”. For this reason, there is a limit to the number of operation keys provided on a terminal device such as a mobile phone or a personal computer device, so that there is a problem that the motion pattern of characters is small and simplified.
[0007]
The operation of “pressing” the operation key is an operation of “pressing” in the real world. The user sensuously expects the action of the character to “push” and to move backward when the character is pushed by the finger.
[0008]
However, the operation key provided on the terminal device has only an operation method of “press”, and the character performs a plurality of patterns of movement for one operation of “press”. There is a problem that there is a reaction that is far from the real world action as the reaction of the character in the world.
[0009]
Further, since the conventional interaction program controls the display of the character after waiting for the user's key operation, there is a problem that only the passive display control can be performed.
[0010]
The present invention has been made in view of the above-described problems, and can display and control a character with a large number of complicated motion patterns so that a reaction corresponding to an action in the real world can be performed. An object of the present invention is to provide an information processing apparatus that can be operated automatically.
[0011]
[Means for Solving the Problems]
  An information processing apparatus according to the present invention includes:In order to solve the above problems,
  A character image display unit for displaying a character image of a predetermined character on the display unit;
  A two-dimensional input unit that includes a pressure sensor, is provided so that the character image displayed on the display unit can be viewed, and detects an operation position, an operation distance, and a pressing force by a user's contact operation;
  At least a timer for measuring time, a light sensor for detecting light, and a sound sensor for detecting sound, and based on outputs from the timer and each sensor, a device to which the information processing apparatus is applied comprehensively A current state determination unit for determining the current state;
  The character image display unit is controlled to display the character image that performs an operation corresponding to the current state of the device determined by the current state determination unit, and the user's contact operation is detected by the two-dimensional input unit. Corresponds to the operation position and operation distance by this contact operation.AndIn addition, the character image display unit is controlled so as to display the character image that performs an action that becomes a reaction in the real world, or corresponds to the pressing force by the contact operation and performs an action that becomes a reaction in the real world. A control unit for controlling the character image display unit to display the character image;
  Have
[0012]
  In the present invention, the current state determination unit includes at least a timer for measuring time, a light sensor for sensing light, and a sound sensor for sensing sound, and based on the outputs from the timer and each sensor, The current status of the device to which the information processing apparatus is applied is determined. The control unit controls the character image display unit to display a character image that performs an operation corresponding to the current state of the device determined by the current state determination unit. Thereby, the character displayed on the display unit can be actively operated. In addition, when the contact operation of the user is detected by the two-dimensional input unit, the control unit displays the character image corresponding to the operation position and the operation distance by the contact operation and performing an action that becomes a real world reaction. The character image display unit is controlled to display, or the character image display unit is controlled so as to display the character image corresponding to the pressing force by the contact operation and performing a real world reaction. To do. Thereby, the character displayed on the display unit can be displayed in a complex and numerous motion patterns so as to be a reaction corresponding to an action in the real world.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, as a first embodiment, an example of a terminal device that actively moves characters and the like, and as a second embodiment, a complex and a large number of operation patterns so as to be a reaction corresponding to an action in the real world. An example of a terminal device that controls the display of characters will be described.
[0014]
[First Embodiment]
[Configuration of First Embodiment]
FIG. 1 is a block diagram showing a main configuration of a terminal device according to a first embodiment to which the present invention is applied. The terminal device shown in FIG. 1 is a mobile phone. Since the block diagram is complicated, the communication system and the like are not shown.
[0015]
In FIG. 1, a mobile phone includes a timer 1 (= time sensor) that measures time, an optical sensor 2 that detects the brightness of a place where the mobile phone is placed, and a place where the mobile phone is placed. And a sound sensor 3 for detecting sounds around the sound.
[0016]
In addition, this mobile phone includes a schedule book 4 in which a user's schedule including data such as date, start time, and end time is stored, and each of the call date, call time, call destination telephone number, call destination name, etc. A call history memory 5 in which a call history consisting of data is stored, and a control pattern in which information on a plurality of control patterns for operating the mobile phone based on each information in the timer 1 to call history memory 5 is stored And a table.
[0017]
In addition, the mobile phone has a vibration function 7 for vibrating the mobile phone, a voice control unit 8 for controlling the sound generation of a predetermined voice corresponding to the control pattern via the speaker unit 9, and a plurality of voice patterns of characters. Based on the stored character voice memory 10, based on the control pattern, a character drawing unit 11 for drawing a character to be displayed on the display unit 12, and a control unit 13 (CPU) for controlling the entire mobile phone. ing.
[0018]
[Operation of First Embodiment]
The flowchart in FIG. 2 shows a flow until the mobile phone actively operates a character or the like. The flowchart of FIG. 2 starts when the main power supply of the mobile phone is turned on.
[0019]
First, in step S1 and step S2, the CPU 13 acquires time information from the timer 1, and holds 1-bit data of “1” or “0” according to the time information.
[0020]
Specifically, as shown in FIG. 3, for example, the CPU 13 determines that “daytime” is from 4:00 am to 16:00 pm, and if the current time corresponds to this daytime, “1” is set. Retain data. On the other hand, the CPU 13 determines that “nighttime” is from 16:00 pm to 4:00 pm, and holds “0” data when the current time corresponds to this nighttime.
[0021]
Next, the schedule book 4 stores, for example, each date such as date, start time, and end time of a future schedule. In step S3 and step S4, the CPU 13 acquires schedule information within a predetermined time, for example, on the current day from the schedule book 4, and holds the 1-bit data according to the schedule information.
[0022]
Specifically, in this case, the CPU 13 operates as a schedule sensor, and when the schedule book 4 stores, for example, the schedule for the current day, the CPU 13 determines that the schedule is “present” as shown in FIG. ”Is retained. On the other hand, when the schedule for the current day is not stored in the schedule book 4, it is determined that the schedule is “none” and data “0” is held.
[0023]
Next, when the user calls, the call history memory 5 stores data such as a call date, a call time, a call destination telephone number, and a call destination name as a history. In step S5 and step S6, the CPU 13 acquires a call history from the call history memory 5, and detects call history information within a predetermined time, for example, within 3 hours from the current time. Then, the 1-bit data is held according to the presence / absence of the call history information within the predetermined time.
[0024]
Specifically, in this case, the CPU 13 operates as a call history sensor, and when the call history within the predetermined time exists in the call history memory 5, the call history is determined to be “present” as shown in FIG. The data “1” is held. On the other hand, when the call history within the predetermined time does not exist in the call history memory 5, the CPU 13 determines that the call history is “none” and holds “0” data.
[0025]
In this example, the call history such as the call date, call time, call destination phone number, call destination name, etc. stored when the user calls is used, but this is because the user receives a call. An incoming history such as an incoming date, an incoming time, a destination telephone number, and a sender name may be used. Alternatively, the call history and the incoming call history may be used together.
[0026]
Next, the optical sensor 2 detects the illuminance (brightness) of the place where the mobile phone is placed. In step S7 and step S8, the CPU 13 acquires illuminance information detected by the optical sensor 2, and holds the 1-bit data corresponding to the illuminance information.
[0027]
Specifically, as shown in FIG. 6, the CPU 13 determines that the illuminance is between 0.0 and 0.4, for example, “dark”, and “1” when the current illuminance corresponds to this range. Retain data. In contrast, the CPU 13 determines that the illuminance is, for example, between 0.4 and 1.0 as “bright”, and retains data of “0” when the current illuminance corresponds to this range.
[0028]
In this example, two kinds of judgments “dark” or “bright” are performed, but this may be performed by a plurality of “dark”, “dim”, “slightly bright”, “bright”, etc. You may make it perform the judgment divided into the step. This is because the CPU 13 sets the number of bits held in this brightness determination to 2 bits, and “dark” = “00”, “dim” = “01”, “slightly bright” = “10”, “bright” = If “11” is set, this can be realized.
[0029]
Next, the sound sensor 3 detects the loudness (sound pressure level) around the place where the mobile phone is placed. In step S9, the CPU 13 acquires information (sound pressure information) indicating the sound pressure level detected by the sound sensor 3, and holds 1-bit data corresponding to the sound pressure information.
[0030]
Specifically, as shown in FIG. 7, the CPU 13 determines that the surroundings are “quiet” when the sound pressure level is less than 40 dB, for example, and “1” when the current sound pressure level is less than 40 dB. ”Is retained. On the other hand, when the sound pressure level is 40 dB or more, for example, the CPU 13 determines that the surroundings are “noisy”, and holds “0” data when the current sound pressure level is 40 dB or more.
[0031]
In this example, two types of judgments are made such as “quiet” or “noisy”, but this is performed in multiple stages such as “quiet”, “normal”, “somewhat noisy”, “noisy”, etc. You may make it perform the judgment divided into. As in the case of the above illuminance, this can be realized by setting the number of bits of data held by the CPU 13 based on the sound pressure information to 2 bits.
[0032]
Next, in step S10, the CPU 13 determines that the “current data pattern”, which is a combination of the 1-bit data held in steps S2, S4, S6, S8, and S9, and the control pattern table 6 are used. Is compared with the “data pattern” of each control pattern. In step S11, the “data pattern” that matches the “current data pattern” is detected from the “data patterns” stored in the operation pattern table 6 to correspond to the “current data pattern”. The “control pattern” to be detected is detected.
[0033]
Next, in step S12, the CPU 13 controls each part of the mobile phone based on the detected control pattern. As a result, one control process shown in the flowchart of FIG. 2 is completed.
[0034]
The control process shown in the flowchart of FIG. 2 is repeatedly executed while the main power source of the mobile phone is turned on.
[0035]
[Specific examples of control]
As an example, FIG. 8 shows a relationship between each control pattern and a control example of each unit.
[0036]
[First control pattern]
In FIG. 8, when the “current data pattern” becomes “11011”, the CPU 13 selects the first control pattern from the control pattern table 6.
[0037]
This first control pattern is currently daytime (1), there is a schedule for the day (1), there is no call history within three hours (0), the surrounding of the mobile phone is dark (1), The case around the telephone is quiet (1).
[0038]
In such a case, it is morning, and the user is sleeping while the schedule is on, and the telephone that is being used every morning is not yet used. In other words, the user is oversleeping in the morning.
[0039]
For this reason, the CPU 13 sets and controls the voice control unit 8 to “ring tone → on” and “volume → maximum level”, and reads out the character voice information for waking up from the character voice memory 10, for example, “Wake up”. Control. This character voice information is supplied to the voice control unit 8.
[0040]
Further, the CPU 13 controls the character drawing unit 11 and drives and controls the vibration function so as to draw a character that performs a screaming action.
[0041]
As a result, the character that performs the screaming action is displayed on the display unit 12 of the mobile phone, and the voice of the character “Wake up” is controlled to be uttered through the speaker unit 9, and the mobile phone is Drive vibration.
[0042]
In this case, the CPU 13 continuously executes the voice production control and the vibration function drive control until a stop operation is performed by the user.
[0043]
Thereby, in this case, the mobile phone functions as an alarm clock. The user will recognize that he / she has been awakened by looking at the character screaming “Wake up” displayed on the display unit 12. You will also remember the schedule for the day and will implement the schedule as scheduled. As a result, emotions such as intimacy will be remembered for the character who has woken up in this way.
[0044]
[Second control pattern]
Next, when the “current data pattern” is “10011”, the CPU 13 selects the second control pattern from the control pattern table 6.
[0045]
This second control pattern is currently daytime (1), there is no schedule for the day (0), there is no call history within three hours (0), the surroundings of the mobile phone are dark (1), and the mobile phone The case around is quiet (1).
[0046]
In such a case, it is morning, and the user is still sleeping, and the telephone that is being used every morning is not yet used. In other words, since the user has no schedule, the user is sleeping comfortably.
[0047]
For this reason, the CPU 13 sets and controls the voice control unit 8 so as to turn on the ringtone without changing the normally set volume, and wakes up from the character voice memory 10, for example, “Would you wake up soon?” The character voice information is read out and controlled.
[0048]
In addition, the CPU 13 controls the character drawing unit 11 and controls the vibration function to be turned off so as to draw a character that performs an easy-visiting action.
[0049]
As a result, a character performing a gentle visit operation is displayed on the display unit 12 of the mobile phone, and the voice of the character “Why do you want to get up?” Is controlled through the speaker unit 9.
[0050]
In this case, the CPU 13 continues to execute the sound production control until the user performs a stop operation.
[0051]
Thus, in this case, as in the first control pattern, the mobile phone functions as an alarm clock, but the mobile phone gently acts as an alarm clock and wakes up the user gently.
[0052]
Thus, depending on the presence or absence of the schedule, the way the user wakes up differs between the first control pattern and the second control pattern. By controlling the operation of each unit based on a plurality of sensor outputs, it is possible to perform control according to the situation in this way.
[0053]
[Third control pattern]
Next, when the “current data pattern” is “10101”, the CPU 13 selects the third control pattern from the control pattern table 6.
[0054]
This third control pattern is currently daytime (1), there is no schedule for the day (0), there is a call history within 3 hours (1), the surroundings of the mobile phone are bright (0), and the mobile phone The case around is quiet (1).
[0055]
In such a case, it is morning, the user is getting up because there is a call history, and the surroundings are quiet. In other words, the user is waking up but not knowing what he is doing.
[0056]
Therefore, the CPU 13 sets and controls the voice control unit 8 to “ring tone → on” and “volume → minimum level”, and also performs voice control so as to ring the ring tone only for 2 seconds, for example, to attract the user's attention. The unit 8 is controlled.
[0057]
Further, the CPU 13 reads out and controls character voice information such as “Hey, what are you doing?” From the character voice memory 10, for example.
[0058]
Further, the CPU 13 controls the character drawing unit 11 and controls the vibration function to be turned off so as to draw a character that performs such a visiting action.
[0059]
As a result, after the ringing tone of the mobile phone has been sounded for 2 seconds, the character that performs the visiting action is displayed on the display unit 12. "Is it?"
[0060]
As a result, since the ringtone of the mobile phone has been ringed, the user will be asked “Hey, what are you doing?” From the character displayed on the display unit 12 when looking at the mobile phone. . For this reason, the user will be more intimate with such characters.
[0061]
[Fourth control pattern]
Next, when the “current data pattern” becomes “10100”, the CPU 13 selects the fourth control pattern from the control pattern table 6.
[0062]
This fourth control pattern is currently daytime (1), there is no schedule for the day (0), there is a call history within three hours (1), the surroundings of the mobile phone are bright (0), and the mobile phone This is a case where the surroundings of the house are noisy (0).
[0063]
In such a case, it is morning and the user has woken up because there is a call history, and the surroundings are noisy, so the user is in a noisy place such as in the city or on a train, or television This is a state in which broadcasting and listening to music are being performed. In this case, in any case, the user is currently unable to rest on the character.
[0064]
For this reason, the CPU 13 sets and controls the voice control unit 8 so as to turn off the ringtone, and controls the character drawing unit 11 so as to draw a character that performs a predetermined action for such a situation. The vibration function is also controlled off.
[0065]
This is the same state as the so-called “manner mode”. For this reason, it is possible to prevent inconvenience caused to the people in the city or on the train by the unexpected ringtone. Alternatively, it is possible to prevent inconvenience that disturbs users who concentrate on television broadcasting and music.
[0066]
The explanation of the control pattern will be limited to the explanation of the above four patterns because the explanation will be long, but other control patterns will be controlled according to the current situation determined according to each sensor output. I want you to understand.
[0067]
[Effect of the first embodiment]
As is apparent from the above description, the cellular phone according to the first embodiment includes each sensor output from the timer 1, the optical sensor 2 and the sound sensor 3, the schedule registered in the schedule book 4, and the call history memory. The current state where the mobile phone is placed is determined based on the call history stored in 5, and each part of the mobile phone is controlled so as to perform an operation in accordance with the determination result.
[0068]
Thus, instead of passive control in which each unit is controlled after waiting for the user's input, active control is performed so that the mobile phone (including characters, etc.) is operated by spontaneously judging the current state. Can do.
[0069]
[Second Embodiment]
[Configuration of Second Embodiment]
Next, FIG. 9 shows a block diagram of a terminal device according to a second embodiment to which the present invention is applied. The terminal device shown in FIG. 9 is also a mobile phone as in the first embodiment, and only the main configuration is shown.
[0070]
In FIG. 9, the cellular phone includes character data that stores position information of each part of the character displayed on the touch pad 20, the CPU 13, the display unit 12, and the display unit 12 with a built-in pressure sensor and position sensor. A holding unit 27 and other components 28 of a mobile phone such as a communication system are included.
[0071]
The touch pad 20 is formed of a transparent plate member in which transparent electrodes are arranged in a matrix, and is provided so as to cover the entire surface of the display unit 12 (or may be a part of the surface). For this reason, when the user operates the touch pad 20, the operation is performed by scanning the surface of the display unit 12 with a finger (or an input pen).
[0072]
The CPU 13 corresponds to the CPU 13 in the first embodiment described above. In the case of the mobile phone according to the second embodiment, the CPU 13 includes an input information conversion unit 21 that converts position information from the position sensor of the touch pad 20 into XY coordinate data on the display screen of the display unit 12, and a touch. A pressure detection unit 22 that detects the presence or absence of the pressing force of the user based on the detection output from the pressure sensor of the pad 20 is provided.
[0073]
Further, the CPU 13 analyzes the input direction of the user's finger (the operation direction of the touch pad 20) based on the XY coordinate data from the input information conversion unit 21, and the input information analysis unit 23. And a user input operation determination unit 24 that determines the movement of the user's finger based on the analysis output from.
[0074]
Further, the CPU 13 selects a character motion selection unit 25 that selects a motion pattern of the character displayed on the display unit 12 based on the determination output from the user input motion determination unit 24 and the pressure detection output from the pressure detection unit 22. Referring to the position information of each part of the character stored in the character data storage unit 27, the character drawing unit 11 performs a drawing process on the character image indicating the action selected by the character action selection unit 25. And a character data processing unit 26 for forming drawing processing data.
[0075]
[Operation of Second Embodiment]
[When pressure is not detected]
First, the pressure detection unit 22 of the CPU 13 detects that the user has pressed the touch pad 20 when a pressure detection output indicating a pressing force equal to or greater than a predetermined threshold is supplied from the pressure sensor of the touch pad 20. It has become. For this reason, when the pressure detection output indicates a pressing force equal to or less than the predetermined threshold, the CPU 13 assumes that the user is not pressing the touch pad 20, and only the movement of the user's finger described below is performed. Perform display control.
[0076]
First, when the user scans the touch pad 20 with a finger, the position sensor forms finger position information corresponding to the scanning, and supplies the information to the input information conversion unit 21. The input information conversion unit 21 captures each position information by sampling at a predetermined interval, and converts each captured position information into XY coordinate data on the display screen of the display unit 12.
[0077]
In FIG. 10, a trajectory when the touch pad 20 is scanned with a finger, XY coordinate data formed by sampling position information corresponding to the trajectory and performing XY coordinate conversion processing, and input from the input information conversion unit 21 are input. The XY coordinate data supplied to the information analysis unit 23 is shown.
[0078]
FIG. 10 shows an example in which a finger is moved in a substantially zigzag shape in the vertical direction of the touch pad 20. For such scanning, (X, Y) = (30, 50) → (X, Y) = (30, 40) → (X, Y) = (30, 30) → (X, Y) ) = (30,20)... XY coordinate data is sequentially formed, and “(30,50), (30,40)” → “(( 30, 40), (30, 30) ”→“ (30, 30), (30, 20) ”...
[0079]
The notation (X, Y) = (30, 50) indicates that the X coordinate is the position of 30 dots in the horizontal direction of the display unit 12, and the Y coordinate is the position of 50 dots in the vertical direction of the display unit 12. I mean.
[0080]
Next, the input information analysis unit 23 analyzes the direction and distance in which the user moved the finger based on the XY coordinate data supplied in a state where the front and rear are set as one set. Specifically, when the set of XY coordinate data is “(X1, Y1), (X2, Y2)”, the input information analysis unit 23 sets “X2-X1” and “Y2-Y1”. An operation is performed, and the direction and distance in which the user moves the finger is analyzed based on the X coordinate value and the Y coordinate value obtained by the operation.
[0081]
FIG. 11 shows an example of this analysis operation. In FIG. 11, for example, if the XY coordinate data supplied in a state where the front and rear are set as one set is “(50, 40), (50, 60)”, the input information analysis unit 23 displays “50− 50 "and" 60-40 "are calculated. The calculation of “50-50” corresponds to the calculation of “X2-X1”, and the calculation of “60-40” corresponds to the calculation of “Y2-Y1”. In this example, the calculated value of “X2−X1” is “0”, and the calculated value of “Y2−Y1” is “+20”.
[0082]
Next, the user input operation determination unit 24 detects the direction and distance in which the user moved the finger based on the analysis result (= the calculated value) from the input information analysis unit 23.
[0083]
Specifically, the user input operation determination unit 24 moves the display unit 12 in the right direction when the sign of the calculation value of “X2−X1” is “+”, and the sign of the calculation value is “−”. Is detected as a leftward movement of the display unit 12, and when the sign of the calculated value of “Y2−Y1” is “+”, the display unit 12 is moved upward. When the sign of the calculated value is “−”, it is detected as a downward movement of the display unit 12.
[0084]
In the case of the above-described calculation values, the calculation value of “X2−X1” is “0”, and the calculation value of “Y2−Y1” is “+20”. This indicates that there is no movement in the horizontal direction of the display unit 12 in the X direction, but a movement of +20 dots has occurred in the vertical direction of the display unit 12 in the Y direction. Therefore, in this case, the user input operation determination unit 24 determines the user's input operation on the assumption that the user has moved his / her finger by 20 dots upward in the display unit 12. Such a determination output is supplied to the character action selection unit 25.
[0085]
Further, in another example, for example, if the XY coordinate data supplied in a state where the front and rear are set as a set is “(30, 30), (40, 50)”, “X2-X1” The calculated value is “+10”, and the calculated value of “Y2−Y1” is “+20”. This indicates that there is a movement of +10 dots in the horizontal direction of the display unit 12 and +20 dots in the vertical direction of the display unit 12. Therefore, in this case, the user input operation determination unit 24 determines that the user has moved his / her finger by about 20 dots in the upper right direction of the display unit 12.
[0086]
Next, the character motion selection unit 25 selects (determines) the character motion based on the character data before moving display stored in the character data storage unit 27 and the determination output from the user input motion determination unit 24. To do.
[0087]
FIG. 12 shows a schematic diagram of a humanoid character displayed on the display unit 12. In this case, the display unit 12 assumes that the number of dots in the vertical (Y direction) × horizontal (X direction) is 100 dots × 80 dots.
[0088]
The character data storage unit 27 stores XY coordinate data for each part such as the head, trunk, right hand, and left hand of the character before moving display as character data.
[0089]
Specifically, in this example, as shown in FIG. 13, the XY coordinate data “(30, 80), (50, 80)” at both ends of the line segment corresponding to the width of the head of the character is used as the character data. XY coordinate data “(40, 60), (40, 40)” at both ends of the line segment corresponding to the length of the trunk, XY coordinate data “(40, 60),” corresponding to the length of the right hand, (20, 80) ", XY coordinate data" (40, 60), (60, 40) "and the like corresponding to the length of the left hand are stored in the character data storage unit 27.
[0090]
Here, when the movement of the user's finger “(50, 40), (60, 40)” described with reference to FIG. 11 is superimposed on the character image, a line corresponding to the left hand of the character as shown in FIG. It can be seen that a line segment corresponding to the movement of the user's finger intersects the minute.
[0091]
The XY coordinate data “(50, 40), (60, 40)” are adjacent samples as described above. That is, it means that the sample (60, 40) was obtained immediately after the sample (50, 40) was obtained. This sample is obtained by using a sampling frequency of several kHz, for example. Despite such a high frequency, each XY coordinate data of (50, 40) → (60, 40) is obtained in a short time. That it was obtained continuously means that the user's finger was moved so as to flick upward on the display screen.
[0092]
Considering such a movement and position of the user's finger over the character image shown in FIG. 12, it can be seen that the left hand of the character is flipped upward by the user's finger.
[0093]
The character action selection unit 25 has an action pattern table in which a plurality of pieces of information indicating action patterns are stored. The character action selection unit 25 selects the corresponding action pattern from the action pattern table based on the character image before moving display and the movement and position of the user's finger in this way, and the selected action pattern. Information to be shown is supplied to the character data processing unit 26.
[0094]
In the case of the above-described example, since the left hand of the character is flipped upward by the user's finger, the character action selection unit 25 selects an action pattern for raising the left hand of the character, and information indicating this action pattern is subjected to character data processing. To the unit 26.
[0095]
Next, the character data processing unit 26 forms drawing processing data for drawing a character that performs an action corresponding to the information indicating the action pattern from the character action selecting unit 25, and controls the character drawing unit 11. To do.
[0096]
The character drawing unit 11 performs drawing processing for the character displayed on the display unit 12 based on the drawing processing data.
[0097]
In the case of the above-described example, the character data processing unit 26 forms drawing processing data for drawing a character that performs the action of raising the left hand, and supplies this to the character drawing unit 11. As a result, the character drawing unit 11 performs display control of the character that performs the action of raising the left hand as indicated by the dotted line in FIG.
[0098]
[When pressure is detected]
Next, the drawing processing operation when the pressure is detected by the pressure detection unit 22 of the CPU 13 will be described.
[0099]
As described above, the pressure detection unit 22 detects that the user has pressed the touch pad 20 when a pressure detection output indicating a pressing level equal to or higher than a predetermined threshold is supplied from the pressure sensor of the touch pad 20. It has become. When the pressure detection unit 22 detects the pressing force, the character action selection unit 25 determines the pressure level and the position on the display unit 12 where the pressure is applied, and the determination from the user input action determination unit 24. The operation pattern is selected based on the output.
[0100]
Specifically, for example, when the user presses the character's mouth with a finger in order to press the character's mouth, for example, “with pressure” is indicated from the position around the mouth of the character indicated by a circle in FIG. Will be detected. The pressure detection unit 22 takes in the pressure detection output of the center coordinates “(40, 72)” of the pressure detection outputs corresponding to the detected range, and supplies this to the character action selection unit 25. .
[0101]
In this example, since the user presses the character's mouth with a finger, the input information analysis unit 23 is continuously supplied with the XY coordinate data of (40, 72). For this reason, the user input motion determination unit 24 determines that the user's finger is stopped at the XY coordinate position of (40, 72) on the display unit 12, and supplies this determination output to the character motion selection unit 25. To do.
[0102]
The character action selection unit 25 detects the position where the user's finger is stopped based on the XY coordinate data of each part of the character stored in the character data storage unit 27.
[0103]
In this case, since the XY coordinates at which the user's finger is stopped are (40, 72), the character motion selection unit 25 determines that the user's finger is stopped at the position of the mouth of the character.
[0104]
In this case, the character action selection unit 25 is supplied with a pressure detection output indicating that a press is detected from the position of the mouth of the character.
[0105]
Since the user's finger is stopped at the position of the character's mouth and the character's mouth is pressed by the user's finger, the character action selection unit 25 selects, for example, an action pattern in which the character closes the mouth, Information indicating this motion pattern is supplied to the character data processing unit 26.
[0106]
The character data processing unit 26 forms drawing processing data for drawing a character that performs an action corresponding to the information indicating the action pattern from the character action selecting unit 25, and controls the character drawing unit 11.
[0107]
As a result, the character drawing unit 11 performs a drawing process on the character that performs the closing action of the mouth, and this is displayed on the display unit 12.
[0108]
[Effect of the second embodiment]
As is clear from the above description, the mobile phone according to the second embodiment detects the movement of the user's finger on the display unit 12 by the touch pad 20 provided with the position sensor and the pressure sensor. Based on the movement of the finger of the user and the display position of the currently displayed character, the movement of the character is determined and display control of the character is performed.
[0109]
Further, the pressure sensor detects a position where the user applies pressure with a finger on the display unit 12, and based on the position where the pressure is applied and the display position of the currently displayed character, The character is controlled by determining the movement.
[0110]
As described above, since the touch pad 20 is provided, it is possible to input a complicated and a large number of inputs corresponding to the scanning of the user's finger. The display can be controlled to
[0111]
In addition, the reaction of the character in the virtual world can be a reaction that matches the action in the real world.
[0112]
The touch pad 20 is provided on the surface of the display unit 12, and can be operated while looking at the character displayed on the display unit 12 through the touch pad 20. The scanning of the finger on the touch pad 20 is reflected in the action of the character displayed on the display unit 12.
[0113]
For this reason, the user can provide the feeling of touching and operating the character displayed on the display part 12 with a finger directly. Therefore, the user can handle the character displayed on the display unit 12 as if it were a pet, such as stroking or tickling the head of the character. Therefore, the character displayed on the display unit 12 can be a character that is more intimate.
[0114]
In this example, the touch pad 20 is provided to enable complicated input. However, instead of the touch pad 20, input means such as a trackball or a joystick may be provided.
[0115]
The trackball and joystick are provided in places other than the display unit 12 due to their characteristics. However, in the same manner as the touchpad 20, it is possible to enable complicated input. Therefore, when the touchpad 20 is provided. Similarly to the above, the same effect as described above can be obtained.
[0116]
Further, although the presence or absence of the pressure is detected by the pressure sensor of the touch pad 20, the pressure pattern of the pressure may be detected, and the action pattern of the character may be determined according to the pressure level. In this case, since the character's motion pattern can be determined according to the pressure level, the character's motion is analyzed by analyzing the user's finger motion in detail rather than determining the character's motion pattern according to the presence or absence of pressing. The pattern can be determined.
[0117]
[Combined operation of the first embodiment and the second embodiment]
As described above, for easy understanding, the mobile phone to which the present invention is applied has been described in the first embodiment and the second embodiment, but the mobile phone of each embodiment may be combined. . The operation in this case will be described by taking the first control pattern (current data pattern = 111011) in the first embodiment as an example and conforming to the usage mode of the mobile phone.
[0118]
First, the CPU 13 of the mobile phone acquires time information from the timer 1. For example, it is assumed that this time information indicates 8:15 am on weekdays.
[0119]
Next, the CPU 13 refers to the schedule of the current day from the schedule book 4 and determines whether or not the schedule is in the vicinity of 8:15 am. As this schedule, for example, it is assumed that there is a schedule for meeting with a friend A at a coffee shop in front of the station at 9 am.
[0120]
Next, the CPU 13 refers to the call history memory 5 and checks whether or not there is a partner who makes a call on a daily basis in the time zone around 8:15 am. For example, it is assumed that it is detected that the user makes a call to the friend B on a daily basis for about 5 minutes in the time zone from 8:00 am to 8:10 am.
[0121]
Next, the CPU 13 detects the brightness around the mobile phone based on the detection output from the optical sensor 2. In this detection, it is assumed that the surroundings of the mobile phone are detected to be dark in the morning.
[0122]
Next, the CPU 13 detects the noise level around the mobile phone based on the detection output from the sound sensor 3. In this detection, it is assumed that almost no sound is detected around the mobile phone.
[0123]
Next, the CPU 13 determines the current state where the mobile phone is placed based on each detection result.
[0124]
That is, in this example, it is currently past 8:00 on weekdays. In addition, there is a meeting with friend A today, and it is less than one hour until this meeting time. Despite this, the surroundings of the mobile phone are dark and quiet. The user does not make a phone call to the friend B who goes on a daily basis. This indicates that there is a high possibility that the user is oversleeping in the morning. And if it keeps as it is, the meeting with the friend A will be late.
[0125]
For this reason, the CPU 13 sounds a ringtone of the mobile phone and simultaneously drives vibration. Further, the CPU 13 controls the display unit 12 to display an image of a character screaming “Wake up”.
[0126]
As a result, the user can be awakened by the character of the mobile phone and execute the schedule as scheduled.
[0127]
On the other hand, if the user has already woken up and is quietly organizing today's behavior at home, the operation of such a mobile phone is annoying for the user.
[0128]
Therefore, in order to stop the operation of the mobile phone, the user picks up the mobile phone and closes the mouth of the character screaming “Wake up” with his / her finger.
[0129]
Such user behavior is detected by the pressure sensor of the touch pad 20, and the CPU controls the ring tone and the vibration function 7 to be turned off, and displays the image of the character closing the mouth on the display unit 12 as described above. Control.
[0130]
In this case, the image that the character bows and is incorrect, the image that the character visits “Wake up?”, Or the character teaches “Oh yes. An image may be displayed.
[0131]
As can be seen from this example, the character displayed on the display unit 12 serves as a manager and watches over the user. The mobile phone according to each of the embodiments that provides such manager-like and friendly characters can be said to be a very convenient device.
[0132]
As mentioned above, although this invention was demonstrated in the form according to embodiment, it should be understood that each of these embodiment is an example of this invention. For this reason, in the description of the above-described embodiment, the present invention is applied to a mobile phone. This is because a PHS phone (PHS: Personal Handyphone System), a PDA device having a communication function (PDA: Personal Digital Assistants). Or other terminal devices such as a personal computer device having a communication function. Even in this case, the same effect as described above can be obtained.
[0133]
In addition to the sensors 2 and 3 described above, other sensors such as a temperature sensor may be used.
[0134]
In addition, it should be added that various modifications can be made according to the design and the like as long as they do not depart from the technical idea of the present invention.
[0135]
【The invention's effect】
  The present invention has a complex and multiple operation pattern so that the reaction corresponds to a real-world action.Displayed on the displayCharacter display can be controlled.
[0136]
  The present invention also provides:Displayed on the displayThe character can be actively moved.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a main configuration of a cellular phone according to a first embodiment to which the present invention is applied.
FIG. 2 is a flowchart showing a control flow of the mobile phone according to the first embodiment.
FIG. 3 is a diagram for explaining a day / night determination operation performed based on time information from a timer provided in the mobile phone according to the first embodiment;
FIG. 4 is a diagram for explaining an operation for determining whether there is a schedule registered in a schedule book provided in the mobile phone according to the first embodiment;
FIG. 5 is a diagram for explaining an operation of determining whether or not there is a call history stored in a call history memory provided in the mobile phone according to the first embodiment.
FIG. 6 is a diagram for explaining an operation for determining brightness around the mobile phone, which is performed based on a detection output from an optical sensor provided in the mobile phone according to the first embodiment.
FIG. 7 is a diagram for explaining a judgment operation of sounds around the mobile phone, which is performed based on a detection output from a sound sensor provided in the mobile phone according to the first embodiment.
FIG. 8 is a diagram for explaining a control pattern of control performed based on each detection result in the mobile phone according to the first embodiment.
FIG. 9 is a block diagram showing a main configuration of a mobile phone according to a second embodiment to which the present invention is applied.
FIG. 10 is a diagram illustrating an example of input to a touch pad provided in the mobile phone according to the second embodiment and an example of XY coordinate data detected based on the input.
FIG. 11 is a diagram for explaining a detection operation of a moving direction and a moving distance of a user's finger of the mobile phone according to the second embodiment, which is performed based on the detected XY coordinate data.
FIG. 12 is a diagram for explaining a display control operation of a character displayed on the display unit of the mobile phone according to the second embodiment.
FIG. 13 is a diagram showing an example of XY coordinate data of each part of the character displayed on the display unit of the mobile phone according to the second embodiment.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Timer, 2 ... Light sensor, 3 ... Sound sensor, 4 ... Schedule book, 5 ... Call history memory, 6 ... Control pattern table, 7 ... Vibration function, 8 ... Voice control part, 9 ... Speaker part, 10 ... Character Audio memory, 11 ... Character drawing unit, 12 ... Display unit, 13 ... Control unit (CPU), 20 ... Touch pad (position sensor, pressure sensor), 21 ... Input information conversion unit, 22 ... Pressure detection unit, 23 ... Input Information analysis unit, 24 ... user input motion determination unit, 25 ... character motion selection unit, 26 ... character data processing unit, 27 ... character data storage unit, 28 ... other mobile phone components

Claims (3)

A character image display unit for displaying a character image of a predetermined character on the display unit;
A two-dimensional input unit that includes a pressure sensor, is provided so that the character image displayed on the display unit can be viewed, and detects an operation position, an operation distance, and a pressing force by a user's contact operation;
At least a timer for measuring time, a light sensor for sensing light, a sound sensor for sensing sound, a schedule sensor for detecting a schedule within a predetermined time from a schedule book in which a user's schedule is stored, and a user's call history are stored. A call history sensor that detects a call history within a predetermined time from the call history memory, and comprehensively determines the current status of the device to which the information processing apparatus is applied, based on each output from the timer and each sensor. The current situation determination section;
The character image display unit is controlled to display the character image that performs an operation corresponding to the current state of the device determined by the current state determination unit, and the user's contact operation is detected by the two-dimensional input unit. In this case, the character image display unit is controlled so as to display the character image corresponding to the operation position and the operation distance by the contact operation and performing the action as a real-world reaction, or the press by the contact operation is performed. An information processing apparatus comprising: a control unit that controls the character image display unit so as to display the character image corresponding to pressure and performing an action that is a reaction in the real world . Having a sound generator for generating a predetermined sound;
The control unit controls the sound generation unit to generate a predetermined sound together with the control of the character image display unit.
  The information processing apparatus according to claim 1. Has vibration function,
The control unit drives and controls the vibration function together with the control of the character image display unit.
The information processing apparatus according to claim 1 or 2.

Images