JP5461735B2 - Input device, input support method, and program - Google Patents

Description

  The present invention relates to an input device that accepts an input operation via a touch panel, an input support method, and a program.

  In recent years, electronic devices equipped with a touch panel are increasing. A touch panel that can be operated intuitively by a user is widely used as a device that receives an input operation of an electronic device including a mobile phone. The touch panel receives input operations for the screen of a display unit (for example, an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) display) provided in the electronic device and displays the processing result of the electronic device in the same screen. Makes it possible to do in

  A touch panel capable of detecting the proximity of a finger is known (see, for example, Patent Document 1). This touch panel can detect a state where a finger is held at a position separated from the touch panel by a predetermined height, that is, a proximity state between the finger and the touch panel, and has a capacitance determined by a distance between the finger and the touch panel. Based on this, it is possible to detect that the finger has been slid in substantially parallel to the touch panel in the same manner as when the finger is directly slid on the touch panel. For this reason, a touch panel capable of detecting the proximity of a finger is expected to be established as a new user interface.

  The non-contact type user input device of Patent Document 1 includes a plurality of linear transmission electrodes, a transmitter that supplies an alternating current for transmission to each transmission electrode, and a plurality that is arranged so as not to contact each transmission electrode. A linear receiving electrode and a receiver for receiving an alternating current flowing through the receiving electrode. A capacitor is formed at each intersection of the transmission electrode and the reception electrode, and a capacitor is formed according to the proximity of the user's fingertip. Therefore, the capacitance of the capacitor changes according to the proximity of the fingertip. The non-contact type user input device can recognize the distance between the touch panel and the finger based on the change in capacitance.

JP 2002-342033 A

  However, the conventional input device is contrary to the user's intention when the user moves his / her finger to a position on a space separated from the touch panel, or when the user touches the position and moves or moves in parallel with the touch panel. Operation was sometimes detected. That is, in the conventional input device, since an operation contrary to the user's intention may be detected, an erroneous operation different from the operation content intended by the user may occur, and the user can enjoy comfortable operability. May become difficult.

  The present invention has been made in view of the above-described conventional circumstances, and effectively prevents detection of an operation contrary to the user's intention, reduces an erroneous operation, and enjoys comfortable operability, and input support An object is to provide a method and a program.

The present invention provides a display unit for displaying data on a screen, a proximity detection unit for detecting proximity of a finger to the screen and outputting a proximity detection signal, and detecting contact of the finger to the screen and outputting a contact detection signal A touch detection unit, an operation validity determination unit that determines whether or not a finger touch operation is valid based on the proximity detection signal and the contact detection signal, and the finger touch operation is invalid A control unit that invalidates the contact detection signal when determined , wherein the operation validity determination unit is the proximity detection signal equal to or greater than a predetermined threshold when the finger touches the screen. The finger touch operation is determined to be valid on the condition that the detection range is only one direction with respect to the periphery of the finger contact position on the screen .

  According to this configuration, it is possible to appropriately determine a user's intentional touch operation and an unconscious contact action, and reduce erroneous detection on the touch panel.

The present invention also provides an input support method in an input device including a display unit that displays data on a screen, the step of detecting the proximity of a finger to the screen and outputting a proximity detection signal; Detecting a contact and outputting a contact detection signal; determining whether or not the finger touch operation is valid based on the proximity detection signal and the contact detection signal; and the finger touch operation When it is determined that the touch detection signal is invalid, a detection range of the proximity detection signal equal to or greater than a predetermined threshold when the finger touches the screen is a finger touch position on the screen. Determining that the touch operation of the finger is valid on the condition that there is only one direction with respect to the periphery .

  According to this method, it is possible to appropriately determine the user's intentional touch operation and the unconscious contact action, and to reduce erroneous detection on the touch panel.

The present invention also includes a step of detecting a proximity of a finger to the screen and outputting a proximity detection signal to a computer that is an input device including a display unit for displaying data on the screen, and detecting a finger contact with the screen. Outputting a contact detection signal, determining whether the finger touch operation is valid based on the proximity detection signal and the contact detection signal, and invalidating the finger touch operation. When it is determined that there is a detection range of the proximity detection signal equal to or greater than a predetermined threshold when the finger touches the screen , the step of invalidating the contact detection signal is a region around the finger contact position on the screen. And determining that the finger touch operation is valid on the condition that it is only in one direction .

  According to this program, a user's intentional touch operation and an unconscious contact act can be determined appropriately, and erroneous detection on the touch panel can be reduced.

  ADVANTAGE OF THE INVENTION According to this invention, the user's intentional operation with respect to a touch panel can be determined appropriately, and the misdetection in a touch panel can be reduced.

The block diagram which shows the hardware constitutions of the portable terminal in each embodiment The block diagram which shows the functional structure of the portable terminal 1 of 1st Embodiment. The figure which shows an example of the content of the table 87 used for determination of valid operation (A), (B) The figure which shows effective operation and return operation in continuous hover slide operation The figure which shows the judgment method of a finger height, (A) The graph which shows a time-dependent change of a coordinate, (B) The graph which shows the time-dependent change of the height of a finger, (C) The time-dependent change of hover signal strength (measured value). Graph showing The figure which shows the determination method of the moving speed of a finger, (A) The graph which shows a time-dependent change of a coordinate, (B) The graph which shows the time-dependent change of the moving speed of a finger The flowchart explaining the determination procedure of effective operation among the continuous hover slide operations in the portable terminal of 1st Embodiment. The block diagram which shows the functional structure of the portable terminal of 2nd Embodiment. (A), (B) The figure which shows the erroneous touch during the continuous hover slide operation The flowchart explaining the determination procedure of effective operation among the hover continuous slide operations in the portable terminal of 2nd Embodiment. Explanatory drawing which shows the specific example for determining a mistouch when the hover slide operation which reciprocates an index finger is performed periodically. The block diagram which shows the functional structure of the portable terminal of 3rd Embodiment. (A) The figure which shows the difference between touch operation and flick operation, (B) The figure which shows the difference between x coordinate value, y coordinate value, and z coordinate value in touch operation and flick operation The flowchart explaining the determination procedure of the flick operation and the touch operation in the portable terminal of the third embodiment (A) The figure which shows the misdetection by unconscious contact action, (B) and (C) The figure which shows an example of the detection range of the proximity detection signal detected at the time of the intentional touch operation with respect to a button, (D) The unconscious with respect to a button The figure which shows an example of the detection range of the proximity detection signal detected at the time of a contact act (A) The figure which shows the image of the spread of the distribution of the proximity detection signal detected at the time of an intentional touch operation and an intentional touch operation, (B) The proximity detection signal detected at the time of an unconscious contact action and an unconscious contact action Figure showing the image of the spread of the distribution of (A) The figure which shows the touch operation with respect to button BT4 of the lowest end of the index finger 68a, The figure which shows an example of the breadth of the detection range of the proximity detection signal detected at the time of the touch operation shown to (B) (A) (A) The figure which shows the image of the spread of the distribution of the proximity detection signal detected at the time of the intentional touch operation in the case of one-handed operation or two-handed operation, (B) The spread of the distribution of the proximity detection signal detected at the time of unconscious contact The figure which shows the image of (C) The figure which shows a mode that the proximity detection signal detected at the time of touch operation with the index finger with the artificial nail spreads in the front direction of a button The flowchart explaining the determination procedure of the intentional touch operation with respect to the button in the portable terminal of 4th Embodiment, and an unconscious touch contact. The block diagram which shows the functional structure of the two-screen portable terminal of 5th Embodiment (A) The figure which shows a mode that the two-screen portable terminal of 5th Embodiment is folded and makes two screen display parts oppose, (B) The figure which shows a mode that the touch operation with respect to a front touch panel is determined to be effective, C) A diagram showing a state in which an indirect touch operation on the index finger movable range provided on the screen display unit 30B is determined to be valid. The flowchart explaining the operation | movement procedure in the two-screen portable terminal of 5th Embodiment.

  Hereinafter, embodiments of an input device, an input support method, and a program according to the present invention will be described with reference to the drawings. The input device of the present embodiment is an electronic device including a display unit that displays data on a screen, and is, for example, a mobile phone, a smartphone, a tablet terminal, a digital still camera, a PDA (personal digital assistant), or an electronic book terminal. Hereinafter, a mobile terminal (for example, a smartphone) will be described as an example of the input device of each embodiment.

  The present invention can also be expressed as an input device as a device or a program for operating the input device as a computer. Furthermore, the present invention can also be expressed as an input support method including each operation (step) executed by the input device. That is, the present invention can be expressed in any category of an apparatus, a method, and a program.

  In the following description, it is possible to accept a touch operation from the user, and to select a part of the content for each application displayed on the screen of the display unit (for example, LCD or organic EL display) of the input device. An item for enabling or starting a predetermined process for content by selection is defined as a “button”. The predetermined process is a process (for example, a process of reproducing video data) that executes contents related to the content currently displayed in the application.

  The “button” as an instruction portion for the user application displayed on the screen may be a hyperlinked character string, that is, a news headline, for example, when a news headline is displayed as the application content. An image (for example, an icon or a keyboard software key) for prompting a user's selection operation may be used, or a combination of a character string and an image may be used. The input device can accept, for example, the selection of “news headline” corresponding to the button as the operation on the button in accordance with the input operation of the user, and can display the details of the news corresponding to the selected button. The “button” is determined according to the application running on the input device.

  In addition, two axes representing a horizontal plane on the touch panel are defined as an x axis and ay axis, and an axis representing the vertical direction (height direction) of the touch panel is defined as a z axis. Furthermore, in the following description, the “coordinate” is a position on the horizontal plane of the touch panel, that is, a coordinate (x, y) determined by a combination of the x coordinate and the y coordinate, and the coordinates (x, y) and the touch panel and the finger. And the coordinate (x, y, z) using the distance in the vertical direction between them, that is, the height z of the finger from the touch panel.

  In the following description, as an example of an instruction medium for the touch panel, a user's finger (for example, an index finger; the same shall apply hereinafter) will be described. However, the present invention is not limited to a finger, but a conductive stylus held by a user's hand. May be used. In addition, the instruction medium is not particularly limited as long as it can detect proximity and touch to the touch panel according to the structure and detection method of the touch panel.

  Further, in the following description, an operation of placing a finger on a position on a space separated from the surface of the touch panel is defined as a “hover operation”, and the position on the touch panel surface is determined from the position on the space that is deceived by the hover operation. The operation of sliding (moving) substantially in parallel is defined as “hover slide operation”. Therefore, the operation in which the finger directly touches the surface of the touch panel is not “hover operation” but “touch operation”. In the touch operation, an operation of sliding (moving) in a state where a finger is in contact with the surface of the touch panel is defined as a “touch slide operation”.

  In order to detect a hover operation or a hover slide operation, the distance between the finger and the surface of the touch panel is inversely proportional to the capacitance detected by the touch panel. It is preferable to correspond.

(Hardware configuration of portable terminal common to each embodiment)
FIG. 1 is a block diagram showing a hardware configuration of the mobile terminals 1 and 1A in each embodiment. 1 includes a processor 11, a display unit 13, a touch panel driver 14, a touch panel 15, a power supply control unit 16, a communication control unit 17 to which an antenna 17a is connected, a ROM (Read Only Memory) 21, and a RAM. (Random Access Memory) 22 and a storage unit 23 are included.

  The processor 11, the display unit 13, the touch panel driver 14, the power supply control unit 16, the communication control unit 17, the ROM 21, the RAM 22, and the storage unit 23 are connected to each other via a bus 19 so that data can be input and output.

  The processor 11 is configured using, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a DSP (Digital Signal Processor), performs overall control of the mobile terminals 1 and 1A, and performs various other arithmetic processes. Alternatively, control processing is performed. The processor 11 reads the program and data stored in the ROM 21 and performs various processes in each embodiment described later.

  The ROM 21 stores an application 65 (see FIG. 2) installed in the mobile terminal 1, and a program and data for the processor 11 to execute processing in each unit shown in FIG. The ROM 21 stores a table 87 (see FIG. 17) described later.

  The RAM 22 operates as a work memory in the operation of the processor 11, the touch panel driver 14, or the communication control unit 17.

  The memory | storage part 23 is comprised using the hard disk or flash memory built in the portable terminal 1, and stores the data which the portable terminals 1 and 1A acquired or the produced | generated data. The application 65 (see FIG. 2) is stored in the storage unit 23. The storage unit 23 may be configured using, for example, an external storage medium (for example, a USB memory) connected via a USB (Universal Serial Bus) terminal instead of a hard disk or a flash memory.

  The display unit 13 has a function of displaying a screen and is configured using, for example, an LCD or an organic EL display, and displays data output from the processor 11 or the touch panel driver 14 on the screen.

  The touch panel driver 14 controls the operation of the touch panel 15 and monitors a user input operation on the touch panel 15. For example, when the touch panel driver 15 detects contact by a touch operation or a touch slide operation of a user's finger 68 (see FIG. 3A) or proximity by a hover operation or a hover slide operation, the touch coordinates (x, y ) Or proximity coordinates (x, y, z), and information on the contact coordinates (x, y) or proximity coordinates (x, y, z) is output to the processor 11, the RAM 22, or the storage unit 23. Hereinafter, the contact coordinates (x, y) are referred to as “touch coordinates (x, y)”.

  The touch panel 15 is mounted on the screen 45 of the display unit 13 (see FIG. 3A), and detects that the user's finger 68 has performed a touch operation or a touch slide operation on the horizontal surface of the touch panel 15. Further, the touch panel 15 detects that the user's finger 68 has approached the touch panel 15 by a hover operation or a hover slide operation.

  Although the specific configuration of the touch panel 15 is disclosed in detail in, for example, Patent Document 1 described above, the description thereof will be omitted, but the touch panel 15 has a finger height z value in a hover operation of a predetermined value zth or less, Alternatively, it is detected that the finger 68 is close to the touch panel 15 when the capacitance determined according to the value of the finger height z is equal to or greater than a predetermined value.

  The power control unit 16 is configured using a power supply source (for example, a battery) of the mobile terminal 1, and switches the power on or off of the mobile terminal 1 according to an input operation to the touch panel 15. When the power supply is on, the power supply control unit 16 supplies power from the power supply source to each unit shown in FIG. 1 so that the mobile terminal 1 can operate.

  The communication control unit 17 is configured using a wireless communication circuit, transmits data as a processing result processed by the processor 11 via a transmission / reception antenna 17a, and further, a base station (not shown) or other communication Receives data sent from the terminal. Further, FIG. 1 illustrates a configuration necessary for the description of each embodiment including the present embodiment, but the mobile terminals 1 and 1A in each embodiment include a voice control unit that controls a call voice, a user And a speaker for outputting voice data of the other party may be further included.

(Functional configuration of the mobile terminal 1 of the first embodiment)
Next, the functional configuration of the mobile terminal 1 according to the first embodiment will be described with reference to FIG. FIG. 2 is a block diagram illustrating a functional configuration of the mobile terminal 1 according to the first embodiment. In the following description, the continuous movement operation is, for example, a repeated operation of a hover slide operation or a touch slide operation having a linear trajectory, or a repeated operation of a hover slide operation or a touch slide operation having a circular or elliptical orbit.

  In the conventional input device, after detecting the proximity of the finger at a position on a space separated from the touch panel capable of detecting the proximity of the finger, a continuous movement operation having a continuous linear or circular or elliptical orbit of the finger is performed. When detecting, the movement (trajectory) of the finger which is not originally required to be detected may be detected.

  Specifically, when a continuous movement operation (for example, a repeated slide operation having a linear trajectory) is performed starting from a position on the space where the finger is separated from the touch panel, the second slide is performed after the first slide operation. The finger returns to the original position to perform the operation.

  However, when the finger returns to the position of the starting point and does not pass through a position on the space sufficiently separated from the touch panel, a signal (for example, electrostatic capacity) detected by the return slide operation becomes a predetermined proximity detection threshold (static When the capacity is exceeded, a return slide operation may be detected on the touch panel. As described above, when the return operation is detected on the touch panel, the mobile terminal may not be able to detect the continuous slide operation, and will execute a process unintended by the user. Therefore, when a continuous movement operation with a finger is performed on the touch panel, it is considered that there is a high possibility that an erroneous operation occurs regardless of the intention of the user's input operation.

  In the first embodiment, when the mobile terminal detects a continuous hover slide operation, an effective operation is performed by appropriately determining an operation (valid operation) that conforms to the user's intention and a return operation that does not conform to the user's intention. An example will be described in which a user's erroneous operation is reduced by discriminating between a return operation and a return operation and invalidating a return operation signal generated in response to detection of the return operation.

  2 includes a proximity detection unit 5, a touch detection unit 10, a screen display unit 30, a proximity coordinate extraction unit 51, a touch coordinate extraction unit 52, an operation determination unit 56, an application screen generation unit 59, and operation effectiveness. A determination unit 84 and an application 65 are included. The portable terminal 1 may be configured to further include a memory 40 (see FIG. 2). In the present embodiment, the mobile terminal 1 may not include the touch detection unit 10 and the touch coordinate extraction unit 52.

  The proximity detection unit 5 detects a state in which the user's finger is close to the touch panel 15 by a hover operation or a hover slide operation. The proximity detection unit 5 outputs a proximity notification indicating that the finger has approached the touch panel 15 to the proximity coordinate extraction unit 51.

  The touch detection unit 10 as a contact detection unit detects an operation in which a finger touches the touch panel 15 by a touch operation or a touch slide operation. The touch detection unit 10 outputs a contact notification that a finger has touched the touch panel 15 to the touch coordinate extraction unit 52. Note that the proximity detection unit 5 and the touch detection unit 10 can be configured using the touch panel 15, and in FIG. 2, the proximity detection unit 5 and the touch detection unit 10 are configured separately. You may comprise.

  The screen display unit 30 corresponds to the display unit 13 shown in FIG. 1, has a function of displaying data on the screen 45, and displays screen data output from the application screen generation unit 59 described later on the screen 45. The screen data is data of the screen of the application 65 (hereinafter simply referred to as “application screen”).

  The memory 40 corresponds to the RAM 22 or the storage unit 23 shown in FIG. 1. For example, screen data and image data used in the application 65, image data generated by the application 65, a base station (not shown) or other communication terminal The received image data, button coordinate information used in the application 65, and operation information of the application 65 assigned to the button are stored.

  The memory 40 temporarily stores information on the proximity coordinates (x, y, z) extracted by the proximity coordinate extraction unit 51 or the touch coordinates (x, y) extracted by the touch coordinate extraction unit 52. May be. In FIG. 2, the arrows from the proximity coordinate extraction unit 51 and the touch coordinate extraction unit 52 to the memory 40 are omitted in order to avoid complication of the drawing.

  The proximity coordinate extraction unit 51 calculates and extracts proximity coordinates (x, y, z) of the finger with respect to the touch panel 15 based on the proximity notification output from the proximity detection unit 5. Among the proximity coordinates (x, y, z), the x component and the y component are coordinate values representing positions on the touch panel 15, and the z component is a vertical distance between the finger and the touch panel 15, that is, the finger. Is a coordinate value representing the height z with respect to the touch panel 15. The proximity coordinate extraction unit 51 outputs information on the extracted proximity coordinates (x, y, z) to the operation determination unit 56.

  The touch coordinate extraction unit 52 calculates and extracts touch coordinates (x, y) when the finger touches the touch panel 15 based on the contact notification output from the touch detection unit 10. The touch coordinate extraction unit 52 outputs information on the extracted touch coordinates (x, y) to the operation determination unit 56.

  In the following description, the user input operation determined by the operation determination unit 56 is a hover operation, a hover slide operation, a touch operation, a touch slide operation, a combination operation of each operation, or a hover slide operation or a touch slide operation. However, the present invention is not limited to these operations.

  The operation determination unit 56 inputs information on the proximity coordinates (x, y, z) output from the proximity coordinate extraction unit 51 or information on the touch coordinates (x, y) output from the touch coordinate extraction unit 52.

  The operation determination unit 56 is based on each information of the proximity coordinates (x, y, z) output from the proximity coordinate extraction unit 51 or the touch coordinates (x, y) output from the touch coordinate extraction unit 52. It is determined whether or not a hover slide operation or a continuous hover slide operation is performed with the index finger 68a.

  The operation determination unit 56 operates an effectiveness determination instruction including information on proximity coordinates (x, y, z) when it is determined that a hover slide operation or a continuous hover slide operation is performed with the user's index finger 68a. The result is output to the validity determination unit 84.

  The operation determination unit 56 outputs the operation determination result information output from the operation validity determination unit 84 to the application 65.

  Based on the validity determination instruction output from the operation determination unit 56, the operation validity determination unit 84 performs a hover slide operation or continuous hover slide operation with the user's finger 68 on the touch panel 15 (screen 45) of the finger 68. The height is determined, and the moving speed of the finger 68 is determined.

  The operation validity determination unit 84 determines the effective operation in the continuous hover slide operation of the finger 68 based on the determined information of “height” or “height and moving speed” and the contents of the table 87 shown in FIG. And a return operation, and the determination result is output to the operation determination unit 56 as validity determination result information.

  FIG. 3 is a diagram illustrating an example of the contents of the table 87 used for determining the valid operation. The table 87 may be stored in the ROM 21 or stored in the storage unit 23. The table 87 indicates conditions for determining an effective operation and a return operation, and whether or not a hover signal (proximity signal) can be applied. In the description of FIG. 3, in the continuous hover slide operation shown in FIGS. 4A and 4B, the value of the finger height during the effective operation is h1, the finger moving speed during the effective operation is v1, and the return operation It is assumed that the value of the finger height at the time is h2, and the moving speed of the finger at the return operation is v2.

  Specifically, in the case where the effective operation and the return operation are determined based on only the finger height with respect to the continuous hover slide operation, the operation effectiveness determination unit 84 determines that the finger height value is greater than h2. An operation having a low value h1 (<h2) is determined as an effective operation, and an operation having a finger height value h2 (> h1) higher than h1 is determined as a return operation.

  Further, in the case where the effective operation and the return operation are determined based on the finger height and the moving speed with respect to the continuous hover slide operation, the operation effectiveness determination unit 84 has a finger height value of h1. Thus, an operation in which the moving speed value is a value v1 (> v2) larger than v2 is determined as an effective operation, and the finger height value is h2 and the moving speed value is smaller than v1 v2 (<v1). Is determined as a return operation.

  When the operation determination unit 56 determines that the operation is valid based on the validity determination result information from the operation validity determination unit 84, the operation determination unit 56 notifies the application 65 that the hover signal detected by the effective operation has been detected. The operation of the application 65 corresponding to the valid operation is notified.

  On the other hand, when the operation determination unit 56 determines that the return operation is based on the validity determination result information from the operation effectiveness determination unit 84, the operation determination unit 56 invalidates and discards the hover signal detected by the return operation. In this case, the operation determination unit 56 does not notify the application 65 that the hover signal detected by the return operation has been detected.

  The application screen generation unit 59 acquires various data necessary for generating a screen in the application 65 from the memory 40 based on the screen generation instruction output from the application 65. The application screen generation unit 59 generates screen data of the application screen in the application 65 using the acquired various data. The application screen generation unit 59 causes the screen display unit 30 to display the screen content of the generated screen data.

  In FIG. 2, the application screen generation unit 59 and the application 65 are shown as separate configurations. However, the application 65 has the function of the application screen generation unit 59, so that the application screen generation unit 59 and the application 65 You may comprise as the application 65 which bundled.

(Outline of operation of first embodiment)
FIGS. 4A and 4B are diagrams showing an effective operation and a return operation in a continuous hover slide operation. As shown in FIGS. 4A and 4B, in a continuous hover slide operation, the index finger 68 a turns a plurality of times in the space separated from the screen 45.

  In the operation (valid operation) intended by the user in the continuous hover slide operation, the index finger 68a is brought close to the screen 45 and slides from the right direction to the left direction in the figure as shown in the locus p shown in FIG. Meanwhile, it is considered that the finger height becomes a value h1 lower than h2, and the finger moving speed becomes a value v1 faster than v2.

  On the other hand, in an operation (return operation) that is not intended by the user in successive hover slide operations, the index finger 68a is moved away from the screen 45 and returned to the original position of the hover slide operation, as shown by the locus q shown in FIG. During the return, it is considered that the height of the finger becomes a value h2 higher than h1, and the moving speed of the finger becomes a value v2 slower than v1.

When determining the effectiveness of the continuous hover slide operation, the operation effectiveness determination unit 84 sets a threshold value h _th between the low value h1 and the high value h2, and the height value of the determined index finger 68a is determined. An operation smaller than the threshold h _th may be determined as an effective operation. Alternatively, the operation effectiveness determination unit 84 may determine that an operation in which the height value of the determined index finger 68a is within a range of ± 5% of h1 (± 5% is illustrated) is an effective operation.

Further, when determining the effectiveness of the continuous hover slide operation, the operation effectiveness determining unit 84 sets a threshold value v _th between the fast value v1 and the slow value v2 of the finger moving speed, and determines the determined finger An operation in which the moving speed is greater than the threshold value v _th may be determined as an effective operation. Alternatively, the operation effectiveness determination unit 84 may determine that an operation in which the determined moving speed of the index finger 68a is within a range of ± 5% of v1 (± 5% is illustrated) is an effective operation.

  FIG. 5 is a diagram illustrating a finger height determination method. FIG. 5A is a graph showing changes in coordinates over time. FIG. 5B is a graph showing changes in finger height over time. FIG. 5C is a graph showing a change with time in the hover signal intensity (actually measured value).

  When a continuous hover slide operation is performed, as shown in FIG. 5A, the x-coordinate and y-coordinate on the touch panel 15 corresponding to the proximity coordinates (x, y, z) correspond to the passage of time. It changes almost periodically. In FIG. 5A, the portions surrounded by dotted line frames j1, j2, and j3 correspond to the return operation.

  When a continuous hover slide operation is performed, as shown in FIG. 5B, the height of the finger periodically changes between a high value h2 and a low value h1 as time passes. In FIG. 5B, h1 and h2 may be predetermined values, for example, or may be experimental appropriate values determined based on simulation or actual measurement. In FIG. 5B, the portions surrounded by dotted line frames j4, j5, and j6 correspond to return operations. In the portion corresponding to the return operation, the height of the finger is a value close to h2.

  When continuous hover slide operations are performed, as shown in FIG. 5C, the hover signal intensity changes substantially periodically with the passage of time. The hover signal intensity is represented by a capacitance determined according to the distance (height) between the touch panel 15 and the finger. In the periods pr1, pr2, pr3, the hover signal intensity is extremely small, which corresponds to a return operation. Therefore, the hover signal intensity has a large value in the portion corresponding to the effective operation and a small value in the portion corresponding to the return operation. By determining the finger height shown in FIG. 19B, the portable terminal 1 can appropriately determine and distinguish between an effective operation and a return operation in successive hover slide operations.

  FIG. 6 is a diagram illustrating a method for determining the moving speed of a finger. FIG. 6A is a graph showing changes in coordinates over time. FIG. 6B is a graph showing changes with time of the moving speed of the finger.

  The moving speed of the finger is determined based on the amount of change of the proximity coordinates (x, y, z) detected by the touch panel 15 in unit time, that is, the differential value of the proximity coordinates. As shown in FIG. 6A, the proximity coordinates (x, y, z) change substantially periodically with the passage of time. In FIG. 6A, in the portion corresponding to the return operation (dotted line frames j1, j2, j3, that is, periods pr4, pr5, pr6), the hover coordinates (proximity coordinates) are the hover coordinates in the periods pr1, pr2, pr3. It changes more slowly than changes in (proximity coordinates).

  As shown in FIG. 6B, the amount of change in unit time of the hover coordinates (proximity coordinates) in the periods pr4, pr5, and pr6, that is, the moving speed of the finger becomes a positive value v1 in the effective operation, and in the return operation. It becomes a negative value v2. Accordingly, valid operations are performed in the periods pr1, pr2, and pr3 shown in FIG. 6B, and return operations are performed in the periods pr4, pr5, and pr6. That is, in the present embodiment, the signals detected in the periods pr4, pr5, pr6 are invalidated and discarded.

(Operation of the mobile terminal 1 of the first embodiment)
FIG. 7 is a flowchart illustrating a determination procedure of an effective operation among continuous hover slide operations in the mobile terminal 1 according to the first embodiment.

  In FIG. 7, the operation determination unit 56 determines whether or not the hover slide operation is performed by the user's index finger 68 a based on the information on the proximity coordinates (x, y, z) output from the proximity coordinate extraction unit 51. Determine (S41). When it is determined that the hover slide operation is performed, the operation of the mobile terminal 1 proceeds to step S42.

  When the operation determination unit 56 determines that the hover slide operation is being performed with the user's index finger 68a, the operation determination unit 56 issues an effectiveness determination instruction including information on proximity coordinates (x, y, z). 84.

  The operation validity determination unit 84 determines the height of the finger 68 relative to the touch panel 15 (screen 45) in the hover slide operation by the user's finger 68 based on the validity determination instruction output from the operation determination unit 56. The moving speed of the finger 68 is determined. The operation validity determination unit 84 outputs the determined “height” or “height and moving speed” information to the operation determination unit 56.

  The operation determination unit 56 holds the hover slide operation information in the hover slide operation output from the operation effectiveness determination unit 84, that is, information on the height of the index finger 68a and the movement speed of the finger in the RAM 22 or the memory 40 (S42). ).

  After step S42, the operation determination unit 56 determines whether or not a continuous hover slide operation is performed with the user's index finger 68a (S43). When it is determined that the continuous hover slide operation is not performed by the user's index finger 68a, the operation of the mobile terminal 1 shown in FIG. 7 ends.

  On the other hand, when it is determined that a continuous hover slide operation is being performed by the user's index finger 68a (S43, YES), the operation determination unit 56 is effective including information on proximity coordinates (x, y, z). A sex determination instruction is output to the operation effectiveness determination unit 84. Based on the validity determination instruction output from the operation determination unit 56, the height of the finger 68 relative to the touch panel 15 (screen 45) is determined in continuous hover slide operations with the user's finger 68 (see FIG. 4A). At the same time, the moving speed of the finger 68 is determined.

  The operation effectiveness determination unit 84 performs the effective operation and the return operation in the continuous hover slide operation of the finger 68 based on the determined “height” or “height and moving speed” information and the table 87. The determination result is output to the operation determination unit 56 as validity determination result information (S44). The operation validity determination unit 84 determines “height” or “height and moving speed” for each hover slide operation, and determines whether the operation is a valid operation or a return operation for each hover slide operation. .

  When it is determined that the hover slide operation is a return operation (S44, NO), the operation effectiveness determination unit 84 uses a signal (for example, capacitance) detected by the hover slide operation determined as the return operation. Invalidate and discard, and output to the operation determination unit 56 that the signal detected by the hover slide operation determined to be a return operation has been discarded. Thereafter, the operation of the mobile terminal 1 returns to step S43.

  On the other hand, when the operation validity determination unit 84 determines that the hover slide operation is an effective operation (YES in S44), the signal detected by the hover slide operation determined to be an effective operation is used as an effective signal. Information indicating that the slide operation has been performed is notified to the application 65 (S45). The application 65 executes an operation according to the hover slide operation based on the information output from the operation determination unit 56. Thereafter, the operation of the mobile terminal 1 returns to step S43.

  As described above, the mobile terminal 1 according to the present embodiment appropriately performs the effective operation and the return operation in the hover slide operation or the continuous hover slide operation based on the “finger height” or “finger height and moving speed”. It is possible to determine and invalidate the signal detected by the return operation, thereby reducing the erroneous operation of the user in the continuous hover slide operation.

(Second Embodiment)
When the above-described continuous movement operation (for example, a continuous periodic hover slide operation that draws a linear trajectory) is performed on the touch panel, a finger may accidentally touch the touch panel (screen). When a button is displayed at such an erroneously touched position, not only the continuous movement operation is interrupted, but an operation unintended by the user is executed, and the user has a comfortable operability. It is difficult to enjoy.

  In the second embodiment, in the continuous hover slide operation by the user's index finger 68a, when the index finger 68a accidentally touches the screen 45 (touch panel 15), the touch signal detected by erroneous contact is invalidated. An example will be described.

  FIG. 8 is a block diagram illustrating a functional configuration of the mobile terminal 1A according to the second embodiment. The same components as those of the mobile terminal 1 shown in FIG. 2 are denoted by the same reference numerals, description thereof is omitted, and different contents are described.

  8 includes a proximity detection unit 5, a touch detection unit 10, a screen display unit 30, a proximity coordinate extraction unit 51, a touch coordinate extraction unit 52, a hover operation determination unit 89, a touch operation determination unit 88, and an operation effective. A sex determination unit 84A and an application 65 are included.

  In the mobile terminal 1A illustrated in FIG. 8, the hover operation determination unit 89 has the same configuration as the operation determination unit 56 illustrated in FIG. 2 and operates in the same manner, and thus the description of the hover operation determination unit 89 is omitted.

  The touch operation determination unit 88 determines whether a touch operation or a touch slide operation has been performed by the user's finger based on the information on the touch coordinates (x, y) output from the touch coordinate extraction unit 52. When it is determined that the touch operation or the touch slide operation has been performed, the touch operation determination unit 88 obtains the information on the touch coordinates (x, y) and the contact position and contact timing of the finger on the touch panel 15 (screen 45). The touch operation validity determination instruction including the information is output to the operation validity determination unit 84A.

  The touch operation determination unit 88 outputs, to the application 65, determination result information as to whether or not a later-described contact position or contact timing matches an invalidation condition described later.

  The operation validity determination unit 84A calculates the contact position and the contact timing output from the touch operation determination unit 88, and determines whether the calculated contact position or contact timing meets an invalidation condition described later. When the invalidation condition is met, the touch operation determination unit 88 invalidates and discards the signal detected by the touch operation, assuming that the touch operation corresponding to the contact position or the contact timing may be erroneous.

  The operation validity determination unit 84A outputs determination result information indicating that the invalidation condition is met or does not match to the touch operation determination unit 88.

(Outline of operation of second embodiment)
9A and 9B are diagrams illustrating erroneous touches during continuous hover slide operations. As shown in FIG. 9A, when the index finger 68a is swung (hover slide operation) substantially parallel to the touch panel 15 in the proximity state of the space on the touch panel 15 (screen 45) (see the locus u). The index finger 68a may accidentally touch the screen 45 at the position w1. The position w1 is the position of the passing point that is the locus u of the continuous hover slide operation.

  Further, as shown in FIG. 9B, when the index finger 68a is turned (hover slide operation) so as to reciprocate with respect to the touch panel 15 in the proximity of the space on the touch panel 15 (screen 45) (trajectory). o), the index finger 68a may accidentally touch the screen 45 at the position w2. The position w2 is a place where the direction change of the index finger 68a is performed when the index finger 68a is reciprocated and the hover slide operation is performed, for example, the vicinity of the start point or the end point of the hover slide operation.

  As shown in FIG. 9A or 9B, the operation validity determination unit 84A is invalidated to determine whether or not a touch operation has been erroneously performed based on the calculated contact position or contact timing. As a condition, determination is made based on the following three contents.

  The first invalidation condition is that “the contact position is a position on a trajectory that passes during continuous hover slide operation” (see FIG. 9A). However, in the first invalidation condition, it is only necessary that the finger performs a continuous hover slide operation, and it is not necessary to draw a trajectory in which the finger moves back and forth.

  The second invalidation condition is “when the hover slide operation is performed periodically (for example, a cycle of 0.5 seconds) so that the finger is reciprocated, the contact position is set to the proximity coordinate that becomes the trajectory of the finger during the hover slide operation. It almost coincides with the corresponding position on the touch panel. When the hover slide operation is periodically performed on the touch panel so as to reciprocate the finger, the user may inadvertently touch the screen (touch panel) during the hover slide operation. The second invalidation condition is a condition for determining that the user touches the screen (touch panel) accidentally during the hover slide operation as an erroneous touch.

  A specific example of the second invalidation condition will be described with reference to FIG. FIG. 11 is an explanatory diagram illustrating a specific example for determining an erroneous touch when a hover slide operation in which the index finger 68a is reciprocated is periodically performed. As a premise, a position on the space separated from the point A (100, 200) on the map image 47 shown on the lower left side of the page of FIG. The index finger 68a is periodically moved so as to reciprocate once every 1.0 seconds between a position on a space separated from the point B (100, 800) (hereinafter referred to as “space position on the point B”). Assume that you are operating a hover slide.

  Note that the point C is a touch panel 15 (screen 45) corresponding to the close coordinates that the index finger 68a becomes a trajectory during the hover slide operation in a hover slide operation that passes through a position on a space separated from each of the points A and B. The position is approximately the same as the upper position.

  Specifically, the position on the touch panel 15 (screen 45) corresponding to the passing position (proximity coordinates) during the hover slide operation of the index finger 68a is, for example, when the elapsed time from the start of the hover slide operation is 0.50 seconds. It is the spatial position on the point A at the coordinates (100, 200), the spatial position on the point C at the coordinate (100, 500) when the elapsed time is 0.75 seconds, and the coordinate ( 100, 800) is a spatial position on the point B, and when the elapsed time is 1.25 seconds, it is a spatial position on the point C at the coordinates (100, 500). 200) at a point A at a point A, and at a time of 1.75 seconds, it is a spatial position at a point C at coordinates (100, 500).

  Here, for example, when the index finger 68a touches the position of the coordinates (100, 710) after 1.1 seconds have elapsed since the start of the hover slide operation, the position of the coordinates (100, 710) is the hover slide. The position substantially coincides with the position on the touch panel corresponding to the close coordinates that are the locus of the finger being operated. That is, the second invalidation condition is satisfied, and the mobile terminal 1A determines that the touch on the position of the coordinates (100, 710) is an erroneous touch.

  On the other hand, for example, when the index finger 68a touches the position of the coordinates (250, 400) after 1.1 seconds have elapsed since the start of the hover slide operation, the position of the coordinates (250, 400) is the hover slide operation. It does not substantially coincide with the position on the touch panel corresponding to the close coordinates that are the locus of the middle finger. That is, the second invalidation condition is not satisfied. In this case, regardless of the hover slide operation, a touch operation according to the user's intention is performed, and the mobile terminal 1A does not determine that the touch at the position of the coordinates (250, 400) is an erroneous touch. The operation corresponding to the touch on the position of the coordinates (250, 400) is executed.

  The third invalidation condition is that “in the hover slide operation to reciprocate, the contact position is in the vicinity of changing the direction” (see FIG. 9B). For example, FIG. 9B shows an example in which the index finger 68a is erroneously touched on the screen 45 at the position w2. However, when the index finger 68a is reciprocated due to the inclination condition of the locus during the reciprocal operation of the index finger 68a. It is also conceivable to contact the screen 45 on the opposite side to the direction changing side. For this reason, even if it corresponds to the first invalidation condition or the second invalidation condition, if the third invalidation condition is satisfied, it is considered that there is a high possibility that a further erroneous operation has been performed. However, the invalidation condition is not limited to these, and can be variously changed.

(Operation of the portable terminal 1A of the second embodiment)
FIG. 10 is a flowchart for explaining a determination procedure of an effective operation among continuous hover slide operations in the mobile terminal 1A according to the second embodiment.

  In FIG. 10, the hover operation determination unit 89 determines whether or not the hover slide operation is performed by the user's index finger 68 a based on the information on the proximity coordinates (x, y, z) output from the proximity coordinate extraction unit 51. Is determined (S51). When it is determined that the hover slide operation is performed, the operation of the mobile terminal 1A proceeds to step S52.

  Note that when the hover operation determination unit 89 determines that the hover slide operation is being performed with the user's index finger 68a, the hover operation validity determination instruction including information on the proximity coordinates (x, y, z) is operated. It outputs to the sex judgment part 84A.

  Based on the hover operation validity determination instruction output from the hover operation determination unit 89, the operation effectiveness determination unit 84A determines the height of the index finger 68a with respect to the touch panel 15 (screen 45) in the hover slide operation by the user's index finger 68a. At the same time, the moving speed of the index finger 68a is determined. The operation validity determination unit 84A outputs the determined “height” or “height and moving speed” information to the hover operation determination unit 89.

  The hover operation determination unit 89 holds the hover slide operation information in the hover slide operation output from the operation effectiveness determination unit 84A, that is, the information on the height of the index finger 68a and the moving speed of the finger in the RAM 22 or the memory 40 ( S52).

  After step S52, the operation determination unit 56 determines whether or not a continuous hover slide operation is performed with the user's index finger 68a (S53). When it is determined that the continuous hover slide operation is not performed by the user's index finger 68a, the operation of the mobile terminal 1A illustrated in FIG. 10 ends.

  On the other hand, when it is determined that a continuous hover slide operation is being performed with the user's index finger 68a (S53, YES), the touch operation determination unit 88 outputs the touch coordinates (x , Y), for example, it is determined whether or not the touch operation is performed with the same index finger 68a as the finger performing the hover slide operation or a different finger (S54). When it is determined that the touch operation is not performed, the operation of the mobile terminal 1A returns to step S53.

  When the touch operation determination unit 88 determines that the touch operation is performed with the same index finger 68a as the finger performing the hover slide operation or a different finger, for example (S54, YES), information on the touch coordinates (x, y) And a touch operation validity determination instruction including information indicating the contact position and contact timing of the finger on the touch panel 15 (screen 45) to the operation effectiveness determination unit 84A.

  The operation validity determination unit 84A calculates the contact position and contact timing output from the touch operation determination unit 88, and determines whether the calculated contact position or contact timing meets an invalidation condition described later ( S55). The operation validity determination unit 84A outputs the determination result to the touch operation determination unit 88.

  When the touch operation determination unit 88 determines that the invalidation condition is met (S55, YES), the touch operation corresponding to the contact position or the contact timing may be erroneously operated, and the signal detected by the touch operation is detected. Is invalidated and discarded (S56).

  When it is determined that the invalidation condition is not met (S55, NO), the touch operation determination unit 88 outputs information indicating that the touch operation has been performed and information on the touch coordinates (x, y) to the application 65. (S57). The application 65 executes an operation according to the touch operation based on the information output from the touch operation determination unit 88 (S58). For example, when a button is displayed at the touch coordinates (x, y) where the touch operation has been performed, the application 65 performs an operation corresponding to the button (S58).

  As described above, the mobile terminal 1 </ b> A according to the present embodiment performs the touch operation when the touch operation is performed with the same finger or a different finger as the finger performing the hover slide operation when the continuous hover slide operation is performed. It is determined whether the invalidation condition is satisfied based on the contact position or the contact timing.

  The portable terminal 1A invalidates and discards the signal detected by the touch operation when the invalidation condition is met, for example, a finger performing a hover slide operation or a different finger while performing a hover slide operation Erroneous operation of touching the screen 45 (touch panel 15) by mistake can be eliminated. Accordingly, the mobile terminal 1A invalidates the detection signal when the invalidation condition is satisfied even if the button is defined at the position on the screen 45 (touch panel 15) where the touch operation is performed. It is possible to prevent the start of the operation that does not.

  Further, since the portable terminal 1A invalidates the touch operation performed while the hover slide operation is performed when any one of the above-described three invalidation conditions is satisfied, the validity of the invalidation Can be secured.

(Background to the contents of the third and subsequent embodiments)
Next, before describing each of the third and subsequent embodiments, problems that occur during an input operation on a touch panel that can detect only a touch operation will be described. As an input operation on the touch panel, a flick operation may be performed in addition to the touch operation. The flick operation is an operation in which a finger touches on the screen and quickly pays (plays or slides). According to the flick operation, for example, the content displayed on the screen can be easily scrolled. For this reason, a touch panel that can detect only a touch operation has a button at the position where the finger touches the screen for a flick operation. A touch operation on a button was sometimes mistakenly detected.

  In addition, when the user's palm or finger touches the screen unconsciously, such as when the user grips the casing of the mobile terminal, the button is located at the position where the change in the capacitance value is the largest, that is, at the center of the contact position. When the touch panel is present, the touch panel that can detect only the touch operation even if the user does not intentionally perform the touch operation on the button may be erroneously detected as a touch operation on the button.

  Here, as a prior art for reducing false detection even when the user's unconscious contact action is performed or when the input operation intended by the user is not detected, for example, the coordinate processing apparatus of Reference Patent Document 1 is known. Yes.

  (Reference Patent Document 1) Japanese Patent Application Laid-Open No. 2010-49469

  The coordinate processing apparatus of Reference Patent 1 arranges coordinate points represented by the coordinates of the designated position on a time-series frame in response to a user's instruction input, and tracks the association of the coordinate points between the frames. Further, the coordinate processing apparatus includes a command input start standby state (first state) defined in advance as a user instruction input state, a movement state (second state) of an instruction position moved by the instruction input, and an instruction input. The operation of the user's instruction input is determined based on the result of tracking the state transition including the end waiting state (third state). Thereby, the coordinate processing apparatus can correctly operate a continuous operation such as a drag operation or a rotation operation.

  Further, as a prior art for ignoring a palm contact detection signal at the time of an input operation using a conductive stylus on a touch panel that can detect only a touch operation, for example, a position detection device and method of Reference Patent Document 2 are known. Yes.

  (Reference Patent Document 2) US Patent Application Publication No. 2012/0007614

  In the position detection apparatus and method of Reference Document 2, when a user performs an input operation on the touch panel using a conductive stylus, the contact detection signal detected for the palm that touches the touch panel is ignored, and the stylus is The detected contact detection signal is used.

  However, in the above-described Reference Patent Documents 1 and 2, it is considered that it is not assumed that the proximity of a detection target (for example, a finger or a conductive stylus) to the touch panel is detected. A conventional touch panel calculates a contact duration from a position at the time of contact or a timer count value based on a contact detection signal (for example, capacitance value or touch coordinate value) detected at the time of a touch operation. For this reason, a portable terminal equipped with a conventional touch panel determines an input operation performed by a user based on an output from the touch panel. However, as described above, a conventional touch panel that uses only a contact detection signal at the time of contact. In some cases, an input operation was erroneously detected.

(Third embodiment)
Therefore, in the third embodiment, in view of the circumstances leading to the contents of the third and subsequent embodiments described above, the touch operation and the flick operation as the user's intentional operation are appropriately determined, and an error with respect to the input operation is determined. An example of a portable terminal that reduces detection will be described.

  In each of the following embodiments, “proximity coordinates (x, y, z)” or “touch panel 15 and finger, palm or hand obtained when the proximity detection unit 5 detects the proximity of the finger, palm or hand to the touch panel 15. The “capacitance value between” can be expressed as “proximity detection signal”, but as an example, “proximity coordinates (x, y, z)” will be described as “proximity detection signal”. However, “capacitance value” can also be described as “proximity detection signal”.

  Similarly, “touch coordinates (x, y)” or “capacitance between the touch panel 15 and the finger, palm, or hand obtained when the touch detection unit 10 detects contact with the touch panel 15 of the finger, palm, or hand. Although “value” can be expressed as “contact detection signal”, “contact coordinates (x, y)” will be described as “contact detection signal” as an example. However, “capacitance value” can also be described as “contact detection signal”.

  FIG. 12 is a block diagram illustrating a functional configuration of the mobile terminal according to the third embodiment. The same components as those of the mobile terminal 1 shown in FIG. 2 are denoted by the same reference numerals, description thereof is omitted, and different contents are described.

  12 includes a proximity detection unit 5, a touch detection unit 10, a screen display unit 30, a proximity coordinate extraction unit 51, a touch coordinate extraction unit 52, a hover operation determination unit 89B, a touch operation determination unit 88B, and an operation effective. A sex determination unit 84B and an application 65 are included. The mobile terminal 1B may include the memory 40 or the storage unit 23.

  The hover operation determination unit 89B performs a hover operation or a hover slide operation with the index finger 68a of the user, for example, based on the information of the proximity coordinates (x, y, z) as the proximity detection signal output from the proximity coordinate extraction unit 51. It is determined whether or not When the hover operation determination unit 89B determines that the hover operation or the hover slide operation is being performed with the user's index finger 68a, the hover operation determination unit 89B outputs information on the proximity coordinates (x, y, z) to the operation effectiveness determination unit 84B. .

  The touch operation determination unit 88B determines whether, for example, the user's finger, palm, or hand has touched the touch panel 15 based on the information of the touch coordinates (x, y) as the contact detection signal output from the touch coordinate extraction unit 52. Determine whether. When it is determined that the user's finger, palm, or hand has touched the touch panel 15, the touch operation determination unit 88 </ b> B calculates the touch coordinates (x, y) and the proximity coordinates (x, y, z) before and after the contact. Based on this, a determination instruction for determining whether the operation is a touch operation or a flick operation and information on touch coordinates (x, y) are output to the operation effectiveness determination unit 84B.

  When the determination result of the operation validity determination unit 84B is a touch operation, the touch operation determination unit 88B outputs information on touch coordinates (x, y) corresponding to the touch operation to the application 65. When the determination result of the operation validity determination unit 84B is a flick operation, the touch operation determination unit 88B performs a flick operation starting from the touch coordinates (x, y) output from the touch coordinate extraction unit 52. Information to the effect 65 is output to the application 65.

  The operation validity determination unit 84B includes information on proximity coordinates (x, y, z) output from the hover operation determination unit 89B, information on touch coordinates (x, y) output from the touch operation determination unit 88B, and determination instructions. Whether the input operation when the touch coordinates (x, y) are detected based on the touch coordinates (x, y) and the proximity coordinates (x, y, z) at the timing before and after the touch is a touch operation Determine whether the operation is a flick operation.

  Next, a method for the operation validity determination unit 84B to determine whether the input operation when the touch coordinates (x, y) is detected is a touch operation or a flick operation will be described with reference to FIG. FIG. 13A is a diagram illustrating a difference between a touch operation and a flick operation. FIG. 13B is a diagram illustrating the difference between the x coordinate value, the y coordinate value, and the z coordinate value between the touch operation and the flick operation. As shown in FIG. 13A, when two buttons are displayed on the screen of the display unit 13 and a finger touches the button on the right side of the figure, it is determined whether the operation is a touch operation or a flick operation. A method will be described.

  As shown in FIG. 13A, when the touch operation as the user's intentional operation is compared with the flick operation, the flick operation displays a predetermined threshold (hereinafter referred to as “first” when the finger touches the screen). In many cases, it moves more than the threshold value D1 ”. When it is detected that the finger has moved more than the first threshold value D1, it is considered that the flick operation is obviously performed, but further, the proximity coordinates (x, y, z) of the finger detected during each operation The following features can be seen in the locus (see FIG. 13B). The first threshold value D1 may be the same value or a different value between the value in the x-axis direction and the value in the y-axis direction.

  First, each z coordinate value in the touch operation and the flick operation decreases from the value at the start of each operation to zero again because both the finger touches the screen from the position where the finger is away from the screen and leaves the screen again. growing. Therefore, each z coordinate value in the touch operation and the flick operation changes in the same manner, and it is difficult to distinguish the touch operation and the flick operation.

  However, changes in the x coordinate value and the y coordinate value in the touch operation and the flick operation are different. That is, the amount of change in both the x coordinate value and the y coordinate value is minute in the touch operation, and any of the x coordinate value, the y coordinate value, the x coordinate value, and the y coordinate value is changed in a certain direction in the flick operation. The coordinate value during the flick operation changes depending on the direction of the flick operation.

  For example, as shown in FIG. 13A, when the flick operation is performed in a direction that is not parallel to the x-axis and the y-axis, the x-coordinate value and the y-coordinate value of the proximity coordinates detected during the flick operation are , It changes in a certain direction, that is, the direction of the flick operation. That is, the x coordinate value and the y coordinate value change by a predetermined value (hereinafter referred to as “second threshold value D2”) or more. The second threshold value D2 may be the same value or a different value between the value in the x-axis direction and the value in the y-axis direction.

  When the flick operation is performed in a direction parallel to the x axis, the x coordinate value of the proximity coordinate detected during the flick operation changes by a second threshold value D2 or more in the direction parallel to the x axis, and the flick operation is performed. Is performed in a direction parallel to the y-axis, the y-coordinate value of the proximity coordinate detected during the flick operation changes by a second threshold value D2 or more in the direction parallel to the y-axis.

  As described above, the operation validity determination unit 84B has one of the coordinate values of the x coordinate value, the y coordinate value, the x coordinate value, and the y coordinate value among the proximity coordinates (x, y, z) before and after the contact. When the amount of change is equal to or greater than the second threshold value D2, it is determined that a flick operation has been performed. The operation validity determination unit 84B determines whether the change amount of any one of the x coordinate value, the y coordinate value, the x coordinate value, and the y coordinate value among the proximity coordinates (x, y, z) before and after the contact is first. When it is less than 2 threshold value D2, it determines with touch operation having been performed.

(Operation of the mobile terminal 1B of the third embodiment)
FIG. 14 is a flowchart illustrating a determination procedure for a flick operation and a touch operation in the mobile terminal according to the third embodiment.

  In FIG. 14, the hover operation determination unit 89B performs, for example, a hover operation or a hover with the index finger 68a of the user based on the information of the proximity coordinates (x, y, z) as the proximity detection signal output from the proximity coordinate extraction unit 51. It is determined whether or not a slide operation is being performed. When the hover operation determination unit 89B determines that the hover operation or the hover slide operation is being performed with the user's index finger 68a, the hover operation determination unit 89B outputs information on the proximity coordinates (x, y, z) to the operation effectiveness determination unit 84B. .

  When the touch operation determination unit 88B acquires information on the touch coordinates (x, y) at the time of contact with the screen of the user's index finger 68a from the touch coordinate extraction unit 52 (S61, YES), the touch coordinates (x, y) And an operation effectiveness determination unit 84B for determining a touch operation or a flick operation based on proximity coordinates (x, y, z) at the timing before and after the contact and information on the touch coordinates (x, y). Output to. Based on the determination instruction output from the touch operation determination unit 88B and the information on the touch coordinates (x, y), the operation validity determination unit 84B changes the x coordinate value and the y coordinate value of the index finger 68a at the time of contact. Is greater than or equal to the first threshold value D1 (S62). Steps S62, S64, and S65 illustrated in FIG. 14 correspond to a determination operation for determining whether or not a flick operation is performed. Here, the flick operation is described as being performed in a direction not parallel to the x-axis and the y-axis.

  When the operation validity determination unit 84B determines that the amount of change in the x-coordinate value and the y-coordinate value of the index finger 68a at the time of contact is greater than or equal to the first threshold value D1 (S62, YES), the flick operation has been performed. Is output to the touch operation determination unit 88B. The touch operation determination unit 88B performs a flick operation starting from the touch coordinates (x, y) output from the touch coordinate extraction unit 52 when the determination result of the operation validity determination unit 84B is a flick operation. Information to that effect is output to the application 65. The application 65 executes an operation corresponding to the flick operation (S63), and outputs an operation result corresponding to the flick operation to the application screen generation unit 59. The application screen generation unit 59 as a display control unit displays the operation result received from the application 65 on the screen of the display unit 13 (screen display unit 30).

  When the operation validity determination unit 84B determines that the amount of change in the x-coordinate value and the y-coordinate value of the index finger 68a at the time of contact is less than the first threshold D1 (S62, NO), the proximity detection unit 5 before and after the contact It is determined whether or not the proximity of the index finger 68a is detected at the timing (S64). Specifically, when the operation validity determination unit 84B has acquired information on the proximity coordinates (x, y, z) from the hover operation determination unit 89B at the timing before and after the contact, the proximity detection unit 5 makes the contact. It is determined that the proximity of the index finger 68a is detected at the timing before and after. When it is determined that the proximity detection unit 5 has not detected the proximity of the index finger 68a at the timing before and after contact (S64, NO), the user's index finger 68a is not flicked, and the operation of the mobile terminal 1B is as follows. Proceed to step S66.

  When it is determined that the proximity detection unit 5 has detected the proximity of the index finger 68a at the timing before and after the contact (S64, YES), the operation effectiveness determination unit 84B before and after the contact with the screen of the index finger 68a in which the proximity has been detected. It is determined whether or not the amount of movement at the timing is greater than or equal to the second threshold value D2 (S65). The operation validity determination unit 84B has the amount of movement at the timing before and after contact with the screen of the index finger 68a where proximity is detected, that is, the amount of change in the x coordinate value and the y coordinate value of the proximity coordinates (x, y, z). If it is determined that the threshold value D2 is greater than or equal to the threshold value D2 (S65, YES), a determination result indicating that the flick operation has been performed is output to the touch operation determination unit 88B. The operation after the determination result indicating that the flick operation has been performed is input to the touch operation determination unit 88B is the same as the description in step 63, and thus the description is omitted.

  It is determined that the amount of movement of the index finger 68a whose proximity has been detected before and after contact with the screen, that is, the amount of change in the x coordinate value and the y coordinate value of the proximity coordinates (x, y, z) is less than the second threshold value D2. If it is determined that the user's index finger 68a has not been flicked (S65, NO), the operation of the portable terminal 1B proceeds to step S66. The operations after Step S66 are operations of the mobile terminal 1B when the user's index finger 68a is touch-operated.

  The touch operation determination unit 88B determines whether a button is displayed at the touch position on the screen based on the information on the touch coordinates (x, y) output from the touch coordinate extraction unit 52 (S66). Specifically, the touch operation determination unit 88B sets the button at the position of the touch coordinates (x, y) output from the touch coordinate extraction unit 52 based on the coordinate information of the buttons on the screen stored in the memory 40. It is determined whether or not is displayed.

  When it is determined that the button is not displayed at the touch position on the screen (S66, NO), the touch operation determination unit 88B performs an operation corresponding to the touch operation on the display position on the screen that is not a button. Is output to the application 65. Based on the information output from the touch operation determination unit 88B, the application 65 performs an operation according to the touch operation on the display position on the screen that is not a button (S67), and the operation result is sent to the application screen generation unit 59. Output. The application screen generation unit 59 as a display control unit displays the operation result received from the application 65 on the screen of the display unit 13 (screen display unit 30).

  When it is determined that the button is displayed at the touch position on the screen (S66, YES), the touch operation determination unit 88B determines whether the touch operation on the button satisfies the existing touch determination condition ( S68). Here, the existing touch determination condition is, for example, that the touch time on the screen is a predetermined value (for example, 300 milliseconds) or less. Further, the existing touch determination condition is, for example, that a position where the finger touching the screen is separated is a position where the touch panel 15 can be detected. When it is determined that the touch operation on the button does not satisfy the existing touch determination condition (S68, NO), the application 65 responds to the user operation based on the information output from the touch operation determination unit 88B. The operation is executed (S69). Note that the case where the existing touch determination condition is not satisfied corresponds to, for example, a case where a long press operation (for example, a long press operation of 1 second or more) is performed at a position where the user performs a touch operation. The application screen generation unit 59 as a display control unit displays the operation result received from the application 65 on the screen of the display unit 13 (screen display unit 30).

  When the touch operation determination unit 88B determines that the touch operation on the button satisfies the existing touch determination condition (S68, YES), the touch operation determination unit 88B outputs information indicating that the operation corresponding to the touch operation on the button is executed to the application 65. To do. The application 65 executes an operation corresponding to the touch operation on the button based on the information output from the touch operation determination unit 88B (S70), and outputs the operation result to the application screen generation unit 59. The application screen generation unit 59 as a display control unit displays the operation result received from the application 65 on the screen of the display unit 13 (screen display unit 30).

  As described above, when the mobile terminal 1B according to the present embodiment detects contact with the screen of the display unit 13, the x coordinate value, the y coordinate value of the proximity coordinates (x, y, z) of the finger at the timing before and after the contact, If any one of the x-coordinate value and the y-coordinate value is greater than or equal to the second threshold value D2, the contact of the display unit 13 with the screen is determined as a flick operation. Further, when the mobile terminal 1B detects contact with the screen of the display unit 13, the x coordinate value, the y coordinate value, the x coordinate value, and y of the proximity coordinates (x, y, z) of the finger at the timing before and after the contact are detected. If any coordinate change amount among the coordinate values is less than the second threshold D2, it is determined that the touch on the screen of the display unit 13 is a touch operation. Thereby, the portable terminal 1B appropriately determines the touch operation and the flick operation as the user's intentional operation, and does not erroneously detect the touch operation as a flick operation. Therefore, it is possible to reduce false detection of the user's input operation and improve operability for the user.

(Fourth embodiment)
In the fourth embodiment, in view of the circumstances leading to the contents of the third and subsequent embodiments described above, the user's intentional touch operation and the unconscious contact act are appropriately determined to reduce erroneous detection on the touch panel. An example of a portable terminal will be described.

  Since the configuration of the mobile terminal of this embodiment is the same as that of the mobile terminal 1B shown in FIG. 12, the same reference numerals as those of the mobile terminal 1B shown in FIG. 12 are used in the description of the functional configuration of the mobile terminal of this embodiment. Description of similar contents is omitted, and different contents are described.

  The touch operation determination unit 88B determines whether the user's finger, palm, or hand has touched the touch panel 15 based on the information of the touch coordinates (x, y) as the contact detection signal output from the touch coordinate extraction unit 52. Determine whether. When it is determined that the user's finger, palm, or hand has touched the touch panel 15, the touch operation determination unit 88 </ b> B and the touch coordinates (x, y) and the proximity coordinates (x, y, z) based on the determination instruction for determining whether the touch operation detected by the touch panel 15 is an intentional touch operation of the user or an unconscious contact action, and information on the touch coordinates (x, y) Are output to the operation validity determination unit 84B.

  The touch operation determination unit 88B invalidates the touch coordinates (x, y) as the contact detection signal output from the touch coordinate extraction unit 52 when the determination result of the operation validity determination unit 84B is an unconscious contact action. To destroy. That is, the touch operation determination unit 88B does not output the touch coordinate (x, y) information as a contact detection signal detected by the touch panel 15 as an unconscious contact action to the application 65.

  Next, a method for determining whether the operation effectiveness determination unit 84B is a user's intentional touch operation or an unconscious contact action will be described with reference to FIGS. 15 to 18. FIG. 15A is a diagram illustrating erroneous detection due to an unconscious contact act. FIGS. 15B and 15C are diagrams illustrating an example of a detection range of a proximity detection signal detected during an intentional touch operation on a button. FIG. 15D is a diagram illustrating an example of a detection range of a proximity detection signal detected during an unconscious contact action on a button. In FIG. 15A and FIG. 15D, a cross indicates a contact position where a part of the hand PA touches the button. In FIGS. 15B and 15C, a cross indicates a touch position where the index finger 68a touches the button.

  As shown in FIG. 15A, for example, when the user unconsciously grips the casing of the portable terminal 1B, the button displayed on the screen of the display unit 13 (the button on the right side of FIG. Parts may come into contact. Therefore, when the button is touched because the user unconsciously grips the casing of the mobile terminal 1B with the hand PA, the mobile terminal 1B performs the user's intentional touch operation on the button. May be falsely detected.

  As shown in FIGS. 15B and 15C, when the user's finger consciously performs a touch operation on the button, the detection range of the proximity detection signal of the finger detected at the time of the touch operation is directed toward the button. There is only one direction, and it is considered that the proximity detection signal of the finger spreads in the opposite area across the button and is not detected. The area on the opposite side across the button refers to the area on the opposite side of the index finger 68a with the dotted line in FIGS. 15B and 15C as the boundary line.

  On the other hand, as shown in FIG. 15D, when a part of the hand PA touches the button when the user grips the casing of the mobile terminal, proximity detection of a part of the hand PA detected at the time of touching The signal detection range is considered to be a range that extends to the periphery including all or part of the button.

  As described above, the operation validity determination unit 84B detects the proximity detection signal (proximity coordinates (x, y, z)) detected when a part of the user's hand PA or the index finger 68a touches the screen of the display unit 13. Whether the detection range of (information) is unidirectional with respect to the button, or whether it is an intentional touch operation by the user or an unconscious contact action, depending on whether the button is expanded to the periphery including all or part of the button judge.

  FIG. 16A is a diagram illustrating an image of the intentional touch operation and the spread of the distribution of the proximity detection signal detected during the intentional touch operation. FIG. 16B is a diagram illustrating an image of the spread of the distribution of the proximity detection signals detected during the unconscious contact action and the unconscious contact action. FIG. 17A is a diagram showing a touch operation on the button BT4 at the lowest end of the index finger 68a. FIG. 17B is a diagram illustrating an example of the expansion of the detection range of the proximity detection signal detected during the touch operation illustrated in FIG.

  As shown in the lower part of FIG. 16A, the image of the spread (detection range) of the proximity detection signal detected at the time of the intentional touch operation represents a state in which the image is spread only in one direction toward the button. The range corresponds to the size of 68a. On the other hand, as shown in the lower part of FIG. 16B, the image of the spread (detection range) of the distribution of the proximity detection signal detected at the time of unconscious contact acts is a range that extends to the periphery including all or part of the button. Become.

  Here, a specific example of the proximity detection signal detected during the touch operation will be described with reference to FIG. In FIG. 17, in order to explain the proximity detection signal in an easy-to-understand manner, the capacitance value between the index finger 68a and the touch panel 15 is used as the proximity detection signal. As shown in FIG. 17A, it is assumed that, among the four buttons BT1, BT2, BT3, and BT4 displayed on the screen, the user's index finger 68a intentionally touches the button BT4 at the lowest end.

  The spread (detection range) of the proximity detection signal obtained for the index finger 68a detected by the touch panel 15 by the intentional touch operation on the button BT4 at the lowest end of the index finger 68a of the user is shown in FIG. In this manner, the proximity detection signal (capacitance value) is the maximum when the touch position (see the x in FIG. 17A) where the index finger 68a touches the button BT4 is the same as in thermography. In this way, a proximity detection signal corresponding to the shape of the index finger 68a centered on the touch position is obtained.

  Further, the operation effectiveness determination unit 84B can determine whether the user is performing an intentional touch operation or an unconscious contact action even when the user is operating with one hand or both hands (FIGS. 18A and 18B). )reference). FIG. 18A is a diagram showing an image of the spread of the proximity detection signal detected during the intentional touch operation in the case of one-handed operation or two-handed operation. FIG. 18B is a diagram illustrating an image of the spread of the proximity detection signal detected during the unconscious contact act.

  As shown in FIG. 18A, when the user is holding and operating the mobile terminal with one hand (for example, the left hand or the right hand), the button displayed on the screen of the display unit 13 is changed to the left hand (right hand). However, when the touch operation is performed with, for example, the thumb, the vicinity of the thumb ball of the left hand (also with the right hand) is considered to be highly likely to be close to or touch the touch panel 15.

  Further, when the user is holding and operating the portable terminal with both hands, when the buttons displayed on the screen of the display unit 13 are touch-operated with the left hand and the right hand, for example, with each thumb, each mother with the left hand and the right hand It is considered that there is a high possibility that the vicinity of the finger ball is close to or touches the touch panel 15.

  However, as shown in FIG. 18A, since neither hand approaches the center of the lower end of the screen of the display unit 13 in either one-handed operation or both-handed operation, the proximity detection signal is not detected or is not easily detected. it is conceivable that.

  On the other hand, as shown in FIG. 18B, when the user unconsciously holds the mobile terminal so as to cover the mobile terminal with one hand, the user spreads around the entire or part of the buttons displayed on the screen. It is considered that the proximity detection signal is often detected at the center part (see the dotted line part) on both side surfaces of the casing of the portable terminal.

  Therefore, the operation effectiveness determination unit 84B uses the detection range of the proximity detection signal shown in FIGS. 18A and 18B to determine whether the user has performed an intentional touch operation or an unconscious contact act. You may judge.

  In addition, when the user is a woman in particular, the mobile terminal 1B may be operated with an artificial nail 67 (see FIG. 18C). As described above, as illustrated in FIG. 15D, the operation validity determination unit 84B has a range in which the detection range of the proximity detection signal detected during the touch operation on the button extends to the periphery including all or part of the button. If it is, it is determined as an unconscious contact action without determining that it is an intentional operation. For this reason, in the case of a user who operates the mobile terminal 1B with the artificial nail 67 attached, the operation effectiveness determination unit 84B may erroneously detect an intentional touch operation as an unconscious contact act.

  FIG. 18C is a diagram showing a state in which the proximity detection signal detected during the touch operation with the index finger 68a to which the artificial nail 67 is attached spreads in the forward direction of the button BT. When the button is touch-operated with the artificial nail 67 attached, the artificial nail 67 is attached, so it is considered that the touch operation is performed with the belly of the index finger 68a.

  As described above, when a touch operation is performed with the index finger 68a to which the artificial nail 67 is attached, the proximity detection signal detected at the time of the touch operation is not only in one direction toward the button BT but also opposite to the button BT. The side area is also detected (see FIG. 18C). Accordingly, in the case of a user who operates the portable terminal 1B with the artificial nail 67, the storage 23 (memory 40) of the portable terminal 1B stores in advance the trend information of the proximity detection signal at the time of touch specific to the user. It is preferable to memorize. As a result, the operation validity determination unit 84B uses the trend information of the proximity detection signal at the time of touch stored in the storage unit 23 (memory 40) to determine whether the operation is an intentional touch operation or an unconscious contact action. Can be determined appropriately. The trend information includes, for example, touch coordinates when the touch panel 15 detects a finger touch operation and a detection range of a proximity detection signal at the time of touch detection. The trend information preferably further includes information on the difference between the end of the detection range of the proximity detection signal at the time of touch detection and the touch coordinates.

(Operation of the mobile terminal 1B of the fourth embodiment)
FIG. 19 is a flowchart for explaining a determination procedure between an intentional touch operation on a button and an unconscious contact action in the mobile terminal according to the fourth embodiment. In the flowchart of FIG. 19, description of each operation of step S61, “determination operation of flick operation”, step S63, step S66, step S67, and step S68 is the same as each corresponding description shown in FIG. Therefore, the description is omitted, and the contents different from the flowchart of FIG. 14 are described.

  In FIG. 19, when the touch operation determination unit 88B determines that the touch operation on the button satisfies the existing touch determination condition (S68, YES), the touch coordinates (x, y) and the finger and palm at the time of the touch operation are determined. Alternatively, a determination instruction and touch coordinates (x, y) for determining whether the touch detected by the touch panel 15 based on the proximity coordinates (x, y, z) of the hand is a user's intentional touch operation or an unconscious touch action. ) Is output to the operation validity determination unit 84B.

  The operation validity determination unit 84B is a proximity detection signal detected when a part of the user's hand PA or the index finger 68a touches the screen of the display unit 13 based on the determination instruction output from the touch operation determination unit 88B. It is determined whether or not the detection range of (proximity coordinates (x, y, z) information) is one direction with respect to the button (S71).

  The operation validity determination unit 84B determines that the detection range of the proximity detection signal detected when a part of the user's hand PA or the index finger 68a touches the screen of the display unit 13 is one direction with respect to the button. In this case (S71, YES), the determination result indicating that the user's intentional touch operation has been performed is output to the touch operation determination unit 88B. The touch operation determination unit 88B outputs, to the application 65, information indicating that an operation corresponding to the touch operation on the button is executed based on the determination result information output from the operation effectiveness determination unit 84B. The application 65 executes an operation corresponding to the touch operation on the button based on the information output from the touch operation determination unit 88B (S72), and outputs the operation result to the application screen generation unit 59. The application screen generation unit 59 as a display control unit displays the operation result received from the application 65 on the screen of the display unit 13 (screen display unit 30).

  The operation effectiveness determination unit 84B determines that the detection range of the proximity detection signal detected when a part of the user's hand PA or the index finger 68a touches the screen of the display unit 13 is not unidirectional with respect to the button. In such a case (S71, NO), a determination result indicating that the user's unconscious contact action has been performed is output to the touch operation determination unit 88B. The touch operation determination unit 88B invalidates the touch coordinates (x, y) as the contact detection signal output from the touch coordinate extraction unit 52 based on the determination result information output from the operation validity determination unit 84B. Discard (S73).

  As described above, when the mobile terminal 1B of the present embodiment detects a touch operation on the screen of the display unit 13, the proximity detection signal (proximity coordinates (x, y, Based on the detection range indicating the spread of the information z), it is properly determined whether the touch operation on the screen of the display unit 13 is a user's intentional touch operation or an unconscious contact action. Furthermore, when it is determined that the touch operation on the screen of the display unit 13 is the user's intentional touch operation, the mobile terminal 1B performs an operation corresponding to the touch operation, and the touch operation on the screen of the display unit 13 is performed by the user. When it is determined that the touch action is unconscious, the touch detection signal (information of touch coordinates (x, y)) of the touch operation is invalidated and discarded. Thereby, the portable terminal 1 </ b> B can appropriately determine the user's intentional touch operation and the unconscious contact action, and can reduce erroneous detection of the user's input operation on the touch panel 15.

(Fifth embodiment)
In the fifth embodiment, unlike the portable terminals of the above-described embodiments, the display unit (screen display unit) has a plurality (for example, two in this embodiment), and different touch panels are mounted on the screens of the display units. An example of a portable terminal will be described. Hereinafter, the mobile terminal of the present embodiment is referred to as a two-screen mobile terminal 1C (see FIG. 21A).

  As shown in FIG. 21A, the two-screen portable terminal 1C is configured such that a front side case 1CF and a back side case 1CB can be rotated via a hinge (not shown). The front side housing 1CF is provided with a screen display unit 30F on which a front touch panel 15F is mounted, and the rear side housing 1CB is provided with a screen display unit 30B on which a rear touch panel 15B is mounted. FIG. 21A is a diagram illustrating a state in which the two-screen portable terminal 1C according to the fifth embodiment is folded to bring the screen display units 30F and 30B into an opposed state. On the right side of FIG. 21 (A), the screen display portions 30F and 30B are shown facing each other. Note that the facing state refers to a state in which the front housing 1CF and the back housing 1CB face each other, and as a result, the screen display units 30F and 30B face each other. For example, a state in which the front side housing 1CF and the back side housing 1CB are equal to or less than a predetermined angle may be included.

  Here, as an example of main operations in the two-screen portable terminal 1C, after the user folds the front-side casing 1CF and the rear-side casing 1CB of the two-screen portable terminal 1C to bring the screen display units 30F and 30B into the opposed state. Assume that a touch operation is performed on the button BT displayed on the screen of the screen display unit 30F. In this case, in order to hold the two-screen portable terminal 1C so as to cover the front-side casing 1CF or the rear-side casing 1CB, the rear touch panel 15B causes the user's hand PA to approach or touch a part of the screen display unit 30B. It is thought to detect. The two-screen portable terminal 1C is for invalidating such proximity or contact, for example.

  FIG. 20 is a block diagram illustrating a functional configuration of a two-screen portable terminal 1C according to the fifth embodiment. A two-screen portable terminal 1C shown in FIG. 20 includes a proximity detection unit 5F, a proximity detection unit 5B, a touch detection unit 10F, a touch detection unit 10B, a screen display unit 30F, a screen display unit 30B, a proximity coordinate extraction unit 51, and touch coordinate extraction. Unit 52, gravity direction detection unit 71, open / close state detection unit 72, hover operation determination unit 89B, touch operation determination unit 88B, operation effectiveness determination unit 84C, application 65, and application screen generation unit 59. The two-screen portable terminal 1C may further include a memory 40 (storage unit 23). The same components as those of the mobile terminal 1 shown in FIG. 2 are denoted by the same reference numerals, description thereof is omitted, and different contents are described.

  The proximity detection unit 5F detects a state in which a user's finger, palm, or hand with respect to the screen display unit 30F illustrated in FIG. 21A is in proximity to the front touch panel 15F by a hover operation or a hover slide operation. The proximity detection unit 5B detects a state in which the user's finger, palm, or hand with respect to the screen display unit 30B shown in FIG. 21A is close to the rear touch panel 15B by a hover operation or a hover slide operation.

  The touch detection unit 10F detects an operation in which a user's finger, palm, or hand touches the front touch panel 15F with respect to the screen display unit 30F illustrated in FIG. 21A by a touch operation or a touch slide operation. The touch detection unit 10B detects an operation in which a user's finger, palm, or hand touches the back touch panel 15B with respect to the screen display unit 30B illustrated in FIG. 21A by a touch operation or a touch slide operation. The proximity detection unit 5F and the touch detection unit 10F constitute a front touch panel 15F, and the proximity detection unit 5B and the touch detection unit 10B constitute a back touch panel 15B.

  The screen display unit 30F is provided in the front-side casing 1CF of the two-screen portable terminal 1C and has a function of displaying data on the screen of the screen display unit 30F. For example, the screen display unit 30F receives the screen data output from the application screen generation unit 59 indicate. Similarly, the screen display unit 30B is provided in the rear case 1CB of the two-screen portable terminal 1C and has a function of displaying data on the screen of the screen display unit 30B. For example, the screen display unit 30B is output from the application screen generation unit 59 Display screen data.

  The proximity coordinate extraction unit 51 calculates proximity coordinates (x, y, z) with respect to the front touch panel 15F or the rear touch panel 15B of the finger, palm, or hand based on the proximity notification output from the proximity detection unit 5F or 5B. Extract. The proximity coordinate extraction unit 51 outputs information on proximity coordinates (x, y, z) to the hover operation determination unit 89B.

  The touch coordinate extraction unit 52, based on the contact notification output from the touch detection unit 10F or 10B, touch coordinates (x, y) when a finger, palm, or hand touches the front touch panel 15F or the back touch panel 15B. Is calculated and extracted. The touch coordinate extraction unit 52 outputs information on the extracted touch coordinates (x, y) to the touch operation determination unit 88B.

  The gravitational direction detection unit 71 is configured using, for example, an acceleration sensor and a gyro sensor, and detects a direction (gravity direction) affected by gravitational acceleration and detects a state in which the two-screen portable terminal 1C is tilted. The state in which the two-screen portable terminal 1C is tilted indicates, for example, which of the screen display units 30F or 30B is on the upper side or the lower side in the direction of gravity. The gravity direction detection unit 71 outputs information of the detection result to the operation validity determination unit 84C.

  The open / close state detection unit 72 is configured using, for example, a magnetic sensor, and detects the open / close state of the front side housing 1CF and the back side housing 1CB. The open / closed state of the front housing 1CF and the back housing 1CB indicates, for example, whether or not the front housing 1CF and the back housing 1CB are opposed to each other. The open / close state detection unit 72 outputs detection result information to the operation validity determination unit 84C.

  Here, when the user grasps the two-screen mobile terminal 1C and consciously performs a touch operation on the button displayed on the screen of the screen display unit 30F on which the front touch panel 15F is mounted, An example of the operation will be described with reference to FIG. FIG. 21B is a diagram illustrating a state in which the touch operation on the front touch panel 15F is determined to be valid.

  First, the user folds the front-side housing 1CF and the back-side housing 1CB so that the front-side housing 1CF and the back-side housing 1CB face each other (see FIG. 21A or 21B). After the front side housing 1CF and the back side housing 1CB are in the facing state, as shown in FIG. 21B, the front side housing in which the user's hand PA (the left hand in FIG. 21B) is facing. The body 1CF and the back side housing 1CB are gripped at approximately the center of each side surface, and the finger of the hand (right hand) (not shown) of the user touches the button BT displayed on the screen of the screen display unit 30F.

  In this case, before the front touch panel 15F detects an intentional touch operation on the button BT displayed on the screen of the screen display unit 30F, the front touch panel 15F detects the user's hand (right hand) (not shown). The proximity or contact of the hand PA (left hand) to the screen display unit 30B is detected. At the same time, the front touch panel 15F detects the proximity or contact of each finger of the hand PA (left hand) that wraps around the front side housing 1CF from the rear side case 1CB with respect to the screen display unit 30F. As described above, the two-screen portable terminal 1C detects the proximity or contact described above by the rear touch panel 15 and the front touch panel 15F before performing an operation according to the button BT that the user wants to intentionally perform a touch operation. As a result, the user may perform an unexpected operation. In other words, the two-screen portable terminal 1C will erroneously detect.

  Therefore, the operation effectiveness determination unit 84C includes the detection results of the gravity direction detection unit 71 and the open / close state detection unit 72, the proximity coordinates (x, y, z) output from the hover operation determination unit 89B, and the touch operation determination unit 88B. Based on the information on the touch coordinates (x, y) output from the touch panel (B), the proximity coordinates (proximity detection signal) or the touch coordinates (contact detection signal) of the hand PA (left hand) detected by the rear touch panel 15B with respect to the screen display unit 30B. Is determined to be invalid. Further, the operation validity determination unit 84C determines that the proximity coordinate (proximity detection signal) or the touch coordinate (contact detection signal) of the hand PA (left hand) detected by the front touch panel 15F with respect to the screen display unit 30F is invalid.

  In addition, while the user's hand PA (left hand) is gripping the approximate center of each side so as to cover the front side housing 1CF or the back side housing 1CB, the user's finger (not shown) When the touch operation is performed on the button BT displayed on the screen of the screen display unit 30F, the rear touch panel 15B is opposed to the screen display unit 30F in accordance with the touch operation on the button displayed on the screen of the screen display unit 30F. A contact with the screen display unit 30B in the state may be detected. In this case, if the button is temporarily displayed on the screen display unit 30B, the two-screen portable terminal 1C performs an operation that the user does not expect in accordance with a touch operation on the button displayed on the screen of the screen display unit 30F. Sometimes. In other words, the two-screen portable terminal 1C will erroneously detect.

  Therefore, the operation effectiveness determination unit 84C includes the detection results of the gravity direction detection unit 71 and the open / close state detection unit 72, the proximity coordinates (x, y, z) output from the hover operation determination unit 89B, and the touch operation determination unit 88B. On the screen display unit 30B detected by the back touch panel 15B in accordance with the touch operation on the button BT of the hand (right hand) (not shown) based on the information on the touch coordinates (x, y) output from ( Contact detection signal) is determined to be invalid.

  In addition, the hand PA (the left hand) is detected by the rear touch panel 15B by gripping the substantially central portion of each side so as to cover the front side housing 1CF or the back side housing 1CB in a facing state. When the proximity detection signal or the contact detection signal for the left hand) is in a steady state, it is assumed that the user's finger (not shown) (right hand) touches the button BT displayed on the screen of the screen display unit 30F. Note that the proximity detection signal or the contact detection signal for the hand PA (left hand) is in a steady state means that the user's hand PA (left hand) covers the front-side casing 1CF or the back-side casing 1CB in a facing state. The state where the substantially central part of each side is continuously gripped is shown.

  In this case, the operation validity determination unit 84C includes the detection results of the gravity direction detection unit 71 and the open / close state detection unit 72, the proximity coordinates (x, y, z) output from the hover operation determination unit 89B, and the touch operation determination unit. Based on the information on the touch coordinates (x, y) output from 88B, it is determined that the touch coordinates (contact detection signal) obtained by the touch operation on the button BT of the hand (right hand) (not shown) of the user are valid. .

  In addition, as disclosed in Reference Document 3 below, in response to an indirect touch operation of a finger using a predetermined area on the back side of the case of the mobile terminal as a touch pad, the display is displayed on the screen on the front side of the case It is known that the displayed pointer is moved and displayed. FIG. 21C is a diagram illustrating a state in which an indirect touch operation with respect to the index finger movable range FG provided in the screen display unit 30B is determined to be valid.

  (Reference Patent Document 3) International Publication No. 2009/031213

  As shown in FIG. 21C, the user's hand PA (the right hand in FIG. 21C) grips the substantially central portion of each side so as to cover the screen display portion 30F or 30B in the facing state. The index finger performs a touch operation or a touch slide operation as an indirect touch operation on a predetermined region (index finger movable range FG) of the screen display unit 30B, and moves the pointer PT displayed on the screen display unit 30F toward the button BT. And For example, when the button BT is displayed on the screen display unit 30F, the operation validity determination unit 84C causes the front touch panel 15F to respond to a touch operation on an intentional button BT of a user's hand (left hand) (not shown). It is determined that the contact detection signal is valid. However, the operation validity determination unit 84C determines that the contact detection signal corresponding to the indirect touch operation of the hand PA (right hand) detected by the rear touch panel 15B is invalid as described in FIG. 21A or 21B. As a result, the two-screen portable terminal 1C cannot control the movement of the pointer PT by the indirect touch operation as disclosed in the above-mentioned Reference Patent Document 3, and the user operability is considered to deteriorate.

  Therefore, the operation effectiveness determination unit 84C includes the detection results of the gravity direction detection unit 71 and the open / close state detection unit 72, the proximity coordinates (x, y, z) output from the hover operation determination unit 89B, and the touch operation determination unit 88B. Based on each information of the touch coordinates (x, y) output from the touch operation or touch slide as an indirect touch operation of the index finger of the hand PA (right hand) with respect to a predetermined region (index finger movable range FG) of the screen display unit 30B The touch coordinates (contact detection signal) corresponding to the operation are determined to be valid (see FIG. 21C).

(Operation of the two-screen portable terminal 1C of the fifth embodiment)
FIG. 22 is a flowchart for explaining the operation procedure in the two-screen portable terminal of the fifth embodiment. As a premise of the flowchart shown in FIG. 22, it is assumed that the front touch panel 15F detects contact of the user's hand PA with the button BT displayed on the screen of the screen display unit 30F.

  In FIG. 22, the operation validity determination unit 84C is based on the detection result information output from the open / close state detection unit 72, and the terminal open / close state of the two-screen portable terminal 1C, that is, the front side case 1CF and the back side case. It is determined whether or not the body 1CB is facing (S81). When it is determined that the terminal open / close state of the two-screen portable terminal 1C is not the facing state (S81, NO), the operation effectiveness determination unit 84C is configured according to the third embodiment according to the front touch panel 15F or the rear touch panel 15B. Alternatively, the determination method of the user input operation described in the fourth embodiment is performed (S82). For example, the operation validity determination unit 84C determines whether the input operation to the front touch panel 15F is a touch operation or a flick operation. Alternatively, the operation validity determination unit 84C determines whether the input operation on the rear touch panel 15B is a user's intentional touch operation or an unconscious contact action.

  Based on the determination instruction output from the touch operation determination unit 88B, the operation effectiveness determination unit 84C is detected when a part of the user's hand PA detected by the front touch panel 15F or when the index finger 68a touches the screen of the screen display unit 30F. It is determined whether or not the detection range of the proximity detection signal (information of proximity coordinates (x, y, z)) is one direction with respect to the button BT displayed on the screen (S83).

  When the operation validity determination unit 84C determines that the detection range of the proximity detection signal (information of proximity coordinates (x, y, z)) detected at the time of contact is not one direction with respect to the button BT (S83). , NO), a determination result indicating that the user's unconscious contact action has been performed is output to the touch operation determination unit 88B. The touch operation determination unit 88B invalidates the touch coordinates (x, y) as the contact detection signal output from the touch coordinate extraction unit 52 based on the determination result information output from the operation validity determination unit 84C. Discard (S84).

  When the operation validity determination unit 84C determines that the detection range of the proximity detection signal (information of proximity coordinates (x, y, z)) detected at the time of contact is one direction with respect to the button BT (S83). YES), the detection direction of the proximity detection signal and the contact detection signal obtained up to the contact detected before step S81 based on the information of the detection result output from the gravity direction detection unit 71 and the direction of gravity. It is determined whether or not they are the same (S85).

  When the operation validity determination unit 84C determines that the proximity detection signal and the detection direction of the contact detection signal obtained before contact and the gravity direction are the same (S85, YES), the operation of the back side housing 1CB is determined. It is determined whether a touch operation on the screen display unit 30B has been received (S86).

  If the operation validity determination unit 84C determines that the touch operation on the screen display unit 30B has not been received (S86, NO), the determination that the user's intentional touch operation on the screen display unit 30F has been performed. The result is output to the touch operation determination unit 88B. The touch operation determination unit 88B outputs, to the application 65, information indicating that an operation corresponding to the touch operation on the button BT is executed based on the determination result information output from the operation effectiveness determination unit 84C. The application 65 executes an operation corresponding to the touch operation on the button BT based on the information output from the touch operation determination unit 88B (S87), and outputs the operation result to the application screen generation unit 59. The application screen generation unit 59 as a display control unit displays the operation result received from the application 65 on the screen of the display unit 13 (screen display unit 30).

  When the operation validity determination unit 84C determines that the proximity detection signal and the detection direction of the contact detection signal obtained until contact are not the same as the direction of gravity, that is, the direction opposite to the direction of gravity (S85). , NO), whether or not the user's hand PA is gripping, for example, a substantially central portion of the side surface of each casing as a peripheral portion of each casing so as to cover the front casing 1CF or the rear casing 1CB in a facing state Is determined (S88). Specifically, the operation effectiveness determination unit 84C determines whether the rear touch panel 15B or the front touch panel 15F has detected a proximity detection signal or a contact detection signal for the hand PA when the hand PA grips any housing. Determine whether.

  If the operation validity determining unit 84C determines that the user's hand PA is not gripping, for example, the approximate center of each side of the casing (S88, NO), the user's hand PA is approximately the side of each casing. A determination result indicating that the center portion is not gripped is output to the touch operation determination unit 88B. Based on the determination result output from the operation effectiveness determination unit 84C, the touch operation determination unit 88B cannot normally perform an operation on the screen display unit 30B without holding the two-screen portable terminal 1C. As described above, the touch detection signal (touch coordinate (x, y) information) corresponding to the touch on the screen display unit 30B detected before step S81 is invalidated and discarded (S89).

  On the other hand, when the operation validity determination unit 84C determines that the user's hand PA is gripping, for example, the substantially central portion of each housing side surface (S88, YES), the rear touch panel 15B and the front touch panel 15F are respectively A proximity operation (for example, hover operation) corresponding to the proximity detection signal detected by gripping the hand PA or a contact operation (touch operation) corresponding to the contact detection signal is determined to be invalid (see FIG. 21A or 21B). . Thereafter, the operation of the two-screen portable terminal 1C proceeds to step S86.

  If the operation validity determination unit 84C determines that the touch coordinate extraction unit 52 has received the information on the touch coordinates (x, y) corresponding to the touch operation on the screen display unit 30B (S86, YES), the screen It is determined whether or not the position of the touch operation on the display unit 30B is within the index finger movable range FG (see FIG. 21C) (S90).

  If the operation validity determination unit 84C determines that the position of the touch operation on the screen display unit 30B is within the index finger movable range FG (see FIG. 21C) (S90, YES), the operation validity determination unit 84C performs the operation on the screen display unit 30B. The touch operation is accepted as an indirect touch operation (see Reference Patent Document 3) (S91), and information indicating that the touch operation on the screen display unit 30B is accepted as an indirect touch operation is output to the touch operation determination unit 88B. The touch operation determination unit 88B outputs information indicating that an operation corresponding to the indirect touch operation is performed to the application 65 based on the information output from the operation validity determination unit 84C. The application 65 moves the pointer PT displayed on the screen display unit 30F, for example, as an operation corresponding to the indirect touch operation based on the information output from the touch operation determination unit 88B. The application screen generation unit 59 as a display control unit displays the operation result of the application 65 on the screen display unit 30F.

  If the operation validity determination unit 84C determines that the position of the touch operation on the screen display unit 30B is not within the index finger movable range FG (see FIG. 21C) (S90, NO), the operation validity determination unit 84C performs the operation on the screen display unit 30B. A determination result indicating that the position of the touch operation is not within the index finger movable range FG is output to the touch operation determination unit 88B. It is generally considered that the touch operation determination unit 88B performs a user's conscious touch operation on the two screen display units 30F and 30B based on the determination result output from the operation effectiveness determination unit 84C. If not, the touch detection signal (information on touch coordinates (x, y)) corresponding to the touch on the screen display unit 30B detected in step S86 is invalidated and discarded (S92).

  As described above, the two-screen portable terminal 1C according to the present embodiment grips the substantially central portion of each case side surface so as to cover the screen display unit 30F and the screen display unit 30B in which one of the user's hands is facing, When the finger of the other hand PA of the user performs a conscious touch operation on the button BT displayed on the screen display unit 30F, for example, proximity detection that has already been detected for one hand before the touch operation Invalidate and discard the signal or contact detection signal. In addition, the two-screen portable terminal 1C holds the substantially central portion of each side of the casing so as to cover the screen display unit 30F and the screen display unit 30B in which one user's hand is facing, and the other hand of the user For example, it is determined that the contact detection signal corresponding to the conscious touch operation performed on the button BT displayed on the screen display unit 30F by the PA finger is valid. Further, the two-screen portable terminal 1C determines that the same finger contact detection signal for the screen display unit 30B detected by the back touch panel 15B when the screen display unit 30F is pressed by the conscious touch operation is invalid. .

  Thereby, the two-screen portable terminal 1C is described in the third embodiment or the fourth embodiment with respect to the determination of the input operation on the screen display unit 30F or 30B when the screen display units 30F and 30B are not in the facing state. Can be used. Furthermore, the two-screen portable terminal 1C is configured such that the front side housing that is already in the facing state before the user performs a conscious touch operation on the screen display unit 30F, for example, when the screen display units 30F and 30B are in the facing state. It is possible to determine that the proximity detection signal or the contact detection signal detected with respect to the user's hand holding the 1CF or the back side housing 1CB so as to cover it is invalid. Accordingly, the two-screen portable terminal 1C is, for example, a proximity detection signal or contact detection that is detected before the user performs a conscious touch operation on the screen display unit 30F when the screen display units 30F and 30B are in an opposing state. Since the signal is discarded, the user does not perform an unexpected operation before performing a conscious touch operation, and false detection can be reduced.

  Although various embodiments have been described with reference to the drawings, it goes without saying that the present invention is not limited to such examples. It is obvious for those skilled in the art that variations and modifications of various embodiments, and combinations of various embodiments can be conceived within the scope of the claims. Of course, it is understood that it belongs to the technical scope of the present invention.

  In the fifth embodiment, it has been described that the gravity direction detection unit 71 (for example, a gyro sensor) detects the direction in which the two-screen mobile terminal 1C is tilted. However, the gravity direction detection unit 71 detects the direction in which the two-screen mobile terminal 1C is tilted. Is not limited to the gravity direction detector 71. For example, a luminance sensor capable of measuring the luminance around the two-screen portable terminal 1C is provided in each of the front case 1CF and the back case 1CB, and the front case 1CF and the back case 1CB are facing each other. The two-screen portable terminal 1C is tilted on the assumption that the front-side casing 1CF or the rear-side casing 1CB provided with the luminance sensor that provides a bright luminance value among the outputs of the respective luminance sensors is directed to the user. The direction may be detected.

  INDUSTRIAL APPLICABILITY The present invention is useful as an input device, an input support method, and a program that can appropriately determine a user's intentional operation on the touch panel and reduce erroneous detection on the touch panel.

1, 1A, 1B portable terminal 1C two-screen portable terminal 5, 5F, 5B proximity detection unit 10, 10F, 10B touch detection unit 30, 30F, 30B screen display unit 40 memory 51 proximity coordinate extraction unit 52 touch coordinate extraction unit 56 operation Determination unit 59 Application screen generation unit 65 Application 84, 84A, 84B, 84C Operation effectiveness determination unit 88, 88B Touch operation determination unit 89, 89B Hover operation determination unit

Claims (8)

A display for displaying data on the screen;
A proximity detector that detects the proximity of a finger to the screen and outputs a proximity detection signal;
A contact detection unit that detects contact of a finger with the screen and outputs a contact detection signal;
Based on the proximity detection signal and the contact detection signal, an operation validity determination unit that determines whether or not a finger touch operation is effective;
A control unit that invalidates the contact detection signal when it is determined that the finger touch operation is invalid, and an input device comprising:
The operation effectiveness determination unit
The touch operation of the finger is effective on the condition that the detection range of the proximity detection signal equal to or greater than a predetermined threshold when the finger touches the screen is only one direction with respect to the periphery of the finger touch position on the screen. An input device for judging. The input device according to claim 1,
A storage unit for storing tendency information of proximity detection signals at the time of user-specific contact;
The operation effectiveness determination unit
An input device that determines whether or not the finger touch operation is valid using the trend information stored in the storage unit . The input device according to any one of claims 1 and 2 ,
The display unit
A first display unit that displays data on a first screen on the front side of the casing of the input device; and a second display unit that displays data on a second screen on the back side of the casing;
The contact detector is
A first contact detection unit that detects contact of a finger, palm, or hand with respect to the first screen and outputs a first contact detection signal; and a second contact by detecting contact of the finger, palm, or hand with respect to the second screen. A second contact detection unit that outputs a detection signal;
The first contact detector is
Detecting contact with a part of an edge of the housing by a finger, palm or hand;
The second contact detector is
Finger, the contact to a portion of the second screen with the palm or hand is detected,
The operation effectiveness determination unit
An input device that determines that a touch operation on a part of an end portion of the housing of the finger, palm, or hand and a part of the second screen detected by the first contact detection unit and the second contact detection unit is invalid. . The input device according to claim 3 ,
The second contact detector is
When the first display unit and the second display unit are opposed to each other, the contact of the finger touching the first screen with respect to the second screen is detected according to the contact of the finger with the first screen. ,
The operation effectiveness determination unit
An input device that determines that a touch operation on a second screen of a finger that has touched the first screen detected by the second contact detection unit is invalid. The input device according to claim 3 or 4 ,
The proximity detector is
A first proximity detector that detects the proximity of a finger, palm, or hand to the first screen and outputs a first proximity detection signal; and a second proximity that detects proximity of the finger, palm, or hand to the second screen. A second proximity detection unit that outputs a detection signal;
The first contact detector is
When the second proximity detection signal corresponding to the proximity of one hand to the second screen detected by the second proximity detection unit is in a steady state, the first screen of the other hand different from the one hand Detecting contact with
The operation effectiveness determination unit
An input device that determines that a touch operation of a finger on the first screen of the other hand detected by the first contact detection unit is valid. The input device according to any one of claims 3 to 5 ,
The second contact detector is
Detecting an indirect finger touch operation on a predetermined range of the second screen;
The operation effectiveness determination unit
An input device that determines that an indirect touch operation of a finger on a predetermined range of the second screen detected by the second contact detection unit is valid. An input support method in an input device including a display unit for displaying data on a screen,
Detecting the proximity of a finger to the screen and outputting a proximity detection signal;
Detecting a contact of a finger on the screen and outputting a contact detection signal;
Determining whether a finger touch operation is effective based on the proximity detection signal and the contact detection signal;
Invalidating the contact detection signal when it is determined that the finger touch operation is invalid;
The touch operation of the finger is effective on the condition that the detection range of the proximity detection signal equal to or greater than a predetermined threshold when the finger touches the screen is only one direction with respect to the periphery of the finger touch position on the screen. An input support method comprising: determining. To a computer that is an input device including a display unit that displays data on a screen,
Detecting the proximity of a finger to the screen and outputting a proximity detection signal;
Detecting a contact of a finger on the screen and outputting a contact detection signal;
Determining whether a finger touch operation is effective based on the proximity detection signal and the contact detection signal;
Invalidating the contact detection signal when it is determined that the finger touch operation is invalid;
The touch operation of the finger is effective on the condition that the detection range of the proximity detection signal equal to or greater than a predetermined threshold when the finger touches the screen is only in one direction with respect to the periphery of the finger touch position on the screen. And a step for determining.

Images