JP2016106305A - User interface apparatus capable of applying tactile response corresponding to contact/pressing operation, tactile response generation method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user interface apparatus capable of applying a tactile response suited to an event generated as a result of finger operation, and to provide a tactile response generation method and a program.SOLUTION: The user interface apparatus includes: a tactile response mechanism unit 202b capable of applying a tactile response to a finger brought into contact with a surface of a screen; a pressing force detection unit 203 for detecting pressing force; a pressing force determination unit 222 for determining whether or not a value of pressing force is a predetermined threshold and more; a contact position determination unit 221 for determining whether or not a finger contact position is included in a set area; a response rate verification unit 225 which when an event correlated to the set area is generated, determines intensity of vibration to be generated in the tactile response mechanism unit on the basis of a determination result of the contact position determination unit and a determination result of the pressing force determination unit; and a tactile response control unit 226 for controlling the tactile response mechanism unit so as to generate vibration of the determined intensity to apply a tactile response to the finger used for operation.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a user interface device including a display that displays an image and a touch panel that enables an operation with a finger.

  Conventionally, user interface devices equipped with touch panels have been widely used. In particular, in recent years, in user interface devices such as smartphones, tablet computers, electronic books, PDAs (Personal Digital Assistants), so-called portable information devices, touch panels have been actively adopted as user interfaces that accept operations by finger contact. ing.

  When the touch panel is adopted, various input operations corresponding to the multi-functionality of the device can be performed. On the other hand, compared with the physical key, an erroneous input operation tends to occur. Specifically, an input operation occurs even when the user unintentionally touches the touch panel, or even if the user performs an input operation, a desired function is not activated and a redo operation is required.

  There is a technique for giving a tactile response by vibration or the like to an operated finger as a measure for dealing with the problem of erroneous input. The user can perform the operation with reference to obtaining a response (feedback) to the operation performed by the user, and can obtain the response with a finger to confirm the completion of the operation.

  For example, Patent Document 1 discloses a touch panel with a tactile feedback function including a flexural vibration type actuator including a piezoelectric element. This touch panel is provided with two flexural vibration type actuators at the periphery. Patent Document 2 discloses a touch panel device that vibrates a multi-touch panel that can detect a plurality of contacts that occur at the same time and performs feedback of touch confirmation. In this device, when the first finger touches, the first vibration is applied to the finger, and when the second finger touches while the first finger is touching, the vibration level is higher than the first vibration. A large second vibration is applied.

JP 2011-43925 A JP 2010-55282 A

  2. Description of the Related Art Conventionally, in many portable information devices, for response or notification of event triggering, an electric motor (vibration motor) connected with an eccentric weight is operated to vibrate the entire device and allow the user to feel the vibration. It was.

  In addition, as in Patent Document 1, there is a technique for applying vibration using two piezoelectric actuators provided at positions separated from each other at the peripheral edge of the touch panel. However, even in this case, since these piezoelectric actuators operate simultaneously, at least the entire touch panel vibrates. Therefore, the tactile response to the event activated as a result of the operation always gives almost the same vibration to the finger. That is, although various events can be triggered as a result of various operations, only the same tactile response can be given to the operated finger.

  On the other hand, as disclosed in Patent Document 2, there is a technique that includes both a piezoelectric element and a vibration motor and feeds back according to an event in which two types of vibrations are activated. However, these vibrations are considerably different from each other and are inappropriate as a variety of tactile responses according to various operations performed with a finger on the same touch panel. That is, the correspondence between the operation and the response is not intuitive, and it is often difficult to instantly confirm whether or not the operation has been accepted.

  Further, when a plurality of fingers touch the multi-touch panel at the same time, the related art described above can apply only the same vibration to any finger at a temporary point. Therefore, for example, in a battle game, in a situation where each player's finger touches the multi-touch panel and performs an operation, it is impossible for each player to give a tactile response suitable for an event triggered as a result of the player's operation. Become.

  Therefore, an object of the present invention is to provide a user interface device, a tactile response issuing method, and a program capable of giving a predetermined finger a tactile response suitable for an event activated as a result of the operation of the finger.

According to the present invention, there is provided a user interface device including an image display unit that displays an image to be operated on a screen, and a touch panel that sequentially outputs a finger contact position as time passes,
A tactile response mechanism capable of giving a tactile response to the finger touching the screen of the image display unit;
A pressing force detection unit that detects a pressing force applied by a finger touching the screen of the image display unit;
A pressing force determining means for determining whether or not the magnitude of the pressing force is equal to or greater than a predetermined threshold;
Contact position determination means for determining whether or not the contact position of the finger is included in the set region;
When an event associated with the region is triggered based on the determination result by the contact position determination unit and the determination result by the pressing force determination unit, the determination result by the contact position determination unit and the determination result by the pressing force determination unit are Based on the tactile response determination means for determining the intensity of vibration generated by the tactile response mechanism unit,
There is provided a user interface device having tactile response control means for controlling a tactile response mechanism unit so as to generate a vibration of a determined intensity so as to give a tactile response to the operated finger.

  As an embodiment of the user interface device according to the present invention, the tactile response determining means includes at least one of the vibration frequency and vibration time generated by the tactile response mechanism based on the determination result by the pressing force determining means. It is also preferable to further determine.

  Furthermore, in this embodiment, the tactile response determining means further determines at least one of the vibration frequency and vibration time generated by the tactile response mechanism based on the determination result by the contact position determining means. It is also preferable.

  As another embodiment of the user interface device according to the present invention, the tactile response determining means determines the intensity of vibration generated by the tactile response mechanism based on the positional relationship of the contact position with respect to the tactile response mechanism. It is also preferable.

Furthermore, in this other embodiment, the user interface device has a plurality of tactile response mechanisms including two facing each other,
It is also preferable that the tactile response determining means determines the intensity of vibration generated by the tactile response mechanism based on the positional relationship of the contact position between the two tactile response mechanisms with respect to the two.

Further, in the user interface device according to the present invention, the set area is an area associated with an event relating to zoom-out and an area associated with an event relating to zoom-in,
The tactile response control means is an event related to zoom that is determined based on the determination result by the contact position determination means and the determination result by the pressing force determination means when the zoom-out event or the zoom-in event occurs. It is also preferable to control the tactile response mechanism unit so as to generate vibration as a tactile response to.

According to the present invention, there is further provided a program mounted on a user interface device that includes an image display unit that displays an image to be operated on a screen, and a touch panel that sequentially outputs a finger contact position as time elapses. And this user interface device
A tactile response mechanism capable of giving a tactile response to the finger touching the screen of the image display unit;
A pressing force detection unit that detects a pressing force applied by a finger that touches the screen of the image display unit.
A pressing force determining means for determining whether or not the magnitude of the pressing force is equal to or greater than a predetermined threshold;
Contact position determination means for determining whether or not the contact position of the finger is included in the set region;
When an event associated with the region is triggered based on the determination result by the contact position determination unit and the determination result by the pressing force determination unit, the determination result by the contact position determination unit and the determination result by the pressing force determination unit are Based on the tactile response determination means for determining the intensity of vibration generated by the tactile response mechanism unit,
A program for a user interface device that causes a computer to function as a tactile response control unit that controls a tactile response mechanism so as to generate a vibration having a determined intensity in order to give a tactile response to the operated finger. Provided.

According to the present invention, in addition, the activation of a tactile response in a user interface device including an image display unit that displays an image to be operated on a screen, and a touch panel that sequentially outputs a finger contact position as time elapses. A method, wherein the user interface device is
A tactile response mechanism capable of giving a tactile response to the finger touching the screen of the image display unit;
A pressing force detection unit that detects a pressing force applied by a finger that touches the screen of the image display unit.
Determining whether the contact position of the finger is included in the set region, and determining whether the magnitude of the pressing force is equal to or greater than a predetermined threshold;
When an event associated with the region is triggered based on the determination result related to the contact position and the determination result related to the pressing force, based on the determination result related to the contact position and the determination result related to the pressing force Determining the intensity of vibration generated by the tactile response mechanism;
There is provided a tactile response invocation method including a step of controlling a tactile response mechanism unit so as to generate a vibration having a determined intensity in order to give a tactile response to the operated finger.

Furthermore, a user interface device related to the present invention, comprising: an image display unit that displays an image to be operated on a screen; and a touch panel that sequentially outputs a finger contact position as time passes,
A plurality of tactile response mechanisms including two facing each other, capable of giving a tactile response to a finger touching the screen of the image display unit;
An area setting means for setting one or more areas in the screen of the image display unit;
When an event associated with one position in one set region is triggered by an operation with a finger on the image, the coordinate system is set in the screen, and the two tactile response mechanism units A response ratio that determines a ratio of the tactile response intensity generated by each of the plurality of tactile response mechanisms according to the coordinate value of the coordinate axis at the one position in the coordinate system having the coordinate axes along the opposing direction. A determination means;
Tactile response control means for instructing each of a plurality of tactile response mechanism units to generate a tactile response having the determined intensity ratio to give a tactile response to the operated finger It is also preferred that a user interface device is provided.

As one embodiment of the user interface device related to the present invention, the user interface device detects a pressing force applied by a finger touching the screen of the image display unit, and
A pressing force determining means for determining whether or not the magnitude of the pressing force is equal to or greater than a predetermined threshold;
Contact position determination means for determining whether the contact position of the finger is included in one set region;
The response ratio determining means determines that an event associated with one area is triggered when the contact position determining means makes a true determination and the pressing force determining means makes a true determination. It is also preferable to determine the proportion of the tactile response intensity generated by each of the plurality of tactile response mechanisms according to the coordinate value at one position.

In the user interface device related to the present invention,
The touch panel is a multi-touch panel capable of simultaneously detecting at least the contact positions of the finger and other fingers,
The tactile response control means, when an event associated with one position in one set region is activated by the operation of either the finger or the other finger that are in contact with each other, In order to give a tactile response to each of the other fingers, it is also preferable to instruct each of the plurality of tactile response mechanism units to generate a tactile response having the determined ratio.

Furthermore, as another embodiment of the user interface device related to the present invention,
The plurality of tactile response mechanism units are two tactile response mechanism units facing each other provided at least near both ends of the screen of the image display unit,
The response ratio determining means is a coordinate value at one position in one region, and the two tactile response mechanisms according to the coordinate values with respect to the coordinate axes along the direction in which the two tactile response mechanism units face each other. It is also preferable to determine the proportion of the tactile response intensity generated by each of the parts.

Furthermore, as another embodiment of the user interface device related to the present invention,
The plurality of tactile response mechanism units are provided in the vicinity of the four sides of the screen of the image display unit, and are four tactile response mechanism units including two facing each other and the other two facing each other.
The response ratio determining means is a coordinate value at one position in one region, and the two tactile response mechanism units facing each other face each other according to the coordinate values about the coordinate axes along the direction in which the two tactile response mechanism units face each other. The ratio of the tactile response intensity generated by each of the two tactile response mechanisms is determined, and the two other tactile response mechanisms are opposite to each other according to the coordinate values of the coordinate axes along the direction in which the two other tactile responses are opposite to each other. It is also preferable to determine the ratio of the haptic response intensity generated by each of the other two opposing haptic response mechanisms.

Further, the present invention is a program related to the present invention, which is mounted on a user interface device including an image display unit that displays an image to be operated on a screen and a touch panel that sequentially outputs a finger contact position as time passes. And this user interface device
The program further comprises a plurality of tactile response mechanism units for providing a tactile response to the finger touching the screen of the image display unit.
An area setting means for setting one or more areas in the screen of the image display unit;
When an event associated with one position in one set region is triggered by an operation with a finger on the image, the coordinate system is set in the screen, and the two tactile response mechanism units A response ratio that determines a ratio of the tactile response intensity generated by each of the plurality of tactile response mechanisms according to the coordinate value of the coordinate axis at the one position in the coordinate system having the coordinate axes along the opposing direction. A determination means;
As a tactile response control means for instructing each of a plurality of tactile response mechanism units to generate a tactile response having the determined strength in order to give a tactile response to the operated finger. It is also preferable to provide a program for a user interface device that causes a computer to function.

Furthermore, the method for invoking a tactile response in the user interface device related to the present invention, further comprising: an image display unit that displays an operation target image on a screen; and a touch panel that sequentially outputs a finger contact position as time passes. And this user interface device
A tactile response can be given to a finger touching the screen of the image display unit, and further includes a plurality of tactile response mechanism units including two facing each other.
A first step of setting one or more areas in the screen of the image display unit;
When an event associated with one position in one set region is triggered by an operation with a finger on the image, the coordinate system is set in the screen, and the two tactile response mechanism units A second tactile response intensity ratio generated by each of the plurality of tactile response mechanism units is determined in accordance with the coordinate value for the coordinate axis at the one position in a coordinate system having coordinate axes along opposite directions. And the steps
A third step of instructing each of a plurality of tactile response mechanisms to generate a tactile response having the determined strength of the ratio in order to give a tactile response to the operated finger; It is also preferable that a tactile response activation method having the following is provided.

  According to the user interface device, the tactile response issuing method, and the program of the present invention, it is possible to provide a predetermined finger with a tactile response suitable for an event that is activated as a result of the operation of the finger.

To explain the activation of tactile response in the portable information apparatus according to the present invention, a graph showing a front view of a portable information device, and the relationship between the intensity ratio parameter R _I of the coordinate values of the event-related position and the tactile response is there. It is a front view of a portable information device for explaining activation of a tactile response in the portable information device according to the present invention. It is the front view which shows other embodiment of the portable information device by this invention, and the schematic which shows operation by a finger | toe. FIG. 4 is a front view of a portable information device for explaining activation of a tactile response in the embodiment of FIG. 3. FIG. 10 is a front view showing still another embodiment of the portable information device according to the present invention. FIG. 2 is a perspective view and a functional configuration diagram schematically showing a configuration of a portable information device according to the present invention. 3 is a flowchart illustrating an embodiment of a tactile response issuing method in a portable information device according to the present invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  The user interface device according to the present invention includes a plurality of tactile response mechanisms, and when an event associated with one position in an area set in the display screen is activated by an operation with a finger, This is characterized in that the ratio of the tactile response intensity generated by each of the plurality of tactile response mechanism units is determined in accordance with the coordinate value of.

  Thus, the finger receives a tactile response that is recognized as a response related to the operation performed by the finger. As a result, a tactile response suitable for an event activated as a result of the operation of the finger can be given to the finger.

For example, as one embodiment, a finger can be operated by itself.
(A) When an event associated with a position in a region farther from its own contact position is activated, a tactile response mechanism at a farther position generates a stronger tactile response (vibration), thereby You can get the recognition that an event at a far position has been triggered,
(B) When an event associated with a position in a region closer to its own contact position is activated, a haptic response mechanism at a closer position generates a stronger haptic response (vibration), thereby being closer It can be recognized that the position event has been triggered.

  Many of the user interface devices according to the present invention are portable information devices such as smartphones and tablet computers that can be carried with one hand or both hands and can be operated with fingers of the held hand. Therefore, hereinafter, a portable information device will be described as an embodiment of the present invention.

1, for explaining the activation of tactile response in the portable information apparatus according to the present invention, a front view of a portable information device, and the relationship between the intensity ratio parameter R _I of the coordinate values of the event-related position and the tactile response It is a graph which shows.

  According to FIG. 1A, the portable information device 1 is arranged on a display 101 for displaying an image to be operated, and the screen of the display 101, and sequentially outputs a finger contact position as time passes. A touch panel 100 and two tactile response mechanisms 102a and 102b are provided. Here, the touch panel 100 is a multi-touch panel that can simultaneously detect the contact positions of a plurality of fingers.

  The tactile response mechanisms 102a and 102b are elements that give a tactile response (vibration) to a user's finger that touches the screen of the display 101, and are directly below the upper end and the lower end of the touch panel 100, respectively. The touch panel 100 is in contact with the touch panel 100.

  Similarly, according to FIG. 1A, in the portable information device 1, an air hockey game application is activated, and a competition table 104 as a stadium image is displayed on the screen of the display 101. Further, on this screen, the mallet 105a and 105b as the competition equipment images and the pack 106 that is the target image to be hit with the mallet 105a and 105b are displayed.

  An xy coordinate system is set in the screen of the display 101. Here, the y coordinate axis is an axis extending in the vertical direction of the portable information device 1, and the x coordinate axis is an axis extending in the horizontal direction of the device 1. By setting this xy coordinate system, a two-dimensional coordinate value (x, y) at a position associated with an event generated by an operation with a finger can be acquired.

  First, the finger of the user A positioned on the upper side of the portable information device 1 comes into contact with the display position range of the mallet 105a. Thereby, the user A can move the mallet 105a according to the movement of the finger by holding the mallet 105a and moving the finger while touching the screen (touch panel 100). Note that the finger of user B who is an opponent also touches the screen (touch panel 100) and holds the mallet 105b. Next, the user A moves the mallet 105a to hit (hits) the pack 106, slides the pack 106, and bounces (bounces back) against the left wall image displayed on the screen.

  Here, wall areas 107a (left side) and 107b (right side) are preset in the wall image. When the display position range of the pack 106 and the wall area 107a come close to each other and come into contact with each other or overlap, a “bound event” in which the pack 106 bounces against the wall image is activated. At this time, the first contact position between the display position range of the pack 106 and the wall region 107a or the center position of the overlapping portion is set as a “bound position” associated with the activated bound event. This bound position is naturally one position in the wall region 107a.

Thus, when the bound event is activated, the tactile response mechanisms 102a and 102b have the vibration intensities (energy intensities) I _v1 and I _v2 and the tactile responses (vibrations v ₁ and v ₂ ) respectively for the users A and B. Give to finger. Here, the intensity ratio (intensity ratio) between the vibration intensity I _v1 of the haptic response mechanism 102a and the vibration intensity I _v2 of the haptic response mechanism 102b.
(1) I _v1 : I _v2 = R _I : (1-R _I )
Determining an intensity ratio parameter R _I is determined according to the y-coordinate value of a bound position (in FIG. 1 0.39).

Here, the y coordinate axis is a coordinate axis along a direction in which the tactile response mechanisms 102a and 102b face each other. By determining the intensity ratio parameter R _I by the coordinate value of such coordinate axes (y coordinate value), as described below, to achieve the tactile response of giving a realistic feeling of operation and sensory.

FIG. 1 (B), as an example of determining the intensity ratio parameter R _I, is a graph showing the relationship between the y-coordinate value of a bound position and intensity ratio parameter R _I. According to the graph, the intensity ratio parameter _RI is
(2) R _I = 1 (0 ≦ y <0.1)
R _I = (0.95−y) /0.9 (0.1 ≦ y <0.95)
R _I = 0 (0.95 ≦ y ≦ 1)
It is. Using this graph, since the y-coordinate value of a bound position is 0.39, the intensity ratio parameter R _I in the bound event is determined to be 0.62.

From the determined intensity ratio parameter R _I value (= 0.62), the vibration intensities I _v1 and I _v2 of the tactile response mechanisms 102a and 102b are respectively
(3) I _v1 = I ₀ · R _I = 0.62 · I ₀
I _v2 = I ₀ · (1-R _I ) = 0.38 · I ₀
Is calculated. Here, I ₀ is the total vibration intensity.

The vibration intensities I _v1 and I _v2 calculated in this way are values corresponding to the y coordinate value (= 0.39) of the bound position. As a result, the user A's finger is given a stronger tactile response (vibration) than the user B's finger. As a result, the user A can obtain a realistic operational feeling that the bound event caused by the operation of his / her finger is closer and is activated on his / her side.

  On the other hand, user B's finger is given a weaker tactile response (vibration) than user A's finger. As a result, the user B can obtain a realistic feeling that the bound event caused by the operation of the opponent's finger is farther and is activated on the opponent side. In this way, by operating the two tactile response mechanism units 102a and 102b by appropriately controlling the intensity ratio, it is possible to cause the event triggered by the operation of the user's finger or the opponent's finger on each finger of the users A and B. An appropriate tactile response can be provided. As a result, both users can obtain a very realistic operational feeling and feeling.

  FIG. 2 is also a front view of the portable information device 1 for explaining the activation of the tactile response in the portable information device 1 according to the present invention. The progress of the game in FIG. 2 is continued from FIG.

  According to FIG. 2, in the portable information device 1 in which the air hockey game application is activated, the user B strikes back the puck 106 hit by the user A toward the goal area 107 b using the mallet 105 b. . This pack 106 passes through the side of user A's mallet 105a and jumps into the goal area 107a.

  The goal areas 107a (107b) are areas set in advance at the center of the upper end and the center of the lower end of the display 101 screen, respectively. When the pack 106 enters the goal area 107a (107b), that is, when the display position range of the pack 106 overlaps the goal area 107a (107b), a “goal event” that the user B (A) scores is activated. At this time, the first contact position between the display position range of the pack 106 and the goal area 107a (107b) or the center position of the overlapping part is set as the “goal position” associated with the activated goal event. This goal position is naturally one position in the goal area 107a.

As shown in FIG. 2, when a goal event in which the puck 106 jumps into the goal area 107a is activated, the intensity ratio between the vibration intensities I _v1 and I _{v2 of} the tactile response mechanisms 102a and 102b (I _v1 : I _v2 = R _{I: (1-R} I)) intensity ratio parameter _{R I} to determine the is determined in accordance with the y coordinate value of the goal position (FIG. 2 0.05).

Also in activation of this goal event, the intensity ratio parameter R _I, can be determined using the graph of FIG. 1 (B). According to the graph, because y-coordinate value of the goal position is 0.05, the intensity ratio parameter R _I in this goal event is determined to be 1.

From the determined intensity ratio parameter R _I value (= 1), the vibration intensities I _v1 and I _v2 of the tactile response mechanisms 102a and 102b are respectively
(4) I _v1 = I ₀ ′ · R _I = I ₀ ′
I _v2 = I ₀ ′ · (1−R _I ) = 0
Is calculated. Here, I ₀ ′ is the total vibration intensity, but can be a value different from I _{0 in the} above formula (3), for example, a value larger than I ₀ . In this case, for example, the tactile response of the goal event can be more strongly applied as a whole than the tactile response of the bound event, so that the user can identify the difference in the type of event from the tactile sense.

The vibration intensities I _v1 and I _v2 calculated in this way are values corresponding to the y coordinate value (= 0.05) of the goal position. Thereby, when the user A is scored, only the haptic response mechanism unit 102a on the user A side (upper side) is activated. Therefore, the user A's finger is given a stronger tactile response (vibration) than the user B's finger. As a result, the user A can obtain a realistic feeling that the pack 106 has jumped (lost points) into his goal area 107a.

  On the other hand, even if this goal event occurs, the tactile response mechanism unit 102b is not activated, and the finger of the user B is given a weaker tactile response (vibration) than the finger of the user A. As a result, the user B can obtain a realistic operational feeling that the pack 106 has jumped (scored) into the opponent's goal area 107a by his / her own operation. In this way, by operating the two tactile response mechanism units 102a and 102b by appropriately controlling the intensity ratio, it is possible to cause the event triggered by the operation of the user's finger or the opponent's finger on each finger of the users A and B. An appropriate tactile response can be provided. As a result, both users can obtain a very realistic operational feeling and feeling.

The relationship between the position and the intensity ratio parameter R _I which event is associated is not limited to the relationship shown in FIG. 1 (B), various relationships can be employed in accordance with the area to be set is there. However, assuming that the y-coordinate values of FIG. 1 (A) and FIG. 2 are employed under the formula (1) (I _v1 : I _v2 = R _I : (1−R _I )), the intensity ratio parameter R _I is A monotonically decreasing function of the y coordinate value is preferable. This makes it possible to generate a stronger tactile response (vibration) on the side where the event is triggered.

  It should be noted that the vibration applied in response to the occurrence of the goal event may be a vibration different from the vibration of the bound event, for example, a vibration having a lower frequency and stronger or a longer time. As a result, the user can receive a tactile response that can be more surely discriminated about the activation of the goal.

  FIG. 3 is a front view showing another embodiment of the portable information device according to the present invention, and a schematic view showing an operation with a finger. FIG. 4 is a front view of the portable information device for explaining the activation of the tactile response in the embodiment of FIG.

  FIG. 3A is a front view of the portable information device 2 in which the camera function is activated. According to the front view, an image including an image display area 204, zoom icons 205 a and 205 b, and a shooting icon 206 is displayed on the screen of the display 201. Further, on this screen, a touch panel 200 that sequentially outputs a finger contact position as time passes is arranged.

Further, two tactile response mechanisms 202a and 202b are installed in contact with the touch panel 200 immediately below the left end and the right end of the touch panel 200, respectively. Although not shown, the pressing force detection unit 203 which will be described later (FIG. 6) is arranged under the four corners of the touch panel 200, the finger detects the pressing force p _c when pushed in the touch panel 200.

The image display area 204 is an area for displaying an image of a subject. For example, it may be designed to imitate a physical liquid crystal screen that a conventional digital camera has. The shooting icon 205 is a display for invoking a shooting operation. For example, it may be designed to imitate a physical shutter button that a conventional digital camera has. User's finger, when performing the pressing operation of pushing the shot icon 205 at a predetermined threshold p _th or more pressure p _c, the photographing operation is triggered to capture images of a subject.

  The zoom icons 205a and 205b are virtual buttons for activating a zoom operation, and are displayed on the lower left side and lower right side of the display 201 screen, respectively. Here, the display position range of the zoom icon 205a is a zoom area associated with a zoom-out event in which the image of the image display area 204 is displayed at a wide angle (wide), and the display position range of the zoom icon 205b is This is a zoom area related to a zoom-in event displayed on a telephoto (telephoto) screen.

  The display position range of the zoom icon 205a (205b) located on the left side (right side) of the device 2 is set in advance as a “zoom area”. Here, as shown in FIG. 4A, when the finger (thumb) of the left hand of the user contacts the zoom icon 205a, that is, the contact position of the finger is included in the zoom area (display position range) of the zoom icon 205a. Then, the zoom selection event that the zoom icon 205a is selected is activated. Specifically, as the zoom selection event, highlighting of the zoom icon 205a indicating that preparations for zooming out have been made (a display that rises or sinks, a display that increases the luminous intensity, or the like) is performed.

  When this zoom selection event is activated, the contact position of the finger in the zoom area is set as a “selection position” associated with the activated zoom selection event. This selection position is naturally one position in the zoom area.

Here, as shown in FIG. 4A, when a zoom selection event occurs, the intensity ratio (I _v3 : I _v4 = R _I) between the vibration intensities I _v3 and I _{v4 of} the tactile response mechanisms 202a and 202b: The intensity ratio parameter R _I that determines (1-R _I )) is determined according to the y coordinate value (0.1 in FIG. 4A) of the selected position.

According to the graph shown in FIG. 4 (A), the intensity ratio parameter _RI is
(5) R _I = 1 (0 ≦ y <0.5)
R _I = 0 (0.5 ≦ y ≦ 1)
It is. Using this graph, since the y-coordinate value of the selected position is 0.1, the intensity ratio parameter R _I in the bound event is determined to be 1.

From the determined intensity ratio parameter R _I value (= 1), the vibration intensities I _v3 and I _v4 of the tactile response mechanisms 202a and 202b are respectively
(6) I _v3 = I ₀ · R _I = I ₀
I _v4 = I ₀ · (1-R _I ) = 0
Is calculated. Here, I ₀ is the total vibration intensity.

The vibration intensities I _v3 and I _v4 calculated in this way are values corresponding to the y coordinate value (= 0.1) of the selected position. Thereby, when the finger of the left hand touches the zoom icon 205a, only the left tactile response mechanism unit 202a is activated. Accordingly, the finger of the left hand is given a stronger tactile response (vibration) than the finger of the right hand. As a result, the user can obtain a realistic operational feeling that the left zoom icon, that is, the icon for zooming out has been selected.

  On the other hand, even if this zoom selection event occurs, the tactile response mechanism 202b is not activated, and the right hand finger is given a weaker tactile response (vibration) than the left hand finger. As a result, the user can obtain a realistic feeling that the left hand has selected the zoom icon on the opposite side of the finger of the right hand, that is, the icon for zooming out. In addition, even when the right hand finger touches the zoom icon 205b and only the tactile response mechanism unit 202b is activated, the user's operational feeling / sense is similar in the form that the right hand finger and the left hand finger are interchanged. It becomes.

  Next, as shown in FIG. 4B, not only the user's left hand (right hand) finger touches the zoom icon 205a (205b) but also the icon 205a (205b) is pressed into the image display area 204. The displayed image is zoomed out (zoomed in).

  FIG. 3B shows a pressing operation with a finger on the zoom icon 205a (205b). According to the figure, when zooming, first, the user touches the zoom icon 205a (205b) with the finger and selects the icon 205a (205b). That is, the finger contact position overlaps the display position range of the zoom icon 205a (205b). Next, the user presses the zoom icon 205a (205b) with his / her finger in order to obtain an image with a desired display magnification while confirming the image displayed in the image display area 204.

At this time, the pressing force p _C by the finger is set as a pressing force threshold value p _th ,
(7) _pc ≧ p _th
It is a value that satisfies the condition. Here, the pressing force threshold value p _th can be set to a value within the range of, for example, 0.5 N (Newton) to 2.0 N.

When the pressing force p _c contact position by and fingers included in the zoom area of the zoom icon 205a of the user's left fingers (thumb) satisfies the formula (1), the image displayed on the image display region 204 is zoomed out Is done. On the other hand, the pressing force p _c contact position by and fingers included in the zoom area of the zoom icon 205b of the right hand of the user's finger (thumb) is the time that satisfies the equation (1), an image displayed on the image display area 204 Zoom in.

  When a zoom-out event is triggered by the above-described finger operation, the finger contact position in the zoom region is set as a “zoom-out position” associated with the triggered zoom selection event. This zoom-out position is naturally one position in the zoom area.

Here, as shown in FIG. 4B, when a zoom-out event occurs, the intensity ratio (I _v3 : I _v4 = R _I) between the vibration intensities I _v3 and I _{v4 of} the tactile response mechanisms 202a and 202b: The intensity ratio parameter R _I that determines (1-R _I )) is determined according to the y coordinate value (0.1 in FIG. 4A) of the selected position.

Here, the intensity ratio parameter _RI is determined to be 1 by the graph shown in FIG. 4B which is the same as the graph of FIG.

From the determined intensity ratio parameter R _I value (= 1), the vibration intensities I _v3 and I _v4 of the tactile response mechanisms 202a and 202b are calculated as I _v3 = I ₀ ′ and I _v4 = 0, respectively. . Here, I ₀ ′ is the total vibration intensity, but can be a value different from I _{0 in the} above formula (6), for example, a value larger than I ₀ . In this case, for example, the tactile response of the zoom-out event can be more strongly applied as a whole than the tactile response of the zoom selection event, so that the user can identify the difference in the type of event from the tactile sense.

The vibration intensities I _v3 and I _v4 calculated in this way are values corresponding to the y coordinate value (= 0.1) of the zoom-out position. Thus, left fingers may pushed the zoom icon 205a at a predetermined threshold value p _th least pressing force, only the haptic feedback arrangement 202a on the left side is started. Accordingly, the finger of the left hand is given a stronger tactile response (vibration) than the finger of the right hand. As a result, the user can obtain a realistic operational feeling that the function of the left zoom icon, that is, zoom-out has been activated.

  On the other hand, even if this zoom-out event occurs, the tactile response mechanism 202b is not activated, and the right hand finger is given a weaker tactile response (vibration) than the left hand finger. As a result, the user can obtain a realistic feeling that the function of the zoom icon on the side opposite to the finger of the right hand, that is, the icon for zooming out, is activated with the left hand. In addition, even when the right hand finger pushes the zoom icon 205b and only the tactile response mechanism unit 202b is activated, the user's operational feeling / sense is similar in the form that the right hand finger and the left hand finger are interchanged. It becomes.

  Note that the vibration applied in response to the occurrence of the zoom-out event may be a vibration different from the vibration of the zoom selection event, for example, a vibration having a lower frequency and stronger or a longer time. Accordingly, the user can receive a tactile response that can be more surely discriminated about the activation of the zoom operation.

  In other words, when an event related to one area of the zoom area is triggered by the operation of either the right hand or the left hand of the user in contact with each other, the user touches the right hand or the left hand of the user. The tactile response mechanism 202a or 202b is activated and controlled to give a stronger tactile response to a finger whose position is closer to (included in) this one region.

  In this way, by appropriately operating the two tactile response mechanism units 202a and 202b appropriately, it is possible to give a tactile response suitable for an event activated as a result of an operation with each finger to each finger of the user. It becomes. As a result, the user can obtain a very realistic operational feeling and feeling.

In the portable information device 2 of the present invention, it is added to the magnitude of the pressing force p _c with the finger on the operating condition. That is, in order to activate the zoom event, it is necessary to press the zoom icons 205a and 205b with a finger rather than a simple finger contact. As a result, a malfunction caused by unintentional or unintentional contact can be avoided, and a zoom operation in which the malfunction is suppressed can be performed. Furthermore, a responsive operation that is not just contact is possible.

  FIG. 5 is a front view showing still another embodiment of the portable information device according to the present invention.

  The portable information device 3 shown in FIG. 5 includes a display 301 and a touch panel 300 arranged on the screen of the display 301. The portable information device 3 further includes four tactile response mechanisms 302a, 302b, 302c, and 302d near the four sides of the screen, that is, directly below the upper and lower ends and the left and right ends of the touch panel 300, respectively. Among these, the tactile response mechanisms 302a and 302b face each other in the y coordinate axis direction, and the tactile response mechanisms 302c and 302d face each other in the x coordinate axis direction.

Here, the intensity ratio parameter R _I1 between the tactile response mechanisms 302a and 302b is a position (for example, a bound position) associated with an event (for example, a bound event shown in FIG. 5) triggered by a user's finger operation. Is determined according to the y-coordinate value at. In addition, the intensity ratio parameter R _I2 between the tactile response mechanisms 302c and 302d is determined according to the x coordinate value of the position (for example, the bound position) with which this event (for example, the bound event) is associated.

For example, the intensity ratio parameters R _I1 and R _I2 are (x ₀ , y ₀ ) where the coordinates of the position where the event is associated are (x ₀ , y ₀ ).
(8) R _I1 = 1−y ₀ , R _I2 = 1−x ₀
As a result, the vibration intensities I _v5 , I _v6 , I _v7 and I _v8 of the tactile response mechanism units 302a to _302d are
(9) I _v5 = I ₅₆ · R _I1
I _v6 = I ₅₆ · (1-R _I1 )
I _v7 = I ₇₈ · R _I2
I _v8 = I ₇₈ · (1-R _I2 )
It becomes. Here, I ₅₆ and I ₇₈ are total vibration strengths.

  In this way, by controlling the strength of the tactile response (vibration) of each of the four tactile response mechanisms 302a, 302b, 302c, and 302d according to the coordinates (x, y) of the position where the triggered event is associated. A tactile response that is recognized as a response related to an operation performed by the user is given to a predetermined finger, while a response to an event triggered by an operation performed by another finger is given to the other finger. A recognized haptic response can be provided. As a result, a tactile response suitable for an event activated as a result of the operation of the finger can be given to each finger. Furthermore, at that time, the user can recognize the position where the event is triggered as a part of the two-dimensional plane with a sense of touch more realistically.

  FIG. 6 is a perspective view and a functional configuration diagram schematically showing the configuration of the portable information device 2 according to the present invention.

  According to FIG. 6, the portable information device 2 includes a touch panel 200, a display 201, tactile response mechanisms 202a and 202b, a pressing force detection unit 203, and a functional configuration unit as a processor memory. . Here, the function configuration unit (processor memory) realizes its function by executing a program for causing the computer mounted on the portable information device 2 to function.

  Note that the portable information devices 1 and 3 as other embodiments can also be realized by the functional configuration of FIG. In this case, the portable information device 1 does not use the functions of the pressing force detection unit 203 and the pressing force determination unit 222 described later. The portable information device 3 is different in that it includes four tactile response mechanisms.

  The display 201 displays an image to be operated on the screen. The touch panel 200 is disposed on the screen of the display 201, and sequentially outputs the contact position information of the user's finger to the contact position determination unit 221 described later as time elapses. As this touch panel 200, for example, a projected capacitive touch panel, a surface capacitive touch panel, a resistive touch panel, an ultrasonic surface acoustic wave touch panel, an infrared scanning touch panel, or the like can be employed. The touch panel 100 of the portable information device 1 is a multi-touch panel. As the touch panel 100, for example, a projected capacitive touch panel or a resistive touch panel can be employed.

  The tactile response mechanisms 202a and 202b are elements that give a tactile response by vibrating the touch panel 200 with respect to a finger touching the screen (touch panel 200) of the display 201. The tactile response mechanisms 202a and 202b are each assigned to one or more areas (zoom areas) set in the screen of the display 201. These tactile response mechanisms 202a and 202b may be piezoelectric actuators formed using a piezoelectric material such as PZT (lead zirconate titanate).

Pressing force detection unit 203 detects the pressing force _{p c} applied to the touch panel 200 by the finger. Pressing force detection unit 203 is, for example, are placed under the four corners of the touch panel 200, touch panel 200 flexed pressed against the finger the total pressing on itself, is detected as the pressing force p _c. The pressing force signal output by the pressing force detection unit 203 is input to a pressing force determination unit 222 described later. The pressing force detection unit 203 can be, for example, a piezoelectric sensor formed using a piezoelectric material such as PZT. Further, it is possible to provide tactile response mechanism units 202a and 202b constituted by piezoelectric actuators, and to use the pressing force detection unit 303 as a further tactile response mechanism unit.

  Similarly, according to FIG. 6, the functional configuration unit as the processor memory includes a contact position determination unit 221, a pressing force determination unit 222, an area setting unit 223, an operation determination unit 224, a response ratio determination unit 225, A tactile response control unit 226, a display control unit 211, and an application processing unit 212 are included.

  The contact position determination unit 221 inputs a contact position signal from the touch panel 200. Also, information on the area set from the area setting unit 223 is input. Thereafter, the contact position determination unit 221 determines whether the contact position of the finger is included in one or more areas set in the screen of the display 201 based on these signals and information. Further, the contact position determination unit 221 outputs the determination result to the operation determination unit 224.

The pressing force determination unit 222 inputs the pressing force signal from the pressing force detection unit 203. Thereafter, the pressing force judging unit 222, based on this signal, determines the magnitude of the pressing force p _c by finger whether a predetermined pressing force threshold p _th least. Further, the pressing force determination unit 222 outputs the determination result to the operation determination unit 224. Further, the area setting unit 223 sets one or more areas in the screen of the display 201 according to instructions / information from the application processing unit 212.

  The operation determination unit 224 inputs determination results from the contact position determination unit 221 and the pressing force determination unit 222. Next, based on these determination results, it is determined whether or not an operation for triggering an event such as a zoom selection event, a zoom-out event, or a zoom-in event has been performed. Further, the operation determination unit 224 outputs the determination result to the application processing unit 212, and outputs event trigger information to the response ratio determination unit 225 and the display control unit 111 via the application processing unit 212 or directly.

The response ratio determination unit 225 inputs information on the region set from the region setting unit 223, and further inputs event trigger information from the operation determination unit 224 or the application processing unit 212. Next, the response ratio determining unit 225 activates an event (zoom selection event, zoom-out event, or zoom-in event) associated with one position (finger contact position) within one set area (zoom area). when the, according to y coordinate values of the position, to determine the ratio (intensity ratio determines the parameters R _I) of the vibration intensity, each generating a haptic feedback mechanism 202a and 202b. Further, the response rate determination unit 225 outputs the rate information of the haptic response intensity to the haptic response control unit 226.

  The tactile response control unit 226 inputs the ratio information of the tactile response intensity from the response rate determination unit 225. Next, each of the tactile response mechanisms 202a and 202b is instructed to generate a tactile response having a determined ratio of intensity.

  The display control unit 211 inputs the application processing information from the application processing unit 212 and causes the display 201 to display an image corresponding to the execution of the application. In addition, the display control unit 211 causes the display 201 to display an image corresponding to the event to be activated, in accordance with the event activation information output from the operation determination unit 224.

  FIG. 7 is a flowchart showing an embodiment of the tactile response issuing method in the portable information device 2 according to the present invention. In addition, the tactile response issuing method in the portable information devices 1 and 3 as another embodiment can also be realized by the flowchart of FIG.

(S600) First, one or more areas (zoom areas) are preset on the screen of the display 201.
(S601) Next, the presence or absence of a finger contact with the touch panel 200 is measured.

(S602) Next, it is determined whether or not the finger touches the touch panel 200.
(S610) Here, when true determination is made, that is, determination that the finger is in contact is made, an operation loop with the finger (steps S610 to S615) is entered, and the contact position of the finger is monitored (monitored). On the other hand, when it is determined that the finger is not in contact, the process returns to step S601 again, and the presence or absence of the finger contact is monitored.

(S611) It is determined whether or not an event (a zoom selection event, a zoom-out event, or a zoom-in event) associated with a position in the set area (zoom area) is triggered by a finger operation.
(S612) If it is determined that the event has occurred, the y-coordinate value of this position (selected position, zoom-out position or zoom-in position) is acquired. On the other hand, when it is determined that the event is not activated, the process proceeds to step S615, and it is determined whether or not the finger is in contact with the touch panel 200.

(S613) from the obtained y coordinate values, to determine the intensity ratio parameter _{R I} to determine the percentage of the vibration intensity of each of the haptic feedback arrangement 202a and 202b are generating.
(S614) a haptic feedback arrangement 202a and 202b, so that the value intensity ratio is calculated from the determined intensity ratio parameter _{R I,} activates.

(S615) It is determined whether or not the finger is in contact with the touch panel 200. Here, when true determination is made, that is, determination that contact is made, an operation loop with fingers (steps S610 to S615) is repeated. On the other hand, when it is determined that the finger is not touching, the tactile response issuing method is ended, assuming that the operation by the user's finger is ended.

  As described above in detail, according to the user interface device, the tactile response issuing method, and the program of the present invention, an event related to one position in one of the set areas by a finger operation. Is activated, each of the plurality of tactile response mechanisms operates with a ratio of the tactile response intensity determined according to the coordinate value of this position in order to give a tactile response to the finger. Thereby, it becomes possible to give this finger a tactile response suitable for an event activated as a result of the operation of this finger.

  Various changes, modifications, and omissions of the above-described various embodiments of the present invention can be easily made by those skilled in the art. The above description is merely an example, and is not intended to be restrictive. The invention is limited only as defined in the following claims and the equivalents thereto.

1, 2, 3 Portable information devices (user interface devices)
100, 200, 300 Touch panel 101, 201, 301 Display 102a, 102b, 202a, 202b, 302a, 302b, 302c, 302d Tactile response mechanism 103, 203 Pressing force detection unit 104 Competition table 105a, 105b Mallet 106 Pack 107a, 107b Goal area 204 Image display area 205a, 205b Zoom icon 206 Shooting icon 211 Display control unit 212 Application processing unit 221 Contact position determination unit 222 Pressing force determination unit 223 Area setting unit 224 Operation determination unit 225 Response ratio determination unit 226 Tactile response control unit

Claims (8)

A user interface device including an image display unit that displays an image to be operated on a screen, and a touch panel that sequentially outputs a finger contact position as time passes,
A tactile response mechanism capable of giving a tactile response to the finger touching the screen of the image display unit;
A pressing force detection unit for detecting a pressing force applied by a finger touching the screen of the image display unit;
A pressing force determining means for determining whether or not the magnitude of the pressing force is a predetermined threshold value or more;
Contact position determination means for determining whether or not the contact position of the finger is included in the set region;
When an event associated with the region is triggered based on the determination result by the contact position determination unit and the determination result by the pressing force determination unit, the determination result by the contact position determination unit and the determination result by the pressing force determination unit And tactile response determining means for determining the intensity of vibration generated by the tactile response mechanism unit,
A tactile response control means for controlling the tactile response mechanism so as to generate a vibration of a determined intensity so as to give a tactile response to the operated finger; .   The tactile response determination unit further determines at least one of a vibration frequency and a vibration time generated by the tactile response mechanism based on a determination result by the pressing force determination unit. Item 4. The user interface device according to Item 1.   The tactile response determination means further determines at least one of a vibration frequency and a vibration time generated by the tactile response mechanism based on a determination result by the contact position determination means. The user interface device according to claim 2.   4. The haptic response determining means determines the intensity of vibration generated by the haptic response mechanism based on the positional relationship of the contact position with respect to the haptic response mechanism. The user interface device according to claim 1. The user interface device has a plurality of tactile response mechanisms including two facing each other,
The tactile response determining means determines the intensity of vibration generated by the tactile response mechanism based on the positional relationship between the two touch positions positioned between the two tactile response mechanisms. 5. The user interface device according to claim 4, wherein The set area is an area associated with an event related to zoom-out and an area associated with an event related to zoom-in.
The tactile response control means is a zoom determined based on a determination result by the contact position determination means and a determination result by the pressing force determination means when the zoom-out event or the zoom-in event is triggered. 6. The user interface device according to claim 1, wherein the tactile response mechanism unit is controlled so as to generate vibration as a tactile response to an event related to the above. A program installed in a user interface device that includes an image display unit that displays an image to be operated on a screen and a touch panel that sequentially outputs a finger contact position as time passes. ,
A tactile response mechanism capable of giving a tactile response to the finger touching the screen of the image display unit;
A pressing force detection unit that detects a pressing force applied by a finger that touches the screen of the image display unit, and the program includes:
A pressing force determining means for determining whether or not the magnitude of the pressing force is a predetermined threshold value or more;
Contact position determination means for determining whether or not the contact position of the finger is included in the set region;
When an event associated with the region is triggered based on the determination result by the contact position determination unit and the determination result by the pressing force determination unit, the determination result by the contact position determination unit and the determination result by the pressing force determination unit And tactile response determining means for determining the intensity of vibration generated by the tactile response mechanism unit,
A user that causes a computer to function as a tactile response control unit that controls the tactile response mechanism unit to generate a vibration having a determined intensity so as to give a tactile response to the finger that has been operated. Program for interface device. A method for invoking a tactile response in a user interface device, comprising: an image display unit that displays an image to be operated on a screen; and a touch panel that sequentially outputs a finger contact position as time passes. But,
A tactile response mechanism capable of giving a tactile response to the finger touching the screen of the image display unit;
A pressing force detection unit that detects a pressing force applied by a finger touching the screen of the image display unit, and the method of activating the tactile response comprises:
Determining whether the contact position of the finger is included in a set region, and determining whether the magnitude of the pressing force is equal to or greater than a predetermined threshold;
When an event associated with the region is triggered based on the determination result related to the contact position and the determination result related to the pressing force, based on the determination result related to the contact position and the determination result related to the pressing force Determining a strength of vibration generated by the tactile response mechanism unit;
And a step of controlling the tactile response mechanism so as to generate a vibration having a determined intensity so as to give a tactile response to the operated finger.

Images