CN102402282B - Information processor and information processing method - Google Patents

Abstract

The present invention relates to an information processing device and an information processing method. The information processing device includes a first detection unit configured to determine whether the user control is within a first threshold distance of the touchpad. The device also includes a second detection unit configured to determine the direction of movement of the user control with respect to the touchpad when the user control is not in contact with the touchpad, and a display control unit configured to determine when the user control is determined to be While moving within the threshold distance and in a predetermined direction, a signal is generated to alter the first display object such that the altered first display object appears to move closer to the user control.

Description

Information processing device and information processing method

technical field

The present disclosure relates to an information processing device, an information processing method, and a computer program.

Background technique

The touch panel makes it possible to realize an intuitive and easy-to-use user interface (hereinafter also referred to as "UI"), and thus has been used in the past for automatic ticket vending machines of transportation systems, ATMs of banks, and the like. Recent touch panels can detect the user's movement and enable device operations other than known button operations. Thus, touch panels have recently been used in portable devices such as cellular phones, game devices, and the like. For example, JP-T-2010-506302 discloses a device that generates haptic effects on a device by initiating haptic feedback before the user touches an input area or area of a touchpad or the like based on the presence of an object near the input area of the device .

However, the information about fingers that can be sensed by the touchpad in the past only cares about the state of the finger that is in contact. Thus, the user cannot operate the device until the finger touches the touch panel, and cannot recognize what processing will be affected by bringing the finger into contact with the touch panel until the user actually touches the finger to the touch panel.

A case will be considered in which a desired object is selected from a plurality of objects displayed on a display section of a mobile terminal (a touch screen device of about A4 size) or the like by an operation on a touch screen. At this time, when the object desired to be selected is located at a position away from the touch screen operation performed by the finger, it is necessary to extend the finger to operate the object, thus possibly increasing the user's operation load.

Also, when an object group formed of a plurality of objects is displayed on the display unit, when the object group is operated, some objects of the object group exit the display area of the display unit. When there are objects not displayed in the display area, the user needs to perform an operation of selecting a desired object after moving the object group displayed in the display section once, so that the user's operation load may increase.

Therefore, the present disclosure has been made in view of the above-mentioned problems, and it is desirable to provide a new and improved information processing device, an information processing method capable of reducing the user's operation burden by changing the display position of an object to be operated according to the position of the operation object and computer programs.

Contents of the invention

In an exemplary embodiment, the present disclosure relates to an information processing device, which includes: a first detection unit configured to determine whether a user control part is within a first threshold distance from the touchpad in a direction perpendicular to the touchpad within a distance; and a second detection unit configured to determine a moving direction of the user control part relative to the touch pad when the user control part is not in contact with the touch pad. The device also includes a display control unit configured to generate a signal to change the first display object such that the changed first The display object appears to move closer to the user control in a direction perpendicular to the touchpad. Wherein, the first detection unit is further configured to detect the proximity of the user control component to the first area of the touch panel in a direction perpendicular to the touch panel, and the display control unit is further configured to detect that the user control component is approaching the first area of the touch panel in a direction perpendicular to the touch panel. A signal is generated to move the first display object from the second area of the touchpad to the first area when the pad is oriented in proximity to the first area. A predetermined position on the display area of the touch panel is set as a reference position, and an interval in which the user control part is separated from the reference position by a preset distance is defined as a third area, and the first detection unit is further configured to detect when the user control part is touched moving a predetermined distance within a third area of the panel and detecting movement of a user control member a predetermined distance outside the third area, and the display control unit is further configured to generate a signal to The first display object moves by a first object response distance, and the display control unit is further configured to generate a signal to move the first display object by a second object response distance upon detection of movement outside the third zone by a predetermined distance, the first object The response distance is different from the second object response distance.

In another exemplary embodiment, the present disclosure relates to an information processing method, the method including: when the user control part is not in contact with the touch pad, determining a moving direction of the user control part relative to the touch pad. The method also includes determining whether the user control is within a threshold distance from the touchpad in a direction perpendicular to the touchpad. The method also includes altering the first display object such that the altered first display object appears to be moving perpendicular to the touchpad when the user control is determined to be moving within a threshold distance and in a direction parallel to the touchpad. Orientation to move the widget closer to the user control. wherein the proximity of the user control to the first area of the touchpad in a direction perpendicular to the touchpad is detected, and upon detection of the proximity of the user control to the first area in a direction perpendicular to the touchpad, a signal is generated to The first display object moves from the second area to the first area of the touchpad. Setting a predetermined position on the display area of the touchpad as a reference position, and defining an interval in which the user control part is separated from the reference position by a preset distance as a third area, and detecting that the user control part moves within the third area of the touch pad a predetermined distance and detecting movement of the user control member a predetermined distance outside the third zone, and generating a signal to move the first display object by the first object response distance upon detection of movement of the predetermined distance within the third zone, and upon detecting movement of the predetermined distance within the third zone, and A signal is generated to move the first displayed object by a second object-responsive distance when moved a predetermined distance outside the third zone, the first object-responsive distance being different than the second object-responsive distance.

In yet another embodiment, the present disclosure relates to a tangibly embodied, non-transitory computer-readable medium storing instructions that, when executed by a processor, perform a method that includes processing when a user control is not in contact with a touch When the pad is in contact, determines the direction of movement of the user control relative to the touch pad. The method also includes determining whether the user control is within a threshold distance of the touchpad, and when the user control is determined to be moving in a predetermined direction and within the threshold distance, altering the first display object such that the altered first display object looks Up to move the widget closer to the user controls.

As described above, according to the present disclosure, it is possible to provide an information processing apparatus, an information processing method, and a computer program capable of reducing the user's operation load by changing the display position of an object to be operated according to the position of the operation object.

Description of drawings

FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing device according to an embodiment of the present disclosure;

FIG. 2 is a diagram of assistance in explaining an example of a hardware configuration of an information processing apparatus according to the embodiment of FIG. 1;

FIG. 3 is a diagram of assistance in explaining the distribution of operation load when operation input is performed with one hand;

4 is a diagram of assistance in explaining an overview of object display position control by the information processing apparatus according to the embodiment of FIG. 1;

FIG. 5 is a block diagram showing a functional configuration of an information processing apparatus according to the embodiment of FIG. 1;

6 is a flow chart of object display position control processing performed by the information processing device according to the embodiment of FIG. 1;

FIG. 7 is a diagram of assistance in explaining display position changes made to object groups and objects;

8 is a diagram of assistance in explaining an example of control of a display position of an object group by the information processing apparatus according to the embodiment of FIG. 1;

FIG. 9 is a graph showing an example of the relationship between the movement amount of a finger and the movement amount of an object group;

10 is a graph showing another example of the relationship between the movement amount of a finger and the movement amount of an object group;

FIG. 11 is a diagram of assistance in explaining that a reference position is set in consideration of an operation load on a device;

12 is a diagram of assistance in explaining the relationship between the width of an object group and the movement range of a finger;

FIG. 13 is a diagram of assistance in explaining contact position correction processing; and

FIG. 14 is a diagram of assistance in explaining an example of displaying an object group including a plurality of objects.

detailed description

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Incidentally, in this specification and the drawings, constituent elements that have substantially the same functional configuration are identified by the same reference numerals, and repeated explanation of these constituent elements is omitted.

Description will be given in the following order: 1. Overview of information processing apparatus, 2. Functional configuration of information processing apparatus, 3. Object display position control processing.

1. Overview of Information Processing Devices

A device according to an embodiment of the present invention includes: a first detection unit configured to determine whether the user control member is within a first threshold distance of the touchpad; a second detection unit configured to detect when the user control member is not in contact with the touchpad , determining the direction of movement of the user control member relative to the touchpad; and a display control unit configured to, when the user control member is determined to be moving within a threshold distance and in a predetermined direction, generate a signal to change the first display object such that the The changed first display object appears to move closer to the user control member.

The device may further include: a contact sensor configured to detect when the user control member is in contact with the touchpad; wherein the display control unit is further configured to generate a signal to select the second display object when the user control member is in contact with the touchpad.

Wherein the changed first display object and the selected second display object are the same object.

Wherein at least one of the first detection unit and the second detection unit or the contact sensor comprises a capacitive sensor.

The device may further include a third detecting unit configured to detect horizontal movement of the user control member relative to the touch panel when the user control member is not in contact with the touch panel.

Wherein the display control unit is further configured to generate a signal to move the changed first display object in response to the detected horizontal movement.

The device may include: a combined detection unit for performing the functions of the first detection unit, the second detection unit and the third detection unit.

Wherein the display control unit is further configured to generate a signal to move the changed first display object only if the detected horizontal movement is detected to occur within less than a second threshold distance.

Wherein, the first detection unit is further configured to detect the proximity of the user control member to the first area of the touch panel, and the display control unit is further configured to generate a signal to display the proximity of the user control member to the first area when detecting the proximity of the user control member to the first area. A display object is moved from the second area of the touchpad to the first area.

Wherein, the first detection unit is further configured to detect that the user control member moves a predetermined distance within the third area of the touch panel and detects that the user control member moves a predetermined distance outside the third area, and the display control unit is further configured to A signal is generated to move the first display object by the first object response distance upon detection of movement within the third zone by a predetermined distance, and the display control unit is further configured to generate a signal upon detection of movement of the predetermined distance outside of the third zone To move the first display object by the second object response distance, the first object response distance is different from the second object response distance.

Wherein, the first object response distance has a first relationship with the predetermined distance, the second object response distance has a second relationship with the predetermined distance, and the first relationship and the second relationship are linear.

Wherein the slope of the linear relationship between the response distance of the first object and the predetermined distance is greater than the slope of the linear relationship between the response distance of the second object and the predetermined distance.

Wherein, the display control unit is further configured to generate a signal to display the third display object and the fourth display object, the first detection unit is further configured to detect the proximity of the user control member to the third display object and the fourth display object, and the display control The unit is further configured to change the virtual distance between the third object and the user control member from a first virtual distance to a second virtual distance when the user control member is detected to be in proximity to the third object, and to change the virtual distance between the third object and the user control member from a first virtual distance to a second virtual distance when the user control member is detected When approaching the fourth object, changing the virtual distance between the fourth object and the user control member from the first virtual distance to a second virtual distance and changing the virtual distance between the third object and the user control member from the second virtual distance Change to the first virtual distance.

Wherein the first virtual distance is greater than the second virtual distance.

Wherein the first virtual distance and the second virtual distance are different at least in a direction perpendicular to the touchpad.

Wherein the display control unit is further configured to change the first virtual distance and the second virtual distance by changing the appearance of the third object and the fourth object between the first size and the second size.

Wherein the second size is greater than the first size.

The first detection unit is further configured to detect the movement of the user control member from the first position to the second position and the movement speed from the first position to the second position, and the display control unit is further configured to change the The first display object corresponding to the first location.

A method according to an embodiment of the present invention includes: when the user control is not in contact with the touchpad, determining the direction of movement of the user control relative to the touchpad; determining whether the user control is within a threshold distance of the touchpad; When the part is determined to be moving in the predetermined direction and within the threshold distance, the first display object is altered such that the altered first display object appears to move closer to the user-controlling part.

Example hardware configuration

First, an example of a hardware configuration of an information processing apparatus according to an embodiment of the present disclosure will be described with reference to FIGS. 1 and 2 . Incidentally, FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing apparatus 100 according to the present embodiment. FIG. 2 is a diagram of assistance in explaining an example of the hardware configuration of the information processing apparatus 100 according to the present embodiment.

The information processing device 100 according to the present embodiment is a device including a detection unit capable of detecting a contact position (for example, via a touch sensor) of an operation object (that is, a user control member) on the display surface of the display device and capable of An approach distance between a display surface of the display device and an operation object located above the display surface is detected. For example, various devices including devices with small display devices such as portable information terminals and smartphones can be regarded as the information processing device 100 regardless of their functions.

As shown in FIG. 1 , an information processing device 100 according to the present embodiment includes a CPU 101, a RAM (Random Access Memory) 102, a nonvolatile memory 103, a display device 104, and a proximity touch sensor 105 that can Includes contact sensors or works in combination with contact sensors.

As described above, the CPU 101 functions as an arithmetic processing unit and a control device, and generally controls operations within the information processing device 100 according to various programs. CPU 101 may also be a microprocessor. The RAM 102 temporarily stores programs used in the execution of the CPU 101 , parameters appropriately changed in the execution of the CPU 101 , and the like. These sections are interconnected by a host bus formed of a CPU bus or the like. The nonvolatile memory 103 stores programs used by the CPU 101, operating parameters, and the like. For example, a ROM (Read Only Memory) or a flash memory can be used as the nonvolatile memory 103 .

The display device 104 is an example of an output device for outputting information. For example, a liquid crystal display (LCD) device or an OLED (Organic Light Emitting Diode) device may be used as the display device 104 . The proximity touch sensor 105 is an example of an input device for a user to input information. The proximity touch sensor 105 includes, for example, an input device for inputting information and an input control circuit for generating an input signal based on a user's input and outputting the input signal to the CPU 101 .

In the information processing device 100 according to the present embodiment, as shown in FIG. 2 , the proximity touch sensor 105 is provided in an exemplary state of being laminated to the display surface of the display device 104 . Thus, when a user brings a user control component (eg, finger, stylus, or other appendage) or the like close to the display surface, the proximity touch sensor 105 can detect the distance from the display surface to the component.

The concept of changing the display position of GUI (Graphical User Interface)

When a user operates a GUI such as an object displayed in a display area (or region), the information processing device 100 according to the present embodiment dynamically changes the display position of the GUI according to the movement of a finger to facilitate the user's operation. For example, as shown in FIG. 3 , when the information processing device 100 is held by one hand, the GUI displayed in the display area 200 is operated by the thumb of the hand holding the information processing device 100 , at the movable position corresponding to the thumb. This operation is easy to perform in the area of the range (low load area) 200B. However, in the area 200A separated from the thumb on the opposite side of the hand and the edge 200C (high load area) on the side where the hand is held, the thumb is not easy to move and the operation is difficult.

Thus, when a predetermined position on the display area (or zone) is set as the origin (reference position) and the thumb is stretched from the origin to the opposite side of the held hand, the information processing apparatus 100 according to the present embodiment displays the GUI as The GUI is close to the side of the clasped hand and close to the extended thumb. In addition, when the thumb moves from the origin to the side of the gripped hand (i.e., the edge of the side of the gripped hand), the display position of the GUI is controlled so that the GUI appears close to the opposite side of the gripped hand and close to the thumb .

For example, as shown in FIG. 4 , it is assumed that an object group 210 including a plurality of objects 212 is displayed in the display area 200 . As shown in FIG. 4 , objects 212 are arranged and displayed in the form of a grid, for example, on an xy plane. First, as shown in state (A), for example, when a finger is placed in the proximity side area separated from the display surface by a predetermined distance, an object 212a (for example, a display object) located at a position closest to the position of the finger is displayed as It is located at a forward position (display surface side) in the depth direction (z direction). At this time, the objects 212 other than the object 212a closest to the finger may be displayed as sinking in the depth direction to increase the separation distance from the finger.

Next, when the finger moves in the positive x-axis direction from the position in state (A), the information processing apparatus 100 determines that the user will operate an object located on the positive x-axis side of the object 212a, and moves the object group 210 to the finger The opposite side of the direction of movement (moving the object response distance in the negative direction of the x-axis). Thereby, the object 212 that the user wants to operate comes close to the finger, so that the user can operate the desired object without greatly moving the finger. At this time, the position in the depth direction of each object 212 forming the object group 210 is also changed due to the movement of the finger and the object group 210 . For example, when the object 212 closest to the finger is changed from the object 212a to the object 212b, the object 212b is displayed as being located at the most forward position. Objects 212 other than object 212b are shown sinking in the depth direction to increase the separation distance from the finger.

Furthermore, when the finger moves in the positive direction of the x-axis from the position in the state (B), the object group 210 is further moved in the negative direction of the x-axis, as shown in the state (C). Then, when the object 212 closest to the finger is changed from the object 212b to the object 212c, the object 212c is displayed at the most forward position. Objects 212 other than object 212c are shown sinking in the depth direction to increase the separation distance from the finger.

Thereafter, when the user brings a finger into contact with the object 212c to be operated, the user can execute a function associated with the object 212c. In this way, the information processing apparatus 100 according to the present embodiment can dynamically move the object 212 according to the movement of the user's finger to enhance operability, and also shows the object being focused on in an easily visually recognizable manner. Next, controlling the position of the object 212 by such an information processing apparatus 100 will be specifically described.

2. Functional configuration of the information processing device

First, the functional configuration of the information processing apparatus 100 according to the present embodiment will be described with reference to FIG. 5 . FIG. 5 is a block diagram showing the functional configuration of the information processing apparatus 100 according to the present embodiment.

As shown in FIG. 4 , the information processing device 100 according to the present embodiment includes an input display section 110 , a position information obtaining section 120 , a display control section 130 , an execution processing section 140 , and a setting storage section 150 .

The input display section 110 is a functional component for displaying information and allowing information to be input. The input display section 110 includes a detection unit 112 and a display unit 114 . The detection unit 112 corresponds to the proximity touch sensor 105 in FIG. 1 . For example, a capacitive touch panel may be used for the detection unit 112 . However, any suitable technique may be used in conjunction with detection unit 212 . For example, the detection unit 212 may detect the approach between the operation object and the display surface of the display unit 114 using optical or other techniques. In the case of an example, the detection unit 112 detects a capacitance value that changes according to the approach distance between the operation object and the display surface of the display unit 114 .

When the operation object approaches the display surface by a predetermined distance or closer, the capacitance detected by the detection unit 112 increases. The capacitance further increases as the operating object moves closer to the display surface. Then, when the operation object touches the display surface, the capacitance detected by the detection unit 112 becomes maximum. Based on the capacitance value detected by such detection unit 112 , the position information obtaining section 120 to be described later can obtain position information of the operation object with respect to the display surface of the display unit 114 . The detection unit 112 outputs the detected capacitance value to the position information obtaining unit 120 as a detection result.

The display unit 114 is an output device for displaying information, which corresponds to the display device 104 in FIG. 1 . The display unit 114 displays, for example, a GUI object, content associated with the object, and the like. Furthermore, when the display control section 130 has changed the display form of the object, the display unit 114 displays the object after the change based on the object display change information notified from the display control section 130 .

The position information obtaining section 120 obtains position information indicating a positional relationship between the operation object and the display surface of the display unit 114 based on the detection result input from the detection unit 112 . The location information obtaining section may obtain location information based on any suitable data type (eg capacitive data or optical data). As described above, the higher the value of the capacitance detected by the detection unit 112 becomes, the closer the operation object becomes to the display surface, and the value of the capacitance becomes maximum when the operation object touches the display surface. The correspondence relationship between the capacitance value and the proximity distance (or the proximity-sensing side area) is pre-stored in the setting storage unit 150 which will be described below. Referring to the setting storage section 150 , the position information obtaining section 120 obtains the position of the finger in the vertical direction (for example, z direction) relative to the display surface based on the value of capacitance input from the detection unit 112 .

Furthermore, the position information obtaining section 120 recognizes the position of the operation object on the display surface of the display unit 114 (for example, on the xy plane) based on the detection result input from the detection unit 112 . For example, assume that the detection unit 112 is formed of a capacitive sensor substrate in which a capacitive detection grid for detecting x-coordinates and y-coordinates is formed. In this case, the detection unit 112 may identify the position of the operation object on the substrate (for example, on the display surface) according to the change in the capacitance of each grid cell in response to the contact of the operation object. For example, the coordinate location of the location of the highest capacitance may be identified as the coordinate of the location where the finger is closer to the display surface. Alternatively, the center-of-gravity position of an area where a capacitance of a predetermined value or higher is detected may be set as coordinates of a position where the finger is closer to the display surface.

The position information obtaining section 120 can thereby obtain position information on the display surface of the display unit 114 . The obtained operation target position information is output to the display control unit 130 and the execution processing unit 140 .

The display control section 130 controls the display position of the object displayed on the display unit 114 based on the position information obtained by the position information obtaining section 120 . As described above with reference to FIGS. 3 and 4 , the display control section 130 controls the display position of the object 212 according to the movement of the user's finger so that the user easily operates the object 212 displayed on the display unit 114 . When the display control section 130 has determined a change in the display position of the object 212 , the display control section 130 generates an image of the object after the change, and outputs the image to the display unit 114 . Furthermore, the display control section 130 performs display control to change the object 212 displayed at the contact position of the finger in response to an instruction of the execution processing section 140 to be described below. Details of this object display position correction processing will be described below.

In response to a predetermined operation input to the information processing apparatus 100 , the execution processing section 140 executes a function associated with the operation input. For example, when the detection unit 112 senses that the user has brought the finger into contact with the specific object 212 displayed on the display unit 114 , the execution processing section 140 recognizes that the finger has come into contact with the object 212 based on the position information input from the position information obtaining section 120 . Then, the execution processing unit 140 recognizes the object 212 that the finger has touched, and executes the function associated with the object 212 . Incidentally, the selected object 212 may change according to the moving speed of the finger selecting the object 212 . Details of the object display position correction processing will be described later.

The setting storage section 150 stores information used when calculating the proximity distance between the operation object and the display surface, information used when generating position information on the position of the operation object on the display surface, and other information used at the time of object display position control processing. information as setting information. For example, the storage unit 150 is set to store a corresponding relationship between the value of the capacitor and the approach distance. The position information obtaining unit 120 can obtain the position corresponding to the capacitance value input from the detection unit 112 with reference to such a correspondence relationship. Furthermore, the setting storage section 150 stores processing contents (functions) to be executed corresponding to operation inputs performed by the user on the object 212 . The setting storage section 150 also stores the moving speed (threshold value) of the finger used to start the object display position correction process. The setting information stored in the setting storage unit 150 may be stored in advance, or may be set by the user.

The information processing apparatus 100 according to the present embodiment may include, for example, a memory for temporarily storing information required in object display position control processing and the like.

3. Object display position control processing

The information processing apparatus 100 according to the present embodiment can detect the movement of a finger on the display surface by having the functions described above. Then, using these pieces of information, the information processing apparatus 100 controls the display position of the object 212 displayed on the display unit 114 according to the movement of the finger, whereby operability can be improved. Object display position control processing by the information processing apparatus 100 according to the present embodiment will be described below with reference to FIGS. 6-13 .

FIG. 6 is a flowchart of object display position control processing performed by the information processing apparatus 100 according to the present embodiment. FIG. 7 is a diagram of assistance in explaining display position changes made to the object group 210 and the object 212 . FIG. 8 is a diagram of assistance in explaining an example of the control of the display position of the object group by the information processing apparatus 100 according to the present embodiment. 9 and 10 are graphs showing exemplary relationships between the amount of movement of a finger in two different areas of the touchpad and the amount of movement of an object group. FIG. 11 is a diagram of assistance in explaining setting of a reference position in consideration of an operation load on the device. FIG. 12 is a diagram of assistance in explaining the relationship between the width of the object group 210 and the movement range of the finger. FIG. 13 is a diagram of assistance in explaining contact position correction processing.

S100: Determination of processing start conditions

As shown in FIG. 6 , the information processing apparatus 100 first determines whether the condition for starting the process of controlling the display position of the object 212 is satisfied ( S100 ). Conditions for starting the process of controlling the display position of the object 212 can be appropriately set. For example, the fact that a finger is positioned within the proximity-sensing side area or the predetermined time has elapsed since the finger is positioned within the proximity-sensing side area may be a condition for starting the process of controlling the display position of the object 212 . Also, for example, in the case where an on-screen keyboard formed by arranging a plurality of keys is displayed on the display unit 114, a process of controlling the display position of the object 212 such as a key may be performed when key input is performed.

When the operation for selecting the operation input of the object 212 displayed on the display unit 114 is started, the information processing apparatus 100 determines that the condition for starting the process for controlling the display position of the object 212 is satisfied, and starts the process of step S110 . On the other hand, when an operation as a condition for starting the processing is not detected in step S100, the processing of step S100 is repeated until an operation is detected.

S110: Object display position control

When the process of controlling the display position of the object 212 starts, the display position of the object 212 is changed and moved according to the approach position of the finger with respect to the display surface (S110). As a result of the display position of the object 212 being controlled, for example, as shown in FIG. 7 , a change in the position of the object group 210 and a change in the position of each object 212 in the depth direction occur.

Control of the display position of the object group

First, the display control unit 130 moves the object group 210 on the xy plane in a direction opposite to the moving direction of the finger. Thereby, the object group 210 is moved so as to meet the moving finger and make it possible for the finger to come into contact with the desired object 212 with a small movement of the finger. This is especially effective in the case where operation input is performed with one hand, and the number of objects 212 that can be touched by the fingers of the held hand can be increased compared to the conventional case.

Describing the movement of the object group 210 more specifically, as shown in the state (A) of FIG. 8 , a reference position o(0, 0) is set to the object group 210 . Based on this reference position, the distance df from the reference position o to the finger and the distance dc from the reference position o to the center P of the object group are defined. The reference position o may be, for example, the position where the user puts the finger on the object group 210 for the first time or a preset position. Furthermore, as will be described later, the reference position o may be set in relation to an area of low operation load for the user.

Next, as in the state (B) of FIG. 8 , when the user moves the finger in the positive x-axis direction, the object group 210 moves in the negative x-axis direction. At this time, the movement amount df of the finger and the movement amount dc of the object group 210 may be set, for example, as shown in FIG. 9 . The movement amount (df) of the finger and the movement amount (dc) of the object group 210 have a linear relationship with each other. When the finger moves in the positive direction, the object group 210 moves in the negative direction. Conversely, when the finger moves in the negative direction, the object group 210 moves in the positive direction. Furthermore, setting a limit (subject movement amount limit value) for the movement of the subject group 210 makes it possible to prevent the subject group 210 from having a portion exceeding the frame. Thus, even when the finger moves a predetermined distance or more from the reference position 0, the object group 210 does not move beyond the object movement amount limit value.

The movement amount (df) of the finger and the movement amount (dc) of the object group 210 may also be set, for example, as shown in FIG. 10 . In FIG. 10 , a dead zone is set with the reference position o as the center. In the section where the finger is separated from the reference position o (dead zone) by a predetermined distance, the movement amount of the object group 210 is smaller than that of the finger compared to the case of FIG. 9 , that is, the weight of the movement amount of the object group 210 is The setting is small. In this way, in the dead zone, the object group 210 reacts only slightly even when the finger moves. By setting the dead zone, it is possible to prevent the desired object 212 from passing the position of the finger when the group of objects 210 greatly moves according to the movement of the finger around the reference position o. Incidentally, also in the case of FIG. 10 as in FIG. 9 , an object movement amount limit value can be set so that the object group 210 can be prevented from having a portion exceeding the frame.

9 and 10 exemplarily show the relationship between the movement amount (df) of the finger and the movement amount (dc) of the object group 210, and the present disclosure is not limited to such an example. For example, the relationship between the movement amount (df) of the finger and the movement amount (dc) of the object group 210 need not be a linear relationship, but may be set such that the movement amount (dc) of the object group 210 increases with the movement amount (df) of the finger. ) increases exponentially.

Object display position control

Furthermore, the display control section 130 moves the objects 212 in the z direction according to the degree of proximity of each object 212 to the finger. Specifically, as shown in FIG. 7 , an object 212 at a position closer to the finger (e.g., a virtual distance) is displayed on a more forward side, thereby increasing the response to the approach of the finger (i.e., reducing the distance between the finger and the object). 212), while the object 212 at a position farther from the finger is displayed on the further back side, thereby reducing the response to the approach of the finger. Thus, the focused object 212 can be presented to the user in an easily recognizable manner. The moving distance Z(index) of the object 212 in the z direction may be defined, for example, in Equation 1 below.

Z(index)=fz(d(focus_index, index))...(equation 1)

Index represents a unique number for identifying each object 212, and d(focus_index, index) represents the distance between the object 212 currently being focused on and another object 212. The depth function fz shown in Equation 1 may be set such that an object 212 closer to the focused object 212 is displayed at a more forward position.

In addition, the object 212 can also change in size according to the positional relationship with the finger. For example, objects 212 at positions closer to the finger increase in size, while objects 212 at positions farther from the finger decrease in size. By setting the size of the object 212 in this way, the response to the approach of the finger can be expressed, and the object 212 is prevented from falling outside the display area, that is, when the object group 210 is moved to approach the edge portion of the display area 200, the object 212 is prevented from going out of the frame outside.

Specifically, the size Size(index) of the object 212 may be defined as in Equation 2 below, for example. The area function fs shown in Equation 2 is basically set such that an object 212 closer to the focused object 212 is displayed in a larger size.

Size(index)=fs(d(focus_index, index))...(equation 2)

Relationship between the control of the display position of the object group and the object and the operation load

The movement of the object group 210 and each object 212 according to the movement of the finger has been described above with reference to FIGS. 7-10 . However, it is desirable to determine the reference position o for the movement of the object group 210 according to the operation load as shown in FIG. 3 and the distance between the movement amount of the finger and the movement amount of the object group 210 as shown in FIGS. Relationship. As shown in the left diagram of FIG. 11 , the display area 200 of the information processing apparatus 100 can be divided into high-burden areas 200A and 200C and a low-burden area 200B according to the state in which the user performs operation input. In this case, the display control section 130 moves the object group 210 so that the object group 210 can be operated within the low-load area 200B in the display area 200 , whereby operability can be improved.

Specifically, as shown in the right diagram of FIG. 11 , for example, the reference position o is set at the center of the low-burden area 200B in the display area 200 of the information processing device 100 . Then, the relationship between the movement amount of the finger and the movement amount of the object group 210 is set so that all the objects 212 of the object group 210 can be touched by the movement of the finger within the low-burden area 200B. Based on the shape of the device and the arrangement of hands and fingers when operating the device, considering an area that is easy to operate for the user can be achieved by setting, for example, the relationship between the reference position o, the movement amount of the finger, and the movement amount of the object group 210, etc. Device with low operating burden.

By setting each parameter in this way, as shown in FIG. 12 , the finger movement range can be made smaller than the width of the object group 210, and the finger movement range can be contained in an area of low operation load. In this way, when the user intends to operate the object 212 located at the right edge with respect to the reference position o and moves the finger in the right direction, position control is performed so that the object group 210 moves in the left direction so that the object 212 at the right edge 212 can be touched in a low burden area. On the other hand, when the user moves the finger in the left direction intending to operate the object 212 located at the left edge with respect to the reference position o, position control is performed so that the object group 210 moves in the right direction so that the object group 210 at the left edge The object 212 can be touched within the low burden area.

S120: Determine the presence or absence of finger contact with the display surface

Returning to the description of FIG. 6, when controlling the display positions of the object group 210 and the object 212 according to the movement of the finger in step S110, the execution processing section 140 determines whether the finger has touched the display surface based on the position information (S120). The execution processing unit 140 executes a function associated with the object 212 touched by the finger. For this, the execution processing part 140 determines whether the user has brought a finger into contact with the display surface to select the object 212 in the object group 210 according to the position information. The processing of step S110 and step S120 is repeated until the finger touches the display surface.

S130: Determination of possible contact position correction

Next, when the execution processing part 140 determines that the finger has touched the display surface, the execution processing part 140 obtains the movement speed of the finger when it touches the display surface based on the position information, and determines whether the movement speed is greater than a predetermined speed (S130). The information processing apparatus 100 according to the present embodiment improves operability by recognizing the object 212 that the user wants to operate more accurately. In this case, when the moving speed of the finger is high, it is difficult for the user to accurately contact the finger to the object 212 to be operated, and the possibility of occurrence of erroneous operation increases.

Thus, in step S130, the moving speed of the finger is obtained, it is determined whether the obtained moving speed of the finger is higher than a predetermined speed, and thus it is determined whether it is necessary to correct the object 212 selected by bringing the finger into contact with the display surface. Specifically, when the moving speed of the finger is higher than a predetermined speed, the information processing apparatus 100 determines that there is a strong possibility of erroneous operation, determines the object 212 to be operated by correcting the selected object 212, and changes the display position of the object 212.

Incidentally, when the approach distance between the display surface and the finger in the direction perpendicular to the display surface of the display unit 114 can be obtained, the movement speed of the finger can be obtained by time differentiation of the approach distance. Furthermore, when the proximity distance between the display surface and the finger in the direction perpendicular to the display surface of the display unit 114 cannot be obtained, the execution processing section 140 may measure the time it takes for the finger to detect a predetermined proximity state to touch the display surface. Get the movement speed of this finger. Specifically, the execution processing section 140 may obtain the moving speed of the finger by dividing the distance d from the display surface to the position where the proximity state is detected by the time it takes for the finger to touch the display surface.

S140: Execute processing corresponding to the selected object

Assume that, as shown in FIG. 13 , for example, a finger moves obliquely from a position above the display surface to the display surface, touches the display surface, and touches a specific object 212 . At this time, when the moving speed of the finger is equal to or less than a predetermined speed, it is considered that the user makes contact with the finger while confirming the position of the object 212 to be operated (for example, object 212(b)). Thus, in this case, the execution processing unit 140 executes the function associated with the object 212(b) touched by the finger (S140).

S150: Contact position correction processing

On the other hand, when the moving speed of the finger is greater than the predetermined speed, the user may have touched the finger without confirming the position of the object 212 to be operated, and the finger may have touched the wrong object 212 . Thus, the execution processing section 140 causes the setting storage section 150 to correct the display position of the object group 210 so that the object 212 that was focused before the finger touches the display surface is selected (S150).

The history of the object of interest 212 is stored in memory (not shown). The execution processing unit 140 specifies the object 212 to be selected by looking up the history. For example, an object that was focused on just before the finger moved at a predetermined speed or higher may be set as the object to be selected by correction 212 .

By determining the object 212 to be selected after correction, the execution processing section 140 causes the display control section 130 to move the object group 210 so that the object 212 in question is located at the position touched by the finger. Assume, for example, that in the example shown in FIG. 13, the object 212(a) is determined as the object to be selected after correction. At this time, when the object 212(b) is displayed at the position touched by the finger, the display control section 130 moves the object group 210, and performs correction so that the object 212(a) is located at the position touched by the finger. In this way, the object 212 considered to be selected by the user is set in a selection state that can be visually detected, whereby the user can perform operation input without any sense of incongruity. Then, the execution processing section 140 executes a function associated with the corrected object 212(a) to be selected (S140).

The object display position control processing performed by the information processing apparatus 100 according to the present embodiment has been described above. Such object display position control processing changes the display position of the object group 210 and the objects 212 forming the object group 210 according to the movement of the finger in the proximity state, so that the user can easily predict possible phenomena before operating the object 212 . Furthermore, the above-described processing displays the object 212 such that the object 212 approaches the finger in the proximity state. In this way, even when an operation is performed with one hand, the object 212 to be operated can be easily selected.

Furthermore, by changing the position of the object 212 in the depth direction according to the position of the finger in the approaching state, it is easy to visually recognize the object 212 that has received attention. Furthermore, by setting the limit value of the movement amount of the object group 210 and changing the size of the object 212 based on the relationship with the position of the finger in the proximity state, the object group 210 can be prevented from extending beyond the display area 200 . Thereby, degradation of bird's-eye view characteristics can be prevented.

Although the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the present disclosure is not limited to such examples. For those of ordinary skill in the art, various changes or modified examples may occur within the scope of the technical concept described in the claims, and it is naturally understood that these examples all fall within the technical scope of the present disclosure.

For example, although the object group 210 is arranged in a grid form in the foregoing embodiments, the present disclosure is not limited to such an example. For example, as shown in FIG. 14 , there may be an object group formed by arranging objects 312 in a circular form. In this case as well, as in the foregoing embodiments, the display position of the object group 310 and the display position of the object 312 in the depth direction are changed according to the position of the finger in the proximity state. In the case of arranging the objects 312 in a circular form as shown in FIG. 14 , for example, the display position of the objects 312 can be changed by rotating the objects 312 so that the objects 312 approach the fingers in the direction of arrangement.

The present disclosure contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2010-199639 filed in the Japan Patent Office on Sep. 7, 2010, the entire content of which is hereby incorporated by reference.

Claims (16)

1. a messaging device, including:

First detector unit, is configured to determine user and controls parts on the direction being perpendicular to touch pad Whether in the first threshold away from described touch pad apart from interior；

Second detector unit, is configured to not contact with described touch pad when described user controls parts Time, determine that described user controls the parts moving direction relative to described touch pad；And

Display control unit, is configured to be confirmed as the most described first when described user controls parts In threshold distance and when the side being parallel to described touch pad moves up, generate signal to change the One display object makes the first altered display object seem in the side being perpendicular to described touch pad It is moved upwards up to control parts closer to described user,

Wherein, described first detector unit is further configured to detect described user and controls parts and hanging down Straight close with the firstth district of described touch pad on the direction of described touch pad,

Described display control unit is further configured to detecting that described user controls parts and hanging down Straight on the direction of described touch pad with described firstth district close to time, generate signal to show described first Show that object moves to described firstth district from the secondth district of described touch pad,

Wherein, the precalculated position on the viewing area of described touch pad is set to reference position, and Described user controlled parts separate the section definition of the distance pre-set with described reference position be 3rd district,

Described first detector unit is further configured to detect described user and controls parts described tactile Mobile preset distance and detect described user and control parts described within described 3rd district of template Mobile described preset distance outside 3rd district, and

Described display control unit is further configured to move within described 3rd district detecting During described preset distance, generation signal is to move the first object response distance by described first display object, And described display control unit is further configured to move outside described 3rd district detecting During described preset distance, generation signal is to move the second object response distance by described first display object, Described first object response distance responds apart from different from described second object.

Equipment the most according to claim 1, also includes:

Touch sensor, is configured to detect described user and controls when parts connect with described touch pad Touch；Wherein

Described display control unit is further configured to when described user controls parts and described touch During plate contact, generate signal to select the second display object.

Equipment the most according to claim 2, the most altered first display object and selected The second display selected is to liking same target.

Equipment the most according to claim 2, wherein said first detector unit and described second At least one or described touch sensor in detector unit include capacitive sensor.

Equipment the most according to claim 1, also includes:

3rd detector unit, is configured to not contact with described touch pad when described user controls parts Time, detection user controls component parallel moving horizontally in described touch pad.

Equipment the most according to claim 5, including:

Combine detection unit, is used for performing described first detector unit, described second detector unit and institute State the function of the 3rd detector unit.

Equipment the most according to claim 5, wherein said display control unit is joined further It is set to only when detected moving horizontally is detected as when less than Second Threshold apart from interior generation, raw Become signal with mobile the first altered display object.

Equipment the most according to claim 1, wherein,

Described first object response distance has the first relation with described preset distance,

Described second object response distance has the second relation with described preset distance, and

Described first relation and described second relation are linear.

Equipment the most according to claim 8, wherein said first object response distance is with described The slope of the linear relationship between preset distance is predetermined with described more than described second object response distance The slope of the linear relationship between Ju Li.

Equipment the most according to claim 1, wherein,

Described display control unit be further configured to generate signal with display the 3rd display object and 4th display object,

Described first detector unit is further configured to detect described user and controls parts and described the Three display objects and the 4th show the close of object,

Described display control unit is further configured to detecting that described user controls parts and institute State the 3rd display object close to time, by described 3rd display object and described user control between parts Pseudo range changes into the second pseudo range from the first pseudo range, and is detecting that described user is controlled Parts processed with described 4th display object close to time, will described 4th display object and described user control Pseudo range between parts is changed into described second pseudo range from described first pseudo range and incites somebody to action Described 3rd display object and described user control the described pseudo range between parts from described second Pseudo range changes into described first pseudo range.

11. equipment according to claim 10, wherein said first pseudo range is more than described Second pseudo range.

12. equipment according to claim 10, wherein said first pseudo range and described Two pseudo ranges are at least different on the direction being perpendicular to described touch pad.

13. equipment according to claim 10, wherein said display control unit further by It is configured through changing described 3rd display object and described the between first size and the second size The outward appearance of four display objects changes described first pseudo range and described second pseudo range.

14. equipment according to claim 13, wherein said second size is more than described first Size.

15. equipment according to claim 1, wherein,

Described first detector unit is further configured to detect described user and controls parts from first Put the movement of the second position and from described primary importance to the translational speed of the described second position, with And

Described display control unit is further configured to when described translational speed is less than threshold value change The first display object corresponding with described primary importance.

16. 1 kinds of information processing methods, including:

When user control parts do not contact with touch pad time, determine that described user controls parts relative to institute State the moving direction of touch pad；

Determine that whether described user controls parts on the direction being perpendicular to described touch pad away from described In the threshold distance of touch pad；And

When described user controls in parts are confirmed as the most described threshold distance and being parallel to State the side of touch pad when moving up, change the first display object and make the first altered display object Seem that moving closer to described user on the direction being perpendicular to described touch pad controls parts,

Wherein, detect described user control parts on the direction being perpendicular to described touch pad with described touch Firstth district of template close,

Detecting that described user controls parts on the direction being perpendicular to described touch pad with described One district close to time, generate signal with by described first display object move from the secondth district of described touch pad To described firstth district,

Wherein, the precalculated position on the viewing area of described touch pad is set to reference position, and Described user controlled parts separate the section definition of the distance pre-set with described reference position be 3rd district,

Detect described user and control parts mobile pre-spacing within described 3rd district of described touch pad From and detect described user and control parts mobile described preset distance outside described 3rd district, and

Signal is generated with by described when mobile described preset distance within described 3rd district being detected First display object moves the first object response distance, and moves outside described 3rd district detecting Generate during dynamic described preset distance signal with described first display object is moved the second object response away from From, described first object response distance responds apart from different from described second object.