JP5520918B2 - Touch panel operation method and program - Google Patents

Description

  The present invention relates to a touch panel operation method and a program.

  In recent years, touch panel devices have been widely used in mobile phones, PCs (Personal Computers), electronic books, and the like. The user operates the touch panel using a finger or a stylus pen.

By the way, since the touch panel is operated by touching a finger or the like, the following operational problems have been pointed out.
(1) Difficult to touch corners and edges
(2) The touched position is hidden by your finger
(3) I don't know if the touch was recognized
In order to improve the operability, various modes have been disclosed for an icon (pointer) display method for displaying the touch position when touched (see, for example, Patent Documents 1, 2, and 3).

JP 2010-102474 A Japanese Patent Laid-Open No. 6-202776 Special table 2008-508629

  However, operating a touch panel using a finger or a stylus pen requires a time-consuming operation as compared with, for example, operating using a mouse device having left and right buttons. For example, when performing an operation on the touch panel, such as selecting a character by left-clicking the mouse device, dragging, displaying a menu by right-clicking, and selecting a function such as copy or paste, multiple touch operations Is required. However, there is no disclosure of a technique that can easily perform operations such as character selection, dragging, and menu display on a touch panel like a mouse device.

  This invention is made in view of the situation which concerns, Comprising: It aims at providing the touchscreen operation method and program which can perform operation easily on a touchscreen.

The present invention for solving the above-described problems includes a display panel, a substantially transparent cover panel disposed on the front surface of the display panel, and a detection unit that detects coordinates and contact pressure of the cover panel surface in contact with an object. In the operation method of the touch panel, the contact pressure on the cover panel surface is divided into a plurality of sections, a function for operating the touch panel is set in each section, the coordinates of the cover panel surface and the contact and detection knowledge and pressure, based on the coordinates and the contact pressure of the cover panel surface detected, the operating image for executing the assigned function from the detected the cover panel surface coordinates of said display This is an operation method of a touch panel that displays to indicate a distant position .

  According to the touch panel operation technique of the present invention, an operation can be easily executed on the touch panel.

The figure which shows the structure of the touchscreen to which the touchscreen operation technique of this Embodiment is applied. The figure which shows the main control blocks of the touch panel of this Embodiment. Schematic explaining the touch panel operation method of this Embodiment. The figure explaining the function of the force pointer in this Embodiment. The figure which displays the press state of the force pointer in this Embodiment. The figure which shows the aspect which performs a series of operation continuously using the force pointer in this Embodiment. The figure which shows the menu display mode in the touch panel operating method of this Embodiment. The figure which shows the display mode in the special function area of the force pointer in this Embodiment. The figure which shows the aspect which changes the direction of the force pointer in this Embodiment. The figure for demonstrating the method to change the direction of the force pointer in this Embodiment. The figure explaining slide operation using a frame field. The figure explaining button operation using a frame field. The figure explaining menu operation using a frame field. The figure for demonstrating the determination area which changes the direction of the force pointer in this Embodiment.

  FIG. 1 is a diagram illustrating a configuration of a touch panel to which the touch panel operation technique of the present embodiment is applied.

  The touch panel 10 includes a liquid crystal display panel (LCD) 1, a cover panel 2, a pressure sensor 3, a pressure sensor control unit 4, and a base unit (not shown). The pressure sensor 3 is provided in the vicinity of the four apexes of the rectangular liquid crystal display panel 1 with the back surface supported by a base portion (not shown). A transparent cover panel 2 is disposed on the front surface of the liquid crystal display panel 1. The output (pressure value) of each pressure sensor 3 is detected and recorded by the pressure sensor control unit 4 at an appropriate period.

  The upper surface position of each pressure sensor 3 is provided to be higher than the upper surface position of the liquid crystal display panel (LCD) 1. Therefore, when a pressure is applied to the cover panel 2 by touching the cover panel 2 with a finger or the like, a signal corresponding to the pressure is output from the base part (not shown) and the pressure sensor 3 that is narrowly applied to the cover panel 2. Is done. And the pressure which each pressure sensor 3 receives changes with the coordinates on the cover panel 2 to touch. Therefore, by obtaining the pressure value from each pressure sensor 3, the coordinates on the touched cover panel 2 can be obtained.

  In the configuration of the touch panel described above, the pressure sensor 3 is higher than the upper surface position of the liquid crystal display panel (LCD) 1 so that the cover panel 2 is disposed with a predetermined gap from the liquid crystal display panel (LCD) 1. However, the pressure sensors 3 may be arranged at the four corners of the lower surface of the liquid crystal display panel (LCD) 1 and the cover panel 2 may be arranged directly on the upper surface of the liquid crystal display panel (LCD) 1. If comprised in this way, the clearance gap between the liquid crystal display panel (LCD) 1 and the cover panel 2 can be narrowed, it becomes difficult to produce parallax, and the touch panel 10 with more operativity can be obtained.

  FIG. 2 is a diagram showing main control blocks of the touch panel of the present embodiment. A control block that controls the operation of the touch panel 10 includes a force management block 20 and a display processing block 30.

  The force management block 20 calculates and manages the touched coordinates based on the output values of the respective pressure sensors 3. The display processing block 30 draws an image such as a pointer on the liquid crystal display panel 1. The force management block 20 and the display processing block 30 exchange information via the communication line 28.

  The force management block 20 includes a main management unit 21, a communication unit 22, a timer processing unit 23, a pressure sensor processing unit 24, an inclination correction unit 25, and a coordinate management unit 26.

  The main management unit 21 manages the operation of the force management block 20 in an integrated manner. The communication unit 22 is a communication interface for exchanging information with the display processing block 30. The timer processing unit 23 generates a timer interrupt at a set time interval. By this timer interruption, the main management unit 21 starts execution of processing for calculating and managing touched coordinates. The pressure sensor processing unit 24 acquires the output value of each pressure sensor 3 via the A / D converter function of the pressure sensor control unit 4. The inclination correction unit 25 calculates a correction value of the output value of the pressure sensor 3 that changes when the touch panel 10 is inclined. The coordinate management unit 26 calculates and manages the coordinates of the touched position.

  The coordinate detection of the touch position is obtained by setting up an equation representing the balance of the force between the touched pressure and the pressure value of each pressure sensor (A to D) 3 and solving the equation. Since this method is a known technique, a detailed description thereof will be omitted.

  The display processing block 30 includes a main control unit 31, a communication unit 32, and a drawing unit 33. The main control unit 31 manages the operation of the display processing block 30 in an integrated manner. The communication unit 32 is a communication interface for exchanging information with the force management block 20. The drawing unit 33 generates and outputs an image to be displayed on the liquid crystal display panel 1.

  The display processing block 30 acquires the coordinates touched from the force management block 20 via the communication line 28. At this time, the display processing block 30 outputs a coordinate transmission request, and the force management block 20 outputs the latest coordinates (X coordinate, Y coordinate) and status to the display processing block 30. The drawing unit 33 displays a pointer image on the liquid crystal display panel 1 based on the acquired coordinates.

  Next, a touch panel operation method in the present embodiment will be described. In addition, the display demonstrated below processes and performs the drawing part 33 of the display process block 30. FIG.

  FIG. 3 is a schematic diagram for explaining the touch panel operation method of the present embodiment. In the following description, the pointer in the present embodiment is referred to as a force pointer.

  As shown in FIG. 3, when the user touches and presses the cover panel 2 with a finger, a force pointer is displayed at a position away from the touched position. In FIG. 3, the force pointer is composed of two blocks, a block represented by a ring representing the touched pressure value and a triangular block representing designated coordinates. The size of a circle displayed in a block represented by a ring corresponds to a pressure value in a functional section described later. Moreover, the position where the tip position of the triangular block is pointed is shown.

  FIG. 4 is a diagram illustrating the function of the force pointer in the present embodiment. In the force pointer of the present embodiment, the touched coordinates are detected from the distribution of the pressure detection values of the four pressure sensors 3, and the function of the force pointer is determined from the total value of the pressure detection values of the four pressure sensors 3. The Hereinafter, the total pressure value is simply referred to as a pressure value.

  The maximum pressure value is set to 1000, and the pressure value range (0 to 1000) is divided into a plurality of sections. In FIG. 4, pressure values 0 to 400 are defined as four sections (first section to fourth section) every 100, pressure values 400 to 900 are special function sections, and pressure values 900 to 1000 are unused sections. It is said. For pressure values 0 to 400, the function of any one of the four sections is selected according to the change in pressure value, but once the pressure value exceeded 400, the function shifted to the special function section. After that, even if the pressure changes, the functions of the first special function section and the second special function section are selected according to the change of the pressure value without returning to the first to fourth sections. Therefore, the force pointer in the operation method of the touch panel is the second function group when the pressure value detected by the pressure sensor 3 exceeds the set maximum pressure, that is, the pressure value exceeding 400 in this embodiment. It can be interpreted that it has a function of a hierarchical structure that transitions to.

Next, the operation of the force pointer will be described with reference to FIG.
When the user touches the cover panel 2, the force pointer operates according to the function of the first layer.

  First, the moving function is assigned to the first section where the pressure value is 0-100. In the first section, when the user moves with the finger touching the cover panel 2, the force pointer moves according to the movement. Therefore, the user can move the position of the forceponter displayed on the liquid crystal display panel 1 to a desired position. As the pressure value increases, the size of the circle displayed in the block represented by the ring increases.

  When the user moves the force pointer to a desired position and increases the pressure of the finger, the force pointer is given a drag function that is a function of the second section. Therefore, the user can select and reverse-display a series of character strings, for example, by dragging the finger while pressing at a pressure value of 100 to 200, and can drag the selected icon. Here, the transition from the function of the first section to the function of the second section can be determined by a change in the display mode of the force pointer. For example, the display color of the triangular block changes, and the circle displayed in the block represented by the ring is displayed large before the pressure value 100, but when the pressure value exceeds 100, the circle is represented by the ring. This can be determined by the smaller circle display in the block.

  When the user further increases the finger press, the function of the third section is given to the force pointer. However, in the example shown in FIG. 4, no function is assigned to the third section. Here, the transition from the function of the second section to the function of the third section can be determined by a change in the display mode of the force pointer. For example, the display color of a triangular block changes, and, similarly to the transition from the first section to the second section, the judgment can be made by changing the size of a circle displayed in the block represented by the ring. it can.

  When the user further increases the finger press, a shortcut menu function which is a function of the fourth section is given to the force pointer. In the fourth section, the force pointer changes to a block only structure represented by a ring, and a plurality of shortcut menus are displayed around the circular block.

  Here, the menu is displayed when the press remains in the fourth section for at least N seconds. If the value does not stay in the fourth section for N seconds and falls below the minimum value or exceeds the maximum value, the menu display is not performed and the function (section) is changed according to the pressure value.

  When the menu is displayed, the display state continues for M seconds even if the user lifts his / her finger from the cover panel 2. Each shortcut menu has a selection area which is a large area including the displayed shortcut menu icon. Therefore, a desired shortcut menu is selected by touching this selection area while the menu is displayed. To select a desired shortcut menu, move your finger over the menu selection area while the menu is displayed, and release your finger from the screen in the menu selection area, or release your finger from the screen once after displaying the menu, and while the menu is displayed There are two methods of touching the selected area again (determined when touching and releasing the finger).

  The functions from the first section to the fourth section described above can change each section mutually (reversibly) by changing the pressure between pressure values 0 to 400.

  When the user exceeds the pressure value 400 and the finger pressure is further increased, the force pointer is given an enlargement / reduction function which is a function of the special function section of the second hierarchy. Here, the transition from the function of the first layer to the function of the second layer is irreversible, which does not return to the first layer when transitioning from the function of the first layer to the function of the second layer, and the transition in only one direction is possible. It is a transition. In the special function section, if the display enlargement / reduction function is given with the pressure value 400 as a reference, the display of the liquid crystal display panel 1 is enlarged and the press becomes smaller as the press becomes larger (second special function section) (the first special function section). The display on the liquid crystal display panel 1 is reduced in accordance with (one special function section). Therefore, in the second hierarchy, the user can display a desired enlargement / reduction by changing the pressure between the pressure values of 0-900.

  The special function section is not limited to display enlargement / reduction, and for example, a function for scrolling the display may be assigned. That is, a function corresponding to an application using this special function section can be given.

  When the user lifts his / her finger from the cover panel 2, the enlargement / reduction operation keeps the state, and the operation by the force pointer is ended. When the user touches the cover panel 2 again, the force pointer starts to operate according to the function of the first layer.

  In addition, although the method of executing the functions of the first layer and the second layer has been described regarding the force pointer, it may be configured to further include a function of a layer higher than the third layer. In this case, when a pressing force equal to or greater than the maximum pressing force set in each layer is input, irreversible transition is made to the next layer.

  A display mode that supports the basic operation of the force pointer described above will be described.

  FIG. 5 is a diagram showing the pressing state of the force pointer in the present embodiment. FIG. 5A shows the force pointer when a touch is started in the first section. At this time, the force pointer is composed of a block represented by a ring and a block represented by a triangle. It is indicated that the vertex position of the triangle is a pointed position.

  Note that the circle at the tip of the block represented by a triangle in FIG. 5A is an animation representing the moment of touch, and this animation can also be displayed at the start of a few sections.

  5 (2) to 5 (5) are display modes of the force pointer when the pressure is increased. A circle area is displayed in the ring, and the area of this circle increases as the pressure increases. And in FIG. 5 (5), the area | region of a circle expands to the full in a ring, and it represents that the maximum press in a 1st area is provided. Such a display mode is the same in the second and third sections.

  FIG. 5 (6) shows a display mode of the force pointer when the shortcut menu of the fourth section is selected. This aspect will be described later.

  FIG. 6 is a diagram showing a mode in which a series of operations are continuously performed using the force pointer in the present embodiment.

  FIG. 6A shows the touch panel 10 displaying text data. FIG. 6B shows a state in which the user touches and presses the cover panel 2 and selects “Sakuragicho Country Golf Club” using the function of the second section of the first hierarchy. When the user further presses in this state, a shortcut menu shown in FIG. 6 (3) is displayed. In FIG. 6 (3), the force pointer is represented by a circle with an arrow. A user can select a desired shortcut menu by touching the selection area.

  The character string “Sakuragicho Country Golf Club” is copied by selecting the menu “Copy”. By selecting the menu “Browser”, the browser screen is displayed by designating the URL corresponding to “Sakuragicho Country Golf Club”. By selecting the menu “Mail”, a mail screen for sending mail to the address corresponding to “Sakuragicho Country Golf Club” is displayed. By selecting the menu “Map”, an address corresponding to “Sakuragicho Country Golf Club” is designated, and a map including the address is displayed.

  As shown in FIG. 6, according to the touch panel operation method of the present embodiment, it is possible to execute character selection and various menus without performing a plurality of touch operations. Note that the operation function can be an operation function depending not only on the above-described browsing and mail instruction but also on an installed application and OS (Operating System).

  FIG. 7 is a diagram showing a menu display mode in the touch panel operation method of the present embodiment. In FIG. 7 (1), the force pointer is represented as a circle area with an arrow, and the menu is represented as an area with a name. In FIG. 7B, the force pointer is represented as a circle area, and the menu is represented as an area describing a figure. Note that the menu display is not limited to this display mode, and any menu display may be used as long as it represents a graphic representing a force pointer and at least one graphic representing a menu.

  FIG. 8 is a diagram showing a display mode in the special function section of the force pointer in the present embodiment.

  At the pressure value 400 (399 to 401), one stationary circle is drawn in the ring of the force pointer. When the pressure value at which the enlargement operation is performed is in the range of 400 to 900, an animation is displayed in which circles swell one after another from the center in the ring and spread outward. When the pressure value at which the reduction operation is performed is in the range of 0 to 400, an animation is displayed in which the circles that spring out from the outer frame in the ring converge toward the center one after another. With this display mode, the user can easily grasp the current state of enlargement or reduction. The display mode of the force pointer can be changed as appropriate according to the user's setting.

  FIG. 9 is a diagram illustrating a mode of changing the direction of the force pointer in the present embodiment.

  FIG. 9 (1) shows a form of a force pointer when a position at a corner or an end of the cover panel 2 is designated. The force pointer is displayed at a position away from the position touched by the finger by a predetermined distance. However, since the touch panel 10 can detect the position of the finger but cannot detect the direction of the finger, it is not possible to display a force pointer according to the direction of the finger as shown in FIG. Can not. This is the same even when the menu is displayed as shown in FIG.

  FIG. 10 is a diagram for explaining a method of changing the direction of the force pointer in the present embodiment.

  In the present embodiment, the problem is solved by switching the display direction by shifting the force pointer from the actual panel touch position to eight directions depending on the touch position. By switching the display direction of the force pointer, the force pointer cannot be seen even at the edge of the display area of the liquid crystal display panel 1. Further, the indication direction also changes the display direction in conjunction with the force pointer display direction change. By providing eight directions in the pointing direction, any position in the display area of the liquid crystal display panel 1 can be pointed without inconvenience.

  (1) of FIG. 10 is a diagram showing in which direction the force pointer is shifted from the touched position when the cover panel 2 is touched with a finger or the like. The cover panel 2 is divided into a display area 2a corresponding to the area of the liquid crystal display panel 1 and a frame area 2b outside the area of the liquid crystal display panel 1. The display area 2a is provided with a determination area, and the determination area is touched. When the touch is performed, a force pointer in a predetermined direction is displayed at a position away from the touch position by a predetermined distance corresponding to the touched position. In the present embodiment, the areas 1 to 8 are set every 45 degrees from the center of the panel 2, for example, when the area 1 (a range of 22.5 degrees before and after the 12 o'clock direction as the center) is touched. The force pointer is displayed upward from the touch position in the drawing, and when the area 2 that is 45 degrees left from the center of the panel 2 is touched, the force pointer is displayed in the direction of 45 degrees left from the touch position. (The display positions of the finger and the force pointer shown in FIG. 3 are displayed by the display method based on the above).

  (2) in FIG. 10 is a diagram showing the directions indicated by the triangular blocks of the force pointer, and the display directions of the triangular blocks can be defined in eight directions.

  The direction for shifting the display of the force pointer is set in advance by setting the relationship between the area and the direction to be shifted and changing the display direction for each area, or as shown in FIG. May be divided finely and the direction of shifting may be determined according to each region. In addition, the setting of the direction in which the force pointer is shifted or the block display direction of the triangle of the force pointer may be assigned as one of the functions of the third section so that these can be set during use, or these settings can be set by default. May be configured to be performed in advance.

  FIG. 14 is a diagram for explaining a determination area for changing the direction of the force pointer in the present embodiment. As shown in FIG. 14, it is possible to finely divide the area on the panel 2 and set the direction of shifting according to each area.

  In general, the touch panel display area has the concept of up / down / left / right, which corresponds to the top / bottom / left / right of the image displayed in the display area. A particularly preferable area is an end portion such as upper and lower or left and right of the display area 2a. Therefore, considering the area at the center of the display screen and the case where the user specifies the edge or corner of the display area 2a as shown in FIG. 14, the edge portion is divided into double areas, and these areas are divided vertically and horizontally. A determination area of 25 divisions is provided, and the display direction and instruction direction of the force pointer corresponding to the determination area are set in advance. The coordinates at the start of touch are used for determining the area. In addition, after touching, even if you continue touching, even if you enter another area, the display direction and instruction direction do not change, or if you continue touching such as changing the display direction and instruction direction every time you enter another area The operation of the force pointer, the size of the determination area, the display direction of the force pointer, and the like can be adjusted by the user. With this configuration, all touch positions in the display area 2a can be specified.

  Next, an operation method other than the force pointer operation of the touch panel 10 using the frame area 2b will be described.

  As described above, touch panel 10 in the present embodiment can detect the touch position of frame region 2b. Therefore, a hierarchical function having a plurality of sections different from the function described in FIG. 4 can be assigned to the frame area 2b.

  FIG. 11 is a diagram illustrating the function of the first section using the frame area 2b. In the first section, the slide operation can be performed with a light touch. By sliding the finger on the frame area 2b, the display image is slid and displayed in the same manner as when the slide bar operation is performed.

  FIG. 12 is a diagram illustrating the function of the second section using the frame area 2b. In the second section, a menu icon can be displayed. In FIG. 12, a camera icon representing recording is displayed. When the user presses the frame area 2b under the camera icon, the icon is selected and the displayed image is determined as a recording target. This icon can display a plurality of types. The user presses the frame region 2b to select and execute an icon provided near the upper position of the position.

  FIG. 13 is a diagram illustrating the function of the third section using the frame area 2b. By pressing the frame area 2b in the above-described state, it is possible to display a more detailed menu icon of icons provided near the upper part of the position. By pressing the frame area 2b below the detailed menu icon, detailed operations can be executed continuously. For example, when “Save” is selected, the displayed image is saved. If “RETURN” is selected, the process ends without performing any processing. When “Print” is selected, the displayed image is edited for printing. When “Mail” is selected, the displayed image is edited into an image for mail attachment.

  As described above, in the touch panel operation method of the present embodiment, the pointer is displayed corresponding to the touch position to detect the position information, and various functions are set corresponding to the press.

  And it is possible to select a several function group irreversibly by changing a press. In one hierarchical group, it is possible to reversibly operate by continuously changing from one function to another function.

  Each function described in the above embodiment may be configured using hardware, or may be realized by reading a program describing each function into a computer using software. Each function may be configured by appropriately selecting either software or hardware.

  Furthermore, each function can be realized by causing a computer to read a program stored in a recording medium (not shown). Here, as long as the recording medium in the present embodiment can record a program and can be read by a computer, the recording format may be any form.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  DESCRIPTION OF SYMBOLS 1 ... Liquid crystal display panel, 2 ... Cover panel, 2a ... Display area, 2b ... Frame area, 3 ... Pressure sensor, 4 ... Pressure sensor control part, 10 ... Touch panel, 20 ... Force management block, 21 ... Main management part, 22 ... Communication unit, 23 ... Timer processing unit, 24 ... Pressure sensor processing unit, 25 ... Inclination correction unit, 26 ... Coordinate management unit, 28 ... Communication line, 30 ... Display processing block, 31 ... Main control unit, 32 ... Communication unit 33 drawing unit.

Claims (5)

In a touch panel operation method comprising a display panel, a substantially transparent cover panel disposed on the front surface of the display panel, and a detection unit that detects coordinates and contact pressure of the cover panel surface in contact with an object,
Dividing the contact pressure of the cover panel surface into a plurality of sections, and setting a function for operating the touch panel in each section,
And detection knowledge and coordinates and the contact pressure of the cover panel surface,
Based on the detected coordinates of the cover panel surface and the contact pressure, the operation image for executing the assigned function is indicated at a position away from the detected coordinates of the cover panel surface of the display. A touch panel operation method characterized by displaying. A plurality of function groups assigned a plurality of functions corresponding to the contact pressure are set,
Set the hierarchical order for each function group,
When a contact pressure that exceeds the maximum contact pressure set for the function group is input during the execution of a function of one layer, it is irreversible to the lower-layer expansion / contraction function that expands or contracts based on the maximum contact pressure The touch panel operation method according to claim 1 , wherein the touch panel operation method is performed. The operation image is a pointer image,
A determination area is provided in which information representing the display direction of the pointer image and the instruction direction is associated by dividing the cover panel surface,
The touch panel operation method according to claim 2 , wherein the pointer image is displayed based on the information associated with the determination area specified from the detected coordinates of the cover panel surface. A program for operating a touch panel including a display panel, a substantially transparent cover panel disposed on the front surface of the display panel, and a detection unit that detects coordinates and contact pressure of the cover panel surface in contact with an object In
Dividing the contact pressure of the cover panel surface into a plurality of sections in a computer that controls the operation of the touch panel, and setting a function of operating the touch panel in each section;
Step of detection known the coordinate and the contact pressure of the cover panel surface,
Based on the detected coordinates of the cover panel surface and the contact pressure, the operation image for executing the assigned function is indicated at a position away from the detected coordinates of the cover panel surface of the display. A program for executing the displayed steps.   Setting a plurality of function groups assigned a plurality of functions corresponding to the contact pressure;
  Setting the hierarchical order for each functional group,
  When a contact pressure that exceeds the maximum contact pressure set for the function group is input during the execution of a function of one layer, it is irreversible to the lower-layer expansion / contraction function that expands / contracts based on the maximum contact pressure. Step to transition to
  The program according to claim 4, further causing the computer to execute the program.

Images