JP2001236180A - Information processing apparatus and pressed key determination method - Google Patents

Abstract

(57) [Problem] To provide an information processing device capable of displaying a freely designed panel image on a touch screen. SOLUTION: An information processing apparatus having a touch screen 51 is provided with each key #K (K =
1 to Kmax), all display sections of the liquid crystal panel 52 used for displaying the key #K (areas surrounded by broken lines)
Is held, and when a finger or the like touches the touch panel 53, one or more detection points at which the touch of the finger or the like is detected with respect to each key in the panel image 100 are held. , And the number of display sections corresponding to the key is counted by the key information, and when one key having the largest counted number can be identified,
The information processing apparatus is configured to determine that the key has been pressed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus in which a touch screen is used as an input device, and which key is pressed (selected) by a user based on an output from a touch panel constituting the touch screen. The present invention relates to a pressed key determination method for determining whether there is any key.

[0002]

2. Description of the Related Art In an information processing apparatus such as a copying machine or an automatic teller machine, a touch screen (a touch panel on a display device such as a liquid crystal panel) is used as an input device for receiving an instruction from a user. Have been.

A touch panel constituting a touch screen has a plurality of detection points, each of which is arranged in a matrix at a predetermined interval (about 1 cm) and functions as a contact sensor. That is, the touch panel is a sensor for detecting that a finger touches a portion where the detection point exists. For this reason, in an information processing apparatus using a touch screen, a panel image (an image including a plurality of keys) to be displayed on the touch screen (display device) is designed so that each key occupies an integer number of detection points. ing. Specifically, as schematically shown in FIG. 13, the display area 200 of the display device is
It is treated as being composed of a plurality of display sections (a rectangular area surrounded by a broken line in the figure) where one detection point (not shown) is located at substantially the center, and each key is an integer number of display sections. Panel image 220 is designed to be occupied.

In a conventional information processing apparatus, information defining the contents of a panel image designed in such a manner and a specific (or zero) key in the panel image are provided at each detection point of the touch panel. And key position information for associating them with each other. Then, the information processing device, when the contact of a finger or the like is detected by one detection point of the touch panel,
The key position information is programmed to determine that the key associated with the detected point has been pressed.

However, the number of detection points on the touch panel is two or more (usually two or four) depending on the part touched by a finger, because the detection point also detects that a finger or the like touches the vicinity.
May be turned on (detecting contact with a finger or the like). The operation when such a situation occurs differs from device to device. For example, when contact with a finger or the like is detected by a plurality of detection points, there is a device that determines that a key is not pressed. I have. There is also a device that determines that a key associated with a detection point located at the upper left (or upper right) of those detection points has been pressed.

[0006]

As described above, an information processing apparatus using a touch screen includes various devices having different procedures for determining a key pressed by a user (hereinafter referred to as a key determination procedure). Exists, but the key determination procedure used in any of the devices is based on a panel image designed such that each key occupies an integer number of display sections (detection points) on a touch screen (display device). Is assumed to be displayed.

In other words, in the conventional information processing apparatus (key determination procedure), the design of the panel image is limited. Specifically, the character information (or graphic information) to be displayed in each key is used to more accurately express the content of the processing associated with the key in order to improve the overall appearance. In some cases, it is desirable to design a panel image such that the boundary between two keys is located at the center of one display section. In a conventional information processing apparatus (key determination procedure), a panel designed in such a manner is required. The use of images was not considered.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an information processing apparatus and a pressed key determination method capable of designing a panel image more freely.

[0009]

According to a first aspect of the present invention, there is provided an information processing apparatus comprising a touch panel having a plurality of detection points arranged in a matrix on a display device. A touch screen, a display control means for displaying a panel image including a plurality of keys on the display device, and a display area of the display device having one detection point located substantially at the center of each key included in the panel image. Key definition information holding means for holding key definition information for associating one or more display sections with which the key is to be displayed when it is assumed that the key is divided into a plurality of display sections; Identification means for identifying one or more detection points of the touch panel detecting the key, and for each key included in the panel image, the key is associated with the key by key definition information. Evaluation value calculating means for calculating an evaluation value corresponding to the number of display sections located below the detection point specified by the specifying means; and a key having the largest evaluation value calculated by the evaluation value calculating means. A search unit that determines that the key is pressed when only one key is searched.

In the information processing apparatus according to the first aspect of the present invention having such a configuration, the key definition information holding means stores a key corresponding to the panel image regardless of the content of the panel image. As long as the definition information is held, when the user touches a key with a finger, the evaluation value of the key becomes larger than the evaluation values of other keys, and it is determined that the key is pressed. Therefore, if this configuration is adopted, an information processing apparatus that can use a freely designed panel image, in other words, an information processing apparatus that is easy to use because a panel image that is easy to operate is displayed is obtained. Become.

The information processing apparatus according to the first aspect of the present invention includes, as key definition information, any configuration information as long as each key can be associated with a display section satisfying the above-described conditions. Can be used. For example, as the key definition information, information including, for each key, position information of a display section to be associated with the key can be used. In addition, the key definition information includes a plurality of key information items respectively associated with a plurality of keys, and each of the plurality of key information items is associated with a corresponding one of the plurality of display segments. It is also possible to use information including information indicating whether or not the display section is associated with the display section.

An information processing apparatus according to a second aspect of the present invention displays a touch screen in which a touch panel having a plurality of detection points arranged in a matrix is superimposed on a display device, and a panel image including a plurality of keys. It is assumed that the display area of the display device is divided into a plurality of display sections where one detection point is located substantially at the center of each of the display control means to be displayed on the device and each key included in the panel image. Key definition information holding means for holding key definition information for associating one or more display sections in which the key is to be displayed in that case with a weight value corresponding to each display section associated with each key; Means for specifying one or more detection points of a touch panel detecting contact of a finger or the like; and, for each key included in the panel image, with reference to the key definition information, It has been correlated, and,
Evaluation value calculating means for calculating an evaluation value corresponding to the sum of weight values associated with the display sections located below the detection point specified by the specifying means, and an evaluation value calculated by the evaluation value calculating means Finds the key with the largest
And determining means for determining that the key has been pressed when only the keys have been searched.

[0013] In the information processing apparatus according to the second aspect of the present invention having such a configuration, no matter what the panel image is, the key definition information holding means can store the panel image according to the panel image. As long as key definition information that associates an appropriate value weight value with each detection point is held, when a user touches a key with a finger, the evaluation value for that key is higher than the evaluation value for other keys. As a result, it is determined that the key has been pressed. Therefore, even if this configuration is adopted, an information processing apparatus that can use a freely designed panel image, in other words, an information processing apparatus that is easy to use because a panel image that is easy to operate is displayed is obtained. Will be done.

In configuring the information processing apparatus according to the second aspect of the present invention, key definition information is used in each display section associated with each key to display the key of that display section. A weight value having a size corresponding to the ratio can be associated. By doing so, when a finger touches one display section in which the ends of the two keys are displayed, the key with the larger area of the portion displayed in that display section is pressed. As a result, an information processing device determined to have failed is obtained. Conversely, if the weight value associated with each detection point is set to a value that is not directly related to the use ratio of the display section (by adopting the configuration of claim 2), the two keys have substantially the same area. An information processing apparatus in which it is determined that, when a finger touches one display section on which an end is displayed, a key having a larger weight value associated with that display section (upper detection point) is pressed. Is obtained.

In the case where the key definition information is to associate each display section with a weight value having a size corresponding to a ratio used for displaying keys in the display section, a panel image is used. As for a plurality of keys to be displayed in common in the display section, it is desirable that the ratios of the display sections used for displaying the keys are different from each other.

In the information processing apparatus according to the second aspect of the present invention, any configuration information can be used as the key definition information as long as the information can be associated with each key. . For example, as the key definition information, information that includes, for each key, the position information of each display section to be associated with the key and the same number of weight values as the position information can be used. In addition, the key definition information includes a plurality of key information items respectively associated with a plurality of keys, and each of the plurality of key information items has a plurality of elements respectively associated with a plurality of display sections. It is possible to use array data in which the value of an element associated with a display section associated with the key is a weight value, and the value of an element relating to a display section not associated with a key is a prescribed value (for example, “0”).

In implementing the information processing apparatus according to the second aspect of the present invention, each key included in the panel image is associated with the key as an evaluation value calculation means.
And a means for calculating an evaluation value corresponding to a value obtained by dividing the sum of the weight values associated with the display sections located below the detection point specified by the specifying means by a value representing the size of the key. You may adopt it.

Further, in realizing the information processing apparatus according to each aspect of the present invention, when two or more keys having the largest evaluation value are searched for, the determining means determines that the key has not been pressed. May be adopted.

In implementing the information processing apparatus according to each aspect of the present invention, the key definition information includes ordered information indicating the priority order assigned to each key included in the panel image, and the determination is made. As a means, when two or more keys having the highest evaluation value are searched, the key having the highest priority is determined from the keys based on the ordered information, and the determined key is determined to be pressed. A means for performing this may be adopted. If this configuration is employed, an information processing apparatus having a low probability of determining that a key has not been pressed can be obtained. In addition, when this configuration is adopted, the ordering information is composed of a plurality of pieces of size information indicating the sizes of a plurality of keys, and the determining unit gives priority to the key having the smallest size indicated by the size information. Means for determining the key with the highest rank can be used. When the information processing apparatus is configured as described above, when there are a plurality of keys having the maximum evaluation value,
A device that determines that the key with the smallest size has been pressed is obtained.

Further, the specifying means used in the information processing apparatus of each aspect may specify one or more detection points at which contact with a finger or the like is detected at that time based on the output of the touch panel. However, by acquiring the output of the touch panel a plurality of times, one or more detection points that have continuously detected contact with a finger or the like for a predetermined time may be specified.

According to the present invention, there is provided a method for determining a pressed key based on an output of a touch panel having a plurality of detection points arranged in a matrix and superimposed on a display device for displaying a panel image including a plurality of keys. Is a method for determining which of the keys is pressed.
A specifying step of specifying one or more detection points of the touch panel that is detecting a touch of a finger or the like; and, in each key included in the panel image, the display area of the display device has one detection point located substantially at the center of each key. Each key included in the panel image is referred to by referring to the key definition information corresponding to one or more display blocks in which the key is displayed when it is assumed that the key is divided into a plurality of display blocks. An evaluation value calculating step of calculating an evaluation value corresponding to the number of display sections which are associated with the key and located below the detection point specified by the specifying means; and A search step of searching for a key having the largest evaluation value calculated in the calculation step, and determining that the key has been pressed when only one key has been searched.

According to another aspect of the present invention, there is provided a method for determining a pressed key, comprising: outputting a touch panel having a plurality of detection points arranged in a matrix and superimposed on a display device for displaying a panel image including a plurality of keys; This is a method for judging which key in the panel image is pressed based on the touch panel 1 which detects the contact of a finger or the like.
A specifying step of specifying one or more detection points, and a display area of the display device is divided into a plurality of display sections each having one detection point located substantially at the center of each key included in the panel image. When one or more display sections in which the key is to be displayed are associated with each other and the weight value is associated with each display section associated with each key, the panel image is referred to. Calculates an evaluation value corresponding to the sum of the weight values associated with the display sections that are associated with the keys and that are located below the detection points specified by the specifying means, for each key included in. An evaluation value calculating step to be performed, and a key having the largest evaluation value calculated in the evaluation value calculating step. When only one key is searched, it is determined that the key is pressed. And a determination step that.

According to these pressed key determination methods, it is possible to accurately determine which key on the freely designed panel image is pressed by the user, so that the touch screen is more effectively used as an input device. You can do it.

[0024]

Embodiments of the present invention will be described below in detail with reference to the drawings.

<First Embodiment> An information processing apparatus according to a first embodiment of the present invention is an apparatus for constructing a copy system using a scanner and a printer which are generally commercially available.

As shown in FIG. 1, the information processing apparatus 10 according to the first embodiment includes an information processing apparatus main body 11 and an operation device 12 connected by a cable 36. Further, the information processing apparatus 10 includes a scanner 13
And the printer 14 is used in a state where the printer 14 is connected by cables 37 and 38. The information processing apparatus 10 is provided with dedicated cabinets of various sizes to which the operation device 12 can be attached as an option.
As described above, the information processing apparatus 10 is usually used in a state where the operation device 12 is attached to a dedicated cabinet 18 having a size corresponding to the scanner 13 and the printer 14.

The operation device 12 (FIG. 1) includes a touch screen unit 50 and a key operation unit 60. Key operation unit 60
Consists of a plurality of push button switches (start button and numeric keypad) and their control circuits. Key operation unit 60
Has a function of transmitting information indicating the pressed push button switch onto the cable 36.

The touch screen section 50 has a touch screen 51 in which a touch panel 53 having detection points arranged in a matrix of 8 rows × 6 columns is superimposed on a liquid crystal panel 52 as a display device. In addition, the touch screen unit 50 includes a touch screen control unit 55 that controls the touch screen 51 (the liquid crystal panel 52 and the touch panel 53).

The touch screen control section 55 controls the liquid crystal panel 52 to display an image corresponding to the data provided from the information processing apparatus main body 11. In addition, the touch screen control unit 55 constantly monitors the state of the touch panel 53, that is, whether or not each detection point of the touch panel 53 detects contact with a finger or the like. Less than,
The fact that the detection point detects contact with a finger or the like and that the detection point does not detect contact with a finger or the like are also described as “the detection point is on” and “the detection point is off”, respectively. I do.

When a finger or the like touches the touch panel 53 (when any of the detection points on the touch panel 53 is turned on), the touch screen control unit 55 provides contact notification information (serial of predetermined content) Data) on the cable 36. Also, the touch screen control unit 5
Reference numeral 5 periodically sends state information indicating all the detection points that are on at that time while the finger or the like is in contact with the touch panel 53. Touch screen unit 50
48 indicates on / off of a specific detection point of the touch panel 53 by the value of each bit as this state information.
Outputs (= 8 × 6) bit serial data. The handling of the state information on the information processing apparatus main body 11 side will be described later.

The information processing apparatus main body 11 includes a CPU bus 31
CPU21, ROM22, RAM2 mutually connected by
3 and a bridge 24. The information processing apparatus main body 11 includes an HDD controller 25 connected to a general-purpose bus (PCI bus) 32 connected to the bridge 24,
An I / F board 26 for an operation panel, an I / F board 27 for a scanner, an I / F board 28 for a printer, an I / F board 29 for a network, and an HDD (hard disk drive) 30 connected to an HDD controller 25 are provided. .

The ROM 22 is a non-volatile memory in which a bootstrap program and a BIOS are stored. HD
D30 is an auxiliary storage device in which an operating system, a copy control program, various drivers, various information used by the copy control program for controlling the touch screen 51 (details will be described later), and the like are stored.

The CPU 21 includes a ROM 22 and an HDD 30
Is a control circuit that reads out the program in the RAM 23 into the RAM 23 and integrally controls each unit according to the read out program. The copy control program described above is executed by the CPU 2
1 is a program for outputting a copy of a document set on the scanner 13 to the printer 14. Also,
The copy control program is a program that causes the CPU 21 to execute a key determination process (details will be described later).

The scanner I / F board 27 and the printer I / F board 28 are interface boards that enable the CPU 21 to control the scanner 13 and the printer 14, respectively. The network I / F board 29 is an interface board for connecting the information processing device 10 to an Ethernet LAN.

The I / F board 26 for the operating device includes a CPU 2
1 is an interface board for enabling control of the operating device 12 by the control unit 1. I / F board 26 for operating device
The CPU 21 includes an I / F circuit for the touch screen unit 50 and an I / F circuit for the key operation unit 60.
(Copy control program) includes an I / O
Via the F-circuit, it is recognized which push button switch on the operation device 12 has been pressed by the user.

When the operation device I / F board 26 (I / F circuit for the touch screen unit 50) receives the contact notification information (serial data having a predetermined content), the CPU 21
Output a predetermined interrupt request. Further, the operating device I / F board 26 converts each state information (serial data) received thereafter into one row of detection points (eight detection points arranged in the horizontal direction of the touch panel 53). It is stored internally as six 1-byte data indicating the state.

For example, the operating device I / F board 26
As schematically shown in FIG. 3, the user touches a portion (hatched portion) where a touch of a finger or the like is detected by the detection points (3, 3) and (3, 4) of the touch panel 53. The state information in the form of serial data output from the touch screen unit 50 when touched by the user is referred to as six 1-byte data "0000000" relating to the detection point group on the 0th to 5th rows, respectively.
0 "," 00000000 "," 00000000 "," 00011000 "," 00000000 "
And "00000000" and store it.

The detection point (i, j) is a detection point located at the i-th row and j-th column (the leftmost column is the 0th column). Also, in FIG. 3, a broken line shown in the touch screen 51 represents a boundary of a display section virtually set on the liquid crystal panel 52 such that a detection point of the touch panel 53 is located at the center thereof. . In other words, each rectangular area surrounded by a broken line represents a display section, and a detection point of the touch panel 53 exists at the center of each display section.

At the time of key determination processing to be described later, six 1-byte data in the operating device I / F board 26
The key is determined by being treated as state information P consisting of [0] to P [5].

Hereinafter, the operation of the information processing apparatus 10 will be described focusing on the operation related to the touch screen 51. First, information used for controlling the touch screen 51 provided in the HDD 30 will be described.

In the HDD 30, panel image definition information and key definition information are stored for each panel image (image including a plurality of keys) which may be displayed on the liquid crystal panel 52 when the information processing apparatus 10 operates. Have been. The panel image defining information is information that defines the contents of the panel image. The CPU 21 according to the copy control program uses the panel image defining information according to the situation at that time to operate the I / F board 26 for the operating device. Via the touch screen control unit 55
Is controlled, the liquid crystal panel 52 displays a panel image according to the situation at that time. That is, in the present embodiment, the portion including the CPU 21, the operation device I / F board 26, and the touch screen control unit 55 functions as a display control unit.

The key definition information on a certain panel image in the HDD 30 (key definition information holding means) includes a key number Kmax which is the total number of keys included in the panel image,
Kmax keys # 1 to #K included in the panel image
Key information Key_1 to key information Key_Kmax regarding max. Each piece of key information Key_K (K = 1 to Kmax) included in the key definition information relating to a certain panel image is used for displaying the key #K when the panel image is displayed on the liquid crystal panel 52. Is information indicating the position of the display section.

The key information Key_K used in the information processing apparatus 10 includes six 1-byte elements Key_K [0] to Key_K.
This is the sequence data consisting of [5]. Element Ke of key information Key_K
The j-th bit (i = 0 to 5, j = 0 to 7; LSB is 0) of y_K [i] is the display section (i, j) (the display section existing below the detection point (i, j)). ). The bit of the key information Key_K corresponding to the display section to be used for displaying the key #K is set to “1”, and the bit corresponding to the display section not used for displaying the key #K is set to “0”.
It has been.

For example, the panel image 1 shown in FIG.
The key #m in 00 is a key in which the display sections (3, 0) to (3, 3) are used for the display. Also, key #n
Are keys for which display sections (3, 3) to (3, 5) are used for the display. Therefore, the key definition information on the panel image 100 stored in the HDD 30 includes the key information
As Key_m, as shown in FIG. 4B, the element Key_m [3] for the third row is “11110000”, and the other elements are “0”.
0000000 ", and as key information Key_n,
As shown in FIG. 4C, the element Key_n related to the third row
[3] contains "00011100" and other elements each contain information "00000000".

Next, the information processing apparatus 1 according to the first embodiment
The key determination process executed at 0 will be described.

The CPU 21 operating in accordance with the copy control program, when a finger or the like touches the touch panel 53 while receiving information input from the touch screen 51 (touch panel 53) (I / O for operation device). When receiving an interrupt request from the F board 26),
The key determination process of the procedure shown in FIG. 5 is executed.

That is, the CPU 21 first outputs the data through the touch screen unit 50 to the operation device I / F.
Based on the state information whose form has been converted by the board 26, panel information Panel used for the evaluation value calculation processing (details will be described later) of step S104 is generated (step S1).
01).

At the time of processing in step S101, the CPU 2
1 denotes a touch panel 5 at time T via the operating device I / F board 26 and the touch screen control unit 55.
3 (hereinafter referred to as P1 [0] to P1 [5]) and state information indicating the state of the touch panel 53 at time T + dT (hereinafter referred to as P2 [0] to P2 [5]). To get) and get. Time T is the time when a finger or the like first touches the touch panel 53, and dT is the cycle at which the touch screen control unit 55 outputs state information.

Then, the CPU 21 sets the state information P1 [0] to P1 [5] acquired first time and the state information P2 acquired second time.
Using [0] to P2 [5], the expression Panel [i] = P1 [i] & P2 [i] (P1
[i] & P2 [i] generates the elements P [0] to P [5] of the panel information Panel based on the bitwise AND operation result of P1 [i] and P2 [i]. That is, the CPU 21 determines in step S10
1, the information indicating the detection points which functioned as the main part of the specifying means and continuously detected the contact of the finger or the like during the time dT, and the status information in the I / F board 26 for the operating device. Panel information Panel, which is information having the same configuration as that shown in FIG. 3, is generated.

After generating the panel information Panel, the CPU 2
Reference numeral 1 denotes key definition information (the number of keys Kmax and key information Key_1 to K_1) regarding a panel image (hereinafter, referred to as a current panel image) currently displayed on the liquid crystal panel 52.
ey_Kmax) is prepared on the RAM 23 (step S10).
2). In this step, if the key definition information relating to the current panel image does not exist in the RAM 23, the CPU 21 reads the key definition information from the HDD 30. On the other hand, if the key definition information regarding the current panel image is RA
If it exists on M23, the CPU 21 does nothing (just confirms the existence of the key definition information) and ends step S102.

Thereafter, the CPU 21 initializes the variable K to "1" (step S103), and calculates an evaluation value for calculating an evaluation value for the key #K (step S104).
To start.

FIG. 6 shows a flowchart of the evaluation value calculation process.
As shown in the figure, at the time of the evaluation value calculation process, the CPU 21 first initializes the variable i to “0” and sets the array variable CN
T [K] is initialized to "0" (step S201). Thereafter, the CPU 21 performs an AND operation for each bit between Key_K [i] and Panel [i], and obtains the operation result (“Key_K [i] & Panel
[i] ") is counted (step S202), and the CPU 21 adds the counting result to CNT [K] (step S203) to obtain the i value and imax. Value (in this embodiment, imax = 5)
(Step S204).

If the two values do not match (step S204; NO), the CPU 21 increments the i value by "1" (step S205), and executes the processing from step S202 again. When the i value and the imax value match (step S205; YES), the CPU 2
1 ends the evaluation value calculation process.

That is, in this evaluation value calculation process, the display section located below the detection point where the contact of the finger or the like has been detected for a predetermined time continuously in the display section used for displaying the key #K. The number of sections is set to CNT [K].

After the end of the evaluation value calculation processing, the CPU 21
It is determined whether the K value and the Kmax value match (FIG. 5:
Step S105). In other words, the CPU 21 determines whether the calculation of the evaluation values for all the keys has been completed, and determines whether there is a key for which the calculation of the evaluation values has not been performed.
In (Step S105; NO), the K value is incremented by "1" (Step S106), and the processing from Step S104 is executed again.

The CPU 21 completes the calculation of the evaluation values CNT [1] to CNT [Kmax] for the keys # 1 to #Kmax.
(Step S105; YES), Steps S104 to S
The processing exits from the processing loop of 106. In other words, K value and Kma
When the x value matches, the CPU 21 ends the operation as the evaluation value calculation means (steps S102 to S106).

Then, the CPU 21 starts the operation as the judging means, obtains the maximum value of the evaluation values CNT [1] to CNT [Kmax], and obtains the evaluation value that matches the maximum value. A process for specifying a key (actually, a key number) is performed (step S107). When the number of keys specified in step S107 is one (step S108;
NO), the CPU 21 determines that the key is the pressed key (step S109), and ends the key determination process. On the other hand, if two or more keys have been specified in step S107 (step S108; YES),
The CPU 21 ends the key determination process without performing anything (without determining that any key is pressed).

When step S109 is executed,
After the key determination process is completed, the CPU 21 executes a process corresponding to the key determined to be pressed (a process for storing the selected condition, a process for displaying a new panel image on the liquid crystal panel 52, and the like). If the key determination process is terminated without executing step S109, the CPU 21 issues an interrupt request from the operating device I / F board 26 (the user once removes his / her finger from the touch panel 53 and then returns to the touch panel 53 again). To touch).

Hereinafter, the information processing apparatus 1 according to the first embodiment
The operation at the time of the key determination process of 0 will be described more specifically.

For example, as schematically shown in FIG. 7A, the user touches a hatched portion of the touch screen 51 on which the panel image 100 is displayed with a finger (for a predetermined time, (Keep touching). That is, a portion on the key #n included in the panel image 100 and where the contact of the finger or the like is detected by the two detection points,
Consider the case where the user touches with a finger.

In this case, in step S101, panel information Panel having the same contents as the state information P shown in FIG. 3 is generated. Then, the panel information Panel and key information Key_1 to Key_Kmax relating to the panel image 100 (FIG. 4)
(See (B) and (C)), the evaluation values CNT [1] to CNT [Kmax] are calculated by the procedure shown in FIG.
[m] is “1”, and the evaluation value CNT [n] is “2”.
Also, evaluation values CN for other keys in panel image 100
T [K] (K ≠ n, m) is all “0”. Therefore, in step S107, only one key #n is specified, and as a result, it is determined that the key #n is pressed.

Further, as schematically shown in FIG. 7B, the user can select the key #n and the key #m of the panel image 100.
Let us consider a case in which a finger is touched on the part over the. In this case, in step S101, the panel information Panel in which Panel [4] is “00010000” and other elements are “00000000”
Is generated. Then, based on the panel information Panel and the key information Key_1 to Key_Kmax, the evaluation values CNT [1] to CNT [K
max] is calculated, the evaluation value CNT [m] and the evaluation value CNT [n]
Are both "1", and the evaluation values for the other keys are all "0". Accordingly, two keys are specified in step S107, and as a result, it is determined that no key is pressed (nothing is performed).

As described above, in the information processing apparatus 10 according to the first embodiment, accurate key determination is performed without setting each key included in the panel screen to occupy an integer number of display sections. The key definition information (key information)
Since it can be easily created, if the configuration used in the present information processing apparatus 10 is adopted, an information processing apparatus that displays an easy-to-operate panel image can be easily realized.

<Second Embodiment> An information processing apparatus according to a second embodiment of the present invention is also an apparatus for constructing a copy system, and its basic configuration is the information processing apparatus according to the first embodiment. Is the same as For this reason, the information processing apparatus according to the second embodiment will be described below using the reference numerals used in the description of the information processing apparatus according to the first embodiment, focusing on the differences from the information processing apparatus according to the first embodiment. Will be described.

The H of the information processing apparatus 10 according to the second embodiment
The DD 30 stores key definition information including weighted key information WKey_K and key size information S_K instead of the key information Key_K. That is, the information processing apparatus 10 according to the second embodiment sets the key number Km for each panel image.
It holds key definition information including ax, weighted key information WKey_1 to WKey_Kmax, and key size information S_1 to S_Kmax.

Weighted key information WKey_K (K = 1 to Kmax)
Is array data having 6 × 8 elements WKey_K [i, j]. The element WKey_K [i, j] of the weighted key information WKey_K is
Display section (i, j) (display section located at the i-th row and j-th column)
Is numerical data indicating the ratio used for displaying the key #K. The key size information S_K included in the key definition information is numeric data indicating the sum of the values of the elements of the weighted key information WKey_K.

For example, the panel image 1 shown in FIG.
Key #m in 10 indicates that the display section (3,0), the display section (3,1) and most of the display section (3,2)
Approximately half of the display section (3,3) is a key used. Therefore, as shown in FIG. 8B, WKey_m [3,0] and WKe
y_m [3,1] and WKey_m [3,2] are each “1” and WKey_
The weighted key information WKey_m in which m [3,3] is “1/2” and all other elements are “0” is included.

In the display of the key #n, the display section (3,
Approximately half of (3), display areas (3,4) and display area
Almost all parts of (3,5) are used. For this reason, the key definition information regarding the panel image 110 includes FIG.
As shown in (C), WKey_n [3,3] is “１ ／”, WKey_n [3,4] and WKey_n [3,5] are both “1”,
Key information WKey_n in which all other elements are “0” is included.

The display of the key #q includes display sections (5, 0) to (5,
Almost all parts of 2) and about 1 of display area (5,3)
/ 4 part is used. Further, the display of the key #r uses a portion of about 3/4 of the display section (5, 3) and almost all of the display section (5, 4) and the display section (5, 5). ing. For this reason, the key definition information regarding the panel image 110 includes the information shown in FIGS. 8D and 8E as the key information WKey_q and the key information WKey_r, respectively. The key definition information related to the panel image 110 includes numerical data indicating 3.5, 2.5, 3.25, and 2.75 as key size information S_m, S_n, S_p, and S_q, respectively.

Next, a key determination process executed by the information processing apparatus 10 according to the second embodiment will be described with reference to FIGS.

As shown in FIG. 9, at the start of the key determination process, the CPU 21 outputs the panel information based on the state information output by the touch screen unit 50 and converted by the operation device I / F board 26. A Panel is generated (Step S301). The processing performed in step S301 is the same as the processing performed in step S101 (FIG. 5).

After generating the panel information Panel, the CPU 2
1 is key definition information (key number Kma
x, key information Key_1 to Key_Kmax, key size information S_
1 to S_Kmax) (step S302). Thereafter, the CPU 21 initializes the variable K to “1” (Step S
303), and the evaluation value calculation process (step S304) is started.

As shown in FIG. 10, during the evaluation value calculation process, the CPU 21 first initializes the variable i to "0" and stores an array variable CNT [K for storing the evaluation value related to the key #K. ] Is initialized to “0” (step S40)
1). Thereafter, the CPU 21 initializes the variable j to “0”.
(Step S402) Then, the WKey_K [i, j] and the j-th of Panel [i]
Multiply the result of the bit value (Panel [i, j] in the figure) by CNT [K]
(Step S403). And the CPU 21
Performs a comparison between the j value and the jmax value (jmax = 7 in this embodiment) (step S404).

If the two values do not match (step S404; NO), the CPU 21 increments the j value by “1” (step S405), and executes the processing from step S403 again. On the other hand, when both values match (step S404; YES), the CPU 21 compares the i value with the imax value (imax = 5 in the present embodiment) (step S406). If the i value and the imax value do not match (step S406; NO), the CPU 21
Increments the i value by “1” (step S407)
Then, the processing from step S402 is executed again. When the i value and the imax value match (step S40)
6; YES), the CPU 21 ends the evaluation value calculation process.

As described above, the weighted key information WK
The element WKey_K [i, j] of ey_K is displayed in the display area (i, j) (line i, line
Numerical data indicating the ratio of the display section located in the j-th column) used for displaying the key #K. Accordingly, by the evaluation value calculation process executed in the above procedure, one or more of the areas corresponding to the detection points, for which the contact with the finger or the like has been detected for a predetermined time continuously, out of the entire area of the key #K to be evaluated The numerical value corresponding to the area of the portion included in the display section is calculated as the evaluation value CNT [K].

After the end of the evaluation value calculation processing, the CPU 21
It is determined whether the K value and the Kmax value match (FIG. 9:
Step S305). That is, the CPU 21 determines whether or not the calculation of the evaluation values for all keys has been completed.
In (step S305; NO), the K value is incremented by "1" (step S306), and the processing from step S304 is executed again.

The CPU 21 completes the calculation of the evaluation values CNT [1] to CNT [Kmax] for the keys # 1 to #Kmax.
(Step S305; YES), Steps S304-
The process exits the processing loop of S306. And the CPU 21
Is a process of obtaining the maximum value of the evaluation values CNT [1] to CNT [Kmax] and specifying a key (key number) for which an evaluation value matching the maximum value is obtained (step S30).
Perform 7).

If the number of keys specified in step S307 is one (step S308; NO), the CPU 21
Determines that the key has been pressed (step S309), and terminates the key determination process. On the other hand, if two or more keys have been specified in step S307 (step S308; YES), the CPU 21 determines, based on the key size information relating to the specified keys, one of the keys having the smallest size among those keys. It is determined whether a key can be specified (step S310). When one key with the smallest size can be specified (step S310; YE)
S), the CPU 21 determines that the key is the pressed key (step S311), and ends the key determination process. This step S311 or the above-described step S3
When step 309 is executed, the CPU 21 executes a process corresponding to the key determined to be pressed after the key determination process ends.

If there are two or more keys having the minimum size among the plurality of keys specified in step S307 (step S310; NO), the CPU 21 does nothing (if any key is pressed). Key determination process), and terminates the key determination process. In this case, the CPU 21 waits until an interrupt request is issued from the operating device I / F board 26 (the user once removes his / her finger from the touch panel 53 and then touches the touch panel 53 again).

Hereinafter, the information processing apparatus 1 according to the second embodiment
The operation at the time of the key determination process of 0 will be described according to a specific example.

For example, as shown schematically in FIG. 11A, the user's finger touches only the hatched portion of the key #m on the touch panel 53 (keeps touching for a predetermined time). T) consider the case. That is, in the state management device 10 according to the first embodiment, a case is considered in which the user touches a portion where it is not determined that a key is pressed with a finger.

In this case, in step S101, Panel
[3] is "00010000" and the other elements are "0000000"
0 "is generated. Based on the panel information Panel and the weighted key information WKey_1 to Wkey_Kmax relating to the panel image 110 (see FIGS. 8B to 8D), FIG. The evaluation values CNT [1] to CNT [Kmax] for each key are calculated according to the procedure shown.
[m] and the evaluation value CNT [n] are both 、, and the evaluation values CNT [K] (K ≠ m, n) for the other keys are all “0”.
Becomes Therefore, in step S307, key #m
And the key #n are specified, the result is that step S31
0 is performed, and the sizes of the key #m and the key #n are compared based on the key size information S_m and S_n. In this case, since the size of key #n is smaller, step S311 is executed, and it is determined that key #n has been pressed.

Further, as schematically shown in FIG. 11B, the user's finger touches the hatched portion of the key #m on the touch panel 53 (the finger is kept touched for a predetermined time). ) Consider the case.

In this case, in step S301, Panel
A panel information Panel in which [5] is "00010000" and other elements are "00000000" is generated. Then, since steps S302 to S308 are performed on the panel information, the evaluation value CNT [q] for the key #q and the evaluation value CNT [r] for the key #r are １ ／, 4/3, respectively. Becomes
The evaluation values for the other keys are all “0”. Therefore,
In step S307, only key #r is specified, and as a result, it is determined that key #r is pressed in step S309.

As described above, in the information processing apparatus 10 according to the second embodiment, similarly to the information processing apparatus 10 according to the first embodiment, each key included in the panel screen is assumed to occupy an integral number of display sections. Even if it does not happen, when the user touches the key with the finger, accurate key determination is always performed. In the information processing device 10 according to the second embodiment,
In the case where the finger touches a portion where it is not determined that the key is pressed in the state management device 10 according to the first embodiment, even if one key can be identified by the area (evaluation value) of the portion touched by the finger ( In the case shown in FIG. 11B) or when one key can be identified by the size of the key (FIG.
1 (A)), it is determined that the key has been pressed.

Since the key definition information (weighted key information) can be easily created, the operation is easy if the configuration used in the information processing apparatus 10 according to the present embodiment is adopted. It is possible to easily realize an information processing apparatus in which a panel image is displayed and a key is not determined to be pressed.

The information processing apparatus 10 (C
PU21), when the evaluation values are equal, it is determined that the key of the smaller size is pressed. The probability of erroneous determination in such a determination is determined by the key of the larger size. Is considered to be smaller than the probability of erroneous determination when it is determined that is pressed. However, since the difference between the two probabilities is not so large, steps S310 and S311 are not executed (FIG. 9).
The information processing apparatus 10 may be configured so that the processing is terminated when the process branches to the YES side in step S308).

<Third Embodiment> An information processing apparatus according to a third embodiment of the present invention is different from the information processing apparatus according to the second embodiment only in the content of an evaluation value calculation process to be executed. I have.

FIG. 12 shows a flowchart of the evaluation value calculation processing executed by the information processing apparatus 10 according to the third embodiment. As illustrated, in steps S501 to S507 of the evaluation value calculation process performed by the information processing apparatus 10,
Exactly the same processing as steps S401 to S407 of the evaluation value calculation processing (see FIG. 10) of the information processing apparatus 10 according to the second embodiment is performed.

Then, the evaluation value calculation process performed by the information processing apparatus 10 according to the third embodiment is performed when the i value and the imax value match (step S50).
6; YES), the process of multiplying the value of CNT [K] by “1 / S_K” (step S507) is performed, and the process is terminated.

That is, in the information processing apparatus 10 according to the third embodiment, the value CNT [K] calculated in the evaluation value calculation processing shown in FIG. 10 is divided by S_K representing the size of the key #K. The value is calculated as the evaluation value CNT [K]. Then, in the information processing apparatus 10 according to the third embodiment, the evaluation values CNT [1] to CNT [Kmax] thus calculated
The key determination is performed in the same procedure (the procedure shown in FIG. 9) as in the information processing apparatus 10 according to the embodiment. Therefore, the information processing device 10 according to the third embodiment functions as a device that performs the same determination as the information processing device 10 according to the second embodiment.

For example, consider a case where the information processing apparatus 10 is configured as an apparatus for displaying the panel image 110 shown in FIG. 8 and the user touches the portion shown in FIG. 11A with a finger. . In this case, 0.5 / 3.5 and 0.5 / 2.5 are calculated as CNT [m] and CNT [n], respectively, so a branch to the “NO” side is performed in a step corresponding to step S308. Thus, it is determined that the key #n has been pressed. When the user touches the part shown in FIG. 11B with a finger, 0.25 / 3.25 and 0.75 / 2.75 are calculated as CNT [q] and CNT [r], respectively. In the step corresponding to step S308, the branch to the “NO” side is performed, and it is determined that the key #r is pressed.

As described above, the information processing device 10 according to the third embodiment functions as a device that performs the same determination as the information processing device 10 according to the second embodiment. In the present information processing apparatus 10, the evaluation value of 2
If there are two or more keys, the probability that the sizes of those keys are equal is extremely high. (If the panel image is not specially designed, the size of the two or more keys for which the maximum evaluation value is calculated is Does not differ), so that steps corresponding to steps S310 and S311 may not be performed during the key determination processing.

<Modifications> The information processing apparatuses according to the first to third embodiments can perform various modifications.
For example, the key information relating to a certain key only needs to be information in which all the display sections used for the display are associated with the key. Therefore, instead of the key information having the above-described configuration, the display information used for displaying the key is used. Information consisting of section position information may be used. That is, instead of the key information Key_n shown in FIG. 4B, four pieces of position information (3,0), (3,
Information consisting of 1), (3,2) and (3,3) may be used.

The weighted key information for a certain key may be any information as long as the information shows all the display sections used to display the key and the weight values related to them. Alternatively, information composed of information having a configuration such as key information and a weight value for each display section associated with “1” in the information may be used. Further, instead of the weighted key information having the above-described configuration, information including position information and a weight value for each display section used for displaying a key may be used.

Further, weighted key information may be created so that each display section associated with each key is associated with a weight value independent of the ratio used for displaying the display section. By creating the weighted key information in this way, when the user touches a part that can determine which of two or more keys has been pressed with a finger, a large weight value is intentionally associated therewith. The information processing apparatus 10 can determine that the pressed key has been pressed. Specifically, for example, if only the element WKey_m [3,3] of the weighted key information WKey_m shown in FIG. 8C is changed to “1”, the information processing apparatus 10 according to the second embodiment To
When the operation shown in FIG. 11A is performed, the key #m
Can be determined to have been pressed.

Further, in the information processing apparatuses according to the second and third embodiments, numerical data indicating the sum of elements other than “0” of the weighted key information is prepared as key size information. May be information indicating the actual area of each key. Further, when one key cannot be identified by the evaluation value, the information processing apparatus 10 according to the second and third embodiments treats a key having a large size as a key having a high priority and determines a pressed key. However, ordered information in which the keys are ordered according to another criterion (for example, information in which the keys are ordered according to the magnitude of the key press probability) is prepared, and the determination in step S310 is made based on the ordered information. Information processing apparatus 10
May be configured.

The information processing apparatus 10 according to each embodiment
Is configured such that panel information is created based on two pieces of state information, but the information processing apparatus 1 is configured to create panel information based on one or three or more pieces of state information.
0 may be configured. Further, the information processing apparatus 10 according to each embodiment has an information processing apparatus main body 11 that is intended to control the scanner 13 and the printer 14.
The device (the key determination procedure using key information / weighted key information) used in the information processing apparatus 10 according to each embodiment Naturally, the present invention may be applied to an information processing device having such a purpose, may be applied to an information processing device having a built-in touch screen, and may be a touch screen unit 50 that outputs parallel data. It is.

Further, in each embodiment, the operation of the information processing apparatus 10 has been described by taking as an example a panel image including several sets of keys arranged in a horizontal direction that commonly use one display section. Naturally, the panel image may include some sets of keys arranged in the vertical direction that commonly use one display section. Further, the panel image 110 (FIG. 8) used for describing the information processing apparatus 10 according to the second and third embodiments includes, among the two keys that are commonly displayed in a certain display section, Two keys (for example, key #m and key #m) having the same ratio used to display each key for the display section
n) is included, but when using the information processing apparatus 10 according to the second or third embodiment, the panel image should be designed so that the number of such two keys is as small as possible. Is desirable.

[0100]

According to the present invention, it is possible to use a freely designed panel image, in other words, a panel image in which the operation method can be more easily understood, so that an easy-to-use information processing apparatus can be obtained. Further, according to the pressed key determination method of the present invention, it is possible to accurately determine which key on the freely designed panel image is pressed by the user, so that the touch screen is more effectively used as an input device. You can do it.

[Brief description of the drawings]

FIG. 1 is a hardware configuration diagram of an information processing apparatus according to a first embodiment of the present invention.

FIG. 2 is an explanatory diagram of a usage pattern of the information processing apparatus according to the first embodiment.

FIG. 3 is an explanatory diagram of an operation of an operation device I / F board included in the information processing apparatus according to the first embodiment.

FIG. 4 is an explanatory diagram of a panel image and key information used in the information processing apparatus according to the first embodiment.

FIG. 5 is a flowchart of a key determination process performed in the information processing apparatus according to the first embodiment.

FIG. 6 is a flowchart of an evaluation value calculation process performed in the information processing apparatus according to the first embodiment.

FIG. 7 is a diagram for describing a key determination process performed in the information processing apparatus according to the first embodiment.

FIG. 8 is an explanatory diagram of a panel image and weighted key information used in an information processing apparatus according to a second embodiment of the present invention.

FIG. 9 is a flowchart of a key determination process performed in the information processing apparatus according to the second embodiment.

FIG. 10 is a flowchart of an evaluation value calculation process performed in the information processing apparatus according to the second embodiment.

FIG. 11 is a diagram illustrating a key determination process performed in the information processing apparatus according to the second embodiment.

FIG. 12 is a flowchart of an evaluation value calculation process performed in the information processing apparatus according to the third embodiment of the present invention.

FIG. 13 is an explanatory diagram of a panel image used in a conventional information processing apparatus having a touch screen.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 Information processing apparatus 11 Information processing apparatus main body 12 Operating device 13 Scanner 14 Printer 21 CPU 22 ROM 23 RAM 24 Bridge 25 HDD controller 26 Operation panel I / F board 27 Scanner I / F board 28 Printer I / F board 29 Network I / F board 30 HDD 31 CPU bus 32 General-purpose bus 36, 37, 38 Cable 50 Touch screen unit 51 Touch screen 52 Liquid crystal panel 53 Touch panel 55 Touch screen control unit 60 Key operation unit 100, 110 Panel image

Claims (11)

[Claims] 1. A touch screen in which a touch panel having a plurality of detection points arranged in a matrix is superimposed on a display device; a display control means for displaying a panel image including a plurality of keys on the display device; For each key included in the image, the key is displayed when it is assumed that the display area of the display device is divided into a plurality of display sections where one detection point is located substantially at the center of each key. Key definition information holding means for holding key definition information for associating one or more display sections, and identification means for identifying one or more detection points of the touch panel for detecting contact with a finger or the like; Each key included in the panel image is associated with the key by the key definition information, and
An evaluation value calculation unit that calculates an evaluation value according to the number of display sections located below the detection point specified by the specifying unit; and a key having the largest evaluation value calculated by the evaluation value calculation unit. An information processing apparatus comprising: a determination unit that searches and determines that one key is pressed when only one key is searched. 2. A touch screen in which a touch panel having a plurality of detection points arranged in a matrix is superimposed on a display device; a display control means for displaying a panel image including a plurality of keys on the display device; For each key included in the image, the key is displayed when it is assumed that the display area of the display device is divided into a plurality of display sections where one detection point is located substantially at the center of each key. One or more display sections are associated with each other, and key definition information holding means holding key definition information for associating a weight value with each display section associated with each key, and detecting contact of a finger or the like. Specifying means for specifying one or more detection points of the touch panel; and referring to the key definition information, associating each key included in the panel image with the key. Evaluation value calculating means for calculating an evaluation value corresponding to the sum of weight values associated with the display sections located below the detection point specified by the specifying means; and An information processing apparatus comprising: a search unit that searches for a key having the largest evaluation value calculated by the unit and, when only one key is searched, determines that the key is pressed. 3. The key definition information is characterized in that each display section associated with each key is associated with a weight value of a size corresponding to a ratio of the display section used for displaying the key. The information processing apparatus according to claim 2, wherein: 4. The panel image according to claim 1, wherein a plurality of keys to be displayed in common in a certain display section have different ratios of the display sections used for displaying the keys. 4. The information processing apparatus according to claim 3, wherein: 5. The display device according to claim 1, wherein said evaluation value calculating means is associated with each key included in said panel image and is located below a detection point specified by said specifying means. 5. The information processing according to claim 2, wherein an evaluation value is calculated according to a value obtained by dividing a sum of weight values associated with the sections by a value representing the size of the key. apparatus. 6. The apparatus according to claim 1, wherein the determining unit determines that no key is pressed when two or more keys having the largest evaluation value are searched. An information processing device according to any one of the above. 7. The key definition information includes ordered information indicating a priority order assigned to each key included in the panel image, and the determination unit searches for two or more keys having the largest evaluation values. 6. The method according to claim 1, further comprising: determining a key having the highest priority among the keys based on the ordered information, and determining that the determined key is pressed. An information processing device according to any one of the above. 8. The ordered information includes a plurality of pieces of size information each indicating a size of the plurality of keys, and the determining unit sets a key having the smallest size indicated by the size information as a key having the highest priority. The information processing apparatus according to claim 7, wherein the determination is performed. 9. The method according to claim 6, wherein the specifying unit specifies one or more detection points that have continuously detected contact with a finger or the like for a predetermined time by acquiring an output of the touch panel a plurality of times. The information processing apparatus according to claim 1, wherein the information processing apparatus performs the processing. 10. Based on an output of a touch panel having a plurality of detection points arranged in a matrix and superimposed on a display device for displaying a panel image including a plurality of keys.
A pressed key determination method for determining which key in a panel image is pressed, a specifying step of specifying one or more detection points of the touch panel detecting contact with a finger or the like, For each key included in the panel image, the key is displayed assuming that the display area of the display device is divided into a plurality of display sections where one detection point is located substantially at the center of each. Each key included in the panel image is associated with the key by referring to the key definition information corresponding to one or more display sections to be identified, and specified by the specifying unit. An evaluation value calculating step for calculating an evaluation value corresponding to the number of display sections located below the detection point, and searching for a key having the largest evaluation value calculated in the evaluation value calculating step. It pressed key determination method only one key when it is searched, characterized in that it comprises a determining step and the key has been pressed. 11. Based on an output of a touch panel having a plurality of detection points arranged in a matrix and superimposed on a display device for displaying a panel image including a plurality of keys.
A pressed key determination method for determining which key in a panel image is pressed, a specifying step of specifying one or more detection points of the touch panel detecting contact with a finger or the like, For each key included in the panel image, the key is displayed assuming that the display area of the display device is divided into a plurality of display sections where one detection point is located substantially at the center of each. For each key included in the panel image, reference is made to key definition information for associating one or more display sections to be associated with each other and to associate a weight value with each display section associated with each key. And an evaluation value for calculating an evaluation value corresponding to the sum of weight values associated with the display sections located below the detection point specified by the specifying means. Output step; and searching for a key having the largest evaluation value calculated in the evaluation value calculating step. When only one key is searched, a determination step of determining that the key has been pressed is included. Characteristic pressed key determination method.