JP4857385B2 - Electronic pen system - Google Patents

Description

  The present invention relates to an electronic pen system that displays an image on a touch surface according to a touch operation by an electronic pen and a finger on a touch surface of a touch panel.

  There is known an electronic pen system in which an electronic pen and a touch panel are combined. This type of electronic pen system is widely used in the field of personal computers and personal digital assistants, but can be used in presentations and lectures for a large number of people by combining a touch panel with a large-screen display device. The technique used as what is called an interactive whiteboard (electronic blackboard) is known (refer patent document 1).

  In such a large-sized electronic pen system, while holding the electronic pen with one hand and performing a required operation such as drawing, another operation is performed with the finger of the other hand, or one user is electronic While using the pen to perform the required operation, another user who does not have the electronic pen can perform the required operation with the finger, and the electronic pen and the finger can be used separately and used in parallel. If you can, it will be easier to use.

In relation to such a demand, conventionally, a technique has been known in which different functions are given to an electronic pen and a finger to properly use them (see Patent Document 2 ). Here, it is disclosed to determine which of the electronic pen and the finger is the pointing object that performed the touch operation, and to perform control according to a function given in advance to each of them (Patent Document 2). .

JP 2008-118301 A Japanese Patent No. 2599019

  However, in the conventional technique disclosed in Patent Document 1, a touch operation with a finger is used for an instruction to the apparatus, and specifically, is performed to set an attribute (drawing color) of the electronic pen. However, the electronic pen and the finger are not used separately in parallel, and cannot be used in parallel, and cannot be a highly convenient electronic pen system that fully utilizes the touch operation with the electronic pen and the finger.

  Further, in the conventional technique disclosed in Patent Document 2, the drawing is performed when the pointing object that has been touched is determined to be an electronic pen, and the display screen is scrolled when it is determined to be a finger. Here, it is assumed that the operation using the electronic pen and the finger is used at different timings. Similar to the conventional technique, the electronic pen and the finger are used in an equivalent manner in parallel. Therefore, it cannot be a highly convenient electronic pen system that fully utilizes the touch operation with an electronic pen and a finger.

  The present invention has been devised to solve such problems of the prior art, and its main purpose is to enable the electronic pen and the finger to be used equally and used in parallel. The object is to provide a structured electronic pen system.

  An electronic pen system of the present invention includes an electronic pen, a touch panel body including a touch surface on which a touch operation is performed with the electronic pen and a finger, and a position detection device that detects a touch position of the electronic pen and the finger on the touch surface. An electronic pen system comprising: a display device that displays a required image using the touch surface as a display screen; and a control device that causes the display device to display an image according to position detection information acquired from the position detection device. When the position detection information is received from the position detection device, the control device determines whether the position detection information is from the electronic pen or a finger, and the electronic pen First control means for performing a predetermined pen input process in response to a touch operation by the user, and second control means for performing a predetermined finger input process in response to a finger touch operation. , A configuration to be executed in parallel with the finger input processing of the first control means of the pen input process and said second control means.

  According to the present invention, since the pen input process of the first control unit and the finger input process of the second control unit are executed in parallel, the electronic pen and the finger are used in an equivalent manner in parallel. Can do.

1 is an overall configuration diagram showing an electronic pen system according to the present invention. Schematic block diagram of the electronic pen shown in FIG. The flowchart which shows the procedure of a process of the electronic pen shown in FIG. 1, and a control apparatus. The flowchart which shows the procedure of the pen input process shown in FIG. The figure which shows the drawing palette displayed on a touch surface by the display apparatus shown in FIG. The flowchart which shows the procedure of the finger input process shown in FIG. Schematic block diagram showing another example of the electronic pen shown in FIG. Schematic block diagram showing another example of the electronic pen shown in FIG. Schematic block diagram showing another example of the electronic pen shown in FIG. The schematic diagram which shows the example of the non-contact mode of the electronic pen shown in FIG. Schematic block diagram showing another example of the electronic pen shown in FIG. The figure which shows an example of the handwriting input in the electronic pen system shown in FIG. FIG. 12 is a timing chart showing the transmission status of pen information during handwriting input shown in FIG. FIG. 3 is a timing chart showing a transmission state of pen information at the time of handwriting input in the electronic pen system shown in FIG. FIG. 1 is a timing chart showing simplified operations of the plurality of electronic pens and the control device shown in FIG. 1 is a schematic diagram showing a schematic configuration of a drawing control unit of the control device shown in FIG. Schematic diagram showing the status of collaborative operations for editing a display object by touching multiple indicators (electronic pen and finger) at the same time Schematic diagram showing the status of collaborative operations for editing a display object by touching multiple indicators (electronic pen and finger) at the same time The flowchart which shows the process sequence in the control apparatus shown in FIG. FIG. 19 is a flowchart showing a processing procedure for joint operation of the electronic pen and the finger shown in FIG. The schematic diagram which shows the condition at the time of drawing a line with the some electronic pen shown in FIG. The schematic diagram which shows the condition at the time of drawing a line with the some electronic pen shown in FIG.

  A first invention made to solve the above problems is an electronic pen, a touch panel body including a touch surface on which a touch operation is performed by the electronic pen and a finger, and the touch of the electronic pen and the finger on the touch surface. A position detection device for detecting a position; a display device for displaying a required image using the touch surface as a display screen; and a control device for causing the display device to display an image according to position detection information acquired from the position detection device; When the position detection information is received from the position detection device, the control device determines whether the position detection information is from the electronic pen or a finger. A first control unit that performs predetermined pen input processing in response to a touch operation with the electronic pen; and a second controller that performs predetermined finger input processing in response to a finger touch operation. And a control unit, and a configuration to be executed in parallel with the finger input processing of the first pen input processing control unit the second control means.

  According to this, since the pen input process of the first control unit and the finger input process of the second control unit are executed in parallel, the electronic pen and the finger can be used in an equivalent manner in parallel. .

  According to a second invention for solving the above-mentioned problems, in the first invention, the finger input processing executed by the second control means is at least one of movement, rotation, enlargement and reduction of a display object. Such a process is included.

  According to this, display objects such as movement, rotation, enlargement, and reduction can be edited by a touch operation with a finger.

  According to a third invention for solving the above-mentioned problems, in the first and second inventions, the electronic pen transmits pen information to the control device at the time of a touch operation, and the control device At substantially the same time as receiving the position detection information from the detection device, the position detection information received from the position detection device depends on whether or not the pen information has been received from the electronic pen. It is configured to determine which is due.

  According to this, it is possible to determine which of the electronic pen and the finger is the pointing object that has performed the touch operation.

  According to a fourth aspect of the present invention for solving the above problem, in the third aspect of the present invention, the position detecting device determines a touch position from a change in capacitance according to the approach or contact of the conductor to the touch surface. The electronic pen is configured to detect an electrical connection between a pen information transmission unit that transmits predetermined pen information to the control unit, and a pen tip unit and a grip unit that are provided in a state of being electrically disconnected from each other. A connection switch for interrupting connection; and a touch state detection unit for detecting a touch state on the touch surface, and the control unit controls the pen information transmission unit when the touch state detection unit detects the touch state. Pen information is transmitted to the control unit, and then the connection switch is turned on so that the pen can be input. After the control device receives the pen information from the electronic pen, When position detection information from the position detection device is received, it is determined that the position detection information is from the electronic pen, and on the other hand, position detection from the position detection device is received without receiving pen information from the electronic pen. When information is received, the position detection information is determined to be a finger.

  According to this, it is possible to definitely determine which of the electronic pen and the finger is the pointing object that has performed the touch operation.

  According to a fifth aspect of the present invention for solving the above-described problems, in the first to fourth aspects of the present invention, the first control unit responds to a touch operation by the electronic pen and an attribute set to the electronic pen. The second control means performs an editing process in response to a finger touch operation on the display object, and the control device performs a finger process according to a user instruction. A finger drawing mode in which the touch operation by the electronic pen is regarded as being performed by the electronic pen, and in this finger drawing mode, the first control means performs a drawing process according to the touch operation with the finger with a standard attribute; To do.

According to this, drawing can be performed by a touch operation with a finger as a substitute for the electronic pen.
According to a sixth aspect of the invention for solving the above-described problem, a touch surface on which a touch operation is performed with an electronic pen and a finger is used as a display screen, and a change in capacitance according to the approach or contact of a conductor to the touch surface. A control device that controls to display an image corresponding to the touch position detected from the display screen on the display screen, was the pen information received from the electronic pen substantially simultaneously with the detection of the touch position? It is determined whether the touch operation is performed by the electronic pen or the finger depending on whether or not, and the pen input process by the electronic pen and the finger input process by the finger are executed in parallel.
According to this, it is possible to use the electronic pen and the finger in parallel by using them equally.
According to a seventh aspect of the present invention for solving the above problems, in the sixth aspect, when the electronic pen and the finger are touching the same display object, the joint operation for the same display object by the electronic pen and the finger is performed. It is set as the structure judged to be.
According to this, in addition to the independent operation in which the display object is operated according to the operation mode selected according to the pen input and the finger input, the touch position on the display object by the electronic pen is used as the center point according to the finger movement. Collaborative operations such as rotating display objects can be performed.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is an overall configuration diagram showing an electronic pen system according to the present invention. The electronic pen system includes an electronic pen 1, a touch panel body 3 including a touch surface 2 on which a touch operation is performed with the electronic pen 1 and a finger F, and electrostatic according to the approach or contact of a conductor to the touch surface 2. The position detection device 4 that detects the touch position from the change in capacity, the display device 5 that displays a required image using the touch surface 2 as a display screen, the position detection information acquired from the position detection device 4 and the attributes of the electronic pen 1 And a control device 6 for displaying a corresponding image on the display device 5.

  The touch panel body 3 includes a plurality of transmission electrodes (first electrodes) 11 that run parallel to each other and a plurality of reception electrodes (second electrodes) 12 that are insulated from the transmission electrodes 11 and run parallel to each other. ing. The insulating state between the transmission electrode 11 and the reception electrode 12 is achieved by providing a sheet-like support between them, for example.

  The position detection device 4 receives the charge / discharge current signal of the transmission unit 13 that applies a drive signal (pulse signal) to the transmission electrode 11 and the reception electrode 12 that responds to the drive signal applied to the transmission electrode 11. The reception unit 14 that outputs a level signal at each electrode intersection where the transmission electrode 11 and the reception electrode 12 intersect (superimpose in an insulated state), and the touch position is detected based on the level signal output from the reception unit 14 In addition, a position detection control unit 15 that controls operations of the transmission unit 13 and the reception unit 14 is provided.

  The touch panel body 3 is used as a so-called interactive whiteboard that can be used for presentations and lectures by being combined with a display device 5 having a large screen. In particular, here, the display device 5 is a projector, and the touch surface. 2 is a projector screen. In addition, the display device 5 may be configured by a liquid crystal display or a plasma display, and may be disposed on the back side of the touch panel body, the transmission electrode, and the reception electrode, both of which are configured by a transparent material.

  The control device 6 is based on the wireless communication unit 16 that communicates with the electronic pen 1 and the position detection information output from the position detection device 4 in response to a touch operation with the electronic pen 1 or the finger F on the touch surface 2. The drawing control unit 17 that draws images such as characters, lines, and graphics, the display control unit 18 that generates display screen data based on the output of the drawing control unit 17 and outputs the display screen data to the display device 5, and these units are summarized. And a main control unit 19 for controlling automatically.

  The drawing control unit 17 performs a process of drawing an image according to the touch operation in the drawing mode, and erasing the image according to the touch operation in the eraser mode. In addition, the drawing control unit 17 includes an indicator determining unit (indicator indicating whether the position detection information is obtained by the electronic pen 1 or the finger F when the position detection information is acquired from the position detection device 4. And a drawing process is performed based on attributes set for the electronic pen 1 and the finger F, respectively.

  The main control unit 19 executes a process assigned to the operation button displayed on the display screen in the cursor operation mode according to the touch operation. The control device 6 is composed of a personal computer and peripheral devices, and an OS for realizing the main control unit 19 and an application program for realizing the drawing control unit 17 are introduced.

  The transmission electrode 11 and the reception electrode 12 are arranged at the same arrangement pitch (for example, 10 mm), and a capacitor is formed at an electrode intersection where the transmission electrode 11 and the reception electrode 12 intersect, and the user performs a touch operation with an indicator. When this is performed, the presence or absence of a touch operation can be detected by substantially reducing the capacitance at the electrode intersection.

  In particular, here, the mutual capacitance method is adopted, and when a drive signal is applied to the transmission electrode 11, a charge / discharge current flows to the reception electrode 12 in response to this, and at this time, according to the touch operation of the user, When the capacitance changes, the charging / discharging current of the receiving electrode 12 changes. The amount of change of the charging / discharging current is converted into a level signal (digital signal) for each electrode intersection by the receiving unit 14 and output to the position detection control unit 15. Then, the position detection control unit 15 calculates the touch position based on the level signal for each electrode intersection. This mutual capacitance method enables so-called multi-touch (multi-point detection) in which a plurality of touch positions are detected simultaneously.

  The transmission unit 13 selects the transmission electrodes 11 one by one and applies a drive signal in synchronization with the timing signal output from the position detection control unit 15. The receiving unit 14 receives the charging / discharging current of the receiving electrode 12 by selecting the receiving electrodes 12 one by one while applying a drive signal to one transmitting electrode 11. Thereby, the charging / discharging current for every electrode intersection can be taken out.

  The position detection control unit 15 obtains a touch position (center coordinate of the touch area) from the level signal for each electrode intersection output from the reception unit 14 by a predetermined calculation process. In the calculation of the touch position, the level at each of a plurality of (for example, 4 × 4) electrode intersections adjacent to each other in the X-axis direction (extension direction of the transmission electrode 11) and the Y-axis direction (extension direction of the reception electrode 12). The touch position is obtained from the signal using a required interpolation method (for example, the center of gravity method). Thereby, a touch position can be detected with a resolution (for example, 1 mm or less) higher than the arrangement pitch (10 mm) of the transmission electrode 11 and the reception electrode 12.

  FIG. 2 is a schematic configuration diagram of the electronic pen 1 shown in FIG. The electronic pen 1 is a wireless communication that performs communication between a control unit 6 and a pen body 22 that includes a grip 21 that a user holds with a hand, a pen tip 23 that is pressed against the touch surface 2 during a touch operation. A circuit 24; a connection switch 25 for interrupting electrical connection between the pen tip portion 23 and the grip portion 21 provided in a state of being electrically disconnected from each other; and a magnetic sensor for detecting a touch state on the touch surface (touch state) Detection means) 26 and a pen control circuit 27 that controls the operation of each unit in a comprehensive manner. In addition, the power of the battery 29 is supplied to the pen control circuit 27, the wireless communication circuit 24, and the like via a power supply circuit 28 as necessary. In the present embodiment, the grip portion 21 is made of a conductive resin. However, a metal material or a resin coated with a conductive material may be used, and when the user grips the electronic pen 1. The conductive material may be appropriately selected so that at least the pen tip 23 and the human body are electrically connected.

  The pen body 22 is made of a conductive synthetic resin material. The pen tip portion 23 includes a pen tip cover 31 and a pen tip shaft 32. The pen tip cover 31 is made of a conductive felt material, and the pen tip shaft 32 is made of a conductive synthetic resin material. The pen tip 23 is held by the pen body 22 via an insulator 33. The pen tip shaft 32 is supported by a guide member (not shown) so as to be movable in the axial direction. When the pen tip 23 is pressed against the touch surface 2 during a touch operation, the pen tip cover 31 made of a felt material contracts and the pen tip shaft 32 is pushed in.

  The magnetic sensor 26 detects the displacement of the magnet 34 provided on the pen tip shaft 32. When the pen tip shaft 32 is pushed in during a touch operation, the distance between the magnet 34 and the magnetic sensor 26 changes with the movement of the pen tip shaft 32, so that the touch state can be detected.

  The connection switch 25 is an electronic switch (a transistor such as an FET) and is on / off controlled by a pen control circuit (switch control means) 27. The electronic switch preferably has a small inter-terminal parasitic capacitance when it is off. This is because, when the capacitance component is large, even if the connection switch 25 is off, the state is equivalent to that conducted to the human body. From this point of view, the connection switch 25 may be constituted by a contact type relay whose capacitance is almost negligible.

  Here, when the connection switch 25 is off, the pen tip portion 23 is electrically disconnected from the grip portion 21. Since the component capacity of the pen tip 23 is extremely small, the position detection device 4 recognizes the proximity / contact of the electronic pen 1 even when the pen tip 23 is brought close to the touch surface 2 (or in a state where it is lightly touched). There is nothing.

  On the other hand, when the connection switch 25 is turned on, the pen tip portion 23 is electrically connected to the grip portion 21, and the human body is electrically connected to the pen tip portion 23 via the grip portion 21. Since the human body has a relatively large capacitance, when the electronic pen 1 approaches or touches the touch surface 2, the lines of electric force between the transmission electrode 11 and the reception electrode 12 (see FIG. 1) change, and the position detection device 4 can reliably detect the touch state of the electronic pen 1.

  The electronic pen 1 is provided with push type operation switches 41 to 43 and a rotary type operation switch 44. The push-type operation switches 41 to 43 cause the pen control circuit 27 to perform operations assigned to the operation switches 41 to 43 by pressing the operation buttons 45 to 47. For example, the first operation switch 41 has the same function as a mouse button, and the second and third operation switches 42 and 43 have a function of scrolling the display screen in the forward direction and the return direction. .

  The rotary operation switch (attribute selection means) 44 is configured to switch the attribute relating to the function of the electronic pen 1 by rotating the operation knob 48. In particular, here, the operation switches 44 can select black, red, green, and blue drawing colors and an eraser mode in the drawing mode. In addition, it is good also as a structure which can select the attribute regarding this other function.

  The pen control circuit 27 stores unique pen identification information (ID). Further, the pen control circuit 27 determines whether or not the touch state is made based on the output of the magnetic sensor 26 and generates status information. The pen control circuit 27 generates attribute information according to the operation of the operation switch 44. In response to a transmission instruction from 27, pen information including pen identification information, status information, and attribute information is transmitted from the wireless communication circuit 24 (pen information transmission means) to the control device 6. The wireless communication circuit 24 employs, for example, 2.4 GHz band advanced low power data communication.

  FIG. 3 is a flowchart showing a processing procedure of the electronic pen 1 and the control device 6 shown in FIG. The electronic pen 1 is operated from the wireless communication circuit 24 in response to the user performing a touch operation, the pen tip 23 being pressed against the touch surface 2 and the magnetic sensor 26 detecting the touch state (Yes in ST102). After the pen information is transmitted to the control device 6 (ST103), the connection switch 25 is turned on so that the pen input is possible (ST105).

  After receiving the pen information from the electronic pen 1 (Yes in ST202), the control device 6 receives the position detection information from the position detection device 4 (Yes in ST206) and sends the position detection information to the electronic pen 1. The touch operation is determined to proceed to pen input processing (ST208). On the other hand, when the position detection information from the position detection device 4 is received without receiving the pen information from the electronic pen 1, it is determined that the touch operation is performed with the finger F and the process proceeds to the finger input process (ST209).

  In the electronic pen 1, the connection switch 25 is turned on after a predetermined time (for example, 500 ms) has elapsed since the touch state was detected by the magnetic sensor 26 (ST104). This ensures that the timing at which the control device 6 receives the pen information from the electronic pen and the timing at which the pen detection is enabled and the position detection information from the position detection device 4 are reversed are prevented. Can do.

  Further, in the electronic pen 1, when the non-touch state detected by the magnetic sensor 26 continues for a predetermined time (for example, 2 seconds) (Yes in ST107), the connection switch 25 is turned off. Thereby, it is possible to avoid frequent repetition of pen information transmission and connection switch 25 on operation as the user performs a touch operation.

  Further, here, when the electronic pen 1 is activated, pen information including pen identification information is first transmitted to the control device 6 (ST101). The control device 6 can recognize the electronic pen 1 in use by receiving pen information at the time of activation from the electronic pen 1 (ST201).

  Note that, for example, pen information including pen identification information, status information, and attribute information may be transmitted to the control device 6 at an arbitrary timing by pressing the first operation switch 41. In the control device 6, when pen information is received from the electronic pen 1, the display device 5 displays the attribute of the electronic pen 1, for example, the drawing color in the drawing mode, on the touch surface 2. Thereby, the user can recognize the attribute set to the electronic pen 1 appropriately.

  FIG. 4 is a flowchart showing a procedure of the pen input process shown in FIG. First, when the pen information attribute is a marker (Yes in ST301), a process of drawing with a specified color at a coordinate position is performed (ST302). On the other hand, when the attribute of the pen information is an eraser (Yes in ST303), if there is drawing data at the coordinate position (Yes in ST304), processing for deleting the drawing data is performed (ST305).

  FIG. 5 is a diagram showing a drawing palette displayed on the touch surface 2 by the display device 5 shown in FIG. In the finger input, an input attribute is selected by a drawing palette. Here, an arrow (cursor), black, red, blue, and green color markers, erasers, special markers, and special function selection boxes are displayed, and are selected by touching with the finger F. When a special marker or special function is selected, a submenu for selecting a specific function is displayed. Special markers include a fluorescent marker and a function of drawing a line by arranging arbitrary figures. The special functions include a loupe function that partially enlarges the display screen, a spotlight function that leaves a part of the display screen dark, and a shade function that hides a part of the display screen.

  FIG. 6 is a flowchart showing the procedure of the finger input process shown in FIG. First, when an arrow is selected in the drawing palette (Yes in ST401), if there is drawing data at the coordinate position (Yes in ST402), processing for moving the drawing data according to the movement of the finger F is performed. (ST403). If there is no drawing data at the coordinate position (No in ST402), the process proceeds to OS cursor operation processing such as menu selection (ST404). On the other hand, when a marker is selected in the drawing palette (Yes in ST405), a process of drawing with a specified color at the coordinate position is performed (ST406). Also, when an eraser is selected in the drawing palette (Yes in ST407), if there is drawing data at the coordinate position (Yes in ST408), a process of deleting the drawing data is performed (ST409).

  6 shows an example in which the three functions of the arrow, the marker, and the eraser are selected in the drawing palette. However, if there are more options as in the example shown in FIG. More steps.

  FIG. 7 is a schematic configuration diagram illustrating another example of the electronic pen 1 illustrated in FIG. 1, and shows an operation state step by step. Here, a first mechanical switch 71 for detecting a touch state, a second mechanical switch 72 serving as a connection switch for interrupting electrical connection between the pen tip portion 23 and the grip portion 21, and a touch operation time A switch operating mechanism 74 for turning on and off the first and second mechanical switches 71 and 72 in conjunction with the displacement of the pen tip 23 is provided.

  The switch operating mechanism 74 includes a first switch operating unit 75 for turning on / off the first mechanical switch 71, and a second switch operating unit 76 for turning on / off the second mechanical switch 72. The second switch operation portions 75 and 76 are provided on the pen tip shaft 32 while being displaced in the axial direction.

  As a result, the first and second mechanical switches 71 and 72 are sequentially turned on according to the backward displacement of the pen tip portion 23 in response to pressing the pen tip portion 23 against the touch surface 2. That is, from the non-touch state shown in FIG. 7A, when the pen tip portion 23 is pressed against the touch surface 2 and retracts, the first mechanical switch 71 is first turned on as shown in FIG. 7B. Then, as shown in FIG. 7C, the second mechanical switch 72 is turned on.

  With such a mechanical configuration, a timer circuit (not shown) of the pen control circuit 27 and the like can be omitted, and battery consumption associated with these operations can be suppressed. Further, by appropriately determining the arrangement interval of the first and second switch operation units 75 and 76, the timing at which the control device 6 receives pen information from the electronic pen 1 and the position where the pen input is enabled It can be reliably avoided that the timing of receiving the position detection information from the detection device 4 is reversed.

  FIG. 8 is a schematic configuration diagram illustrating another example of the electronic pen 1 illustrated in FIG. 1. Here, there is provided an operation button (operation means) 82 for always turning on a mechanical switch 81 serving as a connection switch for interrupting electrical connection between the pen tip portion 23 and the grip portion 21 by a user operation. The operation button 82 has an alternate structure that holds the mechanical switch 81 in either the on state or the off state, and the mechanical switch 81 is forcibly turned on / off by a user operation. Thereby, the electronic pen 1 can be used as a substitute for the finger F even in a state where there is no remaining battery level. Other configurations are the same as those in the example of FIG. 2, and detailed description thereof is omitted. Note that a compulsory connection switch can be similarly provided for the configuration described with reference to FIG.

  FIG. 9 is a schematic configuration diagram illustrating another example of the electronic pen 1 illustrated in FIG. 1. Here, in order to detect a touch state, a position sensor (displacement amount detection means) 91 that detects a displacement amount of the pen tip portion 23 according to pressing the pen tip portion 23 against the touch surface is provided. The electronic pen 1 transmits pen information to which the displacement amount of the pen tip 23 detected by the position sensor 91 is added to the control device 6, and the control device 6 receives the pen information from the electronic pen 1. Predetermined processing according to the acquired pen tip displacement is performed. As the position sensor 91, a variable resistance potentiometer whose resistance value changes according to the amount of movement, an optical position sensor (PSD: Position Sensitive Detector), or the like is used. Other configurations are the same as those in the example of FIG. 2, and detailed description thereof is omitted.

  If it does in this way, various operation instructions can be performed by a user adjusting the writing pressure which changes the amount of displacement of pen point part 23. FIG. For example, the line thickness in the line drawing mode may be changed according to the writing pressure. Alternatively, the amount of displacement of the pen tip 23 may be leveled in stages, and attribute selection, for example, line type (solid line, broken line, one-point broken line) may be selected according to each level. Further, different processing may be assigned to each level, for example, a display object may be selected at level 2 and an operation may be determined at level 5.

  The pen tip portion 23 is formed by the elasticity of the pen tip cover 31 made of a felt material or the elasticity of a rubber member (not shown) interposed between the pen tip shaft 32 and the pen body 22. It is possible to restore the initial state according to the separation of 23 from the touch surface 2 and to displace the pen tip 23 according to the writing pressure by these elastic forces.

  FIG. 10 is a schematic diagram showing an example of the non-contact mode of the electronic pen 1 shown in FIG. As described above, when the electrostatic capacitance method is employed, the position of the electronic pen 1 can be detected by bringing the electronic pen 1 close to the touch surface 2 without contacting the touch surface 2.

  For this reason, as in the example of FIG. 8 described above, an operation button 82 for forcibly turning on / off a mechanical switch 81 serving as a connection switch for interrupting electrical connection between the pen tip portion 23 and the grip portion 21 is provided. In the configuration in which pen information is transmitted according to the operation of the operation button 82, when the operation button 82 is turned on and the electronic pen 1 is brought close to the touch surface 2, the control device 6 receives the position detection information from the position detection device 4. At the same time, the pen information indicating the non-touch state is received from the electronic pen 1. At this time, since the touch position is detected while the pen information is not touched, it is different from the normal pen input mode.

  Therefore, it is preferable to give a special function to the non-touch state operation as a non-contact mode to perform application operations such as displaying a special menu or drawing in the airbrush mode. In this case, in order to avoid confusion with finger input, it is preferable to set a state in which finger input is prohibited.

  FIG. 11 is a schematic configuration diagram illustrating another example of the electronic pen 1 illustrated in FIG. 1. Here, the pen point portion 23 and the grip portion 21 are connected via the variable resistance element 111, and an operation switch 112 that changes the resistance value of the variable resistance element 111 is provided. Other configurations are the same as those in the example of FIG. 2, and detailed description thereof is omitted. Note that a variable capacitance element can be used instead of the variable resistance element 111.

  When configured in this manner, in the non-contact mode shown in FIG. 10, it is possible to change the value of the level signal output from the position detection device 4 by increasing or decreasing the capacitance change caused by the touch operation. The operation amount of the operation switch 112 is transmitted to the control device 6 and various instructions are given by the operation amount of the operation switch 112. For example, the amount of image processing can be changed. For example, in the airbrush mode, it is possible to configure such that the drawing radius is increased as the sensitivity, that is, the detection level or the detection range is increased.

  FIG. 12 is a diagram illustrating an example of handwriting input in the electronic pen system illustrated in FIG. 1. FIG. 13 is a timing chart showing a transmission state of pen information at the time of handwriting input shown in FIG. When inputting a series of characters by handwriting, the stroke inputs S1 to S11 are repeated at short intervals, but each time the electronic pen 1 enters a touch state at the start point of each stroke input S1 to S11, the electronic pen 1 performs wireless communication of pen information. If this is done, the battery 29 will be consumed quickly.

  Therefore, after the end of one stroke input and the pen tip 23 is separated from the touch surface 2 and the detection result by the magnetic sensor 26 changes from the touch state to the non-touch state, the electronic pen 1 If the touch state is entered again before continuing for a predetermined time (T: for example, 2 seconds), pen information is not transmitted. Thereby, the frequency | count of communication of the electronic pen 1 can be reduced, and consumption of the battery 29 can be suppressed.

  When inputting a single character string with the same indicator (electronic pen 1 or finger F), the stroke input takes a short interval, but when inputting different character strings with different indicators, one instruction The last stroke input of a character string input with an object and the first stroke input of a character string input with another indicator are long intervals, and by appropriately setting a reference time (T: for example 2 sec), Pen information is not transmitted during the input of a character string with one indicator, and after the character string is input with one indicator, the pen information is entered when the input of the character string with another indicator is started. Can be sent.

  In the example shown in the figure, the character string “Ai” and the character string “Kaki” are input separately with different indicators, and the starting point of the first stroke input in the input of each character string “Ai” and “Kaki” The pen information is transmitted only at the timing (that is, the leading timings of S1 and S6 in FIG. 13).

  In this case, the control device 6 does not receive pen information from the electronic pen 1 in the second and subsequent stroke inputs. For this reason, it cannot be determined whether each stroke input is performed by the electronic pen 1 or the finger F based on the presence or absence of the pen information. Further, it is impossible to determine which electronic pen 1 is used for each stroke input by the pen identification information in the pen information.

  Therefore, when the control device 6 detects the start point of a new stroke input after detecting the end point of the stroke input, if the two stroke inputs satisfy a predetermined proximity condition (for example, a range of ± 50 mm), the control device 6 It is determined that the correct stroke input is based on the same indicator as the adjacent stroke input.

  Here, the proximity condition is any one of the elapsed time from the detection of the stroke input end point to the detection of the new stroke input start point, and the separation distance between the stroke input end point and the new stroke input start point. Or it sets about both. When this proximity condition is satisfied, it can be determined that the character string is continuously input with one indicator. On the other hand, when the proximity condition is not satisfied, the indicator is changed. It can be determined that there is a possibility that the character string is input.

  Accordingly, it is possible to accurately determine the instruction for each stroke input without transmitting pen information every time the touch state is entered.

  If there is no previous stroke input that satisfies the predetermined proximity condition, a confirmation screen for allowing the user to specify an instruction is displayed on the touch surface 2 by the display device 5. Alternatively, in order to cause the electronic pen 1 to retransmit the attribute information, a display that prompts the user to move the electronic pen 1 away from the touch surface 2 for a predetermined period (for example, 2 seconds) or longer is performed. Alternatively, an instruction unit (for example, a push switch) for forcibly transmitting attribute information to the electronic pen 1 may be provided. Thereby, it is possible to specify a stroke input indicator and input an appropriate character based on the attribute of the indicator.

  The operation of specifying the indicator according to the predetermined proximity condition and displaying the confirmation screen for allowing the user to specify the indicator when the indicator cannot be specified is performed by handwriting as described above. It is not limited to inputting characters with. The present invention can also be applied in the same manner when an indicator cannot be specified when inputting characters other than characters.

  FIG. 14 is a timing diagram showing a transmission state of pen information during handwriting input in the electronic pen system shown in FIG. When the electronic pen 1 completes one stroke input, the pen tip 23 moves away from the touch surface 2, and the detection result by the magnetic sensor 26 changes from the touch state to the non-touch state, the pen identification information, and Pen information including status information (non-touch state) is transmitted to the control device 6.

  On the other hand, during the stroke input, the control device 6 receives the position detection information that gradually changes from the position detection device 4, but when one stroke input is completed, the pen tip 23 and the finger F of the electronic pen 1 are finished. When an end point of the stroke input is detected, the end point of the stroke input at which the series of position detection information disappears is detected. When the end point of the stroke input is detected, the pen information indicating the non-touch state from the electronic pen 1 is received. If almost the same timing is reached, it is determined that the stroke input is from the electronic pen 1. If the pen information is not received when the end point of the stroke input is detected, it is determined that the stroke input is made by the finger F.

  When the timing of the stroke input start point is the same for the electronic pen 1 and the finger F, only the pen information transmitted from the electronic pen 1 to the control device 6 at the timing of the stroke input start point causes each stroke input to be the electronic pen 1 and finger. However, if pen information is transmitted even at the end of stroke input, it is possible to determine whether each stroke input is from the electronic pen 1 or the finger F.

  In addition, when the timing of the stroke input start point overlaps with the plurality of electronic pens 1, each stroke input can be made to any electronic pen by using only the pen information transmitted from the electronic pen 1 to the control device 6 at the timing of the stroke input start point. However, if the pen information is transmitted even at the end point of the stroke input, it is possible to determine which electronic pen 1 is used for each stroke input.

  Further, if the timings of the start point and the end point of the stroke input overlap, the stroke input instruction cannot be specified by the pen information transmitted from the electronic pen 1 to the control device 6 at the timing of the start point and the end point of the stroke input. This is not a complete situation. Therefore, in such a case, when a plurality of stroke inputs are continuously performed, it is preferable to make an analogy determination from the reference information of stroke inputs that are close in position and close in time. . On the other hand, in the case of a single stroke input, a confirmation window for confirming to the user whether the electronic pen 1 or the finger F is displayed is displayed on the touch surface in the vicinity of the position where the stroke input has been performed. It is recommended to select the stroke input indicator.

  FIG. 15 is a timing chart showing simplified operations of the plurality of electronic pens 1 and the control device 6 shown in FIG. Here, an example in which a plurality of electronic pens 1 are simultaneously touched is shown.

  The electronic pen 1 transmits a communication request signal (REQ (1), REQ (2),... REQ (n)) to the control device 6 when the touch state is detected by pressing the pen tip 23 against the touch surface 2. To do. The control device 6 transmits a response signal (ACK (1), ACK (2),... ACK (n)) to each electronic pen 1 in response to reception of the communication request signal (REQ) from the electronic pen 1. In response to receiving the response signal (ACK) from the control device 6, the electronic pen 1 transmits pen information (DATA) to the control device 6.

  At this time, the electronic pen 1 starts transmission of the pen information (DATA), and after a certain delay time (t1), the connection switch 25 that interrupts the electrical connection between the pen tip portion 23 and the grip portion 21. Turn on. As a result, each electronic pen 1 is in a position-detectable state, and the touch positions (position 1, position 2, position 3) of each electronic pen 1 are sequentially detected.

  Here, in order to avoid communication collision, a known distributed control type contention (CSMA → T1 → independent waiting time (random number) → data transfer → ACK) is used in a wireless LAN or the like. For example, each electronic pen 1 performs CSMA (Carrier Sense Multiple Access) to confirm that a wireless channel is not used. If a collision due to simultaneous communication requests from a plurality of electronic pens occurs, as shown in FIG. 15, different independent waiting times (tw1) for each electronic pen 1 determined by the standby unit time and the generated random number, as shown in FIG. , Tw2, twn), each electronic pen 1 transmits a communication request again to avoid a collision, performs data transfer in response to a response signal ACK from the control device 6, and the control device 6 receives the response from the electronic pen 1. In response to the request, a series of communication operations are performed in which a response signal ACK for confirming data reception is returned each time. Further, although not shown, when the electronic pen 1 cannot receive the response signal ACK from the control device 6 after the data transfer, the data can be reliably transferred by repeating the data re-transfer until the response signal ACK is received. Data is being transferred.

  In this way, since the individual attribute information of the plurality of electronic pens 1 can be reliably transmitted to the control device 6, for example, four users use different electronic pens 1 and use them respectively. The drawing color can be selected arbitrarily (that is, independently). That is, the drawing color of each electronic pen 1 can be made different for each user such as black, red, blue, and green, or all users can select the same drawing color. Of course, the attribute information of the electronic pen 1 is not limited to the drawing color, and may be attribute information related to, for example, a solid line / broken line or line thickness. As described above, the electronic pen 1 of the present embodiment can set the attribute information independently even when a plurality of electronic pens 1 are used at the same time, and there are no restrictions imposed by other electronic pens 1. I do not receive it.

  By the way, as described above, since it is possible to definitely determine which of the electronic pen 1 and the finger F is the touch-operated indicator, different functions are given to the electronic pen 1 and the finger F. Various operations are possible. Here, an example in which a display object is edited (moved, rotated, enlarged, and reduced) by a touch operation of the electronic pen 1 and the finger F will be described.

  FIG. 16 is a schematic diagram illustrating a schematic configuration of the drawing control unit 17 of the control device 6 illustrated in FIG. 1. The drawing control unit 17 of the control device 6 includes an indicator determination unit (indicator determination unit) 171 that determines whether the indicator that has been touched as described above is the electronic pen 1 or the finger F. A first control unit (first control means) 172 that performs a predetermined pen input process in response to a touch operation by the electronic pen 1 and a second control that performs a predetermined finger input process in response to a touch operation of the finger F Unit (second control means) 173, and the pen input process of the first control unit 172 and the finger input process of the second control unit 173 are executed in parallel. Thereby, the electronic pen 1 and the finger F can be assigned functions, and processes according to functions set in advance in the electronic pen 1 and the finger F can be executed simultaneously in parallel.

  As already described, the control device 6 is composed of a personal computer and peripheral devices, and the function of the drawing control unit 17 is provided by executing an application program. Therefore, “execute in parallel” here means parallel processing by so-called multitask processing of the OS.

  The first control unit 172 performs a touch operation with the electronic pen 1 and a drawing process according to the attribute set for the electronic pen 1. The second control unit 173 performs an editing process corresponding to the touch operation of the finger F on the display object. It is possible to give the first and second control units 172 and 173 different functions.

  Further, the drawing control unit 17 of the control device 6 has a finger drawing mode in which a touch operation with the finger F is regarded as being performed with the electronic pen 1 in accordance with a user instruction. In this finger drawing mode, a standard attribute is used. The first control unit 172 is caused to perform a drawing process corresponding to the touch operation with the finger F. Thereby, drawing can be performed by a touch operation with the finger F as a substitute for the electronic pen 1.

  Here, in the finger drawing mode, drawing processing corresponding to the touch operation with the finger F is performed with a standard attribute. As this standard attribute, for example, the drawing color is black. In the finger drawing mode, the second control unit 173 stops operating.

  FIG. 17 and FIG. 18 are schematic diagrams illustrating a situation of joint operation in which a plurality of instructions (electronic pen 1 and finger F) are simultaneously touched to edit a display object. When editing the display object by touching the display object with a plurality of instructions, the drawing control unit 17 of the control device 6 uses the touch position of the first indicator that first touched the display object as the operation starting point. Then, using the touch position of the second indicator touched on the display object as the operation action point, the absolute displacement amount of the operation starting point accompanying the movement of the first indicator and the movement of the second indicator The drawing information of the display object is generated and displayed on the screen according to the relative displacement amount of the operation action point with respect to the accompanying operation starting point.

  Here, the first indicator for setting the operation starting point is the electronic pen 1, and the second indicator for setting the operation action point is the finger F. The second indicator can be another electronic pen 1.

  In the example shown in FIG. 17, in the rotation mode, the display object is translated according to the movement of the electronic pen 1 that sets the operation start point, and the display object is rotated according to the movement of the finger F that sets the operation action point. Yes. Here, the rotation of the display object is performed with the operation starting point, that is, the touch position with the electronic pen 1 as the center point.

  In the example shown in FIG. 18, in the enlargement / reduction mode, the display object is translated according to the movement of the electronic pen 1 that sets the operation start point, and the display object is enlarged according to the movement of the finger F that sets the operation action point. -It has been reduced. Here, when the relative distance between the electronic pen 1 and the finger F increases, the enlargement occurs, and when the relative distance between the electronic pen 1 and the finger F decreases, the reduction occurs.

  In addition, the operation starting point and the operation action point are set in the same manner as described above, and the drawing information of the display object is continuously displayed according to the relative displacement amount of the operation action point with respect to the operation starting point accompanying the movement of the second indicator. When the second indicator is separated from the touch surface, the generation of the display object drawing information may be terminated. Accordingly, the editing status of the display object is sequentially displayed on the screen in accordance with the movement of the second indicator, so that the user can perform an operation while viewing the editing status of the display object.

  FIG. 19 is a flowchart showing a processing procedure in the control device 6 shown in FIG. Here, the finger operation (ST503), the finger handwriting operation (ST504), and the pen operation (ST509) depending on whether the pointing object that has performed the touch operation is the electronic pen 1 or the finger F, and also in the handwriting mode. ) And pen handwriting operation (ST510). The finger handwriting operation is drawn based on handwriting attributes (color, thickness, line type) preset for the finger at the input detection position. The pen handwriting operation is drawn based on handwriting attributes (color, thickness, line type) preset for each of the plurality of electronic pens 1 at the input detection position.

  In the finger operation (ST503) and the pen operation (ST509), when the electronic pen 1 and the finger F are touching the same display object, the process proceeds to the joint operation (ST507, ST513). On the other hand, when the electronic pen 1 and the finger F are not touching the same display object, the process proceeds to independent operations (ST506, ST512).

  In the independent operation, the display object is operated according to the operation mode selected from the menu according to the pen input and the finger input. For example, operations related to application control, such as rotation, movement, enlargement / reduction processing, display object color change, display object selection, menu display, and the like, are targeted.

  FIG. 20 is a flowchart showing a processing procedure of the joint operation of the electronic pen 1 and the finger F shown in FIG. First, when the movement of the electronic pen 1 is detected (ST601), a process of translating the display object is performed (ST602). When the movement of the finger F is detected (ST603), vector calculation is performed according to the movement direction and movement amount of the finger F (ST604), and the display object is rotated based on the vector value with the touch position of the electronic pen 1 as a fulcrum.・ Enlargement / reduction processing is performed (ST605).

  By the way, as described above, since a plurality of electronic pens 1 can be set to different attributes and used properly, when images drawn separately by a plurality of electronic pens 1 overlap, how are overlapping portions of both images? It becomes a problem whether to draw in

  FIG. 21 and FIG. 22 are schematic views showing a situation when a line is drawn with the plurality of electronic pens 1 shown in FIG. The drawing control unit (drawing control means) 17 of the control device 6, when a new image is drawn so as to overlap with the previously drawn image, the overlapping portion of both images is based on a drawing rule designated in advance. draw. The electronic pen 1 includes an operation switch (drawing rule designating unit) 44 that allows the user to designate a drawing rule, and transmits information related to the drawing rule designated by the operation switch to the control device 6.

  Note that the drawing rule may be selected and specified from a menu displayed on the touch surface 2 by the display device 5.

  As shown in FIG. 21, the drawing rule is a drawing condition for a new image, which is an overlapping portion between an image previously drawn under the first drawing condition and an image newly drawn under the second drawing condition. The present invention relates to an overwriting process for drawing according to the second drawing condition. In the illustrated example, the drawing condition is the drawing color.

  When it is designated that overwriting is to be performed, as shown in FIG. 21A, the overlapping portion between the previously drawn image and the newly drawn image is the same as the newly drawn image. Replaced by color. That is, in the first overlapping portion, the original blue color is replaced with yellow, and in the second overlapping portion, the original yellow color is replaced with blue. On the other hand, when it is designated that the overwriting process is not performed, as shown in FIG. 21B, the overlapping portion between the previously drawn image and the newly drawn image is the original color. Left untouched.

  In addition, as shown in FIG. 22, the drawing rule specifies a drawing condition for a portion where an image previously drawn under the first drawing condition and an image newly drawn under the second drawing condition overlap. The present invention relates to a superimposition process for drawing under another drawing condition changed according to the ratio of the above. In the illustrated example, the drawing condition is the drawing color. An example of performing an averaging process for the change by the specified ratio will be described below.

  When it is designated that superimposition processing is to be performed, as shown in FIG. 22A, the overlapping portion between the previously drawn image and the newly drawn image averages the drawing colors of both. It is replaced with the mixed color. On the other hand, when it is specified that the superimposition process is not performed, as shown in FIG. 22B, the color of the newly drawn image is replaced. This is the same as the overwriting process in FIG.

  Further, the color mixing ratio may be set so that an image drawn later is emphasized. That is, a mixed color is calculated by performing a weighted average with a weighting coefficient on the first drawing color of the previously drawn image and the second drawing color of the newly drawn image.

  In the first overlapping portion, the blue line drawn with the blue electronic pen 1 and the yellow line drawn with the yellow electronic pen 1 overlap each other, and the yellow drawn later is emphasized. As shown, the mixture ratio of both colors (yellow: blue) is replaced with yellowish green with 6: 4. In the second overlapping portion, the yellow line drawn with the yellow electronic pen 1 and the blue line drawn with the blue electronic pen 1 overlap each other, and the blue drawn later As emphasized, the mixture ratio of both colors (blue: yellow) is replaced with blue-green with 6: 4.

  Accordingly, the user can easily recognize that two lines are drawn with another electronic pen 1 having different drawing colors. Furthermore, the user can easily recognize which of the two lines intersecting each other is drawn later by changing the color of the overlapping portion in accordance with the temporal relationship.

  The mixing ratio of the two colors may be set in proportion to the ratio of the line thickness. In addition, when another line intersects the part where the two lines intersect and change to the mixed color, the intersected part is changed to a mixed color obtained by mixing the original mixed color and the new color, Such a color change may be performed every time the lines intersect. Furthermore, when the electronic pen 1 is set to the eraser mode, the area drawn later is usually erased, but various erase modes can be designated, for example, by selecting an erase rate, It is also possible to erase partly by the erase pattern by reducing the density of the region drawn later or selecting the erase pattern.

  In addition, when performing image editing of a display object, a special function may be assigned when a plurality of electronic pens 1 simultaneously touch one display object. For example, when the control device 6 detects simultaneous touch with a plurality of electronic pens 1, it performs image processing (highlighting, emphasis, color conversion, etc.) of the display object. Further, when the control device 6 detects simultaneous touches with a plurality of electronic pens 1, the attributes (for example, drawing colors) of the electronic pens 1 are randomly changed. As a result, a change (interaction) unexpected by the user occurs in the display object, and an effect can be obtained that is a hint or trigger for an idea in brainstorming or design consideration.

  The electronic pen system according to the present invention has an effect that the electronic pen and the finger can be used in an equal manner and used in parallel, and an image corresponding to the touch operation of the electronic pen and the finger on the touch surface of the touch panel is touched. It is useful as an electronic pen system that displays on a screen.

DESCRIPTION OF SYMBOLS 1 Electronic pen 2 Touch surface 3 Touch panel body 4 Position detection apparatus 5 Display apparatus 6 Control apparatus 16 Wireless communication part 17 Drawing control part 18 Display control part 19 Main control part 21 Grasp part 22 Pen main body 23 Pen tip part 24 Wireless communication circuit 25 Connection switch 26 Magnetic sensor 27 Pen control circuit 28 Power supply circuit 29 Battery 171 Pointed object discriminating unit (indicating object discriminating means)
172 1st control part (1st control means)
173 2nd control part (2nd control means)
F finger

Claims (7)

An electronic pen, a touch panel body having a touch surface on which touch operation is performed with the electronic pen and a finger, a position detection device for detecting a touch position of the electronic pen and the finger on the touch surface, and the touch surface on a display screen As an electronic pen system comprising: a display device that displays a required image as a control device that causes the display device to display an image according to position detection information acquired from the position detection device;
When the position detection information is received from the position detection device, the control device determines whether the position detection information is from the electronic pen or a finger, and touch operation by the electronic pen. A first control unit that performs a predetermined pen input process in response to the first control unit, and a second control unit that performs a predetermined finger input process in response to a finger touch operation. And a finger input process of the second control means are executed in parallel.   The electronic pen system according to claim 1, wherein the finger input process executed by the second control unit includes at least one of movement, rotation, enlargement, and reduction of a display object. The electronic pen transmits pen information to the control device during a touch operation,
The control device receives the position detection information received from the position detection device substantially simultaneously with receiving the position detection information from the position detection device, depending on whether or not the pen information has been received from the electronic pen. 3. The electronic pen system according to claim 1, wherein it is determined whether the information is from an electronic pen or a finger. The position detection device detects a touch position from a change in capacitance according to the approach or contact of a conductor to the touch surface,
The electronic pen is a connection switch for intermittently connecting an electrical connection between a pen information transmission unit that transmits predetermined pen information to the control unit and a pen tip unit and a grip unit that are provided in a state of being electrically disconnected from each other. And a touch state detection unit that detects a touch state on the touch surface, and transmits pen information from the pen information transmission unit to the control device in response to the touch state detection unit detecting the touch state. After that, the connection switch is turned on so that pen input is possible,
When receiving the position detection information from the position detection device after receiving the pen information from the electronic pen, the control device determines that the position detection information is from the electronic pen, 4. The electronic pen system according to claim 3, wherein when position detection information is received from the position detection device without receiving pen information from the position detection apparatus, the position detection information is determined to be a finger. The first control means performs a touch operation with the electronic pen and a drawing process according to an attribute set for the electronic pen, and the second control means touches a display object with a finger. Edit processing according to the operation,
The control device has a finger drawing mode in which a touch operation with a finger is regarded as being performed with the electronic pen in accordance with a user instruction. In this finger drawing mode, a drawing according to a touch operation with a finger with a standard attribute is performed. 5. The electronic pen system according to claim 1, wherein the first control unit performs processing. A touch surface on which a touch operation with an electronic pen and a finger is performed is used as a display screen, and an image corresponding to a touch position detected from a change in capacitance according to the approach or contact of a conductor to the touch surface is displayed on the display screen. A control device that controls to display
At substantially the same time as the detection of the touch position, it is determined whether the touch operation is performed by the electronic pen or the finger depending on whether or not the pen information can be received from the electronic pen. A control device that executes input processing and finger input processing with a finger in parallel. The control device according to claim 6, wherein when the electronic pen and the finger are touching the same display object, it is determined that the electronic pen and the finger are joint operations on the same display object.

Images