JP3033108B2 - Information input processing device and information input processing method - Google Patents

Description

Description: BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information input processing device and an information input processing method for inputting characters and graphics using a pen from a display unit having an input unit superimposed on a display unit.

[Summary of the Invention]

The present invention relates to an information input device that uses a pen to input characters and graphics from a display unit in which an input unit is overlaid on a display unit, and relates to a display / input unit configured by superimposing a display unit and a character input unit with a pen. In an information input device for inputting information, a character input means for displaying a character input window for recognizing a character input with a pen, and a graphic for inputting a desired graphic at a position where the pen touches By providing a graphic input means for displaying an input window and a control means for controlling the window to be simultaneously displayed on the display / input unit, a narrow screen can be effectively used. Are displayed on the screen at the same time so that the user can easily identify which of these character or graphic windows is operating.

[Conventional technology]

Conventionally, a keyboard, a mouse, and the like have been generally used as an information input device of a computer (hereinafter, referred to as a CPU). For example, as an input method when displaying characters or graphics on the display unit of the CPU, when displaying a window having a character and graphic input function for inputting characters and graphics on the display and inputting characters, After selecting a character keyboard from the keyboard, writing of characters is performed. Also, when writing a graphic, a keyboard for the graphic was also selected. That is, in such a case, it is necessary to switch the mode between characters and figures.

Further, there is a type in which a window for graphics and a window for characters are completely separately displayed on a display unit. However, these are used to switch between a window program for characters and a window program for graphics by using a keyboard or mouse switch button. And so on.

[Problems to be solved by the invention]

In the case of displaying a window having a conventional character and graphic input function on a display, the operation of switching between a character mode and a graphic mode is performed by a dedicated key such as a keyboard, so that the operation becomes complicated. In addition, since a character / graphic window projected on the display unit becomes large, if the display unit is small, there is a problem that a part for writing a graphic or character becomes narrow.

Furthermore, in the case where the character window and the graphic window are separated, the character window is projected on the display unit or the graphic window is projected or displayed alternately by switching the keyboard in the same manner. In such an operation in which characters and figures are alternately written, there is a problem that a lot of time is spent in addition to the trouble of switching.

The present invention has been made in order to solve the above-mentioned problems, and the object is to mix a character window and a graphic window so that a narrow screen of a display unit can be effectively used, and It is an object of the present invention to provide an information input processing device and an information input processing method that can visually and clearly distinguish whether a character window is in an active state or a drawing window is in an active state.

[Means for solving the problem]

An information input device according to the present invention is an information input processing device for inputting information by handwriting input to an input unit superimposed on a display unit, wherein: a drawing surface display means for displaying a drawing surface on the display unit; A character input window display means for displaying a character input window for transferring the input character to the drawing surface on the display unit, and inputting a desired figure on the drawing surface by handwriting input to the input unit A graphic attribute input window display means for displaying a graphic attribute input window operated to specify an attribute of an input graphic at the time of drawing; and a drawing surface on which the character input window and the graphic input window are displayed on the display unit While displaying on top of it,
Display control means for displaying on the display unit that the window selected last by the handwriting operation on the input unit among the character input window and the graphic input window is in an input operable state. .

Also, the information input processing method of the present invention is an information input processing method for inputting information by handwriting input to an input unit superimposed on a display unit, wherein a drawing surface display step of displaying a drawing surface on the display unit; A character input window display processing step in which a character to be recognized is input by handwriting input, and a character input window for transferring the input character to the drawing surface is displayed on the display unit, and a desired graphic is displayed on the drawing surface by handwriting input to the input unit. A graphic attribute input window display processing step for displaying a graphic attribute input window operated to specify an attribute of an input graphic when inputting a character, and displaying the character input window and the graphic attribute input window on the display unit The character input window and the graphic input window are displayed in a superimposed manner on the drawn surface. Of window, and has a display control process step of displaying on the display unit that the last selected window input operable by the handwriting operation on the input unit.

[Action]

The information input processing device and the information input processing method of the present invention,
Since the character input window and the graphic input window are superimposed on each other and displayed on the display unit, even when the display area of the display unit is small, the area for covering the writing part of the character and the graphic by both windows is minimized. And a large area can be secured as a writing portion. Among the character input window and the graphic input window which are displayed in a superimposed mixture, an active (operable) window Is displayed on the front, the window in the active state is visually clarified, and the switching operation is performed only by a handwriting operation on the input unit (for example, an operation of bringing the pen tip into contact with the character input window or the graphic input window). It can be done easily.

〔Example〕

Hereinafter, the information input processing device and the information input processing method of the present invention will be described in detail with reference to FIGS. Before describing the flow charts and the screen state explanatory diagrams of FIG. 1 and FIG. 2, the information input device of the present invention will be described with reference to FIG. 3 and FIG. FIG. 3 of the present example shows a front view when this information input device is applied to an electronic organizer. In this figure,
(1) is a display unit composed of liquid crystal or the like, that is, a display unit, on which image data from a CPU or the like described later is displayed, and on the surface of which is an input unit, a so-called transparent touch sensor. An input tablet (2) is provided. Further, (3) is a pen for inputting arbitrary data and the like in cooperation with the input tablet (2), and the CPU detects the change in the capacitance between the tablet and the pen tip through the pen (3). Means for detecting coordinates even when the pen tip is not in contact with the tablet (2) and displaying a cursor at a position facing the pen tip. By taking out the pen (3) and touching the input tablet (2) with the pen tip, information such as the contact state and the contact position is supplied to the CPU via the code (4) or the like, and arbitrary data or the like is obtained. Is input. (5a) (5b) (5c) (5d) and (6a) (6b)
(6c) and (6d) are predetermined key switches, respectively.
The signals from these are also supplied to the CPU.

(7) indicates a speaker. (8) is a battery accommodating portion, in which a battery for power supply is accommodated inside a lid which is opened and closed by releasing the lock mechanism (9). Further, (10) is a power switch.

Further, broken lines indicate the positions of mechanisms and the like provided on the side surface of the electronic organizer. First, (11) denotes a microphone. Reference numeral (12) denotes an operation key for solid-state recording, which will be described later. An audio signal supplied to the microphone (11) is recorded by operating the key (12), and the sound signal is emitted from the speaker (7). You. In addition, (13) is for ROM, RAM, etc.
The socket into which the C card is inserted and connected, and (14) shows the positions of expansion sockets and the like for connection with external devices and the like.

Further, (15) is a hinge incorporating a flexible board or the like for transmitting a signal, and the hinge (15) allows the device to be folded in two without being subjected to an electric obstacle or the like. When using this device, the size of the unfolded state is about 29 cm in length, about 20.5 cm in width, and about 4 cm in thickness when folded, and the size of the display unit (1) is about It is 15cm x 10cm.

Further, in this device, the configuration of the built-in hardware is as shown in FIG. In the figure,
(21) is a CPU, (22) is its bus line, and various functional ICs and the like are connected through this bus line (22). First, (23) is a ROM. In the ROM (23), in addition to the system program of the entire apparatus, for example, a kana-kanji conversion program for a word processor function and dictionary data therefor, and a recognition program for handwriting input and Dictionary data and the like for that purpose are written.

(24) is working RAM, (25) is power supply (2
This is the backup RAM attached to 6).

Further, (27) is a timer IC. This IC (27) is also driven by the power supply (26), counts the clock from the crystal oscillator (28), and constantly counts the date and time at that time. Output data.

In the following, a description will be given including the connection relationship with each part appearing in the front view of FIG. First (29) is the display unit (1)
The controller (29) is controlled by the CPU (21), and the display data created by the CPU (21) is transmitted to the V-RAM (30) via the display controller (29). And the written data is supplied to the display unit (1) through the display controller (29).

Further, (31) is an interface circuit of the input tablet (2) and the pen (3) integrated with the display unit (1), and this interface circuit (31)
And the like written on the input tablet (2) by the CPU (2)
Supplied to 1).

Reference numeral (32) denotes a processing circuit for solid-state recording, in which a sound signal from the microphone (11) is subjected to processing such as AD conversion and stored in the backup RAM (25) through the CPU (21). The audio signal data stored in the backup RAM (25) is subjected to processing such as DA conversion in the processing circuit (32),
It is supplied to the speaker (7) through the mixer (33).

Reference numeral (34) denotes a dialer circuit. When data such as an arbitrary telephone number is supplied from the CPU (21), an acoustic signal corresponding to a so-called dual tone of a push phone is generated, and this signal is converted to a mixer (33). ) Is supplied to the speaker (7).

Further, (35) is a key interface circuit, which is described above in (5a) to (5d), (6a) to (6d), (10) and (1).
2) The signal from the key switch group is supplied directly or through the power supply circuit (36), and a predetermined converted signal is supplied to the CP.
U (21). The power switch (10) and the operation keys (12) except for the key switches (6a) to (6d) and the stop button are supplied to the interface circuit (35) via the power circuit (36), and these key switches are operated. When this is done, the power supply circuit (36) is first activated, and then information on key operation is supplied to the interface circuit (35).

Further, (37) and (38) are interface circuits for the IC card and an external device at the time of expansion, which are connected to the sockets (13) and (14), respectively.

Hereinafter, the operation of this example will be described based on the flowchart of FIG. 1 and the screen example of FIG.

When the power switch (10) shown in FIG. 3 is pressed in the above-described apparatus of the present example, various processable icons (42) as shown in FIG. 2A are displayed on the display unit (1). Is displayed. Here, the pen tip is touched on the “kaku” icon (51) in the icon group (42) on the right side of the screen of the display unit (1), and “action” and “connection” displayed on the left side of the icon group (42). When the tip of the pen (3) is touched to the "report" portion of the characters such as "report" and "report", a report image (50) shown in FIG. 2A is displayed on the display unit (1) (first). First step S in the figure
T _1). Next, as shown in FIG. 2A, among the icons (42) displayed on the upper side of the report screen (50), "Katsuji" is displayed.
Touch the pen tip on the type icon (53) written with. As described above, when the pen tip approaches the panel surface of the display unit (1) which also serves as an input tablet, a cross-shaped position indicating cursor (48) is displayed on the pen (3). ), It is possible to visually confirm the position of the pen very clearly, and after the pen (3) is moved down to the desired icon (53), the pen tip is displayed without releasing the pen tip from the tablet (2). If the pen is moved to a desired position (dragging) and the pen tip is separated from the surface of the tablet (2), the display form for processing the desired icon (53) is enlarged as shown in FIG. (Hereinafter referred to as type plate) (40) is automatically displayed.

In this type plate (40), the handwriting key (43) is activated as shown by hatching when pulled out from the type icon (53), so the square (44)
Fill in the specified characters with a pen and type the characters (4
When 6) is specified, the CPU (21) recognizes the character and changes the handwritten character to the recognized type character and displays it. Here, to transfer the type characters recognized on the report screen (50), touch the cursor key (47) with the pen tip, and drag it to an arbitrary position in the report screen (50). It is displayed at the position where the pen tip is moved. To transfer the type character recognized by handwriting to the position of the cursor (48), touching the "write" key (49) with the pen tip transfers the character to the position of the cursor (48). Of course, although the above-mentioned operation will be described later, a window of a graphic icon (hereinafter referred to as a graphic plate) is drawn on the report screen (50), and a graphic is freely drawn on the report screen (50) with the pen (3). In. That is, a character obtained by using a type plate for character recognition can be directly transferred to an area where graphics can be input. Of course, characters other than the recognized characters can also be input. In the state where the type plate (40) is pulled out to the report screen (50), the "knoll" icon (53) is deleted as shown in FIG. 2B. Next, as shown in FIG. 2C and FIG. 2D, the type plate (40) is moved downward while dragging the type plate (40). Here, the pen (3) is reported as shown in FIG. 2C. In order to project the type plate (40) away from the screen (50) and to move the type plate (40) to a predetermined position and to move the type plate (40) again, a desired position of the type plate (40) may be touched and dragged. In the type plate (similarly in the case of a graphic plate (41) to be described later), the hatched portions (52a) and (52b) in the (40) and the lower shadow portion (52c), that is, the type plate moving area or The type plate (40) or the graphic plate (41) can be moved to a desired position by touching the graphic plate moving area with the pen tip. Therefore, as shown in FIG. 2C, if the tip of the pen (3) is touched to the hatched portion (52a) and moved downward in the screen,
As shown in FIG. D, the lower half of the report screen (50) can be erased while leaving only the necessary portions of the type plate (40), so that the report screen (50) can be widely used.
FIGS. 2G and 2H (showing the case where only the graphic plate is pulled out) are examples of the explanation screen when the graphic plate (41) is pushed upward in this manner, and as shown in FIG. 41) is provided with a shadow part (52c). Touch the tip of the pen (3) to this shadow part (52c),
If the pen is dragged in the direction of arrow A, the window, that is, the graphic plate is moved out of the display area as shown in FIG. 2H, and only the necessary portion can be used, so that the report screen (50) is enlarged. Available. That is, since the shadow part (52c) is provided, a part of the character or graphic plate (40) and (41) can be moved outside the screen area on the upper side.

Although the above has been described until when pulled out character plate (40) on the report screen (50), then as shown in the second step ST ₂ and a second diagram C of Figure 1, written as "Zukei" The pen tip is lowered to the icon (54) (see FIGS. 2A and 2B). This shape plate thereby dragging the pen (3) to the open areas of the graphical icon (54) from the third step in the report screen as shown in ST ₃ (50) (41) is enlarged and displayed. In this state, the shape icon (5
4) is deleted. Character plate (40) in the above description
After pulling out the figure plate (41),
These may be pulled out in reverse, and the plate drawn out later of the respective plates described later becomes active. That is, FIG. 2E shows a state in which the character plate (40) is first drawn out to the open area, and then the graphic plate (41) is drawn out. It is superimposed before (40), and it can be immediately visually confirmed that the graphic plate (41) is in the active state. In the case of FIG. 2F, on the contrary, since the type plate (40) is drawn from the icon group (42) later and the type plate (40) is superimposed on the graphic plate (41) and comes forward, It can be seen that the plate (40) is active. FIG. 1 is a flowchart showing such an operation. That is, FIG. 2 D graphics and characters each plate in the third step ST ₃ is a an example drawn in the open areas of the report screen (50)
In as was done in the state shown, advanced to a fourth step ST ₄ CPU (21) determines whether the pen (3) to the open areas of the report screen (50) is down, pen (3) If the is not down, the fifth step
Proceeding to ST ₅ , other processing is performed. Pen down point willing on coordinates on the report screen (50) to a sixth step ST _6, if the fourth pen-down is made at step ST ₄ "YES" is whether the region of the print plate (40) to decide. Here, in the region of the print plate (40) pen (3) is a print plate (40) as shown in FIG. 2 F in the seventh step ST ₇ if it is down from the front graphic plates (41) Project. Then CPU (21) is pen-down point in the eighth step ST ₈ determines whether print plate for moving the region of print plate (40). That is, it is determined whether or not it is in the hatched area (52a) (52b) or the shadow area (52c) described with reference to FIGS. 2C and 2D. In this step ST ₈ “YE
"Performing movement processing based on the moving coordinates of the pen (3) proceeds to a ninth step ST ₉ if back to the fourth step ST _4. Further, the eighth step ST ₈ is" S print plate NO " moving region (52a), (52 b), (52c) on unless touch pen (3) is advanced to a tenth step ST _10, V-RAM (30) or the like currently stored in this step the 12 plates in an active state is judged whether the print plate (40), the print plate with active treatment advances to the eleventh step ST ₁₁ if "NO", then stores the state in the memory of Proceed to step ST _12. Tenth step
ST ₁₀ is part print plate at the memory is touching the tip of the pen (3) in the 12th step ST ₁₂ if the active state of the print plate (40) function key example, the handwritten key, use It is determined whether the key is on a key such as a case key or a telephone key. If "NO" in this step ST _12,
Pen (3) in the 14 step ST ₁₄ is judged whether or not the up, pen (3) is returned to the 14 step if it is not up (14), although monitoring of the pen up state is carried out, "YES" in the pen (3) is returned to the fourth step ST ₄ if it is up, monitor down state of the pen (3) is made. Then the pen (3) in the 12th step ST ₁₂ is at the 13th step ST _13, if on the function key print plate (40), or Pen (3) is touched to write key (49) not Judge. In print plate (40) setting and the process fifteenth step ST ₁₅ based since it is what is touched in the function key based on other functions in the function in if it is not touching the writing key (49) Done, fourth
It is returned to the step ST _4. 13th 16th step if pen (3) is touched to the write key in step ST ₁₃ (49)
It proceeds to ST _16. 16th step ST ₁₆ the report screen (50) in the input area (in this case graphic plates will also be described later Naturally, in a state freely draw a figure because they are drawn to the report screen (50).) Character It is determined whether the cursor (48) has been designated. To pull out the character cursor (48), as described above, touch the character cursor key (47) with the F mark in FIG. 2 (B) with the pen tip and pull it out to a predetermined area. (47) is erased from the type plate (40), and the character cursor (48) is displayed as the pen (3) moves. Print entered in print plate (40) at the cursor position in the 17th step ST ₁₇ if cursor graphical input area at the sixteenth step ST ₁₆ (48), if specified transferred, for example, the "flat ○ Satoshi ○" fourth is returned to step ST ₄ and. First
If at 6 step ST ₁₆ not specified cursor (48) on the graphical input area advances on a screen to a 18 step ST ₁₈ to display an error message. For example, a message such as "Please specify the cursor" is displayed, and it is determined whether the OK key in this error message has been touched with the pen (3) in the 19th step ST.
Determined in _19, the "NO" state, but is returned to 19 step ST _19, the fourth step ST ₄ if it is pen touch intelligibility key
Is returned to.

Then when pen-down point in the sixth step S (6) is not a print plate regions is advanced to a 20 step ST _20. Down point of the pen (3) on the screen coordinates at the 20th step ST ₂₀ determines whether the area of the figure plate (41). If "YES" state in the 20th step ST ₂₀ 21 step ST ₂₁ in figure plate (41) is issued before the plate (40) in print, in the state shown in FIG. 2 E drawings plate ( 41) is in a state where it is possible to directly see that it is in the active state.

Next, proceeding to a _twenty- second step ST22, the CPU (21) determines whether or not the pen-down point is within the moving area of the graphic plate (41). That is, it is determined whether or not a hatched portion (52b) and a shadow portion (52c) indicated by H and the like are shown in FIG. 2C, D, and G, and if the tip of the pen (3) touches this portion. , proceed to the 23 step ST ₂₃ moving process based on the moving coordinates of the pen (3) is made, it is returned to fourth step ST _4. If the 22nd step ST ₂₂ is “NO”, the 24th step ST
Proceeding to ₂₄ , determine if the currently active plate stored in memory is a graphic plate (41),
If "NO" 25 graphic plate proceeds to step ST ₂₅ (41) stored in the memory and active process advances to the 26 step ST _26. 24 If the figure plate in step ST ₂₄ (41) that are stored in the memory in an active state also advanced to the 26 step ST _26, whether on the pen-down point in the 26 step ST ₂₆ function key Judge. Here, the function keys of the graphic plate (41) will be described with reference to FIG. 2D. One of the function keys in the graphic plate (41), the key (60) written "draw" is activated when it is pulled out from the "type" icon (53) as described above. I have. The move key (61) is a key for moving only a cutout when moving a figure. The copy key (62) is used to copy a figure drawn and cut out on a report screen, and can be copied to a page other than the currently drawn page. The erase key (63) is used when erasing a drawn figure, and the cancel key (64) has a function of canceling the screen drawn before the currently drawn screen. In the function column for drawing figures (64), there are keys such as square, circle, double circle, eraser, etc. If you touch them with a pen, you can freely draw figures such as square, circle, etc. on the report screen (50). And can be erased using an eraser. Arrows and crosses are used to specify the size of a circle or square, and the brush pattern is used when drawing with a bold brush.
The key in the active state in FIG. 2D is a free pen, which is used to draw a free picture. The graphic shown in the column of (65) is a graphic for designating the line thickness of the pen (3) to be drawn, and in FIG. I have. The graphic in the column shown in (66) is a key group designated when the drawn graphic is painted in a pattern as shown in the figure. In this example, all of these are defined as function keys.

It is determined whether the pen (3) is up in the 27 step ST _27, if the state of the 26 step ST ₂₆ with a pen (3) is not touched on the function key "NO", are up Although it returned to the 27 step ST ₂₇ if, back in the fourth step ST ₄ if the pen-up "YEE" state. The 28th step if it is touched to one of the function keys pen (3) in 26 step ST ₂₆ is "YES" state
And proceeds to ST _28, setting and processing based on the function key, that is stored is performed, is returned to fourth step ST _4. Further down point of the pen (3) is advanced to a 29 step ST ₂₉ if not in the area of the figure plate at the 20th step ST _20. Pen-down point in the 29th step ST ₂₉ is determined whether an area for graphic input is made, performs other processing in the 30th step ST ₃₀ If "NO" is returned in the fourth step ST _4. The active plate to determine graphical plate or printing type plate 31 step ST _31, if "YES" in the 29th step ST _29, the set function in the 33 step ST _33, if a figure plate based graphical input is returned to fourth step ST ₄ is made to be done as returned by displaying the cursor if a character plate 34 step ST ₃₄ to pen-down position in the fourth step ST _4.

Since the present invention was operated as described above, the report screen (4
Even if 0) is as small as 15cm x 10cm, the window for characters and figures, that is, characters and figure plates can be displayed in an overlapping manner, so not only can the area for drawing figures and characters be used widely, but also which plate is active An information input processing device and an information input processing method capable of visually visually confirming whether the user is in the state are obtained. It should be noted that the present invention is not limited to the above-described embodiments, but can be variously modified without departing from the gist of the present invention.

〔The invention's effect〕

According to the information input processing device and the information input processing method of the present invention, the character input window and the graphic input window are displayed on the display unit so as to overlap each other. In addition to minimizing the area that covers the writing part of characters and figures by the window, a large area can be secured as the writing part, and the character input window that is displayed in a mixed and overlapping manner Since the window in the active state (operable state) among the graphic input windows is displayed on the foreground, the window in the active state is visually clarified, and the switching operation is also performed by a handwriting operation (for example, a pen) on the input unit. Simple operation only by touching the tip to the character input window or graphic input window) It can be. Therefore, according to the information input processing device and the information input processing method of the present invention, a narrow screen can be effectively used, and when a character or graphic plate is simultaneously displayed on the screen, it can be seen at a glance which plate is active. You get what you can do.

[Brief description of the drawings]

FIG. 1 is a flowchart showing one embodiment of the information input device of the present invention, FIG. 2 is a diagram showing an example of a screen showing one embodiment of the information input device of the present invention, and FIG. 3 is a diagram of the information input device of the present invention. FIG. 4 is a system diagram showing hardware of an information input device according to the present invention. (1) Display unit, (3) Pen, (21) CP
U, (40) is a type plate, (41) is a figure plate, (5
0) is a report screen.

Claims (3)

(57) [Claims] 1. An information input processing device for inputting information by handwriting input to an input unit superimposed on a display unit, comprising: a drawing surface display means for displaying a drawing surface on the display unit; Character input window display means for displaying a character input window for transcribing the input character to the drawing surface on the display unit, and inputting a desired character on the drawing surface by handwriting input to the input unit. A graphic attribute input window display means for displaying a graphic attribute input window operated to specify an attribute of an input graphic when inputting a graphic; and displaying the character input window and the graphic attribute input window on the display unit The character input window and the figure input window are displayed in a superimposed manner on the drawn surface. An information input processing device, comprising: display control means for displaying on the display unit that a window selected last by a handwriting operation on the input unit is in an input operable state. 2. The information input processing device according to claim 2, wherein said display control means displays the last selected window on the front to indicate that the input operation is possible. 3. An information input processing method for inputting information by handwriting input to an input unit superimposed on a display unit, wherein: a drawing surface display processing step of displaying a drawing surface on the display unit; A character to be recognized is input by input, a character input window display processing step of displaying a character input window for transferring the input character to the drawing surface on the display unit, and a handwriting input to the input unit on the drawing surface. A graphic attribute input window display processing step of displaying a graphic attribute input window operated to specify an attribute of an input graphic when a desired graphic is input; and displaying the character input window and the graphic attribute input window. And superimposed on the drawing surface displayed in the section, and the above character input window and A display control processing step of displaying, on the display unit, that the last window selected by a handwriting operation on the input unit among the graphic windows is in an input operable state. Method.