JPH012129A - Information input method - Google Patents

Abstract

(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention comprises an information input/output device, in particular, a handwritten information input device and a display device that are arranged one on top of the other, and the present invention comprises an information input/output device, in particular, a handwritten information input device and a display device, which are arranged in an overlapping manner. The present invention relates to an information input/output device that displays images on the display.

[Prior Art] Conventionally, there has been a device in which a handwritten information input device consisting of various coordinate input devices and a display device are placed one on top of the other, and information such as characters and images are input and output by hand, and information such as editing is added to the device. Proposed.

In this type of device, a display device is provided at the bottom of the input surface of a handwritten information input device that has an input surface made of a transparent material such as glass or plastic, and a display device is provided at the bottom of the input surface of the handwritten information input device, and the display device is installed one after another directly below the input trajectory input by hand on the input surface. By displaying dots or the like, an input character image or the like is displayed in the same size as the input size so that it can be visually recognized through the input screen.

That is, characters and images input as if they were written on paper can be input and generated on the display screen for the operator to see.

[Problems to be Solved by the Invention] However, in the above-mentioned devices, even if the input surface of the information input device is transparent, it has a certain thickness and refractive index, and the distance between the display surface and the input surface is Since the input position is not O, it is difficult to accurately match the input position and the display position due to parallax or refraction.

In other words, a discrepancy occurs between the input position intended by the operator and the information actually input. In particular, in applications such as editing images that have already been input, if there is a large deviation between the input position and the display position, editing, that is, changing, deleting, or adding images, is almost impossible.

[Means for Solving the Problems] In order to solve the above problems, one aspect of the present invention includes a handwritten information input device and a display device arranged one above the other,
In the information input/output device for displaying characters or images handwritten into the handwritten information input device on the display device, an input position of the handwritten information input device and a display position of the display device match at an observation position of an operator. and a control means for correcting the display position of the display based on the control information stored in the means. did.

[Operation] According to the above configuration, the position of the display information corresponding to the input information can be corrected based on the correction control information set in the storage means, so that the input position and display position for the operator can be accurately determined. can be matched.

[Example] Hereinafter, the present invention will be described in detail based on the example shown in the drawings.

FIG. 1 shows the structure of an information input/output device employing the present invention. The information input/output device shown in FIG. 1 inputs coordinates to an input tablet made of a vibration transmission plate 8 using a vibrating pen 3, and a display 11' made of a CRT placed over the input tablet according to the input coordinate information. The input image is displayed on the screen.

The input tablet consisting of the vibration transmission plate 8 functions as a handwritten information input device capable of inputting handwritten characters and images using the vibrating pen 3. First, the configuration of this input section will be explained.

The vibration transmission plate 8 is made of acrylic, glass plate, etc.
In this embodiment, the vibration transmitted from the vibrating pen 3 is transmitted to the vibration sensors 6 provided at three corners thereof.
The coordinates of the vibrating pen 3 on the vibration transmitting plate 8 are detected by measuring the transmission time of the ultrasonic vibrations transmitted from the vibration transmitting plate 8 to the vibration sensor 6.

The vibration transmitting plate 8 has its peripheral portion supported by an anti-reflection material 7 made of silicone rubber or the like in order to prevent vibrations transmitted from the vibrating pen 3 from being reflected at the peripheral portion and returning toward the center. ing.

The vibration transmitting plate 8 is placed on a display 11' capable of displaying dots, such as a CRT (or liquid crystal display), and displays dots at the position traced by the vibrating pen 3. That is, a dot is displayed at a position on the display 11' corresponding to the detected coordinates of the vibrating pen 3, and an image composed of elements such as points and lines inputted by the vibrating pen 3 is displayed as if it were written on paper. Appears after the trajectory of the vibrating pen as if it were done.

Further, according to such a configuration, a menu is displayed on the display 11', and an input method such as having the vibrating pen select the menu item or displaying a prompt and touching the vibrating pen 3 at a predetermined position is possible. You can also use

The vibrating pen 3 transmits ultrasonic vibration to the vibration transmitting plate 8,
It has a vibrator 4 made of a piezoelectric element or the like inside, and transmits ultrasonic vibrations generated by the vibrator 4 to a vibration transmission plate 8 via a horn portion 5 having a sharp tip.

FIG. 2 shows the structure of the vibrating pen 3. A vibrator 4 built into the vibrating pen 3 is driven by a vibrator drive circuit 2. The drive signal for the vibrator 4 is supplied as a low-level pulse signal from the arithmetic and control circuit l shown in FIG. is applied to

The electrical drive signal is converted into mechanical ultrasonic vibration by the vibrator 4 and transmitted to the diaphragm 8 via the horn section 5.

The vibration frequency of the vibrator 4 is selected to a value that can generate plate waves on the vibration transmission plate 8 made of acrylic, glass, or the like. Further, when driving the vibrator, a vibration mode is selected in which the vibrator 4 mainly vibrates in the vertical direction in FIG. 2 with respect to the vibration transmission plate 8. Also, the vibration frequency of the vibrator 4 is set to
Efficient vibration conversion is possible by setting the resonant frequency to .

The elastic waves transmitted to the vibration transmission plate 8 in the manner shown in F are plate waves, which have the advantage of being less affected by scratches, obstacles, etc. on the surface of the vibration transmission plate 8 compared to surface waves.

Again, in FIG. 1, the vibration sensor 6 provided at the corner of the vibration transmission plate 8 is also constituted by a mechanical to electrical conversion element such as a piezoelectric element. The output signals of each of the three vibration sensors 6 are input to the waveform detection circuit 6, and are converted into detection signals that can be processed by the subsequent arithmetic control circuit 1. Arithmetic control circuit
performs vibration transmission time measurement processing and detects the coordinate position of the vibrating pen 3 on the vibration transmission plate 8.

The detected coordinate information of the vibrating pen 3 is processed in the arithmetic control circuit 1 according to the output method by the display 11'.

That is, the arithmetic control circuit controls the output operation of the display 11' via the video signal processing device io based on the input coordinate information.

FIG. 3 shows the structure of the arithmetic control circuit 1 shown in FIG.

Here, the structure of the drive system of the vibrating pen 3 and the vibration detection system using the vibration sensor 6 are mainly shown.

The microcomputer 11 includes an internal counter, ROM, and RAM. The drive signal generation circuit 12
It outputs a drive pulse of a predetermined frequency to the vibrator drive circuit 2 shown in the figure, and is activated by the microcomputer 11 in synchronization with the coordinate calculation circuit.

The count value of the counter 13 is latched into the latch circuit 14 by the microcomputer 11.

On the other hand, the waveform detection circuit 9 obtains timing information of a detection signal for measuring vibration transmission time for coordinate detection and signal level information for pen pressure detection from the output of the vibration sensor 6 as described later. Output. These timing and level information are input to input ports 15 and 17, respectively.

The timing signal input from the waveform detection circuit 9 is input to the input port 15, and the latch circuit 1 is input by the determination circuit 16.
4 and the result is transmitted to the microcomputer 11. That is, the vibration transmission time is expressed as a latch value of the output data of the counter 13, and coordinate calculation is performed using this vibration transmission time value.

Output control processing for the display device 11' is performed via the input/output port 18.

The basic operation of the above configuration will now be explained.

54 illustrates the detected waveform input to the waveform detection circuit 9 of FIG. 1 and the vibration transmission time measurement process based on the detected waveform. In FIG. 4, reference numeral 441 indicates a drive signal pulse applied to the vibrating pen 3. Ultrasonic vibrations transmitted from the vibrating pen 3 driven by such a waveform to the vibration transmission plate 8 pass through the vibration transmission plate 8 and are detected by the vibration sensor 6.

After traveling within the vibration transmission plate 8 for a time tg corresponding to the distance to the vibration sensor 6, the vibration reaches the vibration sensor 6. The reference numeral 42 in FIG. 4 indicates the signal waveform detected by the vibration sensor 6. The plate wave used in this embodiment is a dispersive wave, so the envelope 42 of the detected waveform
The relationship between 1 and phase 422 changes depending on the vibration transmission distance.

Here, the speed at which the envelope advances is assumed to be group velocity Vg, and the phase velocity is assumed to be Vp. The distance between the vibrating pen 3 and the vibration sensor 6 Ill can be detected from the difference in group velocity and phase velocity.

First, if we focus only on the envelope 421, its velocity is Vg, which is a point on a certain waveform.

For example, when a peak is detected as indicated by reference numeral 43 in FIG. 4, the distance between the vibrating pen 3 and the vibration sensor 6, ad is the vibration transmission time tg, and a=vg@t g
...(1) This formula is 1 of vibration sensor 6
However, the distances between the other two vibration sensors 6 and the vibration pen 3 can be expressed using the same formula.

Furthermore, in order to determine coordinate values with higher precision, the phase waveform 4 shown in FIG.
If the time from 22 specific detection points, for example, vibration application to the zero cross point after passing the peak, is tp, then the distance between the vibration sensor and the vibration pen is d=n*inputp+vpHtP-1+(2). Here, input p is the wavelength of the elastic wave, and n is an integer.

From the above equations (1) and (2), the above integral fin is n=[
(Vg ``tg-vp'' tP) / input p +
1/N ] ” (3) Here, N is a real number other than O, and an appropriate value is used. For example, N
=2, and n can be determined if it is within ±1/2 wavelength.

By substituting n determined as above into equation (2), the distance between the vibrating pen 3 and the vibration sensor 6 can be accurately measured.

In order to measure the two vibration transmission times tg and tp shown in FIG. 3, the waveform detection circuit 9 can be configured as shown in FIG. 5, for example.

In FIG. 5, the output signal of the vibration sensor 6 is amplified to a predetermined level by the amplification circuit 51 described above.

The amplified signal is input to the envelope detection circuit 52, and only the envelope of the detection signal is extracted. The timing of the peak of the extracted envelope is detected by the envelope peak detection circuit 53. From the peak detection signal, an envelope delay time detection signal Tg having a predetermined waveform is formed by a signal detection circuit 54 composed of a mono-multivibrator or the like, and is input to an arithmetic control circuit l.

Further, the phase delay time detection signal TP is formed by the detection circuit 58 from this Tg times signal timing and the original signal delayed by the delay time adjustment circuit 57, and the phase delay time detection signal TP is formed by the arithmetic control circuit l.
is input.

That is, the Tg multiplied signal monostable multi-occurrer 55 converts the signal into a pulse of a predetermined width. Further, the comparator level supply circuit 56 forms a threshold value for detecting the tp times signal according to this Nockles timing. As a result, the comparator level supply circuit 56 is supplied with reference numeral 4 in FIG.
A signal 44 having a level and timing such as 4 is generated and input to the detection circuit 57.

That is, the monostable multivibrator 55 and the comparator level supply circuit 56 are used to ensure that the phase delay time measurement is activated only for a certain period of time after the envelope peak is detected.

This signal is sent to a detection circuit 5 consisting of a comparator etc.
8 and is compared with the delayed detection waveform as shown in FIG.

The circuit shown above is for one vibration sensor 6, and the same circuit is provided for each of the other sensors.

If the number of sensors is generalized to h, then h detection signals of envelope delay times Tgl to h and phase delay times Tpl to h are respectively input to the arithmetic control circuit l.

In the arithmetic control circuit of FIG. 3, the above Tgl~h, Tpl-
The h signal is input from the input port 15, and the count value of the counter 13 is taken into the latch circuit 14 using each timing as a trigger.As mentioned above, the counter 13 is started by 1 in synchronization with the vibration + pen drive. , the latch circuit 14 receives data indicating the respective delay times of the envelope and the phase.

When three vibration sensors 6 are arranged at the positions S1 to S3 at the corners of the vibration transmission plate 8 as shown in FIG. Linear pressure fidl-d3 to the position of vibration sensor 6
can be found.

Furthermore, the coordinates (x, y) of the position P of the vibrating pen 3 can be determined by the arithmetic and control circuit 1 based on the linear distance di-d3 using the following formula from the 3-square theorem.

z=X/2+(dl+d2) (dl-d2)/2X
-(4) y-Y/2+(dl + d
l) (di-d3)/2Y...
(5) Here, X and Y are the distances along the X and Y lines between the vibration sensor 6 at the positions S2 and S3 and the sensor at the origin (position i? J S 1 ).

As described above, the position coordinates of the vibrating pen 3 can be detected in real time. In addition, by repeating the above input processing in a short period of time and displaying dots one after another at positions corresponding to the input coordinate points on the display 11', handwritten characters input with the vibrating pen 3, Images and other information can be displayed in their original size.

As described in the section on conventional examples, in such applications, it is impossible to input and edit images accurately unless the image is displayed exactly at the position on the display 11' intended by the operator. .

However, as mentioned above, the 1 display 11' and the vibration transmission plate 8
, the refractive index of the vibration transmission plate 8, etc., a deviation occurs between the input position and the display position at the operator's observation point. In other words,
Even if dots are displayed at the same coordinate position as the coordinate input point on the display 11', the dots will be perceived as being shifted from the position of the operator's eyes.

Some configurations for solving this problem are shown below.

The configuration shown in FIG. 7 allows the operator to input and set the control amount for correcting the display position.

The set control amount is thereafter held (stored) in the setting means.

In Fig. 7, the items indicated by numerals 72 and 73 are:
This volume 72. is a volume (variable resistor) through which the operator inputs and sets a control amount for controlling the display position.
Both ends of 73 are connected to the power supply voltage Vcc via a resistor R, and the other end is grounded. Volume 72.73
The terminal voltages of are respectively converted into digital values by A/D converters 74 and 74 and input to the arithmetic control circuit l.

The operation axis of volume 72.73 is an input tablet,
The arithmetic control circuit 1 is exposed at a predetermined position on the main body, etc., in which it is housed, so that the operator can adjust the resistance value by rotating it. The terminal voltages of the volumes 72 and 73 change according to this manipulated variable, and are recognized by the arithmetic control circuit l via the A/D converter 74.

The arithmetic control circuit 1 recognizes the terminal voltages of the volumes 72 and 73 as correction amounts in the X and Y directions of the display position on the display 11', respectively. That is, the volume 72.
Recognizes the terminal voltage of 73 as a control amount for correcting the position of the display dot in the x and y directions as shown by reference numeral 71, and gives the input control amount to the display control unit IO.
Move the dot display in the x and y directions, respectively. This process can be easily performed by moving the coordinates in parallel by adding or subtracting the display coordinate values.

In such a configuration, when the operator inputs a dot (or line, etc.) using the vibrating pen 3 and rotates the volumes 72 and 73 while keeping the tip of the vibrating pen 3 fixed at the input position, the arithmetic control circuit l changes the display. The display dot is moved in the X and Y directions via the control unit IO. When the rotation of the volume is stopped, the arithmetic control circuit 1 stops the position of the display dot at a corrected position corresponding to the control ms set by the volume.

Therefore, by adjusting the volumes 72 and 73 so that the input dot matches the tip of the vibrating pen 3, the operator can control the input position and the display position seen from the operator's observation point to match. .

Since the set correction control amount is retained as the position of the rotation axis of the volume 72, 73, the same control amount will be calculated and controlled even if the power to the device is cut off or the power is turned on next time and processing starts. can be applied to circuit l. Therefore, if the operating position of the operator does not change, the display position is controlled to a predetermined corrected position after one adjustment.

In the above description, the correction control amount for the display position is input and set using the volume, but since an A/D converter is required, the configuration is relatively complicated. Therefore, as shown in FIG. 8, DIP switches 81 and 82 may be provided to input correction control amounts for the display position in the X and y directions, respectively, so that the control amount in the form of a digital value is directly given to the arithmetic control circuit I.

The number of elements of the DIP switches 81 and 82 is set to the number of bits corresponding to the required correction resolution.

According to such a configuration, the correction control amount of the display position can be input and set using a simpler structure.

In the configurations shown in Figures 7 and 8, if the operator's posture changes or if an operator with different physical conditions uses the device, the volumes 72 and 73 are rotated again and the jlIg clause is changed. Must be repeated.

Therefore, as shown in FIG. 9, the DIP switch 81 in FIG.
．． E that stores the digital control amount so that it is set to 82.
An IC card (or adjustment board, etc.) 91 equipped with a FROM or the like is provided, and correction control amounts for display positions corresponding to differences in operators or differences in the posture of the same operator are stored in the card 91. A possible method is to change the correction control amount by replacing .

The control amount of the IC card 91 is inputted to the arithmetic control circuit 1 via the input/output port 92, loaded into the memory 95, etc., and used to control the display control unit IO. If the memory 92 is constructed from a non-volatile memory (EEPROM) or the like, the same correction control amount can be used thereafter without using the IC card 91.

According to such a configuration, even if the operator or the operator's posture changes, the display position can be easily corrected and controlled by simply replacing the IC card.

The configurations shown in FIGS. 7 to 8 require some adjustment work. In view of this point, structures as shown in FIGS. 10 to 13 can be considered in order to facilitate the adjustment work between the input position and the display position.

FIG. 10 explains the adjustment operation in the following embodiment.

In this embodiment, a point on the display 11'' is first displayed, and then the operator is requested to input coordinates to that point.

Since there is a deviation between the input position and the display position at the operator's observation point before correction, the coordinates should be input to a position such as 3', for example.

Therefore, by taking in the coordinates of this input point and finding the difference between its X coordinate and the x, X coordinate of the initially displayed display point, a correction value for the display coordinate can be found. Thereafter, by correcting the display position based on the collected correction values, it is possible to match the input position and the display position for the operator.

As a configuration for performing such correction processing more accurately, structures as shown in FIGS. 11 to 13 can be considered.

FIG. 11 shows the structure of the vibrating pen 3. In FIG. 11, reference numeral 111 is a pen shaft, and a ring-shaped vibrator 112 is provided inside this pen shaft.
The vibration of the vibrator 112 is configured to be transmitted to the vibration transmission plate 8 via a horn portion 114 made of glass or the like and having optical transparency. The vibration mode of the vibrator 112 is selected in the same manner as in the previous embodiment.

Further, a horn portion 1 is provided at the center of the ring-shaped vibrator 112.
A light sensor 113, such as a photodiode, is provided so as to be able to detect the light transmitted through the light sensor 14.

When actually using the vibrating pen 3 having the structure shown in FIG. 1, most operators tilt the vibrating pen 3 at an angle as shown in FIG.

When a reflective element such as a liquid crystal display is used as the display 11', light emitted from an indoor lighting source is reflected by the reflective surface of the display 11' along a path as shown in the figure, and the pen shaft 11
The light reaches an optical sensor 113 that is provided in alignment with the central axis of 1. However, here, the optical axis is illustrated ignoring refraction at the vibration transmission plate 8.

If a dot is displayed as shown by reference numeral 121, the presence or absence of the display can be detected based on the intensity of light input to the optical sensor 113.

While the display dots are being detected by the optical sensor 11 in this manner, the vibrator 112 is driven, and the vibrations input to the vibration transmission plate 8 are processed as described above to obtain input coordinate values. The correction control amount of the display position can be determined by determining the difference from the coordinates of the display point known in advance.

In this method, the operator places a small display dot on the vibrating pen 3.
Since you are asked to point with
It may become difficult to operate.

Therefore, the following method can be considered.

For example, as shown by reference numeral 131 in FIG. 13, a straight line (y=n) parallel to the X-axis is displayed on the display 11', and a line is input using the vibrating pen 3 so as to intersect this straight line. .

While inputting this line, the output of the optical sensor 113 is monitored, and the difference between the y coordinate of the input coordinates when the sensor 113 detects the displayed straight line 131 and the y value n of the straight line 131 is corrected in the X direction. It becomes the control amount.

Similarly, the amount of correction in the X direction can be obtained by displaying a straight line of x=n, making an input using the vibrating pen 3 so as to intersect the straight line, and performing similar processing.

Although a reflective type display has been exemplified above, a structure similar to that shown in FIGS. 10 to 13 can also be used for a light emitting type display such as EL or CRT.

[Effects of the Invention] As is clear from the above, according to the present invention, the handwritten information input device and the display device are arranged in an overlapping manner, and characters or images handwritten into the handwritten information input device are displayed on the display. In the information input/output device for displaying information on a device, control information is provided for correcting the display t of the display so that the input position of the handwritten information input device and the display position of the display coincide at the observation position of the operator. Since the configuration includes means for storing in a predetermined format and a control means for correcting the display position of the display based on the control information stored in the means, the correction control information set in the storage means is adopted. Since the position of the display information corresponding to the input information can be corrected based on the input information, it is possible to reliably match the input position and the display position for the operator, which has the excellent effect of improving the operability of the apparatus.

[Brief explanation of the drawing]

Fig. 1 is an explanatory diagram showing the configuration of an information input/output device adopting the present invention, Fig. 2 is an explanatory diagram showing the structure of the vibrating pen shown in Fig. 1, and Fig. 3 is an explanatory diagram showing the structure of the vibrating pen shown in Fig. 1. Figure 4 is a waveform diagram showing the detected waveform to explain distance # measurement between the vibrating pen and the vibration sensor, and Figure 5 shows the configuration of the waveform detection circuit in Figure 1. Block diagram, Fig. 6 is an explanatory diagram showing the arrangement of the vibration sensor, Figs. 7 to 9 are explanatory diagrams showing different configurations for correcting the input position and display position, and Figs. The figures explain further different configurations for correcting the input position and display position. Figure 1o is an explanatory diagram showing the operating procedure, Figure 11 is an explanatory diagram showing the structure of the vibrating pen, and Figure 12 is an explanatory diagram showing the structure of the vibrating pen. 13 is an explanatory diagram showing detection of a correction control amount, and FIG. 13 is an explanatory diagram showing detection of different correction control information. 1... Arithmetic control circuit 3... Vibrating pen 4...
Vibrator 6... Vibration sensor 8... Vibration transmission plate 51... Preamplifier 15.16... Input boat 52... Envelope detection circuit 54.58... Signal detection circuit 72.73. ...Volume 81.82...DIP switch 91...IC card

Claims (1)

[Claims] In an information input/output device that includes a handwritten information input device and a display device arranged one above the other, and displays characters or images handwritten into the handwritten information input device on the display device, the input position of the handwritten information input device and , means for storing control information in a predetermined manner for correcting the display position of the display so that the display position of the display coincides with the observation position of the operator, and the display based on the control information stored in the means. An information input/output device characterized by comprising a control means for correcting a display position of a device.