JP2002082771A - Display medium, coordinate input system and information processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To minutely detect coordinates of a display, especially a liquid crystal display of a personal computer or a portable information terminal. SOLUTION: A pixel electrode 23 provided on an inner surface of at least one of a pair of substrates 22 at least one of which is transparent and having at least one liquid crystal display layer (active element) 25 is provided, a display layer is formed between the substrates 22 and a spacer (structural supporting body) 12 is provided in the display layer. Then the spacer 12 is made to form code symbols to indicate coordinate information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display medium, a coordinate input system for an information device such as a personal computer or a portable information terminal having a display device, and an information processing system provided with the coordinate input system.

[0002]

2. Description of the Related Art Generally, a mouse and a keyboard are used as input devices of a computer, but it is not always optimal to use these means. For example,
It is troublesome to switch between the keyboard and the mouse, and it is difficult to operate the mouse. Also, particularly in the case of a portable notebook personal computer, there is a disadvantage that the cord becomes an obstacle when a mouse is connected, and the pointing means as a substitute for the attached mouse is difficult to operate unless used. Furthermore, especially when carrying around a portable laptop computer,
In some cases, it is difficult to use the keyboard. In such a case, it is convenient to hold a pen-shaped device in hand and input characters and figures by hand.

[0003] As one example of a handwriting input method using a finger or pen-like writing device to solve these problems, there is a touch panel type, which is widely used.
As one example, there is a sensor in which a film-like sensor made of a resistive film such as conductive rubber is bonded to an LCD (see Japanese Patent Application Laid-Open No. 07-182091). In this method, a contact position is read by a change in resistance value of a sensor due to pen touch, and detected coordinates are input to a computer, and are used in notebook computers, portable information terminals, and the like.

As a second example, there is one that optically inputs coordinates (see JP-A-2000-10567).
There is. It is composed of two light emitting and receiving devices having a fan-shaped light source and a retroreflective device installed at the display device boundary, receives the light reflected recursively, and, based on its intensity distribution, It measures the pen position based on the principle of triangulation.

[0005]

SUMMARY OF THE INVENTION Japanese Patent Laid-Open No. 07-1820
In the method described in Japanese Patent Publication No. 91, when the sensor film is attached to a liquid crystal display device with an air layer interposed therebetween, light absorption and scattering occur, which causes a problem of reduction in resolution and contrast. .

Further, there is a problem that the thickness of the display screen is increased and that the designated coordinates are visually shifted when viewed obliquely due to refraction characteristics.

Further, in this method, when a plurality of objects touch the screen, there is a problem that the coordinates may not be detected or may be erroneously detected.

Further, this method has a drawback that the resolution is low, so that it is not possible to input very fine characters and figures, and character recognition may not be performed well.

On the other hand, the system disclosed in Japanese Patent Application Laid-Open No. 2000-105671 is suitable for inputting coordinates on a large screen such as a plasma display or a white board, but is small for a personal computer including a notebook personal computer or a portable information terminal. A resolution of a few millimeters is too low for screen applications.

In this method, when a plurality of objects touch the screen, the coordinates may not be detected or may be erroneously detected.

Furthermore, since there is no sensor for sensing that the screen has been touched, there is a problem that the optical sensor reacts when the pen is brought close to the screen to some extent. In order to solve this, it is necessary to perform optical scanning just over the screen. However, if the range is narrowed, the sensitivity of the sensor is reduced and the screen itself is slightly distorted. Further, since light is always received and emitted, useless power is consumed when not in use.

An object of the present invention is to enable the coordinates of a display device of a personal computer or a portable information terminal, particularly a liquid crystal display, to be precisely detected.

Another object of the present invention is to be able to detect the coordinates of the display device of a personal computer or a portable information terminal without lowering the display resolution and contrast.

Another object of the present invention is to make it possible to detect the coordinates of the display device of a personal computer or a portable information terminal without increasing the thickness of the display screen.

Another object of the present invention is to perform coordinate input without causing erroneous coordinate detection even when an object other than the coordinate input device touches a display device of a personal computer or a portable information terminal. .

Another object of the present invention is to perform a pointing or button click operation by directly touching the display device screen using a pen-like coordinate input device when using a personal computer or a portable information terminal.

Another object of the present invention is to make it possible to input coordinates of a fine character or figure by directly tracing the display screen with a pen-shaped coordinate input device when using a personal computer or a portable information terminal. That is.

Another object of the present invention is to efficiently recognize characters when performing coordinate input to a personal computer or a portable information terminal using a pen-shaped coordinate input device.

Another object of the present invention is to reduce power consumption when a coordinate is input to a personal computer or a portable information terminal using a pen-shaped coordinate input device.

[0020]

According to the first aspect of the present invention,
A pair of substrates, at least one of which is transparent, a pixel electrode provided on at least one inner surface of the substrate and having at least one active element, a display layer formed between the substrates, and formed in the display layer And a structure support formed thereon, wherein the structure support forms a code symbol indicating coordinate information.

According to a second aspect of the present invention, there is provided a display medium including at least one transparent substrate having a planar structure or a curved surface structure and a display layer capable of electrically controlling light emission characteristics as a part of its constituent elements. A part of the surface of one sheet of the transparent substrate is coated with a dielectric multilayer film having optical characteristics such that transmittance is high in a certain wavelength range and reflectance is high in a wavelength range different from the wavelength range. And the dielectric multilayer film forms a code symbol indicating coordinates on the display medium.

According to a third aspect of the present invention, there is provided a pair of substrates at least one of which is transparent, a pixel electrode provided on at least one inner surface of the substrate and having at least one active element, and formed between the substrates. Display layer, and a structural support formed in the display layer, a portion of the surface of the transparent substrate, high transmittance in a certain wavelength range, in a wavelength range different from the wavelength range. A display medium characterized by being coated with a dielectric multilayer film having optical characteristics to increase the reflectivity, wherein the dielectric multilayer film forms a code symbol indicating coordinates on the medium.

The invention according to claim 4 is provided on a pair of transparent substrates and at least one inner surface of the transparent substrates,
A structure in which a device including a pixel electrode having at least one active element, a liquid crystal layer formed between the transparent substrates, and a spacer formed in the liquid crystal layer is sandwiched between a pair of polarizing plates. For a display medium having, at least a part of one surface of the polarizing plate, a dielectric multilayer film having optical characteristics in which transmittance is high in at least a certain wavelength range and reflectance is high in a different wavelength range. Coated,
A display medium, wherein the dielectric multilayer film forms a code symbol indicating coordinate information.

The invention according to claim 5 is characterized in that the dielectric multilayer material has optical characteristics such that transmittance is high in a visible light region and reflectance is high in an infrared light region. 4. The display medium according to any one of 4.

[0025] The invention according to claim 6 is the invention according to claims 1 to 5.
A display medium and a coordinate input device according to any one of the above, the coordinate input device is provided in the device body and a device body capable of performing a writing operation while being held by a person,
An image reading device that optically reads a code symbol formed on a medium, a decoding unit that decodes the read code symbol, and a position, orientation, and distortion amount of the code symbol in an image read by the image reading device. Calculating means for calculating at least one of them, coordinate information indicating coordinates on the display medium included in the decoded information, and at least one of the position, direction and distortion amount of the code symbol. And a coordinate detecting means for detecting a position of a predetermined point on the display medium based on the coordinates.

According to a seventh aspect of the present invention, in the specific wavelength region, the structural support forming the code symbol has at least one of a reflectance and a transmittance with respect to other components of the display medium. The display medium according to claim 1, wherein the display medium has spectral characteristics that can be identified by the image reading device according to claim 6.

The invention according to claim 8 is the coordinate input system according to claim 6, further comprising a sensor for detecting that a part of the apparatus main body has come into contact with the surface of the display medium.

[0028] The invention according to claim 9 has a function of calculating that a part of the apparatus main body has come into contact with the surface of the display medium based on the size, position, orientation and distortion amount of the code symbol. 9. The coordinate input system according to claim 8, wherein:

According to a tenth aspect of the present invention, an operation corresponding to pointing and clicking a mouse button can be performed by operating the apparatus main body, and a signal processing unit for processing coordinate data is provided to enable handwriting input. The coordinate input system according to claim 6, 8 or 9, wherein the coordinate input is performed.

According to an eleventh aspect of the present invention, there is provided the coordinate input system according to the sixth aspect, wherein the coordinate input device indicates the communication unit and the coordinate information or the identity of the display medium to the communication unit. An instruction unit for instructing the transmission destination of the document information or both thereof, wherein the communication unit receives the instruction of the transmission destination from the instruction unit, and outputs the coordinate information or the document information or its information to an external communication device. Means for transmitting both, and the external communication device includes a communication unit for receiving coordinate information or document information or both from the coordinate input device.

According to a twelfth aspect of the present invention, the external communication device comprises: a communication unit; and an instruction unit for instructing the communication unit to transmit the coordinate information of the coordinate input device, the document information, or both. The communication unit in the external communication device, to the communication unit in the coordinate input device, transmits a destination instruction of coordinate information or document information or both thereof, the communication in the external communication device The unit receives the destination instruction of the coordinate information or the document information or both from the communication unit in the coordinate input device, the communication unit in the external communication device, the communication unit of the coordinate information or the document information or both The information processing system according to claim 11, further comprising means for transmitting coordinate information in accordance with a destination instruction.

According to a thirteenth aspect of the present invention, the coordinate input device includes a storage unit for recording coordinate information and / or document information, and the storage unit has means for monitoring the amount of recorded information. When the amount of information reaches a maximum amount that does not exceed a certain threshold, the communication unit is notified that the maximum amount has been reached, the coordinate information and / or the document information are transmitted, and the coordinate information or the document that has been recorded is transmitted. Erasing information or both, the communication unit receives a notification that the maximum amount has been reached from the recording unit, and transmits coordinate information or document information or both according to the notification from the recording unit, 12. The information processing system according to claim 11, wherein coordinate information and / or document information are acquired from said recording unit.

According to a fourteenth aspect of the present invention, the communication device in the coordinate input device finds the external communication device, and when the communication device in the coordinate input device discovers the external communication device, the communication device in the external communication device sends the coordinates to the communication unit. The information processing system according to claim 11, wherein information or document information or both of them is transmitted.

According to a fifteenth aspect of the present invention, the instruction unit in the coordinate input device instructs the image reading device to start reading a code symbol and instructs the image reading device to finish reading a code symbol. The image reading device transmits coordinate information from the start of reading to the end of reading to the processing unit, and the processing unit receives the coordinate information from the image reading device, and uses the coordinate information from the start of reading to the end of reading. The information processing system according to claim 11, wherein document information existing in an enclosed area is transmitted to the communication unit.

According to a sixteenth aspect of the present invention, the instruction unit in the coordinate input device instructs the image reading device to start reading a code symbol, and instructs the image reading device to finish reading the code symbol. The image reading device transmits the coordinate information from the start of reading to the end of reading to the communication unit in the coordinate input device, and the communication unit in the coordinate input device transmits the coordinate information to the external communication device. Send to
The external communication device includes a communication unit that receives coordinate information, the communication unit of the external communication device transmits the coordinate information to a processing unit in the external communication device, and transmits the coordinate information and the document information to the external device. Transmitting to the recording unit in the communication device, the processing unit receives the coordinate information, and receives from the recording unit the coordinate information and the document information present in the area surrounded by the coordinate information, the recording unit The information processing system according to claim 11, wherein the coordinate information and the document information are received, the coordinate information and the document information are recorded, and the coordinate information and the document information are transmitted to the processing unit.

[0036] The invention according to claim 17, wherein the recording unit in the external communication device acquires coordinate information and document information from other than the communication unit in the external communication device. Information processing system.

According to a preferred embodiment of the present invention, the recording unit in the external communication device records a description of a process to be performed on the document information corresponding to the coordinate information, and records the description of the process performed on the document information corresponding to the coordinate information. A process to be performed is transmitted to the processing unit, and the processing unit in the external communication device receives a description of the process to be performed on the document information corresponding to the coordinate information from the recording unit, and follows the description of the process. 17. The information processing system according to claim 16, wherein said information processing system performs a process.

[0038]

DESCRIPTION OF THE PREFERRED EMBODIMENTS [First Embodiment] A first embodiment of the present invention will be described with reference to FIGS.

FIG. 1 is a schematic diagram showing an example of a system outline of a coordinate input system according to the present invention.

To briefly describe the system configuration, the main body of the coordinate input device includes an image reading device 1, a contact detection unit 2, a function key 3, a signal processing unit 4, a power control unit 5, and a wireless module 6a. . In the system of the present embodiment, using the coordinate input device body, the coordinates of the display device 10 in which the spacer forms the code symbol are detected, and the detected coordinates and a part used for indicating the coordinates of the input device body are used. A detection signal indicating whether or not the user is touching the screen,
And a signal from function key 3 to signal processing unit 4
This signal is transmitted by wireless communication between the wireless module 6a attached to the body of the coordinate input device and the wireless module 6b attached between the personal computer or the portable information terminal having the display device 10. Do. In the present embodiment, a color transmission type liquid crystal display device will be described as an example of the display device 10 and will be described.

FIG. 2 is a schematic diagram of the system configuration of the apparatus main body. The apparatus has a pen-like shape so that the operator can easily operate the apparatus, and the coordinates are designated by the tip 11 thereof.

The wireless module 6a attached to the main body of the coordinate device can perform at least wireless transmission, and the wireless module 6b attached between a personal computer or a portable information terminal can at least perform wireless reception. Furthermore, both wireless modules have transmission and reception capabilities,
Embodiments that perform bidirectional communication are also possible.

In the personal computer or the portable information terminal, the signal received by the wireless module 6b is transmitted to the central processing unit 7. The central processing unit 7 performs display on the display device 10 from the display control unit 9 based on the information signal. The central processing unit 7 has a memory, and the display device 1 is
By tracing the screen 0, a desired character string, a plurality of figures, a screen area, and the like can be selected.

Further, the central processing unit 7 has a soft keyboard and palette software for performing character recognition on characters input by handwriting, and thereby it is possible to input digital data.

Next, a description will be given of a coordinate expression using a code symbol by a spacer, which is the basis of the present invention, and a method of detecting the coordinates. First, a reading method by the coordinate input device body will be described.

FIG. 3 shows a configuration example of the image reading apparatus 1. The image reading device 1 includes a lighting device 45, an imaging device 46, an image forming optical system 47, and a signal processing circuit 48 for performing control, data processing, and the like thereof. Imaging device 46
Is composed of an image sensor array such as a CCD camera or a CMOS sensor. As will be described later, it is desirable that these elements have a wavelength characteristic necessary for detecting the code symbol or are covered with a wavelength filter so that the wavelength region to be imaged can be limited. Further, the imaging device 46 may include an imaging lens system 47 including at least one imaging lens, and an embodiment having a function of performing autofocusing is also possible if necessary.

The illumination device 45 is for improving the code symbol detection sensitivity of the imaging device 46. This is a very effective means of improving sensitivity when detecting a reflective liquid crystal code symbol whose screen is dark because it has no backlight. Alternatively, if the illumination device 45 is illuminated with light having a wavelength within the wavelength selection range, the detection sensitivity can be further increased. These will be described in detail in the section of the spacer material forming the code symbol.

Next, the signal processing performed by the signal processing section 4 of the coordinate input device body will be described with reference to FIG.

First, a code symbol is decoded from the image read by the image reading device 1, and the center coordinates of the code symbol are obtained (S1). Next, the position, the direction, and the amount of distortion of the code symbol in the image read by the image reading device 1 are calculated (S2). Based on this information,
The coordinates indicated by the tip 11 of the apparatus main body are calculated (S3). Since the absolute coordinates of the display device 10 are calculated from the relative designated coordinates of the tip 11 with respect to the code symbol, the coordinates can be specified more finely than the coordinate information of the code symbol.

Next, regarding the display device 10 in which the spacer forms the code symbol, a method for forming the code symbol and a method for increasing the detection sensitivity will be described in detail.

As an embodiment of the present invention, the liquid crystal display device 10
An example using a color transmission type liquid crystal display device will be described. FIG. 5 is a schematic diagram showing the configuration of the color transmission type liquid crystal display device, and is a cross-sectional view as viewed from a direction perpendicular to the display screen.

The liquid crystal display device includes a polarizing filter 21, a transparent substrate 22, a transparent electrode 23, an alignment film 24, a liquid crystal layer 25, a spacer 12, a color filter 26, and a backlight 27.

The polarization filter 21 controls the polarization of light entering and exiting.

The transparent substrate 22 is for preventing electricity from the electrode portion from leaking to other portions.

The transparent electrode 23 is an electrode for driving a liquid crystal display, and is made of a material having high transparency so as not to hinder display.

The alignment film 24 is a film for aligning liquid crystal molecules in a certain direction.

The liquid crystal molecule layer 25 is composed of liquid crystal molecules, and the voltage applied to the transparent electrode 23 controls the orientation of the molecules.

The spacer 12 is for securing a uniform space between two transparent substrates sandwiching a liquid crystal substance.

The color filter 27 is a wavelength filter for three colors of RGB.

The backlight 28 illuminates from behind the display to brighten the screen.

FIG. 5 is a schematic diagram showing the configuration of a cross section of a color transmission type liquid crystal display device, and the above-mentioned components are not necessarily arranged in a spatial arrangement as illustrated.
Further, the spacer 12 does not always exist at the boundary of the color filter 26.

In the present invention, the spacer 12 forms a code symbol indicating coordinate information. As an example of a method of forming a code symbol using the spacer 12, a method of forming a two-dimensional code by arranging a plurality of spacers based on a certain rule indicating coordinates as shown in FIG. In this case, two types of spacers as described later are used, and the spacer 12b indicated by a white square has low sensitivity for reading by the coordinate input system.
Just like a conventional spacer, a transparent substrate 2 of a liquid crystal display device
2 is for supporting. The black square spacer 12a can be read by the coordinate input system, and the spacer 12a forms a code symbol. The example shown in FIG. 11 is a case where the code symbol 13 is formed by 5 × 5 spacers. However, the code symbol is formed by an arbitrary number of spacer units according to the fineness of the input coordinates and the sensitivity of the reader 1. It is possible to create. In the example of FIG. 11, the spacers 12 are regularly arranged in a grid pattern, but the two types of spacers need not necessarily be arranged in this manner. In particular, it is sufficient that the spacers 12b having the lower sensitivity are dispersed almost uniformly at an appropriate concentration capable of supporting the transparent substrate 22. In addition, the arrangement of the spacers 12a having high sensitivity can be changed to more various code patterns.

As another example, as shown in FIG. 12, as shown in an Anoto pattern of Anoto Corporation, a grid composed of vertical and horizontal virtual grid lines 14 on the display device 10
There is a method of disposing a spacer 12a having high sensitivity to the reading device 1 at a point shifted from the intersection of the virtual grid by a sufficiently small range with respect to the size of the grid. The shift pattern of the spacer 12a is unique in that each shift pattern forms a code indicating a coordinate position.

In the example of FIG. 6, only the spacer 12a forming the code symbol 13 is displayed.
As in the previous example shown in FIG. 1, it is not possible to read with the coordinate input system 1, and an embodiment using a spacer 12b for simply supporting the transparent substrate 22 of the display device 10 is also possible. Furthermore, the spacer 12a forming the code symbol 13 does not need to be a single spacer,
It is also possible to form the code symbol 13 by arranging the plurality of spacers 12a as one block at a point shifted from the intersection of the virtual lattice by a sufficiently small range with respect to the size of the lattice.

The code symbol 13 can be formed by combining the above two examples.

In order to increase the detection sensitivity of the code symbol 13, the spacer 12 a
Other elements constituting the liquid crystal display device 10 as the material of
It is desired to have characteristic optical characteristics for 1 to 27 and 12b. For example, there is a characteristic in the absorption spectrum and the reflection spectrum.

FIG. 10 shows an example in which the spacer 12 has optical characteristics such that it is transparent to visible light and has a low transmittance in the infrared region. Further, the image reading device 1
By limiting the detection wavelength range, it is possible to detect a spacer with high sensitivity. The wavelength range is limited by the imaging device 46.
This is realized by using an image sensor having desired characteristics or by biting a desired wavelength filter in the image pickup device 46.

The illumination included in the image reading apparatus 1 of the apparatus body according to claim 6, wherein the wavelength region exhibiting the characteristic spectral characteristic is not a visible region but an ultraviolet region or an infrared region. The device 45 can be invisible light illumination such as an infrared LED or the like, and the spacer 12a forming the code symbol 13 can be highly sensitive without visually affecting the screen display of the display device 10. Can be detected. In particular, when the display device 10 is a reflective liquid crystal display device,
Illumination in the invisible light region is desirable because it is less susceptible to visual effects.

Further, if an LD (laser diode) is used as the illumination light source 45 and the wavelength is further restricted, it is possible to perform coordinate detection with higher sensitivity.

By increasing the image reading sensitivity of the code symbols 13 formed by the spacers 12a, finer code symbols 13 can be formed.
As a result, it is possible to input coordinates with higher accuracy.

Here, as described above, the code symbol 13 does not necessarily need to use all the spacers in the display device 10, and may be configured using a plurality of types of spacers having different optical characteristics. Is also possible.

For example, in a desired wavelength region, two types of spacers, a spacer 12a having high sensitivity to the image reading apparatus 1 and a spacer 12b having low sensitivity, are used, and only the spacer having high sensitivity is detected. It means that the symbol 13 can be read.

As a first embodiment for realizing this, the spacers 12a forming the code symbols 13 and the spacers 12b not forming the code symbols 13 are made of different materials having different optical characteristics.

The second embodiment is realized by doping a metal atom or an organic dye molecule for realizing a desired spectral characteristic into the spacer 12a forming the code symbol 13. .

An example of the manufacturing method in the first embodiment will be described with reference to FIG. First, a display device 51 is prepared in which the spacers are doped with organic dye molecules having desired optical characteristics and the like, and are uniformly distributed in the liquid crystal layer 25 sandwiched between the transparent substrates 22. Next, the liquid crystal substrate is irradiated with ultraviolet light 50 through a photomask 50 having a pattern shape of the code symbol 13 to degrade a dye doped in a spacer existing in an unmasked region, and to improve optical characteristics. Is obtained.
Dyes doped into the spacers present in the masked areas retain their optical properties. Utilizing this difference in optical characteristics, highly sensitive detection is possible.

As described above, the signal processing unit 4
Then, in addition to the center coordinate information of the code symbol 13 obtained by decoding the code symbol 13, the size of the code symbol read by the image reading device 1, the position, the direction, and the amount of distortion of the code symbol 13, Since the position of the coordinate input tip 11 for performing pointing of the coordinate input device body is calculated, the coordinates can be detected more minutely than the code symbol 13. Conversely, if this is used, fine coordinate detection / input can be performed with a rough code symbol structure, as compared with the case where coordinate detection is performed using only the code symbol 13. In other words, this means that the detection sensitivity of the image reading apparatus 1 can be reduced as compared with the case where coordinate detection / input is performed using only the code symbol 13. This means that, with respect to the coordinate detection resolution required by the device, the design of the degree of freedom can be made with the parameters of the constituent elements according to the performance of the elements of the reading device 1 and the calculation processing capability of the signal processing unit 4. Means

As described above, in this embodiment, the liquid crystal display device (LC
Although the example of D) has been given, other display devices having a structural support include a nematic liquid crystal display device, an organic EL display, a plasma display, a field emission display, and the like. FIGS. 6 to 9 show various configurations. In these display devices, an embodiment in which a code symbol is formed using the spacer 12 is also possible. 6 to 9 are schematic diagrams, and each component drawn is shown in FIG.
It does not always have the spatial arrangement as depicted.

Next, an additional mechanism of the coordinate input device body will be described in detail.

The contact detection unit 2 provided in the main body of the coordinate input device is an example of the above-described conventional example (JP-A-2000-10567).
No. 1) is to avoid the problem of erroneously recognizing that the user has pointed just by bringing the pen close to the pen. It is to detect whether or not the screen 10 is touched.

As a first embodiment for realizing this, FIG.
4, a button-shaped sensor device. By contacting the display device 10, the tip portion 11 is depressed,
The switch 53 conducts, a current flows through the circuit, and the current sensing unit 54 can detect contact.

As a second embodiment, as shown in the flowchart of FIG. 15, the size, position, direction, and amount of distortion of the code symbol 13 read by the image reading device 1 are used.
There is a method in which the signal processing unit 4 determines whether the tip 11 of the pen is in contact with the screen of the liquid crystal display device 10 by calculation processing.

The first example is characterized in that it can be realized by a mechanically and electrically simple mechanism. In the second example, since the coordinate detection mechanism is used, the calculation can be performed almost simultaneously with the coordinate detection. In addition, although the power consumed by the sensor of the first example can be saved, it has the second inferior aspect in the reliability of contact sensing and the response time. Also in the second example, in order to improve the tactile usability of the operator, as in the first example, the distal end portion 11 is mechanically dented or deformed by pressure, and the tactile sense of the operator is increased. It is desirable to have a mechanism that appeals to

Further, the main body of the coordinate input device is provided with a function key 3 so that various functions can be added to the coordinate input system. A first example is to provide a button for right-clicking a mouse. When a certain coordinate of the liquid crystal display device 10 is designated for the first time immediately after pressing this button, the same processing as when right-clicking the designated coordinate is performed. Another example is that a left double-click button is similarly provided.

As a second example of the function keys 3, as described above, there is an example in which the central processing unit 7 is provided with a button for displaying a soft keyboard or handwritten character recognition software on the display device 10. It is desirable that the above two examples be provided in order to effectively use the coordinate input system.

The third function key 3
Examples of Shift key, Ctrl key, Es
A function key 3 having at least one of the keys frequently used when using a normal keyboard, such as the c key and the Delete key, and a function key 3 having a mechanism that allows an operator to assign a key as desired. What you have.

The wireless module 6 for performing wireless communication is realized by an infrared system or a radio wave system. The former is
It is realized by a remote control method, an IrDA format, or the like. The latter is realized by a radio wave method using a Bluetooth format or the like. However, in the former case, when image reading is performed in the infrared region, care must be taken so that both wavelengths do not overlap. On the other hand, in the wireless radio system, there is no optical problem, and in the radio radio system, since there is no directivity of transmission, the communication speed is less affected by the positional relationship of the wireless module than the former. I'm done. In particular
Since the Bluetooth format has a small chip size, weight, and low power consumption, it is suitable for being incorporated in an apparatus main body. In addition, since various energy saving modes are defined, transmission / reception power can be reduced when communication is not necessary, so that the battery is suitable for using the battery or the rechargeable battery of the apparatus for a long time.

When performing wireless communication, if a plurality of coordinate input systems of the same model are present in a wireless communication range, a malfunction may occur. It is desirable to have
Authentication is achieved using device codes and, in addition, cryptography.

In this embodiment, a radio system is used in consideration of the convenience of use by the operator. However, the coordinate input system of the present invention does not necessarily need to exchange data wirelessly, and is realized by using a wired cable. It is also possible. In this case, although the convenience is reduced, the image data obtained by the image reading device 1 is directly transmitted to the central processing unit 7, and the central processing unit 7 performs decoding, calculation of distortion and the like, and coordinate detection, thereby obtaining the coordinates. An embodiment is also possible in which coordinate input with a higher response speed than that performed by the signal processing unit 4 provided in the input device main body is performed, and the device main body can be reduced in size and weight. Another advantage is that since the power source of the main body of the coordinate input device is supplied from a personal computer or a portable information terminal, only the battery or the rechargeable battery of the main body of the coordinate input device is not consumed. .

In consideration of the usefulness of the power supply when a wired cable is used, the coordinate input system having a wireless module 6 equipped with a terminal connectable by a wired cable is also mentioned as one of the embodiments. Can be Using a wired cable when the power of the coordinate input device itself is exhausted,
Desirably, at least power can be supplied from a personal computer or a portable information terminal, and in addition to image reading data or coordinate data, a touch sensing signal and data of the function key 3 can be transmitted by wire. Next, the operation of the power control unit 5 will be described. The power control unit 5 shown in FIGS. 1 and 2 includes a sensor for sensing that the operator is holding the body of the coordinate input device, a timer for counting time, and a control device for controlling power ON / OFF and power consumption.

Examples of the sensors include a temperature sensor for detecting the temperature of the hand and a pressure sensor for detecting the pressure at the time of grasping.

When the operator grips the main body of the coordinate input device and the sensor reading exceeds a certain threshold, the power is turned on. When one hand leaves and the sensor reading exceeds a certain threshold, the timer is activated. However, when a certain threshold is exceeded, power consumption can be reduced by automatically turning off the power or entering a standby mode so as not to consume unnecessary power. This flowchart is shown in FIG. In addition, as shown in the flowchart of FIG. 17, a function of providing two thresholds, reducing the power of wireless communication with the first threshold, turning off the power of the entire apparatus with the second threshold, or entering the standby mode It is desirable to have When wireless radio communication is performed in the Bluetooth format, the communication power can be reduced by using an energy saving mode such as a park mode, a sniff mode, and a hold mode defined by the Bluetooth standard. Further, an embodiment in which these energy saving modes are effectively combined and two or more threshold processes are performed is also possible. Also, when wireless communication is performed by another wireless means, a similar energy saving mode can be defined.

If the operator does not point at the screen of the display device 10 even if the operator holds the body of the coordinate input device,
The power consumed by the wireless module 6 is wasted. As a method of saving this power, a timer for measuring a code symbol non-detection time is provided in the coordinate input device main body, and when the code symbol 13 is not detected, the timer is activated. Is realized by adding a function of reducing Even in this state, the parts other than the communication of the apparatus main body retain the normal functions. Further, when the code symbol 13 is detected in the power saving mode, a function of restarting normal communication is provided. This is also realized by means similar to the above-described energy saving mechanism based on detection and detection of the device by the operator.

The power of the main body of the coordinate input device is turned on when the power of the host such as a personal computer or a portable information terminal is turned off or in a standby mode so that coordinates cannot be input. Therefore, it is desirable to have a function of turning off the power of the coordinate input device body by detecting that the power of the host device is turned off or that the host device is in a standby mode. This means that the personal computer or the portable information terminal has a function of notifying the coordinate input device main body that the power is turned off or enters the standby mode from the personal computer or the portable information terminal side, or a timer is provided in the device main body, If there is no response from the personal computer or portable information terminal, a timer is activated, and when a certain threshold is exceeded, the power is automatically turned off or a function to enter the standby mode is provided so that unnecessary power is not consumed. Is achieved. This is also realized by the same means as the energy saving mechanism based on the detection of the grasp of the body of the coordinate input device by the operator.

By combining the above-described power saving mechanisms, the use period of the battery or rechargeable battery of the coordinate input device main body can be further extended.

[Second Embodiment] A second embodiment of the present invention will be described with reference to FIGS.

FIG. 18 is a schematic diagram showing an outline of the coordinate input system.

The system configuration of the coordinate input device is briefly described below. The main body of the coordinate input device includes an image reading device 1, a contact detection unit 2, a function key 3, a signal processing unit 4, a power control unit 5, and a wireless module 6a. . Using the coordinate input device main body, the coordinates of the display device 10 where the spacer forms the code symbol are detected, and the detected coordinates,
The signal processing unit 4 processes a detection signal indicating whether or not a part of the input device main body used for coordinate designation is touching the screen, and a signal from the function key 3, and this signal is attached to the coordinate input device main body. A wireless module 6a;
Data wireless communication is performed with a personal computer having the display device 10 or a wireless module 6b attached between portable information terminals. FIG. 19 is a schematic diagram of a system configuration of the apparatus main body. The apparatus main body has a pen-like shape for easy operation by an operator, and coordinates are designated by a tip portion 11 thereof.

The wireless module 6a attached to the main body of the coordinate device can perform at least wireless transmission, and the wireless module 6b attached between a personal computer or a portable information terminal can at least perform wireless reception.
Further, an embodiment in which both wireless modules have transmission / reception capability and perform bidirectional communication is also possible.

In the personal computer or the portable information terminal, the signal received by the wireless module 6b is transmitted to the central processing unit 7. The central processing unit 7 performs display on the liquid crystal screen 10 from the display control unit 9 based on the information signal. The central processing unit 7 has a memory, and it is possible to select a desired character string, a plurality of figures, a screen area, and the like by tracing the screen of the display device 10 with the coordinate device body.

Further, the central processing unit 7 has a soft keyboard and palette software for performing character recognition on characters input by handwriting, so that digital data can be input.

Next, a description will be given of a coordinate expression using a code symbol by a spacer which is the basis of the present invention, and a method of detecting the coordinate. First, a reading method by the coordinate input device body will be described.

FIG. 20 shows an example of the configuration of the image reading apparatus 1.
The image reading device 1 includes a lighting device 45, an imaging device 46, an image forming optical system 47, and a signal processing circuit 48 for performing control, data processing, and the like thereof. Imaging device 46
Is composed of, for example, an image sensor array such as a CCD camera or a CMOS sensor. As will be described later, it is desirable that these elements have a wavelength characteristic necessary for detecting the code symbol or are covered with a wavelength filter so that the wavelength region to be imaged can be limited. Further, the imaging device 46 may include an imaging lens system 47 including at least one imaging lens, and an embodiment having a function of performing autofocusing is also possible if necessary.

The illumination device 45 is for improving the code symbol detection sensitivity of the imaging device 46. This is a very effective means of improving sensitivity when detecting a reflective liquid crystal code symbol whose screen is dark because it has no backlight. Alternatively, if the illumination device 45 is illuminated with light having a wavelength within the wavelength selection range, the detection sensitivity can be further increased. For more information on these,
It will be described later.

Next, the signal processing performed by the signal processing section 4 of the coordinate input device body will be described with reference to the chart of FIG.

First, a code symbol is decoded from the image read by the image reading device 1, and the center coordinates of the code symbol are obtained (S1). Next, the position, the direction, and the amount of distortion of the code symbol in the image read by the image reading device 1 are calculated (S2). Based on this information,
The coordinates indicated by the tip 11 of the apparatus main body are calculated (S3). Since the absolute coordinates of the display device 10 are calculated from the relative designated coordinates of the tip 11 with respect to the code symbol, the coordinates can be specified more finely than the coordinate information of the code symbol.

Next, regarding a display device in which a dielectric multilayer film coated on a transparent substrate or a polarizing plate forms a code symbol, a method of forming a code symbol and a method of improving detection sensitivity will be described in detail. State.

As the display device 10 according to the embodiment of the present invention, a display device using a color transmission type liquid crystal display device will be described. FIG.
And FIG. 23 is a schematic view showing the configuration of a color transmission type liquid crystal display device, and is a cross-sectional view seen from a direction perpendicular to a display screen.

The liquid crystal display device 10 includes a polarizing plate 21, a transparent substrate 22, a transparent electrode 23, an alignment film 24, a liquid crystal layer 25, a spacer 12, a color filter 26, and a backlight 2.
7.

The polarizing plate 21 controls the polarization of light entering and exiting.

The transparent substrate 22 is for preventing electricity from the electrode portion from leaking to other portions.

The transparent electrode 23 is an electrode for driving a voltage applied to the liquid crystal layer, and is made of a material having high transparency so as not to hinder display.

The alignment film 24 is a film for aligning liquid crystal molecules in a certain direction.

The liquid crystal molecule layer 25 is composed of liquid crystal molecules, and the voltage applied to the transparent electrode 23 controls the orientation of the molecules.

The spacer 12 is for securing a uniform space between two transparent substrates sandwiching a liquid crystal substance.

The color filter 27 is a wavelength filter for three colors of RGB. The backlight 28 illuminates from behind the display to brighten the screen.

FIGS. 22 and 23 are schematic diagrams showing the cross-sectional structure of a color transmission type liquid crystal display device, and the above-mentioned components are not necessarily arranged in a spatial manner as illustrated. Further, the spacer 12 does not always exist at the boundary of the color filter 26.

FIG. 22 shows a display medium according to a first embodiment of the present invention, in which a code symbol 13 of a dielectric multilayer film is formed on a polarizing plate 21a of a color transmission type liquid crystal display device.

FIG. 23 shows a transparent substrate 22a of a color transmission type liquid crystal display as a second embodiment of the display medium of the present invention.
The code symbol 13 is formed by a dielectric multilayer film.

Although two embodiments relating to a liquid crystal display (LCD) have been described as the display device 10 of this embodiment, other than these, as a display medium according to the second aspect, a nematic liquid crystal display, an organic EL display, and the like. , A plasma display, and a display device in which a code symbol is formed by a dielectric multilayer film on a transparent substrate of a field emission display are possible as the third to sixth embodiments, respectively. These simple configurations are shown in FIGS.
Code symbol 1 using dielectric multilayer film on transparent substrate 22a
3 are formed. Note that the display device configuration diagrams in FIGS. 24 to 27 are schematic diagrams, and the depicted components are not necessarily arranged in the spatial arrangement as depicted.

In all of the embodiments other than the above-described six embodiments, the code symbols formed of the dielectric multilayer film are formed on the transparent substrate having a planar structure. However, as described in the description of the principle of detecting the coordinates of the present coordinate input system, In the display device according to the first aspect, it is possible to form a code symbol using a dielectric multilayer film on a transparent substrate having a curved surface structure. As a seventh embodiment, there is a CRT display as shown in FIG. A code symbol of a dielectric multilayer film is formed on a screen 56 having a curved surface structure. PC CR
The present invention is also applicable to a T display. Of course, embodiments for flat-panel CRT displays are also possible.
FIG. 28 is a schematic diagram.

Next, an embodiment of the code symbol 13 using a dielectric multilayer film will be described. As a first embodiment, FIG.
As described above, there is a method of forming a two-dimensional code based on a certain rule with a dielectric multilayer film 15 on a transparent substrate or a polarizing filter 14. The example of FIG. 30 is an example of a two-dimensional code, and is not necessarily required to have such a shape.
More various code patterns can be realized.

As a second embodiment, as shown in FIG. 31, a vertical and horizontal virtual grid line 1 on a transparent substrate or a polarizing filter 14 like an Anoto pattern shown in FIG.
From the intersection of the virtual grid,
There is a method of arranging a dielectric multilayer film 15 having a coating pattern of a rectangle, a circle, or another shape sufficiently small with respect to the grid at a point shifted by a sufficiently small range with respect to the size of the grid. Each of the shift patterns of the dielectric multilayer film has a specificity, and the shift patterns form a code indicating a coordinate position. Also, in contrast to the example of FIG. 31, an embodiment in which a code symbol 13 is formed by a small area not coated with a dielectric multilayer film on a transparent substrate or a polarizing filter 14 coated with a dielectric multilayer film on almost one surface. Is also possible.

The code symbol 13 can be formed by combining the above two examples.

Next, a method for forming the dielectric multilayer code pattern 13 of the above-described two embodiments on a transparent substrate or a polarizing plate 14 will be described with reference to an embodiment shown in FIG. First, the substrate 51 is the transparent substrate or the polarizing plate 14 before coating the dielectric multilayer film. A mask 49 having a desired code pattern is placed on the substrate 51, or the mask 49 is formed on the substrate 51 (S31). The pattern portion 50 corresponds to a portion where the mask 49 is hollowed out, or a portion where the mask is not formed on the substrate 51. Next, with the mask, a dielectric multilayer film is formed so as to have desired optical characteristics (S32). After the formation of the dielectric multilayer film, the mask is removed to obtain a substrate 52 having only the pattern portion 50 coated with the dielectric multilayer film (S33).

Next, a method for detecting a code symbol with high sensitivity will be described.

In order to increase the detection sensitivity of the code symbol 13, the detection wavelength range of the image reading device 1 is limited, so that the dielectric multilayer portion 15 with high sensitivity can be detected. Restriction of the wavelength range is realized by using an image sensor having desired characteristics or by biting a desired wavelength filter in the image pickup apparatus.

Further, in particular, the image reading apparatus of the apparatus body according to claim 8, wherein the wavelength region exhibiting a high reflection spectrum characteristic is not a visible region but an infrared region. 1 can be illuminated by an infrared LED or the like, and the dielectric multilayer film 15 that forms the code symbol 13 without visually affecting illumination on the screen display of the display device 10. Can be detected with high sensitivity. In particular, when the display device 10 is a display medium such as a reflective liquid crystal display device that cannot perform a very bright display, it is preferable to perform illumination in an invisible light region because it is less likely to be visually affected. .

Further, if an LD (laser diode) is used as the illumination light source and the wavelength is further restricted, it is possible to perform coordinate detection with higher sensitivity.

By increasing the image reading sensitivity of the code symbol 13 constituted by the dielectric multilayer film portion 15,
Finer code symbols can be formed. As a result, it is possible to input coordinates with higher accuracy.

Further, as described above, the signal processing unit 4
Then, in addition to the center coordinate information of the code symbol 13 obtained by decoding the code symbol 13, the size of the code symbol read by the image reading device 1, the position, the direction, and the amount of distortion of the code symbol 13, Since the position of the coordinate input tip 11 for performing pointing of the coordinate input device body is calculated, the coordinates can be detected more minutely than the code symbol 13. Conversely, if this is used, fine coordinate detection / input can be performed with a rough code symbol structure, as compared with the case where coordinate detection is performed using only the code symbol 13. In other words, this means that the detection sensitivity of the image reading apparatus 1 can be reduced as compared with the case where coordinate detection / input is performed using only the code symbol 13. This means that, with respect to the coordinate detection resolution required by the device, the design of the degree of freedom can be made with the parameters of the constituent elements according to the performance of the elements of the reading device 1 and the calculation processing capability of the signal processing unit 4. Means

Next, an additional mechanism of the main body of the coordinate input device will be described in detail.

The contact detecting section 2 provided in the main body of the coordinate input device is an example of the above-described conventional example (Japanese Patent Laid-Open No.
No. 1) is to avoid the problem of erroneously recognizing that the user has pointed just by bringing the pen close to the pen. It is to detect whether or not the screen 10 is touched.

As a first embodiment for realizing this, FIG.
And a button-shaped sensor device such as 3. By contacting the display device 10, the tip portion 11 is depressed,
The switch 53 conducts, a current flows through the circuit, and the current sensing unit 54 can detect contact.

As a second embodiment, as shown in the flowchart of FIG. 34, the size, position, direction and distortion of the code symbol 13 read by the image reading device 1
There is a method in which the signal processing unit 4 determines whether the tip 11 of the pen is in contact with the screen of the liquid crystal display device 10 by calculation processing.

The first example is characterized in that it can be realized by a mechanically and electrically simple mechanism. In the second example, since the coordinate detection mechanism is used, the calculation can be performed almost simultaneously with the coordinate detection. Although the power consumed by the sensor of the first example can be omitted, the reliability of contact sensing and the response time are inferior. Also, in the second example,
In order to improve the tactile usability of the operator, it is desirable to have a mechanism in which the tip portion 11 is mechanically dented or deformed by pressure to appeal to the operator's tactile sense as in the first example. .

Further, the coordinate input device is provided with a function key 3 so that various functions can be added to the coordinate input system. First
Is to provide a button for right-clicking the mouse. When a certain coordinate of the liquid crystal display device 10 is designated for the first time immediately after pressing this button, the same processing as when right-clicking the designated coordinate is performed. Another example is that a left double-click button is similarly provided.

As a second example of the function keys 3, as described above, there is an example in which the central processing unit 7 is provided with a button for displaying a soft keyboard or handwritten character recognition software on the display device 10. It is desirable that the above two examples be provided in order to effectively use the coordinate input system.

The third function key 3
Examples of Shift key, Ctrl key, Es
A key provided with at least one of the keys frequently used when using a normal keyboard, such as the c key and the Delete key, as a function key 3, or a function key 3 provided with a mechanism that allows an operator to assign a key as desired. What you have.

In this embodiment, wireless communication is performed between the main body of the coordinate input device and an information device for controlling the display device. This method is desirable in order for the operator to input coordinates without feeling the trouble of the cable. The wireless module 6 for performing wireless communication is realized by an infrared method or a radio wave method. The former is realized by a remote control system, an IrDA format, or the like. The latter is Blueto
It is realized by a radio wave system using the oth format. However, in the former case, when performing image reading in the infrared region,
Care must be taken so that both wavelengths do not overlap. On the other hand, in the wireless radio system, there is no optical problem, and in the radio radio system, since there is no directivity of transmission, the communication speed is less affected by the positional relationship of the wireless module than the former. I'm done. In particular, the Bluetooth format is suitable for incorporation into a device body because of its small chip size, weight, and power consumption. In addition, since various energy saving modes are defined, transmission / reception power can be reduced when communication is not necessary, so that the battery is suitable for using the battery or the rechargeable battery of the apparatus for a long time.

When performing wireless communication, if a plurality of coordinate input systems of the same model are present in a wireless communication range, a malfunction may occur. It is desirable to have
Authentication is achieved using device codes and, in addition, cryptography.

In this embodiment, a radio system is used in consideration of the convenience of the operator. However, the coordinate input system of the present invention does not always need to exchange data wirelessly, and is realized by using a wired cable. It is also possible. In this case, although the convenience is reduced, the image data obtained by the image reading device 1 is directly transmitted to the central processing unit 7, and the central processing unit 7 performs decoding, calculation of distortion and the like, and coordinate detection, thereby obtaining the coordinates. An embodiment is also possible in which coordinate input with a higher response speed than that performed by the signal processing unit 4 provided in the input device main body is performed, and the device main body can be reduced in size and weight. Another advantage is that the battery of the coordinate input device itself or the rechargeable battery is not consumed because the power supply of the coordinate input device body is supplied from a personal computer or a portable information terminal. Can be

In consideration of the usefulness of the power supply when a wired cable is used, the coordinate input system having a wireless module 6 equipped with a terminal connectable by a wired cable is also mentioned as one of the embodiments. Can be Using a wired cable when the power of the coordinate input device itself is exhausted,
Desirably, at least power can be supplied from a personal computer or a portable information terminal, and in addition to image reading data or coordinate data, a touch sensing signal and data of the function key 3 can be transmitted by wire.

It is preferable that the coordinate input system of the present invention has a mechanism that does not consume wasteful power. The necessity is particularly high when the portable information terminal is driven by a battery or when data is exchanged wirelessly as in this embodiment. The operation of the power control unit 5 shown in FIG. 29 will be described. The power control unit 5 includes a sensor for detecting that the operator is holding the coordinate input device main body, a timer for counting time, power ON / OFF and power consumption. It consists of a control device that controls power.

Examples of the sensors include a temperature sensor for detecting the temperature of the hand and a pressure sensor for detecting the pressure at the time of grasping.

When the operator grips the main body of the coordinate input device and the sensor reading exceeds a certain threshold, the power is turned on. When one hand leaves and the sensor reading exceeds a certain threshold, the timer is activated. However, when a certain threshold is exceeded, power consumption can be reduced by automatically turning off the power or entering a standby mode so as not to consume unnecessary power. This flowchart is shown in FIG. Also, as shown in the flowchart of FIG. 36, a function of providing two thresholds, reducing the power of wireless communication with the first threshold, turning off the power of the entire apparatus with the second threshold, or entering the standby mode It is desirable to have When wireless radio communication is performed in the Bluetooth format, the communication power can be reduced by using an energy saving mode such as a park mode, a sniff mode, and a hold mode defined by the Bluetooth standard. Further, an embodiment in which these energy saving modes are effectively combined and two or more threshold processes are performed is also possible. Also, when wireless communication is performed by another wireless means, a similar energy saving mode can be defined.

If the operator does not point at the screen of the display device 10 even if the operator holds the coordinate input device main body,
The power consumed by the wireless module 6 is wasted. As a method of saving this power, a timer for measuring a code symbol non-detection time is provided in the coordinate input device main body, and when the code symbol 13 is not detected, the timer is activated. Is realized by adding a function of reducing Even in this state, the parts other than the communication of the apparatus main body retain the normal functions. Further, when the code symbol 13 is detected in the power saving mode, a function of restarting normal communication is provided. This is also realized by means similar to the above-described energy saving mechanism based on detection and detection of the device by the operator.

The power of the main body of the coordinate input device is turned on when the power of the host such as a personal computer or a portable information terminal is turned off, or in a standby mode, and coordinates cannot be input. Therefore, it is desirable to have a function of turning off the power of the coordinate input device main body by detecting that the power of the host device is turned off or that the host device is in a standby mode. this is,
The personal computer or the portable information terminal has a function of notifying the body of the coordinate input device of turning off the power or entering the standby mode from the personal computer or the portable information terminal. When there is no response from the portable information terminal side, it is realized by activating a timer, and when a certain threshold is exceeded, turning off the power automatically or providing a function to enter the standby mode so as not to consume unnecessary power You. This is also realized by the same means as the energy saving mechanism based on the detection of the grasp of the body of the coordinate input device by the operator.

By combining the above-mentioned power saving mechanisms, the use period of the battery or the rechargeable battery of the coordinate input device main body can be further extended.

[Third Embodiment] A third embodiment of the present invention will be described with reference to FIG. In this embodiment,
Each of the embodiments described above is assumed.

FIG. 37 shows an example of the overall schematic configuration. In the figure, a coordinate input pen 201 and a multi-function copier 202 are shown.

The coordinate input pen 201 is used for the writing pen tip 20.
When the user writes on the paper, a code symbol image written on the paper is obtained from the image reading CCD 204. The processing processor 205 includes an image reading C
Image data is received from the CD, coordinates are calculated, and the calculation result is stored in the recording memory 206. User submit button 2
07, the BlueTooth module 208 in the coordinate input pen 201 and the multi-function copier 202
Data is transmitted to the multi-function copier 202 via the BlueTooth module 209.

[Instructing Transmission of Data Stored in Coordinate Input Device from Remote Receiving Device] A user gives an instruction to obtain information stored in the coordinate input pen 201 from the operation unit 210 of the multi-function copier 202. When you do
The instruction of the operation unit 210 is the multi-function copier 2
The data is transmitted to the recording memory 206 in the coordinate input pen 201 via the BlueTooth module 209 in the coordinate input pen 02 and the BlueTooth module 208 in the coordinate input pen 201.
The recording memory 206 stores the Blue in the coordinate input pen 201.
The coordinate data and the document data recorded in the recording memory are transmitted to the recording HDD 211 via the Tooth module 208 and the BlueTooth module 209 in the multifunction copier 202. HDD 211 for recording
Receives and records coordinate data and document data. The user further gives a print instruction from the operation unit,
The data recorded on the recording HDD 211 can be printed.

[Confirmation of processing state of coordinate input pen] When the user presses the transmission button 207 to transmit, the BlueTooth
Status information of the communication partner and the like is transmitted from the module to the display liquid crystal 212. At the same time, the transmission data amount is transmitted from the recording memory 206 to the display liquid crystal 212. Thereby, the user can confirm the transmission destination and the transmission data amount.

[Confirmation from Multi-Function Copier] BlueTooth in the multi-function copier 202
The module 209 transmits the communication status information to the display unit 216. Thereby, the user can grasp the communication state of the multifunction copier 202.

[Data transmission when pen memory is full] Recording memory 206 inside the coordinate input pen 201
When the amount of recorded information reaches a maximum amount that does not exceed a certain threshold, the recording HD in the multi-function copier 202 is passed through the BlueTooth modules 208 and 209.
The information is automatically transmitted to D211 and after transmission, the data in the recording memory 206 is deleted.

[Automatic transmission when BlueTooth module finds partner] The BlueTooth module 208 in the coordinate input pen 201 detects the multi-function copier 202 which is the transmission destination selected by the user in advance, and records it. The information recorded in the memory 206 is taken out and the multi-function copier 202 is taken out.
It has a function to send to.

[Perform Processing Corresponding to Detected Coordinate Area] An area on the paper is indicated by a coordinate input pen 201. For example, when writing is performed so as to encircle a certain part in a circle, the writing pressure by the writing is transmitted to the switch 213, and the image reading CCD 204 reads the code symbol on the paper only during the time when the load is applied to the switch. The read code symbol is transmitted to the processing processor 205, converted into coordinates, and transmitted to the processing processor 214 in the multi-function copier 202 via the BlueTooth modules 208 and 209. In the processing processor 214, processing corresponding to the coordinate information is performed.

As an application example, a case where the paper is a mail order catalog will be described. Suppose you check the items you want in the mail order catalog, and fill in the color, size, quantity, and shipping address. The processing processor 205 in the coordinate input pen 201 obtains the entered coordinates from the code symbol and transmits the coordinate data to the BlueTooth module 2.
08, 209 through multi-function copier 20
2 is sent to the processing processor 214 in the processing unit 2. In the processing processor 214, order processing is performed as processing corresponding to the coordinates. Multi-function copier 202
It can be confirmed from the notification printed by the printing unit 216 that the order is placed through the FAX / data module 215 in the printer. Alternatively, the BlueTooth module 20 is displayed on the display liquid crystal 212 in the coordinate input pen 201.
The status is transmitted and displayed through 9, 208, so that the status can be confirmed with the pen at hand of the user.

[Input of Document Information] In an application such as a mail order catalog as described above, the processing information corresponding to the coordinates of the mail order catalog must be recorded in the multi-function copier 202 in advance. The information is stored in the recording HDD 211 by receiving data from the outside by a FAX module or the like.

[0160]

According to the present invention, the coordinates of the trajectory specified on the display device, especially the liquid crystal display device, can be detected in real time without using a tablet, and the coordinates can be input. Further, in addition to the information obtained by decoding the code symbol indicating the coordinates on the display medium, the position of the code symbol,
Since the position of the predetermined point on the medium is detected using at least one of the direction and the amount of distortion, the coordinates on the display medium can be precisely detected.

In the present invention, since the coordinates are detected by the structural support of the display device, in particular, the code symbol having a fine structure constituted by the spacer of the liquid crystal display device, the coordinates can be detected and input with higher resolution than the conventional method. In addition, since a film that causes a decrease in contrast and resolution is not bonded, the image can be formed without deteriorating the image quality of the display device.

In the present invention, since an image is optically read by the imaging device of the coordinate input device main body and the coordinates are detected based on the image signal, an object other than the coordinate input device main body comes into contact with the display device. However, the coordinates can be correctly input.

According to the seventh aspect of the present invention, the detection sensitivity of the structural support can be increased, and a finer code symbol can be formed. As a result, a coordinate input with higher accuracy can be performed.

The coordinate input system according to the eighth and ninth aspects has a sensor mechanism for detecting that a part of the apparatus main body has come into contact with the surface of the display medium. There is no.

In the coordinate input system according to the tenth aspect, the same operation as a mouse can be performed by operating a button having a specific function on the coordinate input device main body. Further, by providing a soft keyboard and function keys for starting up a palette for performing handwriting recognition, the convenience of coordinate input can be improved.

In the information processing system according to the eleventh aspect, when the user explicitly transmits, it is possible to indicate that the writing data is a set of data.

The information processing system according to the twelfth aspect can provide means for acquiring information of a remote coordinate input device.

The information processing system according to the thirteenth aspect can realize a task of automatically transmitting information so that a coordinate input task can be continued when the memory is full.

The information processing system according to the fourteenth aspect automatically backs up information stored in the pen in order to prevent data stored inside the pen from being erased due to consumption of a battery in the pen when a transmission destination is found. Can be.

The information processing system according to the fifteenth aspect can extract information corresponding to the coordinates specified by the coordinate input device.

The information processing system according to claim 16 can extract information corresponding to the coordinates specified by the coordinate input device.

In the information processing system according to the present invention, when the document information is read in the external communication device in advance, the document information is input not only from the coordinate input device but also from other devices such as a personal computer. Means can be provided.

The information processing system according to the eighteenth aspect can perform complicated processing, high-speed mass processing, and the like by performing processing in an external processing device without performing processing in the coordinate input device.

[Brief description of the drawings]

FIG. 1 is a block diagram schematically illustrating a coordinate input system according to a first embodiment of the present invention.

FIG. 2 is a schematic diagram of a system configuration of a coordinate reading device main body of the coordinate input system.

FIG. 3 is a schematic diagram of a system configuration of an image reading device of a coordinate reading device main body of the coordinate input system.

FIG. 4 is a chart illustrating a process of detecting coordinates on a liquid crystal display device using the coordinate input system.

FIG. 5 is a schematic diagram of a configuration of an LCD which is a first example of the display device of the present invention.

FIG. 6 is a schematic diagram of a configuration of a nematic liquid crystal display which is a second example of the display device of the present invention.

FIG. 7 shows an organic EL according to a third example of the display device of the present invention.
It is a schematic diagram of a configuration of a display.

FIG. 8 is a schematic diagram of a configuration of a plasma display which is a fourth example of the display device of the present invention.

FIG. 9 is a schematic diagram of a configuration of a field emission display, which is a fifth example of the display device of the present invention.

FIG. 10 is a diagram showing an example of the wavelength characteristic of the transmittance of the structural support of the display device of the present invention.

FIG. 11 is a diagram showing a first example in which code symbols are formed on the liquid crystal display device using spacers.

FIG. 12 is a diagram showing a second example in which code symbols are formed on the liquid crystal display device using spacers.

FIG. 13 is a diagram illustrating an example of a process of forming a code symbol on the display device.

FIG. 14 is a block diagram showing a configuration of a first means for detecting that a part of the input device main body of the present invention has contacted the display device screen.

FIG. 15 is a chart illustrating a detection process of a second unit that senses that a part of the input device main body of the present invention has touched the display device screen.

FIG. 16 is a chart illustrating a first operation example of a power control unit in the input device body of the present invention.

FIG. 17 is a chart illustrating a second operation example of the power control unit in the input device body of the present invention.

FIG. 18 is a block diagram schematically illustrating a coordinate input system according to a second embodiment of the present invention.

FIG. 19 is a schematic diagram of a system configuration of a main body of a coordinate reading device of the coordinate input system.

FIG. 20 is a schematic diagram of a system configuration of an image reading device of the coordinate reading device main body of the coordinate input system.

FIG. 21 is a chart illustrating a process of detecting coordinates on a liquid crystal display device using the coordinate input system.

FIG. 22 is a schematic view of a configuration of an LCD in which a transparent substrate is coated with a dielectric multilayer film, which is a first example of the display device of the present invention.

FIG. 23 is a schematic diagram of a configuration of an LCD LCD, which is a second example of the display device of the present invention, in which a polarizing plate is coated with a dielectric multilayer film.

FIG. 24 is a schematic diagram of a configuration of a nematic liquid crystal display which is a third example of the display device of the present invention.

FIG. 25 shows a fourth example of the display device of the present invention, that is, organic E.
It is the schematic of the structure of L display.

FIG. 26 is a schematic view of a configuration of a plasma display which is a fifth example of the display device of the present invention.

FIG. 27 is a schematic diagram of a configuration of a field emission display, which is a sixth example of the display device of the present invention.

FIG. 28 is a CRT, which is a seventh example of the display device of the present invention.
It is a schematic diagram of a configuration of a display.

FIG. 29 is a diagram showing an example of the wavelength characteristic of the transmittance of the structural support of the display device of the present invention.

FIG. 30 is a diagram showing a first example in which code symbols are formed on the liquid crystal display device by using spacers.

FIG. 31 is a diagram showing a second example in which code symbols are formed on the liquid crystal display device using spacers.

FIG. 32 is a diagram illustrating an example of a process of forming a code symbol on the display device.

FIG. 33 is a block diagram showing a configuration of first means for detecting that a part of the input device main body of the present invention has touched the display device screen.

FIG. 34 is a chart illustrating a detection process of a second means for detecting that a part of the input device body of the present invention has touched the display device screen.

FIG. 35 is a chart illustrating a first operation example of the power control unit in the input device body of the present invention.

FIG. 36 is a chart illustrating a second operation example of the power control unit in the input device body of the present invention.

FIG. 37 is a schematic diagram showing an outline of a coordinate input system as a third embodiment of the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Image reading apparatus 2 Contact detection part 3 Function key 4 Signal processing part 5 Power control part 6 Wireless module 7 Central processing part 8 Main storage device 9 Display control part 10 Display device 11 Tip part 12 Spacer 12a Sensitivity with respect to a reading device High spacer 12b Low sensitivity to reader 13 Code symbol 14 Virtual grid line 21 Polarization filter 22 Transparent substrate 23 Transparent electrode 24 Alignment film 25 Liquid crystal layer 26 Color filter 27 Backlight 28 Cholesteric liquid crystal layer 29 Visible light absorption Layer 30 Organic EL medium 31 First display electrode line 32 Second display electrode line 33 Protective film 34 Reflective film 35 Dielectric layer 36 Address electrode 37 Silicon substrate 38 Insulating layer 39 Field emission emitter 40 Phosphor film 41 Anode electrode 42 Gate electrode 43 Emitter charge Pole 44 Power drop electrode 45 Illumination device 46 Imaging device 47 Imaging optical system 48 Signal processing circuit 49 Photomask 50 Ultraviolet light 51 Display medium in which dye-doped spacers are uniformly distributed 52 Display medium in which a code pattern is formed 53 Switch 54 Current detector 55 Power supply

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Toshiyuki Furuta 1-3-6 Nakamagome, Ota-ku, Tokyo Inside Ricoh Company (72) Inventor Tomohiko Beppu 1-3-6 Nakamagome, Ota-ku, Tokyo Share Inside Ricoh Company (72) Inventor Sadao Takahashi 1-3-6 Nakamagome, Ota-ku, Tokyo Stock Company Ricoh Company (72) Inventor Masayoshi Kato 1-3-6 Nakamagome, Ota-ku, Tokyo Stock Company Ricoh Company (72) Inventor Nobuyuki Doi 1-36 Nakamagome, Ota-ku, Tokyo F-term in Ricoh Co., Ltd. 5B068 AA04 BD02 BD09 BE06 CC11 5B087 AA02 AE00 AE09 BC03 CC11 CC14 CC18 CC33 DG02 DJ03

Claims (18)

[Claims] A pair of substrates, at least one of which is transparent; a pixel electrode provided on at least one inner surface of the substrate, the pixel electrode having at least one active element; a display layer formed between the substrates; A structural support formed in a display layer, wherein the structural support forms a code symbol indicating coordinate information. 2. A display medium comprising at least one transparent substrate having a planar structure or a curved surface structure and a display layer capable of electrically controlling light emission characteristics as a part of a constituent element, A part of the surface of the sheet is coated with a dielectric multilayer having high optical transmittance in a certain wavelength range and having an optical property of increasing reflectance in a wavelength range different from the wavelength range, Form a code symbol indicating coordinates on the display medium. 3. A pair of substrates at least one of which is transparent; a pixel electrode provided on at least one inner surface of the substrate and having at least one active element; and a display layer formed between the substrates. A structural support formed in a display layer, wherein a part of the surface of the transparent substrate has a high transmittance in a certain wavelength range and a high reflectance in a wavelength range different from the wavelength range. A display medium, wherein a dielectric multilayer film having characteristics is coated, and the dielectric multilayer film forms a code symbol indicating coordinates on the medium. 4. A pair of transparent substrates; a pixel electrode provided on at least one inner surface of the transparent substrate and having at least one active element; a liquid crystal layer formed between the transparent substrates; And a spacer having a structure in which a device having the spacer is sandwiched between a pair of polarizing plates. At least a part of one surface of the polarizing plates has a transmittance at least in a certain wavelength range. Is coated with a dielectric multilayer film having an optical property of increasing the reflectance in a wavelength range different from that of the dielectric multilayer film, and the dielectric multilayer film forms a code symbol indicating coordinate information. Display medium. 5. The dielectric multilayer material according to claim 2, wherein the material has an optical property of high transmittance in a visible light region and high reflectance in an infrared light region. Display medium according to the description. 6. A device main body, comprising: the display medium according to claim 1; and a coordinate input device, wherein the coordinate input device is capable of performing a writing operation while being held in a hand by a person; An image reading device provided in the apparatus main body and optically reading a code symbol formed on a medium; decoding means for decoding the read code symbol; and a code symbol of the code symbol in an image read by the image reading device. Calculating means for calculating at least one of the position, orientation and distortion amount; coordinate information indicating coordinates on the display medium included in the decoded information; and position and orientation of the code symbol And a coordinate detecting means for detecting a position of a predetermined point on the display medium based on at least one of the distortion amount and the distortion amount. Target input system. 7. The structure according to claim 6, wherein, in a specific wavelength region, the structural support forming the code symbol has at least one of reflectance and transmittance with respect to other components of the display medium. The display medium according to claim 1, wherein the display medium has a spectral characteristic that can be identified by the image reading device. 8. The coordinate input system according to claim 6, further comprising a sensor for detecting that a part of the apparatus main body has contacted the surface of the display medium. 9. A function for calculating that a part of the apparatus main body has contacted the surface of the display medium based on a size, a position, an orientation, and a distortion amount of the code symbol. 8. The coordinate input system according to 8. 10. An apparatus according to claim 1, wherein said apparatus main body is operated to perform an operation corresponding to pointing and clicking a mouse button, and said apparatus is provided with a signal processing unit for processing coordinate data to perform handwriting input. 10. The coordinate input system according to claim 6, 8 or 9. 11. The coordinate input system according to claim 6, wherein the coordinate input device comprises: a communication unit; and coordinate information or document information indicating the identity of the display medium to the communication unit, or both of the communication unit and the communication unit. An instruction unit for instructing a transmission destination, wherein the communication unit receives a transmission destination instruction from the instruction unit, and transmits coordinate information and / or document information to an external communication device. An information processing system, comprising: a communication unit that receives coordinate information and / or document information from the coordinate input device. 12. The external communication device, comprising: a communication unit; and an instruction unit for instructing the communication unit to send the coordinate information of the coordinate input device and / or the document information to the communication unit. The communication unit in the device transmits, to the communication unit in the coordinate input device, a destination instruction of coordinate information and / or document information, and the communication unit in the external communication device transmits the coordinate input. Receiving the destination information of the coordinate information and / or the document information from the communication unit in the device, the communication unit in the external communication device, the coordinate information according to the destination instruction of the coordinate information and / or the document information or both 12. The information processing system according to claim 11, further comprising means for transmitting the information. 13. The coordinate input device includes a storage unit for recording coordinate information and / or document information, and the storage unit includes a unit that monitors a recorded information amount, and the information amount is fixed. When the maximum amount that does not exceed the threshold is reached, the communication unit is notified that the maximum amount has been reached, the coordinate information and / or the document information are transmitted, and the recorded coordinate information and / or the document information are erased. The communication unit receives a notification that the maximum amount has been reached from the recording unit, transmits coordinate information and / or document information according to the notification from the recording unit, and transmits the coordinate information from the recording unit. 12. The information processing system according to claim 11, wherein document information or both of them are acquired. 14. The communication device in the coordinate input device finds the external communication device, and when the communication device in the coordinate input device finds the external communication device, the communication unit in the external communication device sends coordinate information or document information or the same to the communication unit. The information processing system according to claim 11, wherein both are transmitted. 15. An instruction unit in the coordinate input device instructs the image reading device to start reading a code symbol, and instructs the image reading device to finish reading a code symbol. Transmitting the coordinate information from the reading start to the reading end to the processing unit, the processing unit receiving the coordinate information from the image reading device, and in the area surrounded by the coordinate information from the reading start to the reading end. The information processing system according to claim 11, wherein existing document information is transmitted to the communication unit. 16. The pointing unit in the coordinate input device,
Instructs the image reading device to start reading a code symbol, instructs the image reading device to finish reading a code symbol, and inputs the coordinate information from the reading start to the reading end to the coordinate. Transmitting to the communication unit in the device, the communication unit in the coordinate input device transmits coordinate information to the external communication device, the external communication device includes a communication unit to receive the coordinate information, The communication unit of the communication device transmits coordinate information to a processing unit in the external communication device, transmits coordinate information and document information to the recording unit in the external communication device, the processing unit Receiving the information, the coordinate information and the document information present in the area surrounded by the coordinate information from the recording unit, the recording unit receives the coordinate information and the document information, the coordinate information and the document information Claim 11 recorded, and transmits the coordinate information and document information to the processing unit, characterized in that
The information processing system as described. 17. The recording unit in the external communication device,
17. The information processing system according to claim 16, wherein coordinate information and document information are acquired from a part other than the communication unit in the external communication device. 18. The recording unit in the external communication device,
A description of a process performed on the document information corresponding to the coordinate information is recorded, and a process performed on the document information corresponding to the coordinate information is transmitted to the processing unit. The processing unit in the external communication device includes: 17. The information processing system according to claim 16, wherein a description of a process to be performed on the document information corresponding to the coordinate information is received from the recording unit, and the process according to the description of the process is performed.