JP4068292B2 - Information processing system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present invention includes a coordinate input system for an information device such as a personal computer having a display device or a portable information terminal.FeelingsInformation processing system.
[0002]
[Prior art]
As a computer input device, a mouse and a keyboard are generally used, but it is not necessarily optimal to use these means. For example, it is troublesome to switch between a keyboard and a mouse, and it is difficult to operate the mouse. In particular, in the case of a portable notebook personal computer, a cord becomes an obstacle when a mouse is connected, and the pointing means that substitutes for the attached mouse has a drawback that it is difficult to operate unless used. Furthermore, especially when carrying a portable notebook computer, there are scenes where it is difficult to use the keyboard. In such a case, it is convenient to be able to input a handwritten character or figure by holding a pen-like device in hand.
[0003]
Therefore, as an example of a handwriting input method using a finger or pen-like writing device that solves these problems, there is a touch panel type, which is widely used. As an example, there is one in which a film-like sensor made of a resistive film such as conductive rubber is bonded to an LCD (see Japanese Patent Application Laid-Open No. 07-182091). This is a method of reading a touched position according to a change in the resistance value of a sensor caused by a pen touch and inputting detected coordinates to a computer, and is used in a notebook computer, a portable information terminal, and the like.
[0004]
As a second example, there is one that performs coordinate input optically (see Japanese Patent Laid-Open No. 2000-10567). This is composed of two light emitting / receiving devices having a light source spreading in a fan shape and a retroreflecting device installed at the boundary of the display device, receiving the recursively reflected light, and from its intensity distribution, The pen position is measured by the principle of triangulation.
[0005]
[Problem to be Solved by the Invention]
In the method described in Japanese Patent Application Laid-Open No. 07-182091, when the sensor film is laminated on a liquid crystal display device with an air layer interposed therebetween, light absorption and scattering occur, resulting in a decrease in resolution and contrast. Is a problem.
[0006]
In addition, the display screen is increased in thickness, and the display coordinates are visually displaced when viewed obliquely due to refraction characteristics.
[0007]
In addition, in this method, when a plurality of objects touch the screen, there is a problem that coordinates may not be detected or may be erroneously detected.
[0008]
Furthermore, this method has the disadvantage that the resolution is low and it is not possible to input very fine characters and figures, and character recognition may not be performed well.
[0009]
On the other hand, the method disclosed in Japanese Patent Laid-Open No. 2000-105671 is suitable for inputting coordinates on a large screen such as a plasma display or a whiteboard, but is used on a small screen such as a personal computer including a laptop computer or a portable information terminal. Is too low for a few millimeters of resolution.
[0010]
In this method, when a plurality of objects touch the screen, coordinates may not be detected or may be erroneously detected.
[0011]
Furthermore, since there is no sensor for sensing that the screen is touched, there is a problem that the optical sensor reacts when the pen is brought close to the screen to some extent. In order to solve this, it is necessary to perform optical scanning by passing the screen. However, if the range is narrowed, the sensitivity of the sensor is lowered, and a problem of subtle distortion of the screen itself occurs.
Further, since light is always received and emitted, wasteful power is consumed when not in use.
[0012]
An object of the present invention is to enable precise detection of coordinates of a display device of a personal computer or a portable information terminal, particularly a liquid crystal display.
[0013]
Another object of the present invention is to make it possible to detect the coordinates of a display device of a personal computer or a portable information terminal without reducing the display resolution and contrast.
[0014]
Another object of the present invention is to make it possible to detect the coordinates of a display device of a personal computer or a portable information terminal without increasing the thickness of the display screen.
[0015]
Another object of the present invention is to perform coordinate input without causing erroneous detection of coordinates even when an object other than the coordinate input device touches the display device of a personal computer or a portable information terminal.
[0016]
Another object of the present invention is to perform a pointing or button click operation by directly touching the display device screen using a pen-like coordinate input device when using a personal computer or a portable information terminal.
[0017]
Another object of the present invention is to enable precise character or figure coordinate input by tracing the display device screen directly using a pen-like coordinate input device when using a personal computer or a portable information terminal. .
[0018]
Another object of the present invention is to efficiently recognize characters when performing coordinate input on a personal computer or portable information terminal using a pen-like coordinate input device.
[0019]
Another object of the present invention is to reduce power consumption when performing coordinate input to a personal computer or portable information terminal using a pen-like coordinate input device.
[0021]
[Means for Solving the Problems]
  Claim1The invention described is a display medium including at least one transparent substrate having a planar structure or a curved structure and a display layer capable of electrically controlling light emission characteristics as a component.In the information processing system comprising the coordinate input device and the external communication device, the display medium has a high transmittance in a certain wavelength region on a part of one surface of the transparent substrate, and the wavelength region A dielectric multilayer film having an optical characteristic that increases reflectivity in a wavelength range different from the above, and the dielectric multilayer film forms a code symbol indicating coordinates on the display medium. An apparatus includes an apparatus main body that a person can hold and perform a writing operation, an image reading apparatus that is provided in the apparatus main body and optically reads a code symbol formed on the display medium, and a read code Decoding means for decoding a symbol, and distortion amount equality for calculating at least one of the position, orientation and distortion amount of the code symbol in the image read by the image reading device Based on means, coordinate information indicating coordinates on the display medium included in the decoded information, and at least one of a position, an orientation, and a distortion amount of the code symbol. Coordinate detection means for detecting the position of a predetermined point, a first communication unit, and an instruction for instructing the first communication unit of coordinate information or document information indicating the identity of the display medium or a transmission destination of both The first communication unit includes means for receiving a destination instruction from the instruction unit, and means for transmitting coordinate information and / or document information to an external communication device, The external communication device is an information processing system including a second communication unit that receives coordinate information and / or document information from the coordinate input device.
[0022]
  Claim2The invention described inIn an information processing system including a display medium, a coordinate input device, and an external communication device, the display medium includes:A pair of substrates at least one of which is transparent, a pixel electrode provided on at least one inner surface of the substrate and having at least one active element, a display layer formed between the substrates, and formed in the display layer A dielectric having an optical characteristic that a part of the surface of the transparent substrate has a high transmittance in a certain wavelength region and a high reflectance in a wavelength region different from the wavelength region. A multilayer film is coated, and the dielectric multilayer film forms a code symbol indicating coordinates on the display medium.The coordinate input device includes a device main body that a person can hold and perform a writing operation, and an image reading device that is provided in the device main body and optically reads a code symbol formed on the display medium A decoding means for decoding the read code symbol, a distortion amount calculation means for calculating at least one of the position, orientation and distortion amount of the code symbol in the image read by the image reading device, and the decoding The position of the predetermined point on the display medium based on coordinate information indicating coordinates on the display medium included in later information and at least one of the position, orientation, and distortion amount of the code symbol Coordinate detection means for detecting the first communication unit, coordinate information for the first communication unit or document information indicating the identity of the display medium, or its An instruction unit for instructing the transmission destination of the user, wherein the first communication unit receives the instruction of the transmission destination from the instruction unit, coordinate information and / or document information for the external communication device And the external communication device includes a second communication unit that receives coordinate information and / or document information from the coordinate input device.
[0023]
  Claim3The invention described inIn an information processing system including a display medium, a coordinate input device, and an external communication device, the display medium is provided on at least one inner surface of a pair of transparent substrates and the transparent substrate, and at least one active element A display medium having a structure in which a device including a pixel electrode having a liquid crystal layer, a liquid crystal layer formed between the transparent substrates, and a spacer formed in the liquid crystal layer is sandwiched between a pair of polarizing plates A part of one surface of the polarizing plate is coated with a dielectric multilayer film having an optical characteristic that has a high transmittance at least in a certain wavelength region and a high reflectance in a different wavelength region, The dielectric multilayer film forms a code symbol indicating coordinate information, and the coordinate input device is provided in a device main body capable of performing a writing operation by a human hand, and the device main body, An image reading device for optically reading the code symbol formed on the display medium, a decoding means for decoding the read code symbol, and a position, orientation and distortion of the code symbol in the image read by the image reading device A distortion amount calculation means for calculating at least one of the amounts, coordinate information indicating coordinates on the display medium included in the decoded information, and the position, orientation, and distortion amount of the code symbol Based on at least one, coordinate detection means for detecting the position of a predetermined point on the display medium, the first communication unit, and the coordinate information or the identity of the display medium with respect to the first communication unit An instruction unit for instructing the transmission destination of the document information to be displayed or both of them, and the first communication unit receives the instruction of the transmission destination from the instruction unit; Means for transmitting coordinate information and / or document information to an external communication device, and the external communication device includes a second communication unit for receiving coordinate information and / or document information from the coordinate input device. This is an information processing system characterized by that.
[0024]
  Claim4The invention described inAn information processing system according to any one of claims 1 to 3,The dielectric multilayer film material has optical characteristics such that the transmittance is high in the visible light region and the reflectance is high in the infrared light region.
[0031]
  Claim5The invention described inAn information processing system according to any one of claims 1 to 4,The external communication device includes thesecondAn instruction unit that instructs the communication unit to send coordinate information of the coordinate input device and / or document information, or both,secondA communication unit is provided in the coordinate input device.The firstTransmits coordinate information and / or document information transmission destination instructions to the communication unit, and transmits the instructions in the external communication device.secondThe communication unit includes the coordinate input device.firstCoordinate information and / or document information from the communication unit is received, and the external communication device in the external communication devicesecondThe communication unit includes means for transmitting coordinate information in accordance with transmission destination instructions of coordinate information and / or document information.
[0032]
  Claim6The invention described inAn information processing system according to any one of claims 1 to 4,The coordinate input device includes a storage unit that records coordinate information and / or document information, and the storage unit has means for monitoring the amount of information recorded, and the information amount does not exceed a certain threshold. When a large amount is reached,firstNotifying the communication unit that the maximum amount has been reached, sending coordinate information and / or document information, erasing the recorded coordinate information and / or document information,firstThe communication unit receives a notification that the maximum amount has been reached from the recording unit, transmits coordinate information and / or document information according to the notification from the recording unit, and transmits the coordinate information or document information from the recording unit. Alternatively, both of them are acquired.
[0033]
  Claim7The invention described inAn information processing system according to any one of claims 1 to 4,In the coordinate input deviceThe firstcommunicationPartFinds the external communication device, and discovers the external communication device, the inside of the external communication devicesecondCoordinate information and / or document information is transmitted to the communication unit.
[0034]
  Claim8The invention described inAn information processing system according to any one of claims 1 to 4,The instructing unit in the coordinate input device instructs the image reading device to start reading code symbols, instructs the image reading device to end reading of code symbols, and the image reading device starts reading from Coordinate information until the end of reading is transmitted to the processing unit, and the processing unit receives the coordinate information from the image reading apparatus, and the document information exists in an area surrounded by the coordinate information from the start of reading to the end of reading. Is transmitted to the communication unit.
[0035]
  Claim9The invention described inAn information processing system according to any one of claims 1 to 4,The instruction unit in the coordinate input device instructs the image reading device to start reading code symbols, instructs the image reading device to end reading of code symbols, and the image reading device starts reading. Coordinate information from the end of reading to the end of reading in the coordinate input devicefirstTransmitted to the communication unit, the coordinate input devicefirstThe communication unit transmits coordinate information to the external communication device, andThe second communication unit isCoordinate information is received, and the external communication devicesecondThe communication unit transmits coordinate information to a processing unit in the external communication device, transmits coordinate information and document information to the recording unit in the external communication device, and the processing unit receives the coordinate information. Receiving coordinate information and document information existing in an area surrounded by coordinate information from the recording unit, the recording unit receiving coordinate information and document information, recording coordinate information and document information, and processing The coordinate information and the document information are transmitted to the part.
[0036]
  Claim10The invention described inThe information processing system according to claim 9,The recording unit in the external communication device is the recording unit in the external communication device.secondCoordinate information and document information are obtained from other than the communication unit.
[0037]
  Claim11The described inventionThe information processing system according to claim 9,The recording unit in the external communication apparatus records a description of processing to be performed on document information corresponding to coordinate information, and transmits processing to be performed on document information corresponding to coordinate information to the processing unit. The processing unit in the external communication device receives a description of processing to be performed on document information corresponding to coordinate information from the recording unit, and performs processing according to the processing description.
[0038]
DETAILED DESCRIPTION OF THE INVENTION
[First Embodiment]
A first embodiment of the present invention will be described with reference to FIGS.
[0039]
FIG. 1 is a schematic diagram showing an example of a system outline of a coordinate input system of the present invention.
[0040]
Briefly describing the system configuration, the coordinate input device main body includes an image reading device 1, a contact detection unit 2, a function key 3, a signal processing unit 4, a power control unit 5, and a wireless module 6a. In the system of the present embodiment, the coordinate input device main body is used to detect the coordinates of the display device 10 in which the spacer forms a code symbol, and the detected coordinates and a part used for the coordinate instruction of the input device main body are included. A detection signal indicating whether or not the screen is touched and a signal from the function key 3 are processed by the signal processing unit 4, and the signal is processed by the wireless module 6 a attached to the coordinate input device body and the personal computer having the display device 10. Alternatively, wireless communication of data is performed with the wireless module 6b attached between the portable information terminals. In the present embodiment, a color transmission type liquid crystal display device will be described as an example of the display device 10.
[0041]
FIG. 2 is a schematic diagram of the system configuration of the apparatus main body, which has a pen-like shape for easy operation by an operator, and coordinates are designated by the tip 11 thereof.
[0042]
The wireless module 6a attached to the coordinate device main body can perform at least wireless transmission, and the wireless module 6b attached between the personal computer or the portable information terminal can perform at least wireless reception. Furthermore, an embodiment in which both wireless modules have transmission and reception capabilities and perform bidirectional communication is also possible.
[0043]
The personal computer or the portable information terminal transmits a signal received by the wireless module 6 b to the central processing unit 7. The central processing unit 7 performs display on the display device 10 from the display control unit 9 based on the information signal. The central processing unit 7 has a memory, and by tracing the screen of the display device 10 with the coordinate device body, it is possible to select a desired character string, a plurality of figures, or a screen area.
[0044]
Further, the central processing unit 7 has a soft keyboard and palette software for performing character recognition with respect to characters input by handwriting, whereby digital data can be input.
[0045]
Next, the coordinate expression by the code symbol by the spacer which is the basis of the present invention and the coordinate detection method will be described. First, a reading method by the coordinate input device main body will be described.
[0046]
A configuration example of the image reading apparatus 1 is shown in FIG. The image reading apparatus 1 includes an illuminating device 45, an imaging device 46, a conjugating optical system 47, and a signal processing circuit 48 that performs control / data processing thereof. The imaging device 46 is configured by an imaging element array such as a CCD camera or a CMOS sensor, for example. As will be described later, it is desirable that these elements have a wavelength characteristic necessary for detecting a code symbol or are covered with a wavelength filter so that the wavelength range for imaging can be limited. In addition, the imaging device 46 can include an imaging lens system 47 including at least one conjunctive lens, and an embodiment having a function of performing autofocus as necessary is also possible.
[0047]
The illumination device 45 is for improving the code symbol detection sensitivity of the imaging device 46. Since it does not have a backlight, when detecting a code symbol of a reflection type liquid crystal whose screen is dark, this is a very effective sensitivity improvement means. Alternatively, the detection sensitivity can be further increased by performing illumination with wavelength light in a wavelength selection range performed on the illumination device 45 described above. These will be described in detail in the section of the spacer material forming the code symbol.
[0048]
Next, signal processing performed in the signal processing unit 4 of the coordinate input device main body will be described with reference to FIG.
[0049]
First, a code symbol is decoded from an image read by the image reading device 1 to obtain a center coordinate of the code symbol (S1). Next, the position, orientation, and distortion amount of the code symbol in the image read by the image reading device 1 are calculated (S2). Based on this information, the coordinates indicated by the tip 11 of the apparatus main body are calculated (S3). Since the absolute coordinates of the display device 10 are calculated from the relative designated coordinates of the tip 11 with respect to the code symbol, the coordinates can be specified more finely than the coordinate information of the code symbol.
[0050]
Next, with respect to the display device 10 in which the spacer forms the code symbol, the details of the code symbol forming method and the method for increasing the detection sensitivity will be described.
[0051]
As an embodiment of the present invention, a liquid crystal display device 10 using a color transmission type liquid crystal display device is exemplified. FIG. 5 is a schematic view showing the configuration of a color transmission type liquid crystal display device, and is a cross-sectional view seen from the direction perpendicular to the display screen.
[0052]
The liquid crystal display device includes a polarizing filter 21, a transparent substrate 22, a transparent electrode 23, an alignment film 24, a liquid crystal layer 25, a spacer 12, a color filter 26, and a backlight 27.
[0053]
The polarizing filter 21 controls the polarization of incoming and outgoing light.
[0054]
The transparent substrate 22 is for preventing the electricity from the electrode part from leaking to other parts.
[0055]
The transparent electrode 23 is an electrode for driving the liquid crystal display, and a highly transparent material is used so as not to hinder display.
[0056]
The alignment film 24 is a film for aligning liquid crystal molecules in a certain direction.
[0057]
The liquid crystal molecule layer 25 is composed of liquid crystal molecules, and the orientation of the molecules is controlled by the voltage applied to the transparent electrode 23.
[0058]
The spacer 12 is for ensuring a uniform space on the two transparent substrates sandwiching the liquid crystal substance.
[0059]
The color filter 27 is an RGB three-color wavelength filter.
[0060]
The backlight 28 illuminates from behind the display to brighten the screen.
[0061]
FIG. 5 is a schematic diagram showing a cross-sectional configuration of a color transmission type liquid crystal display device, and the respective components are not necessarily arranged in a space as depicted. Further, the spacer 12 does not necessarily exist at the boundary of the color filter 26.
[0062]
In the present invention, the spacer 12 forms a code symbol indicating coordinate information. As an example of a method of forming a code symbol using the spacer 12, there is a method of forming a two-dimensional code by arranging a plurality of spacers based on a certain rule indicating coordinates as shown in FIG. In this case, two types of spacers as will be described later are used, and the white square spacer 12b is low in sensitivity for reading by the coordinate input system, and is simply a liquid crystal display device like a conventional spacer. This is for supporting the transparent substrate 22. A spacer 12a indicated by a black square can be read by the coordinate input system, and the spacer 12a forms a code symbol. The example shown in FIG. 11 is a case where the code symbol 13 is formed with a 5 × 5 unit spacer, but the code symbol is formed with an arbitrary number of spacer units according to the fineness of the input coordinates and the sensitivity of the reading device 1. It is possible to create. In the example of FIG. 11, the spacers 12 are regularly arranged in a lattice pattern, but the two types of spacers are not necessarily arranged in this way. In particular, it is only necessary that the spacers 12b having the lower sensitivity be distributed almost uniformly at an appropriate concentration capable of supporting the transparent substrate 22. In addition, the arrangement of the highly sensitive spacers 12a can be made into various code patterns.
[0063]
As another example, an intersection of virtual grids with respect to a grid formed of vertical and horizontal virtual grid lines 14 on the display device 10 as shown in FIG. Therefore, there is a method in which a spacer 12a having a high sensitivity with respect to the reading device 1 is arranged at a point shifted within a sufficiently small range with respect to the size of the grating. Each of the displacement patterns of the spacers 12a is unique, and the displacement pattern forms a code indicating the coordinate position.
[0064]
In the example of FIG. 6, only the spacer 12a forming the code symbol 13 is displayed, but cannot be read by the coordinate input system 1 as in the previous example shown in FIG. An embodiment in which the spacer 12b for supporting the transparent substrate 22 is also used. Furthermore, the spacer 12a forming the code symbol 13 does not need to be a single spacer, and a plurality of spacers 12a are grouped together to be sufficiently small relative to the size of the lattice from a virtual lattice intersection. It is also possible to form code symbols 13 by arranging them at points shifted in the range.
[0065]
It is also possible to form the code symbol 13 by combining the two examples.
[0066]
In order to increase the detection sensitivity of the code symbol 13, characteristic optical characteristics are given to the other elements 21 to 27 and 12 b constituting the liquid crystal display device 10 as a material of the spacer 12 a forming the code symbol 13. It is desirable to have. For example, the absorption spectrum and the reflection spectrum are characteristic.
[0067]
FIG. 10 shows an example in which the spacer 12 has an optical characteristic that it is transparent to visible light and has a low transmittance in the infrared region. Further, by limiting the detection wavelength range of the image reading apparatus 1, highly sensitive spacer detection can be performed. The limitation of the wavelength range is realized by using an imaging device having desired characteristics in the imaging device 46 or by biting the imaging device 46 with a desired wavelength filter.
[0068]
In particular, when the wavelength region showing the characteristic spectral characteristics is not a visible region but an ultraviolet region or an infrared region, the illumination device 45 included in the image reading device 1 of the apparatus body according to claim 6 is provided. Invisible light illumination such as an infrared LED can be used, and the spacer 12a forming the code symbol 13 can be detected with high sensitivity without visually affecting the screen display of the display device 10. . In particular, when the display device 10 is a reflective liquid crystal display device, it is desirable to perform illumination in the invisible light region because it is less susceptible to visual influence.
[0069]
Further, if an LD (laser diode) is used as the illumination light source 45 and the wavelength is further limited, coordinate detection with higher sensitivity can be performed.
[0070]
By increasing the image reading sensitivity of the code symbol 13 formed by the spacer 12a, a finer code symbol 13 can be formed. As a result, coordinate input with higher accuracy is possible.
[0071]
Here, as described above, the code symbol 13 does not necessarily need to use all the spacers in the display device 10, and can also be configured using a plurality of types of spacers having different optical characteristics. is there.
[0072]
For example, by using two types of spacers, a spacer 12a having high sensitivity to the image reading apparatus 1 and a spacer 12b having low sensitivity in a desired wavelength region, only the highly sensitive spacer is detected, and the code symbol 13 is obtained. It means that it can be read.
[0073]
As a first embodiment for realizing this, it is possible to use different materials having different optical characteristics for the spacer 12a for forming the code symbol 13 and the spacer 12b for not forming the code symbol 13.
[0074]
Further, the second embodiment is realized by doping the spacer 12a forming the code symbol 13 with a metal atom or an organic dye molecule for realizing a desired spectral characteristic.
[0075]
Based on FIG. 13, the example of the manufacturing method in the said 1st Example is given. First, a display device 51 is prepared in which a spacer doped with organic pigment molecules having desired optical characteristics is used and is uniformly distributed in a liquid crystal layer 25 sandwiched between transparent substrates 22. Next, the liquid crystal substrate is irradiated with ultraviolet light 50 through the photomask 50 having the pattern shape of the code symbol 13 to deteriorate the pigment doped in the spacer existing in the unmasked region, and the optical characteristics. A display device 52 in which is changed is obtained. The dye doped in the spacers present in the masked area retains its optical properties. Using this difference in optical characteristics, highly sensitive detection is possible.
[0076]
Further, as described above, in the signal processing unit 4, in addition to the center coordinate information of the code symbol 13 obtained by decoding the code symbol 13, the size of the code symbol read by the image reading device 1, Since the position of the coordinate input tip 11 that performs pointing of the coordinate input device body is calculated from the position, orientation, and amount of distortion of the code symbol 13, the coordinates are detected more finely than the code symbol 13. Can do. On the other hand, if this is utilized, it is possible to detect and input fine coordinates with a rough code symbol structure, rather than performing coordinate detection using only the code symbol 13. This also means that the detection sensitivity of the image reading apparatus 1 can be reduced by performing another interpretation than when performing coordinate detection / input only by the code symbol 13. This is because the coordinate detection resolution required by the apparatus can be designed with a high degree of freedom depending on the parameters of the constituent elements, depending on the performance of the elements of the reader 1 and the calculation processing capability of the signal processing unit 4. Means.
[0077]
As mentioned above, although the present Example gave the example about a liquid crystal display device (LCD), besides this, the display device which has a structure support other than that, a nematic liquid crystal display device, an organic EL display, a plasma display, and There are field emission displays and the like, and their simple configurations are shown in FIGS. In these display devices, an embodiment in which the code symbol is formed using the spacer 12 is also possible. Moreover, the display apparatus block diagrams of FIGS. 6 to 9 are schematic diagrams, and the illustrated components are not necessarily arranged in the spatial arrangement as illustrated.
[0078]
Next, the details of the additional mechanism of the coordinate input device main body will be described.
[0079]
The contact detection unit 2 provided on the coordinate input device main body erroneously recognizes that the user has pointed just by bringing the pen close as described in the conventional example (Japanese Patent Laid-Open No. 2000-105671). Is for detecting whether or not the tip 11 of the coordinate input device main body used for coordinate instructions is touching the screen of the display device 10.
[0080]
As a first embodiment for realizing this, there is a button-shaped sensor device as shown in FIG. By contacting the display device 10, the tip 11 is recessed, the switch 53 is turned on, and a current flows through the circuit, so that the current sensing unit 54 can detect the contact.
[0081]
As a second embodiment, as shown in the flowchart of FIG. 15, the pen tip 11 appears on the screen of the liquid crystal display device 10 based on the size, position, orientation, and amount of distortion of the code symbol 13 read by the image reading device 1. There is a method in which the signal processing unit 4 obtains contact by calculation processing.
[0082]
The first example is characterized in that it can be realized by a mechanically and electrically simple mechanism. Since the second example uses the coordinate detection mechanism, the calculation can be performed almost simultaneously with the coordinate detection. In addition, it is possible to save power consumed by the sensor of the first example, but it has a second aspect that is inferior in certainty of touch detection and response time. Also in the second example, in order to improve the tactile usability of the operator, as in the first example, the tip portion 11 is mechanically dented or deformed by pressure, and the tactile sense of the operator It is desirable to have a mechanism to appeal to
[0083]
In addition, the coordinate input device main body is provided with the function keys 3, whereby various functions can be added to the coordinate input system. As a first example, it is possible to provide a button for performing a right click of the mouse. When a certain coordinate of the liquid crystal display device 10 is designated for the first time immediately after this button is pressed, processing equivalent to that of right-clicking the designated coordinate is performed. In addition, an example in which a left double-click button is similarly provided can be given.
[0084]
As a second example related to the function key 3, as described above, there is an example in which a button for displaying the software keyboard or handwritten character recognition software on the display device 10 is provided in the central processing unit 7. The above two examples are preferably provided in order to effectively use the coordinate input system.
[0085]
In addition, as a third embodiment related to the function key 3, a function key 3 having at least one of the frequently used keys such as a Shift key, a Ctrl key, an Esc key and a Delete key as a function key 3 is used. May have a function key 3 having a mechanism capable of assigning keys according to preference.
[0086]
The wireless module 6 that performs wireless communication is realized by an infrared method or a wireless radio wave method. The former is realized by a remote control method or an IrDA format. The latter is realized by a wireless radio system using the Bluetooth format. However, in the former, when image reading is performed in the infrared region, care must be taken so that the wavelengths of both do not overlap. On the other hand, the radio wave method does not have the above optical problem, and the radio wave method does not have the directivity of transmission, so the communication speed is less affected by the positional relationship of the wireless module than the former. That's it. In particular, the Bluetooth format is suitable for incorporation into the device body because of its small chip size / weight and low power consumption. In addition, since various energy saving modes are defined, transmission / reception power can be reduced when communication is not required, which is suitable for using the battery or rechargeable battery of the apparatus main body for a long time.
[0087]
When performing wireless communication, if multiple coordinate input systems of the same model are present in the wireless communicable range, there is a possibility of malfunction, so the wireless module 6 has a function of performing mutual authentication. Is desirable. Authentication is realized using a device code and, in addition, encryption.
[0088]
In this embodiment, the wireless system is mentioned in consideration of the convenience of use by the operator. However, the coordinate input system of the present invention does not necessarily need to exchange data wirelessly, and can be realized using a wired cable. Is possible. In this case, although convenience is reduced, the image data obtained by the image reading device 1 is directly transmitted to the central processing unit 7, and the central processing unit 7 performs decoding, distortion equality calculation, and coordinate detection, thereby An embodiment in which coordinate input with a faster response speed than that processed by the signal processing unit 4 provided in the input device main body is performed and the device main body can be reduced in size and weight is also possible. In addition, since the power of the coordinate input device main body is supplied from a personal computer or a portable information terminal, one of the advantages is that only the battery or the rechargeable battery of the coordinate input input device main body is not consumed. .
[0089]
The coordinate input system including the wireless module 6 equipped with a terminal that can be connected with a wired cable is also considered as one of the embodiments in consideration of the utility related to the power source when the wired cable is used. When the power of the coordinate input device is consumed, a wired cable can be used to supply at least power from a personal computer or portable information terminal. In addition to image reading data or coordinate data, the touch detection signal and the function key 3 data are wired. It is desirable that it can also be transmitted.
Next, the operation of the power control unit 5 will be described.
The power control unit 5 shown in FIGS. 1 and 2 includes a sensor that senses that the operator is holding the coordinate input device body, a timer that counts time, a control device that controls power ON / OFF and power consumption.
[0090]
Examples of the sensor include a temperature sensor that senses the temperature of the hand and a pressure sensor that senses pressure when gripping.
[0091]
When the operator grips the coordinate input device main body and the indicated value of the sensor exceeds a certain threshold value, the power is turned on, and when the hand is released and the indicated value of the sensor exceeds the certain threshold value, the timer is activated, and When the threshold value is exceeded, the power consumption can be suppressed by automatically turning off the power or entering standby mode so as not to consume unnecessary power. This flowchart is shown in FIG. Also, as shown in the flowchart of FIG. 17, there are two thresholds, the function of reducing the power of wireless communication with the first threshold, turning off the entire apparatus with the second threshold, or entering the standby mode It is desirable to have Reduction of communication power is realized by using energy saving modes such as a park mode, a sniff mode, and a hold mode defined in the Bluetooth standard when wireless radio wave communication is performed in the Bluetooth format. Further, an embodiment in which these energy saving modes are effectively combined and two or more threshold processes are performed is also possible. Also, when performing wireless communication with other wireless means, it is possible to define a similar energy saving mode.
[0092]
Even if the operator holds the coordinate input device main body and does not point to the screen of the display device 10, the power consumed by the wireless module 6 is wasted. As a method of saving this power, a timer for measuring the code symbol non-detection time is provided in the coordinate input device body, and if the code symbol 13 is not detected, the timer is activated. This is realized by adding a function of lowering. Even in this state, the portions other than the communication of the apparatus main body retain normal functions. Further, when the code symbol 13 is detected in the power saving mode, it has a function of resuming normal communication. This is also realized by the same means as the energy saving mechanism based on the device grasp detection by the operator.
[0093]
In addition, if the host side of the personal computer or portable information terminal or the like is turned off or is in standby mode and the coordinate input device main unit is turned on when the coordinate input cannot be performed, Therefore, it is desirable to have a function of turning off the power of the coordinate input device main body by detecting that the host device is turned off or in the standby mode. This is provided on the personal computer or portable information terminal side from the personal computer or portable information terminal side to the coordinate input device main body, a function to notify that the power OFF or standby mode is entered, or a timer is provided on the device main body, When there is no response from the personal computer or portable information terminal side, a timer is activated, and if a certain threshold is exceeded, a function to enter standby mode is provided so that the power is automatically turned off or unnecessary power is not consumed. Realized. This is also realized by the same means as the energy saving mechanism by grasping and detecting the operator's coordinate input device main body.
[0094]
By combining the power saving mechanisms listed above, the use period of the battery or the rechargeable battery of the coordinate input device main body can be further extended.
[0095]
[Second Embodiment]
A second embodiment of the present invention will be described with reference to FIGS.
[0096]
FIG. 18 is a schematic diagram showing an outline of the coordinate input system.
[0097]
Briefly describing the system configuration, the coordinate input device main body includes an image reading device 1, a contact detection unit 2, a function key 3, a signal processing unit 4, a power control unit 5, and a wireless module 6a. Using this coordinate input device main body, the coordinates of the display device 10 on which the spacer forms the code symbol are detected, and whether the detected coordinate and a part used for the coordinate instruction of the input device main body are touching the screen. The detection signal and the signal from the function key 3 are processed by the signal processing unit 4, and this signal is transmitted between the wireless module 6 a attached to the coordinate input device main body and the personal computer or the portable information terminal having the display device 10. Wireless communication of data is performed with the wireless module 6b attached to the. FIG. 19 is a schematic diagram of a system configuration of the apparatus main body, which has a pen-like shape for easy operation by an operator, and coordinates are designated by the tip 11 thereof.
[0098]
The wireless module 6a attached to the coordinate apparatus main body can perform at least wireless transmission, and the wireless module 6b attached between the personal computer or the portable information terminal can perform at least wireless reception. Furthermore, an embodiment in which both wireless modules have transmission and reception capabilities and perform bidirectional communication is also possible.
[0099]
The personal computer or the portable information terminal transmits a signal received by the wireless module 6 b to the central processing unit 7. The central processing unit 7 performs display on the liquid crystal screen 10 from the display control unit 9 based on the information signal. The central processing unit 7 has a memory, and by tracing the screen of the display device 10 with the coordinate device body, it is possible to select a desired character string, a plurality of figures, or a screen area.
[0100]
Further, the central processing unit 7 has a soft keyboard and palette software for performing character recognition with respect to characters input by handwriting, whereby digital data can be input.
[0101]
Next, the coordinate expression by the code symbol by the spacer which is the basis of the present invention and the coordinate detection method will be described. First, a reading method by the coordinate input device main body will be described.
[0102]
A configuration example of the image reading apparatus 1 is shown in FIG. The image reading apparatus 1 includes an illuminating device 45, an imaging device 46, a conjugating optical system 47, and a signal processing circuit 48 that performs control / data processing thereof. The imaging device 46 is constituted by an imaging element array such as a CCD camera or a CMOS sensor, for example. As will be described later, it is desirable that these elements have a wavelength characteristic necessary for detecting a code symbol or are covered with a wavelength filter so that the wavelength range for imaging can be limited. In addition, the imaging device 46 can include an imaging lens system 47 including at least one conjunctive lens, and an embodiment having a function of performing autofocus as necessary is also possible.
[0103]
The illumination device 45 is for improving the code symbol detection sensitivity of the imaging device 46. Since it does not have a backlight, when detecting a code symbol of a reflection type liquid crystal whose screen is dark, this is a very effective sensitivity improvement means. Alternatively, the detection sensitivity can be further increased by performing illumination with wavelength light in a wavelength selection range performed on the illumination device 45 described above. Details of these will be described later.
[0104]
Next, signal processing performed by the signal processing unit 4 of the coordinate input apparatus main body will be described with reference to the chart FIG.
[0105]
First, a code symbol is decoded from an image read by the image reading device 1 to obtain a center coordinate of the code symbol (S1). Next, the position, orientation, and distortion amount of the code symbol in the image read by the image reading device 1 are calculated (S2). Based on this information, the coordinates indicated by the tip 11 of the apparatus main body are calculated (S3). Since the absolute coordinates of the display device 10 are calculated from the relative designated coordinates of the tip 11 with respect to the code symbol, the coordinates can be specified more finely than the coordinate information of the code symbol.
[0106]
Next, a code symbol forming method and a method for increasing detection sensitivity will be described in detail with respect to a display device in which a dielectric multilayer film coated on a transparent substrate or a polarizing plate forms a code symbol.
[0107]
As a display device 10 according to an embodiment of the present invention, a display device using a color transmission type liquid crystal display device is given. FIG. 22 and FIG. 23 are schematic views showing the configuration of a color transmission type liquid crystal display device, and are cross-sectional views seen from the direction perpendicular to the display screen.
[0108]
The liquid crystal display device 10 includes a polarizing plate 21, a transparent substrate 22, a transparent electrode 23, an alignment film 24, a liquid crystal layer 25, a spacer 12, a color filter 26, and a backlight 27.
[0109]
The polarizing plate 21 controls the polarization of incoming and outgoing light.
[0110]
The transparent substrate 22 is for preventing the electricity from the electrode part from leaking to other parts.
[0111]
The transparent electrode 23 is an electrode for driving a voltage applied to the liquid crystal layer, and a highly transparent material is used so as not to hinder display.
[0112]
The alignment film 24 is a film for aligning liquid crystal molecules in a certain direction.
[0113]
The liquid crystal molecule layer 25 is composed of liquid crystal molecules, and the orientation of the molecules is controlled by the voltage applied to the transparent electrode 23.
[0114]
The spacer 12 is for ensuring a uniform space on the two transparent substrates sandwiching the liquid crystal substance.
[0115]
The color filter 27 is an RGB three-color wavelength filter.
The backlight 28 illuminates from behind the display to brighten the screen.
[0116]
FIG. 22 and FIG. 23 are schematic views showing a cross-sectional configuration of a color transmission type liquid crystal display device, and the respective components are not necessarily arranged in a space as depicted. Further, the spacer 12 does not necessarily exist at the boundary of the color filter 26.
[0117]
FIG. 22 shows a first embodiment of the display medium of the present invention in which a code symbol 13 made of a dielectric multilayer film is formed on a polarizing plate 21a of a color transmission type liquid crystal display device.
[0118]
FIG. 23 shows a second embodiment of the display medium of the present invention, in which a code symbol 13 made of a dielectric multilayer film is formed on a transparent substrate 22a of a color transmission type liquid crystal display device.
[0119]
Two examples relating to a liquid crystal display device (LCD) have been given as the display device 10 of this embodiment, but besides these, as a display medium according to claim 2, a nematic liquid crystal display device, an organic EL display, and a plasma display are used. A display device in which a code symbol is formed of a dielectric multilayer film on a transparent substrate of a field emission display is possible as the third to sixth embodiments, respectively. These simple configurations are shown in FIGS. A code symbol 13 made of a dielectric multilayer film is formed on the transparent substrate 22a. It should be noted that the display device configuration diagrams of FIGS. 24 to 27 are schematic diagrams, and the illustrated components are not necessarily arranged in the spatial arrangement as illustrated.
[0120]
Except for the above six embodiments, all of the code symbols are formed by a dielectric multilayer film on a transparent substrate having a planar structure. However, as described in the explanation of the coordinate detection principle of this coordinate input system, claim 1 In the display device described in 1), it is possible to form a code symbol by a dielectric multilayer film on a transparent substrate having a curved structure. As a seventh embodiment, there is a cathode ray tube display as shown in FIG. A code symbol made of a dielectric multilayer film is formed on a screen 56 having a curved surface structure. It can also be implemented in a CRT display of a personal computer. Of course, embodiments for flat cathode ray tube displays are also possible. FIG. 28 is a schematic diagram.
[0121]
Next, an example of the code symbol 13 using a dielectric multilayer film is given.
As a first embodiment, as shown in FIG. 30, there is a method of forming a two-dimensional code based on a certain rule with a dielectric multilayer film 15 on a transparent substrate or a polarizing filter 14. The example of FIG. 30 is an example of a two-dimensional code, and does not necessarily have such a shape, and more various code patterns can be realized.
[0122]
As a second embodiment, as shown in FIG. 31, a virtual grid line 16 having vertical and horizontal virtual grid lines 16 on a transparent substrate or polarizing filter 14, such as an Anoto pattern of Anoto, is used. A dielectric multi-layer film 15 having a sufficiently small rectangular, circular, or other shape with respect to the lattice is disposed at a point deviated from the intersection of the typical lattice within a sufficiently small range with respect to the size of the lattice. The way to go is mentioned. Each of the shift patterns of the dielectric multilayer film is unique, and the shift pattern forms a code indicating the coordinate position. In contrast to the example of FIG. 31, the code symbol 13 is formed by a small region not coated with a dielectric multilayer film on a transparent substrate or polarizing filter 14 coated with a dielectric multilayer film on almost one surface. Is also possible.
[0123]
It is also possible to form the code symbol 13 by combining the two examples.
[0124]
Next, an embodiment shown in FIG. 32 will be given for a method of forming the dielectric multilayer code pattern 13 of the second embodiment on the transparent substrate or the polarizing plate 14. First, the substrate 51 is the transparent substrate or the polarizing plate 14 before coating the dielectric multilayer film. A mask 49 having a desired code pattern is placed on the substrate 51, or the mask 49 is formed on the substrate 51 (S31). The pattern portion 50 corresponds to a portion where the mask 49 is penetrated or a portion where no mask is formed on the substrate 51. Next, a dielectric multilayer film is formed so as to have desired optical characteristics in a masked state (S32). After forming the dielectric multilayer film, the mask is removed to obtain a substrate 52 in which only the pattern portion 50 is coated with the dielectric multilayer film (S33).
[0125]
Next, a method for detecting a code symbol with high sensitivity will be described.
[0126]
In order to increase the detection sensitivity of the code symbol 13, by limiting the detection wavelength range of the image reading device 1, it is possible to detect the dielectric multilayer film portion 15 with high sensitivity. The limitation of the wavelength range is realized by using an image sensor having desired characteristics or by biting a desired wavelength filter into the image pickup apparatus.
[0127]
In particular, as described in claim 4, when the wavelength region exhibiting high reflection spectrum characteristics is not a visible region but an infrared region, the image reading device 1 of the apparatus main body according to claim 8 has. The illumination device can be illuminated by an infrared LED or the like, and the dielectric multilayer film 15 forming the code symbol 13 is highly sensitive without visually affecting the screen display of the display device 10. Can be detected. In particular, when the display device 10 is a display medium that cannot perform a very bright display such as a reflective liquid crystal display device, it is preferable to perform illumination in a non-visible light region because it is less susceptible to visual influences. .
[0128]
If the wavelength is further limited by using an LD (laser diode) as an illumination light source, coordinate detection with higher sensitivity can be performed.
[0129]
By increasing the image reading sensitivity of the code symbol 13 composed of the dielectric multilayer portion 15, it becomes possible to form a finer code symbol. As a result, coordinate input with higher accuracy is possible.
[0130]
Further, as described above, in the signal processing unit 4, in addition to the center coordinate information of the code symbol 13 obtained by decoding the code symbol 13, the size of the code symbol read by the image reading device 1, Since the position of the coordinate input tip 11 that performs pointing of the coordinate input device body is calculated from the position, orientation, and amount of distortion of the code symbol 13, the coordinates are detected more finely than the code symbol 13. Can do. On the other hand, if this is utilized, it is possible to detect and input fine coordinates with a rough code symbol structure, rather than performing coordinate detection using only the code symbol 13. This also means that the detection sensitivity of the image reading apparatus 1 can be reduced by performing another interpretation than when performing coordinate detection / input only by the code symbol 13. This is because the coordinate detection resolution required by the apparatus can be designed with a high degree of freedom depending on the parameters of the constituent elements, depending on the performance of the elements of the reader 1 and the calculation processing capability of the signal processing unit 4. Means.
[0131]
Next, the details of the additional mechanism of the coordinate input device main body will be described.
[0132]
The contact detection unit 2 provided on the coordinate input device main body erroneously recognizes that the user has pointed just by bringing the pen close as described in the conventional example (Japanese Patent Laid-Open No. 2000-105671). Is for detecting whether or not the tip 11 of the coordinate input device main body used for coordinate instructions is touching the screen of the display device 10.
[0133]
As a first embodiment for realizing this, there is a button-shaped sensor device as shown in FIG. By contacting the display device 10, the tip 11 is recessed, the switch 53 is turned on, and a current flows through the circuit, so that the current sensing unit 54 can detect the contact.
[0134]
As a second embodiment, as shown in the flowchart of FIG. 34, the tip 11 of the pen is displayed on the screen of the liquid crystal display device 10 based on the size, position, orientation and amount of distortion of the code symbol 13 read by the image reading device 1. There is a method in which the signal processing unit 4 obtains contact by calculation processing.
[0135]
The first example is characterized in that it can be realized by a mechanically and electrically simple mechanism. Since the second example uses the coordinate detection mechanism, the calculation can be performed almost simultaneously with the coordinate detection. In addition, it is possible to save power consumed by the sensor of the first example, but it has a second aspect that is inferior in certainty of touch detection and response time. Also in the second example, in order to improve the tactile usability of the operator, as in the first example, the tip portion 11 is mechanically dented or deformed by pressure, and the tactile sense of the operator It is desirable to have a mechanism to appeal to
[0136]
Further, the coordinate input device main body is provided with a function key 3, whereby various functions can be added to the coordinate input system. As a first example, it is possible to provide a button for performing a right click of the mouse. When a certain coordinate of the liquid crystal display device 10 is designated for the first time immediately after this button is pressed, processing equivalent to that of right-clicking the designated coordinate is performed. In addition, an example in which a left double-click button is similarly provided can be given.
[0137]
As a second example related to the function key 3, as described above, there is an example in which a button for displaying the software keyboard or handwritten character recognition software on the display device 10 is provided in the central processing unit 7. The above two examples are preferably provided in order to effectively use the coordinate input system.
[0138]
In addition, as a third embodiment related to the function key 3, a function key 3 having at least one of the frequently used keys such as a Shift key, a Ctrl key, an Esc key, and a Delete key as a function key 3 is used. May have a function key 3 having a mechanism capable of assigning keys according to preference.
[0139]
In this embodiment, wireless communication is performed between the coordinate input device main body and an information device that controls the display device. This method is desirable for the operator to input the coordinates without feeling the trouble of the cable. The wireless module 6 that performs wireless communication is realized by an infrared method or a wireless radio wave method. The former is realized by a remote control method or an IrDA format. The latter is realized by a wireless radio system using the Bluetooth format. However, in the former, when image reading is performed in the infrared region, care must be taken so that the wavelengths of both do not overlap. On the other hand, the radio wave method does not have the above optical problem, and the radio wave method does not have the directivity of transmission, so the communication speed is less affected by the positional relationship of the wireless module than the former. That's it. In particular, the Bluetooth format is suitable for incorporation into the device body because of its small chip size / weight and low power consumption. In addition, since various energy saving modes are defined, transmission / reception power can be reduced when communication is not required, which is suitable for using the battery or rechargeable battery of the apparatus main body for a long time.
[0140]
When performing wireless communication, if multiple coordinate input systems of the same model are present in the wireless communicable range, there is a possibility of malfunction, so the wireless module 6 has a function of performing mutual authentication. Is desirable. Authentication is realized using a device code and, in addition, encryption.
[0141]
In this embodiment, the wireless system is mentioned in consideration of the convenience of use by the operator. However, the coordinate input system of the present invention does not necessarily need to exchange data wirelessly, and can be realized using a wired cable. Is possible. In this case, although convenience is reduced, the image data obtained by the image reading device 1 is directly transmitted to the central processing unit 7, and the central processing unit 7 performs decoding, distortion equality calculation, and coordinate detection, thereby An embodiment in which coordinate input with a faster response speed than that processed by the signal processing unit 4 provided in the input device main body is performed and the device main body can be reduced in size and weight is also possible. In addition, since the power of the coordinate input device main body is supplied from a personal computer or a portable information terminal, one of the advantages is that only the battery or rechargeable battery of the coordinate input input device main body is not consumed. It is done.
[0142]
The coordinate input system including the wireless module 6 equipped with a terminal that can be connected with a wired cable is also considered as one of the embodiments in consideration of the utility related to the power source when the wired cable is used. When the power of the coordinate input device is consumed, a wired cable can be used to supply at least power from a personal computer or portable information terminal. In addition to image reading data or coordinate data, the touch detection signal and the function key 3 data are wired. It is desirable that it can also be transmitted.
[0143]
The coordinate input system of the present invention preferably has a mechanism that does not consume useless power. The necessity is particularly high when the portable information terminal is driven by a battery or when data is exchanged wirelessly as in this embodiment. The operation of the power control unit 5 shown in FIG. 29 will be described. The power control unit 5 includes a sensor that senses that the operator is holding the coordinate input device body, a timer that counts time, power ON / OFF, and consumption. It consists of a control device that controls electric power.
[0144]
Examples of the sensor include a temperature sensor that senses the temperature of the hand and a pressure sensor that senses pressure when gripping.
[0145]
When the operator grips the coordinate input device main body and the indicated value of the sensor exceeds a certain threshold value, the power is turned on, and when the hand is released and the indicated value of the sensor exceeds the certain threshold value, the timer is activated, and When the threshold value is exceeded, the power consumption can be suppressed by automatically turning off the power or entering standby mode so as not to consume unnecessary power. This flowchart is shown in FIG. In addition, as shown in the flowchart of FIG. 36, a function that includes two thresholds, reduces the power of wireless communication with the first threshold, turns off the entire apparatus with the second threshold, or enters the standby mode. It is desirable to have Reduction of communication power is realized by using energy saving modes such as a park mode, a sniff mode, and a hold mode defined in the Bluetooth standard when wireless radio wave communication is performed in the Bluetooth format. Further, an embodiment in which these energy saving modes are effectively combined and two or more threshold processes are performed is also possible. Also, when performing wireless communication with other wireless means, it is possible to define a similar energy saving mode.
[0146]
Even if the operator holds the coordinate input device main body and does not point to the screen of the display device 10, the power consumed by the wireless module 6 is wasted. As a method of saving this power, a timer for measuring the code symbol non-detection time is provided in the coordinate input device body, and if the code symbol 13 is not detected, the timer is activated. This is realized by adding a function of lowering. Even in this state, the portions other than the communication of the apparatus main body retain normal functions. Further, when the code symbol 13 is detected in the power saving mode, it has a function of resuming normal communication. This is also realized by the same means as the energy saving mechanism based on the device grasp detection by the operator.
[0147]
In addition, if the host side of the personal computer or portable information terminal or the like is turned off or is in standby mode and the coordinate input device main unit is turned on when the coordinate input cannot be performed, Therefore, it is desirable to have a function of turning off the power of the coordinate input device main body by detecting that the host device is powered off or in the standby mode. This is because the personal computer or portable information terminal side has a function to notify the coordinate input device body that the power is turned off or the standby mode is entered, or the personal computer or portable information terminal side is provided with a timer. When there is no response from the personal computer or portable information terminal, a timer is activated, and when a certain threshold is exceeded, a function to enter standby mode is provided so that the power is automatically turned off or unnecessary power is not consumed. It is realized with. This is also realized by the same means as the energy saving mechanism by grasping and detecting the operator's coordinate input device main body.
[0148]
By combining the power saving mechanisms listed above, the use period of the battery or the rechargeable battery of the coordinate input device main body can be further extended.
[0149]
[Third Embodiment]
A third embodiment of the present invention will be described with reference to FIG. This embodiment is based on the above-described embodiments.
[0150]
FIG. 37 shows an overall schematic configuration example. In the figure, a coordinate input pen 201 and a multifunction copier 202 are shown.
[0151]
The coordinate input pen 201 includes a writing pen tip 203, and when the user performs writing on the paper surface, obtains a code symbol image written on the paper surface from the image reading CCD 204. The processing processor 205 receives image data from the image reading CCD, calculates coordinates, and stores the calculation results in the recording memory 206. When the user presses the transmission button 207, data is transmitted to the multifunction copier 202 through the BlueTooth module 208 in the coordinate input pen 201 and the BlueTooth module 209 in the multifunction copier 202.
[0152]
[Instruct the remote receiving device to transmit the data stored in the coordinate input device]
When the user gives an instruction to acquire information stored in the coordinate input pen 201 from the operation unit 210 of the multi-function copier 202, the instruction of the operation unit 210 is changed to the BlueTooth module 209 in the multi-function copier 202 and the coordinate input pen. The data is transmitted to the recording memory 206 in the coordinate input pen 201 through the BlueTooth module 208 in 201. The recording memory 206 transmits the coordinate data and document data recorded in the recording memory to the recording HDD 211 through the BlueTooth module 208 in the coordinate input pen 201 and the BlueTooth module 209 in the multifunction copier 202. The recording HDD 211 receives and records coordinate data and document data. Further, the user can print the data recorded in the recording HDD 211 by giving a print instruction from the operation unit.
[0153]
[Check the processing status of the coordinate input pen]
When the user presses the transmission button 207 to transmit, status information such as the communication partner is transmitted from the BlueTooth module to the display liquid crystal 212. At the same time, the transmission data amount is transmitted from the recording memory 206 to the display liquid crystal 212. Thereby, the user can confirm the transmission destination and the transmission data amount.
[0154]
[Confirmation from multifunction copier]
The BlueTooth module 209 in the multifunction copier 202 transmits the communication status information to the display unit 216. Thereby, the user can grasp the communication state of the multifunction copier 202.
[0155]
[Send data when pen memory is full]
When the amount of recorded information in the recording memory 206 inside the coordinate input pen 201 reaches a maximum amount that does not exceed a threshold, information is automatically sent to the recording HDD 211 in the multifunction copier 202 through the BlueTooth modules 208 and 209. The data in the recording memory 206 is erased after transmission.
[0156]
[Automatically sent when BlueTooth module finds partner]
The BlueTooth module 208 in the coordinate input pen 201 detects the multi-function copier 202 that is the transmission destination selected in advance by the user, extracts the recorded information from the recording memory 206, and multi-function copier 202. With the ability to send to.
[0157]
[Perform processing corresponding to the detected coordinate area]
An area having a paper surface is indicated by a coordinate input pen 201. For example, when writing is performed so as to encircle a certain portion, the writing pressure by the writing is transmitted to the switch 213, and the image reading CCD 204 reads the code symbol on the paper for the time when the load is applied to the switch. The read code symbol is transmitted to the processing processor 205, converted into coordinates, and transmitted to the processing processor 214 in the multifunction copier 202 through the BlueTooth modules 208 and 209. The processing processor 214 performs processing corresponding to the coordinate information.
[0158]
As an application example, the paper is a mail order catalog. Suppose you check the items you want in the mail-order catalog and enter the color, size, quantity, and delivery address. The processing processor 205 in the coordinate input pen 201 acquires the coordinates entered from the code symbol, and transmits the coordinate data to the processing processor 214 in the multifunction copier 202 through the BlueTooth modules 208 and 209. . The processing processor 214 performs ordering processing as processing corresponding to the coordinates. It can be confirmed by the notification printed by the printing unit 216 that an order has been placed through the FAX / data module 215 in the multifunction copier 202. Alternatively, the status is transmitted to the display liquid crystal 212 in the coordinate input pen 201 through the BlueTooth modules 209 and 208 and displayed, so that the status can be confirmed by the pen at hand of the user.
[0159]
[Enter document information]
In an application such as the above-mentioned mail order catalog, processing information corresponding to the coordinates of the mail order catalog must be recorded in the multifunction copier 202 in advance. Such information is stored in the recording HDD 211 by receiving data from the outside by a FAX module or the like.
[0160]
【The invention's effect】
According to the present invention, it is possible to detect coordinates of a locus designated on a display device, particularly a liquid crystal display device in real time without using a tablet, and perform coordinate input. In addition to information obtained by decoding code symbols indicating coordinates on the display medium, the position of a predetermined point on the medium is detected using at least one of the position, orientation, and distortion amount of the code symbol. The upper coordinates can be precisely detected.
[0161]
In the present invention, coordinates are detected and input with higher resolution than the conventional method because coordinates are detected by a code symbol having a fine structure composed of a structural support of a display device, particularly a spacer of a liquid crystal display device. In addition, since the film that causes a decrease in contrast and resolution is not bonded, the image quality of the display device can be reduced.
[0162]
In the present invention, an image is optically read by the imaging device of the coordinate input device main body, and coordinates are detected based on the image signal. Therefore, even if an object other than the coordinate input device main body contacts the display device, Coordinate input can be performed correctly.
[0166]
  In the information processing system according to the first to fourth aspects, the user can instruct that the written data is a set of data by explicitly transmitting.
[0167]
  Claim5The described information processing system can provide means for acquiring information of a remote coordinate input device.
[0168]
  Claim6The described information processing system can realize an operation of automatically transmitting information so that the coordinate input operation can be continued when the memory is full.
[0169]
  Claim7The described information processing system can automatically back up information in order to prevent the data recorded therein from being erased due to battery consumption in the pen when a transmission destination is found.
[0170]
  Claim8The described information processing system can extract information corresponding to the coordinates designated by the coordinate input device.
[0171]
  Claim9The described information processing system can extract information corresponding to the coordinates designated by the coordinate input device.
[0172]
  Claim10The described information processing system can provide means for inputting document information not only from the coordinate input device but also from other devices such as a personal computer when the document information is read in advance into the external communication device. it can.
[0173]
  Claim11The described information processing system can perform complicated processing, high-speed and large-volume processing, and the like by performing processing in an external processing device without performing processing in the coordinate input device.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an outline of a coordinate input system as a first embodiment of the present invention.
FIG. 2 is a schematic diagram of a system configuration of a coordinate reader main body of the coordinate input system.
FIG. 3 is a schematic diagram of a system configuration of an image reading apparatus of a coordinate reading apparatus main body of the coordinate input system.
FIG. 4 is a chart illustrating a process of detecting coordinates on a liquid crystal display device using the coordinate input system.
FIG. 5 is a schematic diagram of a configuration of an LCD, which is a first example of a display device of the present invention.
FIG. 6 is a schematic view of a configuration of a nematic liquid crystal display as a second example of the display device of the present invention.
FIG. 7 is a schematic diagram of a configuration of an organic EL display which is a third example of the display device of the present invention.
FIG. 8 is a schematic diagram of a configuration of a plasma display which is a fourth example of the display device of the present invention.
FIG. 9 is a schematic view of a configuration of a field emission display as a fifth example of the display device of the present invention.
FIG. 10 is a diagram showing an example of wavelength characteristics of transmittance of the structure support of the display device of the present invention.
FIG. 11 is a diagram showing a first example in which code symbols are formed using spacers on the liquid crystal display device.
FIG. 12 is a diagram showing a second example in which code symbols are formed using spacers on the liquid crystal display device.
FIG. 13 is a diagram showing an example of a process for forming a code symbol on the display device.
FIG. 14 is a block diagram showing a configuration of first means for sensing that a part of the input device main body of the present invention has touched the display device screen;
FIG. 15 is a chart for explaining a detection process of a second means for sensing that a part of the input device main body of the present invention has touched the display device screen;
FIG. 16 is a chart illustrating a first operation example of a power control unit in the input device body of the present invention.
FIG. 17 is a chart illustrating a second operation example of the power control unit in the input device main body according to the invention.
FIG. 18 is a block diagram showing an outline of a coordinate input system as a second embodiment of the present invention.
FIG. 19 is a schematic diagram of a system configuration of a coordinate reader main body of the coordinate input system.
FIG. 20 is a schematic diagram of a system configuration of an image reading device of a coordinate reading device main body of the coordinate input system.
FIG. 21 is a chart illustrating a process of detecting coordinates on a liquid crystal display device using the coordinate input system.
FIG. 22 is a schematic view of a configuration of an LCD according to a first example of the display device of the present invention, in which a transparent multilayer substrate is coated with a dielectric multilayer film.
FIG. 23 is a schematic diagram of a configuration of an LCDLCD, which is a second example of the display device of the present invention, in which a polarizing plate is coated with a dielectric multilayer film.
FIG. 24 is a schematic diagram of a configuration of a nematic liquid crystal display as a third example of the display device of the present invention.
FIG. 25 is a schematic diagram of a configuration of an organic EL display which is a fourth example of the display device of the present invention.
FIG. 26 is a schematic view of a configuration of a plasma display which is a fifth example of the display device of the present invention.
FIG. 27 is a schematic view of a configuration of a field emission display which is a sixth example of the display device of the present invention.
FIG. 28 is a schematic diagram of a configuration of a CRT display as a seventh example of the display device of the present invention.
FIG. 29 is a diagram showing an example of wavelength characteristics of transmittance of the structure support of the display device of the present invention.
30 is a diagram showing a first example in which code symbols are formed using spacers on the liquid crystal display device. FIG.
FIG. 31 is a diagram showing a second example in which code symbols are formed using spacers on the liquid crystal display device.
FIG. 32 is a diagram showing an example of a process for forming code symbols on the display device.
FIG. 33 is a block diagram showing a configuration of first means for sensing that a part of the input device main body of the present invention has touched the display device screen;
FIG. 34 is a chart for explaining the detection process of the second means for sensing that a part of the input device main body of the present invention has touched the display device screen.
FIG. 35 is a chart illustrating a first operation example of the power control unit in the input device main body according to the invention.
FIG. 36 is a chart illustrating a second operation example of the power control unit in the input device main body according to the invention.
FIG. 37 is a schematic diagram showing an outline of a coordinate input system as a third embodiment of the present invention.
[Explanation of symbols]
1 Image reader
2 Contact detector
3 Function keys
4 Signal processor
5 Power control unit
6 Wireless module
7 Central processing unit
8 Main memory
9 Display control unit
10 Display device
11 Tip
12 Spacer
12a Spacer with high sensitivity to reader
12b Spacer with low sensitivity to reader
13 Code symbol
14 Virtual grid lines
21 Polarizing filter
22 Transparent substrate
23 Transparent electrode
24 Alignment film
25 Liquid crystal layer
26 Color filters
27 Backlight
28 Cholesteric liquid crystal layer
29 Visible light absorption layer
30 Organic EL media
31 First display electrode line
32 Second display electrode line
33 Protective film
34 Reflective film
35 Dielectric layer
36 Address electrode
37 Silicon substrate
38 Insulating layer
39 Electrolytic emission emitter
40 phosphor film
41 Anode electrode
42 Gate electrode
43 Emitter electrode
44 Falling electrode
45 Lighting equipment
46 Imaging device
47 Concise optical system
48 Signal processing circuit
49 Photomask
50 UV
51 Display medium in which pigment-doped spacers are uniformly distributed
52 Display medium with code pattern
53 switch
54 Current detector
55 Power supply

Claims (11)

A display medium including at least one planar structure or a transparent substrate having a curved structure and a display layer capable of electrically controlling light emission characteristics , a coordinate input device, an external communication device, In an information processing system equipped with
The display medium is
A part of one surface of the transparent substrate is coated with a dielectric multilayer film having optical characteristics such that the transmittance is high in a certain wavelength range and the reflectance is increased in a wavelength range different from the wavelength range, The dielectric multilayer film forms a code symbol indicating coordinates on the display medium;
The coordinate input device includes:
A device body that a person can hold in his hand and perform writing operations;
An image reading apparatus provided in the apparatus main body for optically reading a code symbol formed on the display medium;
Decoding means for decoding the read code symbol;
A distortion amount calculation means for calculating at least one of the position, orientation and distortion amount of the code symbol in the image read by the image reading device;
A predetermined point on the display medium based on coordinate information indicating coordinates on the display medium included in the decoded information and at least one of a position, an orientation, and a distortion amount of the code symbol. Coordinate detection means for detecting the position of
The first communication department;
An instruction unit that instructs coordinate information or document information indicating the identity of the display medium or a transmission destination of both to the first communication unit,
The first communication unit includes means for receiving a destination instruction from the instruction unit, and means for transmitting coordinate information and / or document information to the external communication device,
The external communication device is
An information processing system comprising: a second communication unit that receives coordinate information and / or document information from the coordinate input device. In an information processing system comprising a display medium, a coordinate input device, and an external communication device,
The display medium is
A pair of substrates at least one of which is transparent;
A pixel electrode provided on at least one inner surface of the substrate and having at least one active element;
A display layer formed between the substrates;
A structural support formed in the display layer,
A part of the surface of the transparent substrate is coated with a dielectric multilayer film having optical characteristics such that the transmittance is high in a certain wavelength range and the reflectance is high in a wavelength range different from the wavelength range, The multilayer film forms a code symbol indicating coordinates on the display medium ,
The coordinate input device includes:
A device body that a person can hold in his hand and perform writing operations;
An image reading apparatus provided in the apparatus main body for optically reading a code symbol formed on the display medium;
Decoding means for decoding the read code symbol;
A distortion amount calculation means for calculating at least one of the position, orientation and distortion amount of the code symbol in the image read by the image reading device;
A predetermined point on the display medium based on coordinate information indicating coordinates on the display medium included in the decoded information and at least one of a position, an orientation, and a distortion amount of the code symbol. Coordinate detection means for detecting the position of
The first communication department;
An instruction unit that instructs coordinate information or document information indicating the identity of the display medium or a transmission destination of both to the first communication unit,
The first communication unit includes means for receiving a destination instruction from the instruction unit, and means for transmitting coordinate information and / or document information to the external communication device,
The external communication device is
An information processing system comprising: a second communication unit that receives coordinate information and / or document information from the coordinate input device. In an information processing system comprising a display medium, a coordinate input device, and an external communication device,
  The display medium includes a pair of transparent substrates, a pixel electrode provided on at least one inner surface of the transparent substrate and having at least one active element, a liquid crystal layer formed between the transparent substrates, and the liquid crystal layer A display medium having a structure sandwiched between a pair of polarizing plates, and having a transmittance at least in a certain wavelength region on a part of one surface of the polarizing plates. Is coated with a dielectric multilayer film having an optical characteristic that has a high reflectance in a wavelength region different from that, and the dielectric multilayer film forms a code symbol indicating coordinate information,
  The coordinate input device includes:
  A device body that a person can hold in his hand and perform writing operations;
  An image reading apparatus provided in the apparatus main body for optically reading a code symbol formed on the display medium;
  Decoding means for decoding the read code symbol;
  A distortion amount calculation means for calculating at least one of the position, orientation and distortion amount of the code symbol in the image read by the image reading device;
  A predetermined point on the display medium based on coordinate information indicating coordinates on the display medium included in the decoded information and at least one of a position, an orientation, and a distortion amount of the code symbol. Coordinate detection means for detecting the position of
  The first communication department;
  An instruction unit for instructing the first communication unit of coordinate information or document information indicating the identity of the display medium or a transmission destination of both;
  The first communication unit includes means for receiving a destination instruction from the instruction unit, and means for transmitting coordinate information and / or document information to an external communication device,
  The external communication device is
  An information processing system comprising: a second communication unit that receives coordinate information and / or document information from the coordinate input device. The information processing according to any one of claims 1 to 3, wherein the dielectric multilayer film material has an optical characteristic of high transmittance in a visible light region and high reflectance in an infrared light region. system. The external communication device,
For the previous SL second communication unit, and a instructing unit for performing the destination instruction of the coordinate information or the document information or both of the coordinate input device,
The second communication unit in the external communication device transmits coordinate information and / or document information transmission destination instructions to the first communication unit in the coordinate input device,
The second communication unit in the external communication device receives coordinate information and / or document information from the first communication unit in the coordinate input device, or a transmission destination instruction for both.
The said 2nd communication part in the said external communication apparatus has a means to transmit coordinate information according to the transmission destination instruction | indication of coordinate information or document information, or both, The one of Claim 1 thru | or 4 characterized by the above-mentioned. Information processing system described in 1. The coordinate input device includes a storage unit that records coordinate information and / or document information,
The storage unit has means for monitoring the amount of information recorded, and when the amount of information reaches a maximum amount that does not exceed a certain threshold, notifies the first communication unit that the maximum amount has been reached, and coordinates Send information and / or document information, erase recorded coordinate information and / or document information,
The first communication unit receives a notification that the maximum amount has been reached from the recording unit, transmits coordinate information and / or document information according to the notification from the recording unit, and receives coordinate information from the recording unit. 5. The information processing system according to claim 1 , wherein the document information or both of them is acquired. When the first communication unit in the coordinate input device discovers the external communication device and discovers the external communication device, coordinate information or document information or its information is sent to the second communication unit in the external communication device. Both are transmitted, The information processing system as described in any one of Claims 1 thru | or 4 characterized by the above-mentioned. The instruction unit in the coordinate input device instructs the image reading device to start reading a code symbol, instructs the image reading device to end the reading of the code symbol,
The image reading device transmits coordinate information from a reading start to a reading end to the processing unit,
Wherein the processing unit, wherein the receiving the coordinate information from the image reading apparatus, and transmits the document information present in the area having a coordinate information to the end read from the reading start to the communication unit, it is characterized by Item 5. The information processing system according to any one of Items 1 to 4 . The instruction unit in the coordinate input device instructs the image reading device to start reading a code symbol, instructs the image reading device to end reading of the code symbol,
The image reading device transmits coordinate information from a reading start to a reading end to the first communication unit in the coordinate input device,
The first communication unit in the coordinate input device transmits coordinate information to the external communication device,
The second communication unit of the external communication device receives coordinate information,
The second communication unit of the external communication device transmits coordinate information to a processing unit in the external communication device, and transmits coordinate information and document information to the recording unit in the external communication device;
The processing unit receives coordinate information, receives coordinate information and document information existing in an area surrounded by coordinate information from the recording unit,
The recording unit receives the coordinate information and document information, to record the coordinate information and document information, and transmits the coordinate information and document information to the processing unit, any one of claims 1 to 4, characterized in that one the information processing system according to One. The information processing system according to claim 9 , wherein the recording unit in the external communication device acquires coordinate information and document information from other than the second communication unit in the external communication device. The recording unit in the external communication apparatus records a description of processing to be performed on document information corresponding to coordinate information, and transmits processing to be performed on document information corresponding to coordinate information to the processing unit. ,
The processing unit in the external communication device receives a description of processing to be performed on document information corresponding to coordinate information from the recording unit, and performs processing according to the processing description. 9. The information processing system according to 9 .

Images