KR20070020431A - Penlight and Touch Screen Data Entry Systems for Flat Panel Displays and Methods - Google Patents

Abstract

Receive or detect touch or optical inputs for flat panel displays, such as flat panel organic light emitting diode (OLED) displays or other emissive display panels, using the same or different sensors as those used to sense and maintain pixel brightness. Provides a system, apparatus, and method. Provided are a penlight and touch screen data input system and method for a display. A photometric irradiation display and a touch panel input device are provided. Methods and apparatus are provided for reading display pixel emission and ambient luminance levels.

Display, pixel, stylus, penlight, optical sensor

Description

Penlight and touch screen data input system for flat panel display and method thereof {PENLIGHT AND TOUCH SCREEN DATA INPUT SYSTEM AND METHOD FOR FLAT PANEL DISPLAYS}

The present invention relates generally to a system, apparatus, and method for receiving or sensing contact and contactless inputs to a surface of an emissive display device, and more particularly to device or pixel luminance as described above. A system, apparatus, and method for receiving or sensing a touch or light input to a flat panel organic light emitting diode (OLED) display panel using different sensors used to sense and maintain.

This application claims 35 U.S.C §119 and / or 35 U.S.C. Prior to § 120, claims are made to the following applications, all of which are incorporated by reference in this application: Invention of the "Penlight and Touch Screen Data Input System for Flat Panel Displays" filed February 24, 2004 US Provisional Application No. 60 / 547,358, entitled; US Provisional Application No. 60 / 583,744, entitled “High-Impedance to Low-Impedance Conversion,” filed June 29, 2004; And US Utility Patent Application No. 11 / 015,638, entitled "Feedback Control System and Method for Operating a High-Performance Stabilized Active Matrix Emissive Display," filed December 17, 2004.

This application also claims U.S. Utility Patent Application No. XX / XXX, XXX (Representative Document No. 34135 /) entitled “PENLIGHT AND TOUCH SCREEN DATA INPUT SYSTEM AND METHOD FOR FLAT PANEL DISPLAYS”, filed Feb. 8, 2005. US / 2), US Utility Patent Application No. XX / XXX, XXX (Representative Document No. 34135 / US / 3, entitled “SIDELIGHT ILLUMINATED PANEL DISPLAY AND TOUCH PANEL INPUT DEVICE”, filed Feb. 8, 2005) ), US Utility Patent Application No. XX / XXX, XXX filed February 8, 2005 entitled "METHOD AND DEVICE FOR READING DISPLAY PIXEL EMISSION AND AMBIENT LUMINANCE LEVEL" (Agent Document No. 34135 / US / 4) , US Utility Patent Application No. XX / XXX, XXX filed Feb. 8, 2005 entitled "EMISSIVE DISPLAY DEVICE HAVING SENSING FOR LUMINANCE STABILIZATION AND USER LIGHT OR TOUCH SCREEN INPUT", Representative Document No. 34135 / US / 5), "METHOD AND DEVICE FO, filed February 8, 2005. R FLAT PANEL EMISSIVE DISPLAY USING SHIELDED OR PARTIALLY SHIELDED SENSORS TO DETECT USER SCREEN INPUT ", the US Utility Patent Application No. XX / XXX, XXX (Attorney Docket No. 34135 / US / 6). It is incorporated herein by reference.

Various display applications and various other systems and devices, such as personal assistants (PDAs), positioning systems (GPSs) and GPS, aviation facilities, check-in terminals, navigation systems incorporating public computer boots, and a variety of other systems and devices It includes an added touch screen, which allows a user to effectively identify an icon or graphic for a data item or action and to select a data item or action by pressing a finger or stylus over the icon.

Conventional devices may think that the user is touching the display screen, but in practice, the top of the display is typically such that the user provides input to a separate device attached to the display panel or placed between the user and the display device. Provides a separate touch panel located in.

Thus, these devices must not only include two panels for touch input and information display, but also provide separate electronic devices and interfaces for the devices, and in some instances separate drivers for the touch input panel and the display panel. The operating system and / or application software must be provided. Accordingly, assembly and maintenance costs will also increase. All of these additional parts add to the cost of the device, and the competition is so intense that additional costs are not welcome where the benefits are small. In some devices, the cost of adding the touch panel to the display panel will double the cost compared to the display panel only when added after initial manufacture.

Thus, in addition to displaying or outputting two-dimensional symbols and graphic information generated by the device, it may also include an integrated sensor array capable of receiving position sensing input from the user and communicating such position information to the device. There is a need for a single low cost display device.

There is also a need for a sensor array that can be integrated with the display during manufacture of the display such that the additional cost for manufacturing and distributing the input sensor array as a touch screen is at a level of typical cost.

In addition, some environments provide non-contact inputs, such as in the form of pen-light inputs, to reduce abrasion and other wear or damage that may be caused by repeated touch pressures on the input device, thereby reducing the device to harsh service environments. It is necessary to extend the life of the. There is also a need to provide contact inputs that do not depend on ambient light or external light sources such as light pens.

The present invention provides a system, display device, pixel and sensor architecture, and method for receiving or sensing contact and contactless inputs (such as penlights) to the surface of an emissive display device, in particular sensing and maintaining pixel brightness. Systems, apparatus, and methods for receiving or sensing touch or light inputs for flat panel displays, such as flat panel organic light emitting diode (OLED) displays or other emissive display panels, using sensors that are the same or different than those used to to provide.

In one aspect, the present invention provides a touch screen data input system and method for a flat panel display, and in another aspect, the present invention provides a sidelight illuminated flat panel display and a touch panel input device. In another aspect, the present invention provides a method and apparatus for reading display pixel emission and ambient luminance levels. In still another aspect, the present invention provides an emissive display apparatus that senses luminance stabilization and user light or touch screen input. In another aspect, the present invention provides a method and apparatus for a flat-panel emissive display that utilizes a fully shielded or partially shielded sensor to detect user screen input.

In still another aspect, the present invention provides an emission pixel display device of a type having a plurality of pixels, wherein each pixel has a drive circuit for generating a drive signal for driving a light emitting element and a display pixel, The pixel display device has at least one photon sensor disposed within the display device pixels such that the sensor is operative to sense photons emitted by emitters in the pixels and peripheral photons emitted by sources external to the display device. The sensed internal emitted photons are used for display brightness feedback control, and the sensed peripheral photons are used to detect external light sources or to detect shadow inputs to the display.

In another aspect, the present invention provides a method, display, pixel structure and emission pixel device for an integrated brightness and input sensor, the pixel device comprising: a light emitting element; A pixel emitter driving circuit for generating a voltage for driving the light emitting element to have a predetermined brightness corresponding to an image voltage, and applying the driving voltage to the light emitting element for a frame time; (i) intercept the measurable luminous flux when the light emitting element is in the emitting state; and (ii) in order to detect the luminous flux measurable from a source outside the pixel when the light emitting element is not in the emitting state. At least one photo sensor disposed to exhibit a change in electrical properties in response to a change in incident photon flux; And (i) a first voltage across the photosensor, a first current from the photosensor, or a first charge generated by the photosensor at the end of the first non-emission time period portion during the non-luminous state. (ii) measuring a second voltage across the photosensor, a second current from the photosensor, or a second charge generated by the photosensor at the end of the second emission time period portion during the luminous state; At least one voltage, current, and charge readout circuitry, wherein the measured first voltage, first current, or first charge is an indication of the measured luminance emitted from a source outside the pixel during the first time period portion; And the measured second voltage, second current or second charge is an indication of the measured luminance emitted from the pixel during the second time period portion.

In still another aspect of the present invention, there is provided a method for generating a current for driving a light emitting device to have a predetermined brightness corresponding to an image voltage, and applying the driving current to the light emitting device for a frame time; Connecting at least one charge storage element to the sensor to accumulate or release charge and simultaneously represent an electrostatic charge and a voltage proportional to the charge; Exposing a sensor that exhibits a change in electrical properties in response to a change in incident light flux to photons emitted by the light emitting element during a first time period and a second time period; The sensor includes means for controlling the rate of accumulation or release of charge during the first and second time periods, the charge being charged to or discharging charge from the at least one charge storage element connected to the sensor Making a step; Measuring the voltage or current raised by the charge present in the charge storage element at the end of the first time period portion and the second time period portion, wherein the voltage or current measured during the first time period portion is measured in the first time period. A measurement step, wherein the measurement is an indication of actual luminance emitted from the pixel during the portion and the voltage or current measured during the second time period portion is an indication of the actual luminance incident on the pixel sensor from an external source; Generating a difference value by comparing the actual luminance emitted from the pixel-related measurement voltage or current with the reference target pixel luminance for the pixel emitter image voltage and the pixel emitter drive current; Applying the difference value as a feedback input to a correction circuit that modifies the image voltage and drive current for the same pixel for subsequent frame times; And comparing the actual brightness incident on the pixel sensor during the second time period portion with the actual brightness for at least one other pixel in the display to identify a touch input or penlight input location on the display. Provide a way of working.

In still another aspect of the present invention, there is provided a method for detecting an input to a display device in which a plurality of separately addressable first image component (pixel) positions are arranged in a two-dimensional array, the first address of the separately addressable two-dimensional array. Providing photon sensing means in proximity to at least a portion of the plurality of pixel positions; Detecting photons impinging on each of said sensing means for a predetermined detection time period; Generating a sensing signal for each of the photon sensing means, in accordance with the number or energy of photons detected; And analyzing the sensing signal to identify at least one pixel position receiving the input.

In still another aspect of the present invention, there is provided a method of operating an emission type pixel device having an integrated brightness and an input sensor, the method comprising: generating a current for driving a light emitting element in each pixel to have a predetermined brightness corresponding to an image voltage, Applying the driving current to the light emitting element for a frame time; (i) intercept the measurable luminous flux when the light emitting element is in the emitting state; and (ii) detect the luminous flux measurable from a source outside the pixel when the light emitting element is not in the emitting state. Providing at least one optical sensor in the vicinity of the light emitting element, the optical sensor exhibiting a change in electrical properties in response to a change in incident photon flux; (i) a first voltage across the photosensor, a first current from the photosensor, or a first charge generated by the photosensor at the end of the first non-emission time period portion during the non-luminous state; (ii) a voltage representing a second voltage across the photosensor, a second current from the photosensor, or a second charge generated by the photosensor at the end of the second emission time period portion during the luminous state; And reading at least one of the current and charge measurements.

In still another aspect of the present invention, there is provided a device for detecting an input to a display device in which a plurality of separately addressable first image component (pixel) positions are arranged in a two-dimensional array, wherein the separately addressable two-dimensional array is provided. Photon sensing means proximate to at least a portion of the first plurality of pixel positions of the apparatus; At least one detection circuit for detecting photons impinging on each of said photon sensing means for a predetermined detection time period; At least one measuring circuit for generating a sensing signal for each of said photon sensing means in accordance with the number or energy of photons detected; And a comparison circuit for comparing and analyzing the sensing signals to identify at least one pixel position receiving the input.

In still another aspect of the present invention, there is provided a device for detecting an input to a display device in which a plurality of separately addressable first image component (pixel) positions are arranged in a two-dimensional array, wherein the separately addressable two-dimensional array is provided. Photon sensing means proximate to at least a portion of the first plurality of pixel positions of the apparatus; At least one detection circuit for detecting photons impinging on each of said photon sensing means for a predetermined detection time period; At least one measuring circuit for generating a sensing signal for each of said photon sensing means in accordance with the number or energy of photons detected; And a comparison circuit for comparing and analyzing the sensing signals to identify at least one pixel position receiving the input.

In still another aspect of the present invention, there is provided an emission pixel display device, comprising: a plurality of light emitting elements as display screens arranged in a two-dimensional array; A pixel emitter driving circuit for driving the plurality of light emitting elements to have a predetermined brightness; in relation to each of the light emitting elements in order to (i) intercept photons when the light emitting element is in an emitting state and (ii) detect photons from a source outside the pixel when the light emitting element is not in a light emitting state, At least one photon sensor exhibiting a change in electrical properties in response to a change in the incident photon; And (i) a first electrical parameter as an indicator of luminance emitted from a source external to the pixel and display, related to the photon sensor during the non-emission time, and (ii) to the photon sensor during the emission time, At the end of the second emission time period portion for measuring a second electrical parameter as an indication of the luminance emitted from the pixel, to the second voltage across the photosensor, to a second current from the photosensor, or to the photosensor An emission pixel display device comprising at least one voltage, current and charge readout circuit for measuring a second charge generated by the present invention.

In another aspect of the invention, the invention provides a display device or panel incorporating pixel structures and devices and embodiments of sensor structures and devices, the circuits and methods and processes of which are described in this regard. For example, the present invention provides flat panel display devices for use in computing, entertainment, television, PDAs, automotive display devices, graphic display devices, home applications, and / or other information or display devices.

1 is a diagram illustrating an embodiment of an OLED pixel array on a glass substrate on which an optical sensor array is disposed.

2 is a diagram illustrating an embodiment of a manually driven OLED in which a solid passive sensor array is installed on top of the OLED array.

3 is a diagram illustrating an embodiment of a sensor array in which the penlight's laser pointer operates one of the sensors in the array.

4 is a diagram illustrating an embodiment of a sensor array exposed to ambient light but shadowed by an optically dense object such as a finger or a stylus.

5 is a diagram illustrating an embodiment of a sensor array in which a red LED or laser penlight exposes sensors in the array through a red filter.

FIG. 6 illustrates an embodiment of a sensor array using a glass plate having a red LED that provides red light at one edge of the glass plate and a stylus that scatters red light through the red filter to operate one sensor in the array.

FIG. 7 employs a sensor set extending below the full length of the column and an additional set of sensors perpendicular to the column sensor extending the full width of the row, with the red penlight actuating one column and one row to locate the penlight. Is a diagram illustrating an embodiment of a sensor array in which can be determined.

8 is a diagram illustrating an embodiment of a top emitting OLED pixel structure.

9 is a diagram illustrating an embodiment of a bottom emitting OLED pixel structure.

FIG. 10 is a diagram illustrating an embodiment of a bottom emitting OLED pixel structure having holes in a light blocking dark shield to block backside ambient light.

FIG. 11 is a diagram illustrating an embodiment of a two-sensor pixel circuit showing a sensor, a photon flux integrator, and a charge amplifier circuit used to read the sensor.

12 is a diagram illustrating an embodiment of a top emitting OLED pixel structure using OLED material as a reverse biased diode photo detector as a sensor for both emitted light and ambient light for a touch sensor.

FIG. 13 is a diagram illustrating an embodiment of a pixel circuit showing a concept for an reverse biased OLED photodiode.

14 is a diagram illustrating a schematic diagram of an OLED device including its biasing features.

FIG. 15 shows an embodiment of a sensor pixel circuit having a dark shield gate and a dark shield bias as well as showing a sensor, a photo flux integrator, and a charge amplifier circuit used to read the sensor.

US Patent Application No. 10 / 872,268, entitled "Controlled Passive Display, Apparatus and Method for Controlling and Making a Passive Display," filed June 17, 2004, filed "Method and U.S. Patent Application No. 10 / 841,198 entitled "Apparatus for Controlling A Light Source", "Passive Matrix Emission Stabilized Flat Panel Display" filed November 19, 2004 U.S. Patent Application No. 10 / 872,344, entitled "Method and Apparatus for Controlling an Active Matrix Display," filed June 10,515,575, filed June 17, 2004, describes flat panel display technology and in particular organic light emitting diodes ( Various features are disclosed for OLED) display technology. These patent applications are incorporated herein by reference.

The structures, methods and features disclosed in these patents include structures for building arrays of optical sensors that are one-to-one matched to the pixel arrays of OLED displays. There is one optical sensing element per OLED pixel. Because feed pack-stabilized displays have built-in sensor arrays, there is an opportunity to use optical sensor arrays to enter data into computers or other devices or circuits that control and drive OLED displays. Therefore, the optical sensor array not only stabilizes the display but may also be used as an optical power or touch screen.

Various different approaches to using the optical sensor array as input means are possible. In one embodiment, to use an optical sensor array that is already provided and used to stabilize the illuminance, brightness and / or other pixel emission or transmission characteristics of an OLED display as a touch screen, stylus or penlight input device, A portion of the line address time period is used to scan to detect which sensors in the array are exposed to light from an input device such as an LED based penlight device or a light-scattering touch plate. In contrast, since in most operating environments ambient light typically reaches the light sensor, there is virtually always a background voltage appearing on the pixel feedback circuit due to the ambient light detected by the sensor or sensing circuit. . If a shadow is cast on one or a group of array sensors, this shadow will be detected when the array sensor is scanned during the portion of the line address used to detect input data and / or peripheral data.

Most displays use refresh rates of 30 to 60 frames per second (fps). A refresh rate of 60 fps means that the frame address time is 16.67 ms. If the display has 100 lines, the address time is 16.67 ÷ 100 or 167 ms. At the start of each line scan, the pixels in the line are turned off so that the only light on the lines in the light sensor array is from ambient light (such as indoor lights) in the display operating environment, or the light input device. From (e.g., from an emitting light pen or from light scattered on a scatter plate). In this example, if 20 percent (20%) or 1/5 (i.e. 167 ÷ 5 = 33.4) of the line write time is used to scan the voltage in the feedback circuit for the sensor, then for detection of the external light input About 33 ms time slots or periods (or a few of them) may be dedicated. This will leave 134 ms for line writing. The circuitry for detecting the voltage on the feedback circuitry is integrated into the drive integrated circuit (IC) electronics and logic used to drive the display and manage the feedback circuitry for display brightness control and stabilization. Details of this type of circuit are well known to those skilled in the art of electricity and are not described in detail herein.

There are a number of structures and methods for inputting optical information into a display screen with a plurality of sensors, and a series of examples are provided below for purposes of illustration and not for limiting the invention, as described herein. It will be appreciated that the focus is on that many other structures and methods may be practiced.

In the first embodiment, an input device in the form of a general ink pen or stylus is used, but the pen includes a foot and a diode (LED) that emits a stream of light or photons instead of ink or other display material. Examples of such LEDs are LEDs that emit at visible or infrared wavelengths, such as red or infrared LEDs. Alternatively, other white, mono, multi, or colored LEDs may be used, and / or the LEDs may emit or become multicolored over a wavelength range. Monochrome LEDs, however, would be desirable because they allow for the optimal combination of light inputs while suppressing other ambient light that is not at that wavelength. Other embodiments may use incandescent light sources. Fiber optic and / or lens systems may be used to communicate light from a light source inside or outside the light pen to the tip of the pen. Optical lens systems in the pen and / or at the tip of the pen focus light at fine points on the optical sensor array. Alternatively, the optical system may produce a substantially collimated beam exiting the pen at or near the tip. The pen is preferably designed to be mounted on the surface of the front glass plate of the display including the sensor array on the inner surface of the glass plate or other transparent surface. Because it is advantageous for the pen to be raised on the outer surface and focused on the inner surface to provide as small a spot as possible, in one embodiment the focal length of the pen-shaped lens system is determined by the distance from the lens system to the sensor array or approximately the glass plate. Will be thick.

Various optical techniques are known in the art for relaying images and creating spots at required locations in space, whereby the optical system need not be a compact lens located at the tip of the light pen. Thus, any optics known in the art to create a desired spot, focused beam, collimated beam, or other photon concentrator that interfaces with one or a few sensors and may be detected by the sensor. It will be appreciated that systems or techniques may also be applied. Since the distance from the tip of the pen to the sensor array remains fixed, the lens system will remain fixed, eliminating the need for expensive adjustable designs.

A dark shield is applied to each sensor of the sensor array to block or attenuate light so that the detection performed to detect the luminance or photon stream emitted by each pixel in the display is not unduly disturbed by ambient light conditions. It is advantageous to be provided and used to block or mask all or a substantial portion of the ambient light. The dark shield is an opaque structure interposed between the sensor and the ambient or external light source, which does not have to interfere with the light emitted by the pixel emitter. The dark shield is preferably composed of deposited metal, or may be formed of, for example, an opaque colored material known in the art as a polyimide material. The dark shield can also be formed from a filter material that blocks most of the ambient light and passes a narrow band of spectrum, such as a 710 nm wavelength that is perceived as red.

Thus, the dark shield when used in combination with a light input system is not absolutely opaque, but rather a filter material that blocks or attenuates most of the ambient light but allows light to pass through or conform to the substantial transmission of a particular wavelength of the LED in the pen. Is beneficial. For example, where the LED is a red LED emitting light in the vicinity of 710 nm, the dark shield is advantageously a 710 nm notch filter or a filter that can be manufactured similarly to such a notch filter. The LEDs can be of any color, and the matching filter can be of any wavelength as long as it matches or nearly matches the LED wavelength in the pen. Of course, the filter pass wavelength range and the LED emission wavelength range must have at least some spectral wavelength range overlap. The resolution of the penlight input system can be as high as the pixel resolution of the display itself. This means that the input system can be used to accurately record block or handwriting, or other graphical or symbolic data or information such as fingerprints.

In a second embodiment, a human finger may be used to shade the sensor array from ambient light. This is a relatively coarse input system, but accurate enough to activate the icons on the display. Moreover, the ambient light will need to be of sufficient intensity on the display where the shadow is detectable with respect to the non-shadowed sensor.

In the third embodiment, the total internal reflection phenomenon in the plate is used. Light entering the edge of a plate composed of any transparent material of a wide range of optical densities (refractive indexes), without light exiting the brand and base surfaces of the plate, provided that the optical density of the plate and the material in contact with the plate are properly selected, It will move from one side of the plate to the other side. Typical glasses surrounded by higher optical density transparent materials are suitable for use. Therefore, a plate made of glass or methylmethacrylate plastic can be attached to the front of the OLED display and sensor array. Red LEDs can direct light to one side of the plate without any LED light impinging on the sensor array since light will propagate throughout the plate without any interference. However, if an object is touched on the plate, the change in the optical interface between the two materials will cause light to escape from the surface of the plate at the point where the plate is touched and be sufficient to irradiate the object touching the plate. If the object is made of or coated with a reflective material (eg, a white material or a material of a color that exhibits high reflectivity to the wavelength of light in the plate), the light will be scattered to the sensor of the nearest array at the point where the scattering plate is touched. This type of light input does not have a light pen of relatively higher resolution, but if a stylus with a narrow tip is used, the resolution is better than using a relatively larger finger tip. It is also possible to use a finger to scatter side input light. The advantage of such an input system is that an object that cannot act magnetically can be used as a stylus or that a finger can be used because the input system is of a shadowing technique and the conditions of ambient light become insignificant.

In the fourth embodiment, the image may be input at a position other than just the position on the screen. For example, an image of a fingerprint may be input to the optical sensor array, placing the image on the surface of the display glass (such as by using ink or collecting moisture or oil from a finger), and taking the image from a light source of external light. It can be captured by shading the light passing through it. If collimated light is used as an external light source, the resolution will increase. Unlike such direct input, a system may be implemented in which a thin film material such as cellophane may be attached to the front of the display with a dispensing roll on one side and a take-up spool on the other side. have. Between the cellophane and the display glass is provided an optical medium such as glycerin that matches the optical density of the scattering plate. Cellophane is placed on or placed in the glycerin layer in contact with both the scattering plate and the cellophane. This makes the cellophane a light receiving top plate. When the finger is pressed into the cellophane, the light will scatter the ridges defining the fingerprint and will be recorded in the sensor array. Other means and methods may be employed to create regions of light on the surface of the display or to generate a plurality of regions of light in the form of an image.

Further embodiments are described in various places in the specification and in the drawings, and the invention is not limited to the specific embodiments described above. In addition, various features and configurations of the structures and methods of the present invention may be used separately or in any combination in the light of the description provided herein, and certain embodiments improve performance or operability, but are not necessarily required. Is not described as an optional feature.

Hereinafter, various embodiments of the sensor array will be described. FIG. 1 shows an embodiment of a display panel substrate such as an OLED display substrate 100 provided with a sensor plate 1. The sensor element 2 is located on the sensor plate 1. The OLED display substrate 100 has an array of OLED pixels 7 disposed thereon. The sensor plate 1 has a sensor array 20 of light (photons) or optical sensors 2 disposed or formed thereon (the sensor plate 1 has a display substrate so that no physically separate plate is required). May be formed integrally). It will be appreciated that the optical sensor may be an optical register, an optical diode, an optical transistor, or any other device that undergoes a detectable change that can be sensed or measured in response to a change in light level, brightness or light flux change. Optically active materials can be selected from a number of materials including, but not limited to, any of silicon, amorphous silicon, cadmium selenide, and poly-silicon, or combinations thereof. Although not shown, preventing the sensor or other inventive features of the array from being hidden may directly affect sensing such as, for example, isolated thin film transistors (TFTs) or other elements or circuits that prevent crosstalk between the sensor and the sensor. Any circuit element not involved. Such structures are illustrated in co-pending patent applications mentioned above and incorporated herein, or are known to those of ordinary skill in the art.

The sensor array 20 has electrical contacts 5, 6 connected to the contact pads 10, 11, respectively, when the sensor array and the OLED display substrate are joined together. The sensor array 20 operates so that feedback to the drive circuitry of the OLED display maintains stable illuminance and uniformity across the display. An example of such a drive circuit is U.S. Patent Application No. 10 / 872,268, filed June 17, 2004 entitled "Controlled Passive Display, Apparatus and Method for Controlling and Making a Passive Display." US Patent Application No. 10 / 841,198, entitled "Passive Matrix Emission Stabilized Flat Panel Display" filed November 19, 2004, entitled "Method and Apparatus for Controlling A Light Source" US Patent Application No. 10 / 515,575, filed June 17, 2004, entitled "Method and Apparatus for Controlling an Active Matrix Display," one or more of US Patent Application No. 10 / 872,344, entitled Convention It is illustrated where the driving circuit of may be used or is known as a prior art.

The present invention discloses a sensor array that can control the illuminance or luminance uniformity of an OLED or other display as well as be used as an input device that operates somewhat similar to a computer touch screen or light pen input device. The sensor array may for example be used as a touch screen without deformation of the sensor system on the glass substrate. That is, in the case of an active matrix where emission feedback is being implemented, the touch screen sensing system may be an emission feedback sensor system at the same time and vice versa.

Thus, in one aspect, the present invention provides a method for detecting an input to a display device in which a first plurality of separately addressable picture component (pixel) positions are arranged as a two dimensional array. In one embodiment, the method comprises providing a two-dimensional array of photon sensing elements proximate at least a portion of a first plurality of separately addressable pixel locations, impinging upon each of the sensing elements for a predetermined detection time period. Detecting a photon, generating a sense signal for each of the photon sensing elements in response to the number or energy of the detected photons, and detecting the at least one pixel location receiving the input signal. Analyzing.

In another embodiment, a plurality of sensing elements may have corresponding OLED pixels arranged in alignment with the sensing elements. The photon sensing element may be provided in proximity to each of the first plurality of separately addressable pixel locations. The sensing element provided in proximity to each pixel position may comprise a sensing element provided in the structure of each pixel at the pixel position. The photon sensing element may be provided in close proximity to every Nth row and every Mth column of the first plurality of separately addressable pixel positions, where N and M are between 1 and the maximum number of pixels in N rows and M columns. It may be independently selected as a positive integer of. The sensing element may act as a light flux integrator, alone or in combination with other elements.

In one embodiment, the sensing element is provided at every pixel position, but may not be provided at every pixel, but instead may be provided at a different position. The precondition would be whether the pixel spacing is different or the same for the rows and columns. For example, sensing elements are provided every 2, 3, 4, 5, 6, 7, 8, 9, 10, 20, 50th, or every other value between them and at every larger value in the row and column dimensions of the display. An embodiment is possible. Alternatively, the sensing element may be provided according to a predetermined or dynamically determined sensor interval, pixel color or other regular or irregular pattern.

The display may be a color display with black / white, monochrome, or a plurality of different color pixels. The plurality of different color pixels include red, green and blue pixels or any other set of colors, in particular colors that provide the ability to generate and combine any color for the viewer of the display. The sensing element may be provided only for pixels having certain specific emitter colors (such as red, green and blue emitters), or may be provided for all emitter color pixels.

The pixel sensing element may not be deformed or may be deformed so that modifications to the light blocking shield (dark shield) are made. For example, such modifications include providing holes, apertures or areas of less opacity (more transparent) so that some light can enter the pixel and hit the sensor. These holes or other modifications cause external light signals to reach the sensor, which is brighter than the ambient light from the light pen, or darker than the ambient light picked up as shades by an opaque, partially transparent or translucent object. It is particularly useful for detecting or allowing detection by a sensor.

Embodiments of the present invention may allow some pixels to have light blocking dark shields without holes and other pixels to have holes, apertures, or other modifications such that light from outside the pixel and outside of the display device is in it. For example, the separately addressable pixel may include a light shield that attenuates at least a portion (or the entirety of the pixel) at least a portion of the photons from the ambient light incident on the display from an external light source. The light shield may comprise a metallic nearly opaque layer or a nonmetallic layer. The light shield comprises a filter material, which is neutral in the spectrum, or a light input device (such as a 710 nm laser) while the broad spectrum ambient room or environmental light (such as white light) is completely or nearly blocked or attenuated. Is a spectrally selectable material such that narrow spectral light from the light is transmitted to the sensor or sensing element through the dark shield. In one embodiment, different opaque shields and / or filters may be used differently in different pixels.

In contrast, the light shield is provided with a deformation portion in each of the photosensitive elements, in proximity to the photosensitive element, or near the photosensitive element such that the attenuation of the ambient light is less than that of the portion surrounding the light shield. It may also include. Such a deformation may be an aperture having an area smaller than that of the light sensing element. Such deformations may be apertures comprising holes in the light shield. The aperture or aperture can be sized or dimensioned such that a suitable amount of light (an appropriate number of photons) reaches the sensor during sensing or integration time so that light or shaded input can be detected.

FIG. 2 shows an embodiment of a schematic functional part for using the sensor array 20 of the sensor 2 as a light pen 60 input sensor device and system. Only devices and circuit elements that participate in the operation of the light sensing device and system are shown and illustrated, and devices and circuit elements that are essentially conventional elements have been omitted to avoid obscuring the present invention. In addition, exemplary array matrix display light generation and pixel drive circuits and methods are disclosed herein as disclosed in the co-pending US patent application or as known in the art as incorporated herein by reference. .

The data reader circuit 71 is connected to the voltage divider between the voltage divider resistor 25 and the sensor element 2 via the isolation TFT 40. The voltage divider includes two resistors placed in series between the supply voltage and ground. The voltage drop from the supply voltage to ground is the total voltage. However, the voltage at the node between the two resistors is proportional to the total voltage as determined by the ratio of each resistor to the total resistance of the two resistors, for example two resistors connected in series between a 10 volt supply and ground. If the total resistance of is 20 ohms and each 20 ohms consists of two resistors of 10 ohms, then the voltage at the node between the resistors is [10 volts-(10 ohms / 20 ohms) x 10 volts], 5 volts. Becomes If the resistance of the resistor between the 10 volt power supply and the second resistor is reduced to 5 ohms, for example, the voltage at the node between the registers is [10 volts-(5 ohms / 15 ohms) x 10 volts = 6.7 volts] to 10 volts. Move closer to the power source. If the optical resistor is a resistance between the 10 volt voltage source and the second resistor, the resistance of the optical resistor depends on the intensity of the photon stream hitting the optical register, so the voltage at the node between the two resistors is 10 volts depending on the luminance level. Will move closer or farther to the voltage source.

Thus, embodiments of the sensor array 20 are used to sense additional light on the periphery protruding from a light pen or other light emitting device, or compared to the periphery caused by shading from an object such as a stylus or other pointing tool. It may be used to detect a decrease in light. The pixel sensor may be used as a light or dark actuation input device. In one embodiment, the photon sensing element is configured to sense the photon wavelength (energy) and luminance emitted by an external photon emitter, such as a light pen, carried by the stylus. In another embodiment, the photon sensing element is adapted to sense an amount of luminance received from an external photon emitter carried by a stylus higher than the amount of ambient background luminance received by the photon sensing element that is not illuminated by the external photon emitter. It is composed. In yet another embodiment, the photon sensing element is adapted to sense an amount of luminance received from an external photon emitter carried by a stylus lower than the amount of ambient background luminance received by the photon sensing element not irradiated by the external photon emitter. It is composed. External photon emitters may include light emitting diodes (LEDs), incandescent photon emitters such as incandescent bulbs, or any other light emitting device.

When the illuminance (luminance) of the OLED pixel in line 1 (and any other line as appropriate) rises, the resistance of the sensor 2 decreases (or increases in conductance) so that at each of the voltage dividers the detected voltage 30 ) Will increase to +10 volts (or other turn-on voltage) provided by the select drive circuit 16. In this embodiment, this sensed voltage 30 is used to determine when the pixel achieves the correct illuminance (luminance). This operation just described is known to occur when addressing the first display line or line one. After line 1 is addressed, the scan moves to line 2 and proceeds in this manner until all lines (or any given set of lines) are operated on the image in the first frame.

The addressing of each line is assigned a time period. Address time is typically defined as the inverse of the frames per second divided by the number of lines in the display. Thus, in a QVGA display with 240 lines and a frame rate of 60 frames per second, the line address time is approximately 70 ms. Since the system, apparatus and method of the present invention can be used with various display types and sizes, the addressing time of 70 ms is only an exemplary figure.

In order to use the sensor array 20 as a light pen 60 input device, a portion of the dirt time will be reserved as a period for the light pen input. For example, in an apparatus, system, and method having, for example, a 70 ms address time, the first 10 ms of line address time would be used for a light pen input. During this time (or a portion of this time), the entire pixel in the line to be addressed is switched off so that the light emitted from the OLED or other display type pixel does not reach the sensor 2 of the line being addressed (OLED display is seen). Is just one example of a display type that would benefit from the invention). The absolute period of time or part of time while all the pixels in the line to be addressed are switched off so that no light is emitted from the OLED is determined by the gate line enable line resistance (see FIG. 13) and T1 and Is determined based on factors such as the RC time constant, which is multiplied by the total capacitance of all gates of T3. Another factor is the RC time constant, which is the product of the data line resistance multiplied by the capacitance of C1. Typical RC time constants for the gate enable line are 1 to 10 Hz. Similar RC time constants would be applicable to data lines. These two RC time constants do not need to be summed together since the lines may be active at the same time and data may be transmitted at several kilohertz. Manipulation of the RC time constant and how to apply this RC time constant to drive a display is well known by flat panel display designers.

For example, the period should be long enough that the sensed signal is long enough given the amount of light (luminance or photo flux) but not enough to saturate the sensor 2. Also, while the display brightness is maintained at an acceptable level, enough address time remains to display the image so that the row addressing time is a small percentage of the on time of the pixels, typically the length of one frame (e.g., the inverse of the number of lines). It is advantageous that a generally amount of time reserved for image row addressing can handle pixel or display luminance levels (eg, having about 1% row address time for a 100 line display).

Thus, the time allotted for touch sensing and image addressing will typically depend on the time it takes to obtain the sensing measurement and how long it takes to transfer the image data to the pixel. For example, if it takes 10 ms to transmit the image data and 10 ms to measure the sensor data, the pixel would have to be made dark by first deleting previous imaging data from the pixel. In one embodiment, the amount of passing image data (zero value) to the pixel to turn off the pixel consumes 10 microseconds, and reading the sensor may cost another 10 microseconds for a total of 20 microseconds for the sensor reading portion. will be. The remaining time for transmitting the image data would be only 10 ms in this case. This 10 ms time is just an example.

At this point, any light on the sensor 2 of the line is due to the light pen or other light or light rays or photons 62 emitted from the photon emitting device 60. The data reader 71 reads the voltage developed in the voltage divider register 25, and the sensed voltage data readings are stored in the data buffer 70, which can be any buffer known in the art. Do. The data in the data buffer 70 is queried, read and / or analyzed by software or other means located in the processor or computing unit (or separate processor, computer or other logic) 72. The systems, apparatus, and methods of the present invention may incorporate a processing unit or computing unit, or may communicate in combination with an external computing or processing environment. The details of the processing or computing section are not shown nor further described as such processing, operations, or other hardware and / or software and logic are well known in the art.

After the data is read by the data reader 71, the data reader 71 switches off the circuit using any form of switch or switching logic, and the system displays a normal display for the balance of the remaining 60 ms of address time. Invert mode. In one embodiment, the delay amount is refreshed at a rate of 60 times per second. This refresh rate is much faster than that required for pen light input, and the input or movement of the light beam from the pen or other light source ranges from about 0.01 microseconds to several seconds, more typically from about 0.1 seconds to about 1.0 seconds or Manual movement is made equivalent to about 6 to 60 frames to repeat the measurement. Because the user may be moving the penlight at a faster rate than 0.1 seconds. A typical user would stop moving the pen light 60 when trying to identify an input location on the screen. Longer or shorter durations may be used so that the present invention is not limited to a specific range, for example, if the input system is desired to be able to trace continuous movement, the optical input sensing frequency achieves the required capture of the continuous movement. It may be increased as required to do so.

This means that the data being read by the data reader 71 can be updated several times during the use of the penlight, so that the sensed data is integrated over time (or over multiple read cycles) to be cleaner. And to provide a relatively noise free reading. If higher reading speeds are required, such as when capturing continuous movements or paths, a smoothing algorithm may optionally be applied to minimize the sharpness in the curve that may produce noise. Also note that the information collected during the pen light input (or shade input) time is a digital or binary input with one of 1 or 0 values rather than the shade of gray required. Other embodiments of the present invention will provide some range of input or shades of grey so that equivalents of pressure or position and some other data may be entered.

One of a variety of different ways to read a sensor may be employed within the spirit of the invention. This approach includes reading the sensor during the display row addressing time, reading the sensor during the frame dedicated to sensor input, reading the sensor during the selected dedicated frame when the screen is touched, reading the sensor during the vertical-retrace time, and And / or one of the readings of the sensor during the horizontal-retrace.

In one embodiment, the sensor is read during the display frame row address time. For example, a two-dimensional display array may be arranged as a frame having a plurality of rows and a plurality of columns, each row including a row write address time and a plurality of rows and columns while a row of pixels is being written. All pixels of the display have a frame time while being written, and the sensing elements in each row are read during a portion of each row write address time. The read may be justified for all or part of the row write address time. In one example, a portion of each row write address time is a portion between 0.001 and 0.5 of the row address time, a portion of 0.01 and 0.2 of the row address time, a portion of 0.01 and 0.1 of the row address time, or 0.1 and a portion of the row address time. May be part of 0.5.

In yet another embodiment, the sensor is read during a frame dedicated to sensor input. For example, a two-dimensional array may be arranged as a frame having a plurality of rows and a plurality of columns, each row being written at a write frame time during which all pixels of the display comprising the plurality of rows and columns are written. The row read address time while the row of sense elements is being read, the row read address time is issued during the sensor read frame time separate from the pixel emitter write time, and all rows of the sense elements are read or multiple sensed. It is read out for a plurality of row read address times during the read frame time which does not overlap the write plane time and read frame time dedicated to the element.

In another embodiment, the sensor is read during the selected dedicated frame when the screen is touched or illuminated by the light pen. For example, the plurality of sensing elements may be read for a dedicated sensor reading time. This dedicated sensor reading frame can be arranged to occur only or periodically on a display screen that receives a given input. For example, the predetermined input may include physical contact with the surface of the display screen. Such physical contact may include physical touching with a finger or a tool or stylus shaped object.

Alternatively, the predetermined input may include a predetermined magnitude change in photon flux luminance over which a display screen is over a portion of the surface, and the predetermined input includes a non-contact change in a parameter proximate the display screen surface. The contactless change may be selected from a set of localized temperature changes, capacitance or charge concentration changes, flux changes, local higher or lower photon fluxes or luminance changes, and / or changes consisting of two or more combinations thereof. .

In yet another embodiment, the sensor is read during the vertical-retrace time between successive display frames. Note that the vertical retrace time is the time between successive frames between successive frames, and that the horizontal retrace time is the time between sequential line (or row) writes (directly on a flat panel display such as an OLED display). Although not considered applicable, the vertical retrace time in conventional CRT displays is the time it takes for the electron beam to travel from the bottom of the CRT tube to the top of the CRT tube.)

For embodiments in which the sensor is read during the vertical-retrace time, it is advantageous to provide separate or additional sensor lines. The circuit configured for reading during the display vertical-retrace time is the same described photon flux integrator circuit without modification. Instead of the TFT T3 (second TFT) connected to the same line L2 to which the gate line for T1 is connected, there is another separate gate line dedicated to the TFT T3. With this structure, regular feedback sensing for emission luminance control is performed during the line address time, and then when all the lines are written, all the sensors are read again to apply any touch or light / shading input before the next frame starts. Detect. Typically, the vertical retrace time is 10% to 50% of the total frame time, but may be longer or shorter than this. Thus, in one embodiment the sensing element is read by a sensor line separate from the sensor line used to read the pixel emission luminance, and the reading of the sensor is controlled by a separate touch sensor controlled through the gate terminal of the transistor. do.

In another embodiment, the sensor is read during the horizontal-retrace time. It would be desirable to employ separate sensor and control lines for horizontal retrace time sensing. In one embodiment (see FIG. 11), the gate line for T4 is connected to the horizontal line L5 while the line L5 is an additional line dedicated to actuating the gate of T4 during sensor reading.

The embodiment of the system and apparatus illustrated in FIG. 2 illustrates the use of any pen light or light source 60 without filtering of light from any pen light. In this mode of operation, the sensor array 20 is configured to display ambient light (at lower than the typically higher luminance of the penlight 62 or lower luminance of the shaded portion of the display from an object placed or positioned in front of or near the display screen). 63).

Alternatively, the embodiment illustrated in FIG. 3 is the same sensor array structure, but uses an optically dense object 64 that extracts the shaded or attenuated signal 61 on one sensor 2 within the sensor array 20. The structure which does not require a separate light source, such as the light pen 60 which emits the photon beam in the output beam 62, is shown. The process for implementing such shading is practically similar to the input of the light pen described above, but the success of the shading embodiment is the illuminance between the ambient light 63 and the shade 61 on the sensor 2 of the sensor array 20. Relative brightness). It is desirable to ensure that optically dense objects have fine points or that shadows can be located within small areas on the display. In one embodiment, the optically dense or opaque portion is formed at the tip and the rest of the stylus, or is formed of a structure or optically transparent material that minimizes the handle carrying the tip or does not extract strong shadows. Algorithms may optionally be applied to detect known stylus shaped terminal points or tips so that input at the tip can be easily identified even when shading is taken from the stylus or handle.

Accordingly, it will be appreciated that in addition to the apparatus and method for detecting an increase in brightness from other light or photon light emitting devices, sensor 2 and sensor array 20 may be used to detect shaded input. In at least one embodiment, the apparatus and method may simultaneously monitor higher and / or lower luminance input relative to the background. In another embodiment, the user may change a parameter for the display to change from penlight input to shaded input.

Thus, in accordance with at least one embodiment of the present invention, the photon sensing element may be configured to sense photon wavelength and energy and the amount of luminance emitted by an external photon emitter carried by the stylus. In another embodiment, the photon sensing element may be configured to sense an amount of luminance received from a stylus carrying external photon emitter that is higher than the amount of ambient background luminance received by the photon sensing element not irradiated by the external photon emitter. It may be. The stylus carrying external photon emitter may comprise a light pen, and the external photon emitter may comprise a light emitting diode (LED) or fluorescent photon emitter. In any of these embodiments, optical systems or refractive index transfer trains and / or refractive optics may be employed to shape and control the distribution of light and the path of light at the display front or sensing elements. For example, an optical lens system may be employed to receive light emitted from the LED and focus the spot of light on the sensor plane in front of or below the display screen.

Figure 4 has the same sensor array and circuit as in the embodiment of Figures 2 and 3, but penlight 60 emits light in a narrow spectral wavelength band, such as red light 65 (because of photon source emission characteristics and And / or from spatial filtering in penlights), the embodiment of the invention differs in that this light passes through the spectral wavelength filter 72 and reaches the sensor 2 of the sensor array 20. This figure shows an optical lens system that focuses light from an LED or other light source at a narrow point, or a penlight that can employ a narrow waisted beam that generates a very high resolution by irradiating a single pixel sensor at the same time. The structure of is not shown.

Indeed, a high resolution optical system may be used to detect handwritten characters and provide a foundation for recognizing these handwritten characters. In one embodiment where the pen light is used for capturing and recognizing handwritten characters, the pen light or other light emitting stylus device remains obliquely on the glass or other surface of the display to print or shed a handwritten sample such as a signature or other handwritten message. A uniform or near uniform distance from the sensor array is maintained during the trace. A filter is used as the dark shield that protects the sensor array from all or part of the ambient light. Various combinations of emitters and filters may be employed to provide the required difference between the ambient light and the light pen or stylus light.

In at least one embodiment of the invention, it will be appreciated that the OLED pixel emitter may be selected such that the required color display characteristics of the image can be generated. Since the same sensor used to detect and maintain the required illuminance and luminance levels of the display pixels is used to sense the light pen input, the pen light spectrum must be within the spectral response of the sensor, but the pen light emitter must It is not necessary to have the same spectral characteristics as other display pixel emitters. The pen light spectrum may be, for example, both monochromatic and multicolored spectra, and an infrared penlight emitter may be employed where the sensor 2 may detect invisible spectral components such as infrared spectral components.

It will be appreciated from the description herein that the filter is aligned with the sensor to block ambient light but passes light from a particular color terrain laser or LED or light from a specific color or spectral metering. Directed and scattered metering embodiments are described elsewhere herein. Embodiments of the present invention block most of the ambient light that is not at the baseband of the filter but place a spectral selectable filter in the optical (light) path between the source of ambient light and the sensing element to transmit light from the input light source. Let's do it. In one embodiment, the spectral selectable filter will be a filter that substantially transmits red light. In yet another embodiment, the substantial transmission of certain light will be at least 50 percent, at least 70 percent, at least 90 percent, or at least 95 percent. In yet another embodiment, the substantial transmission amount is between about 10 percent and 100 percent.

The particular spectral light transmitted will be red, green, blue or any other color. In one embodiment, the spectrally selectable filter is a filter that transmits photons having a red wavelength substantially in the range between 700 nm and 710 nm. In one embodiment, the spectrally selectable filter is a filter that transmits photons having a wavelength substantially in the range between 400 nm and 800 nm.

In one embodiment, the ambient light providing the input signal for pointing includes light (photons) from red metering that is confined to the plate by total internal reflection and directed to the sensing element by alteration of the surface interface. . In yet another embodiment, the ambient light providing the input signal for pointing comprises light (photons) from a red light emitting diode directed to the red laser light or sensing element.

In one embodiment, the use of color Jeanne spectral filters may be combined with any sensor reading scheme. For example, in one embodiment, in one embodiment of the apparatus and method of the present invention, the spectrum selective filter is disposed between the optical (light) path between the light source of the ambient light or input light and the sensing element, the optical input device being a spectrum It emits light at a wavelength within the pass band of the selection filter and includes a sensor where the photon sensing element is read during the display vertical retrace time.

Referring to FIG. 5, another embodiment of the present invention is illustrated in which a passive stylus 68 is used to enter information into the sensor array 20. This system employs a glass plate 67 having light 69 from the edge 66 of the glass plate 67 (or any other transparent material). In one embodiment, edge illumination is provided by red light from an array of red LEDs 69 provided at one edge 66 of glass plate 67. As long as glass plate 67 or other transparent material has a relatively clean surface, red LED light leaves glass plate 67 and passes straight through glass plate 67 without light impinging on sensor array 20. When the point of the stylus 68 is pressed obliquely to the glass plate 67, the change in the refractive index and the optical density of the air (where the stylus is not touching) and the stylus 68 (where the stylus is touching) changes with the glass plate ( Light is emitted at the front of 67) and scatters the light at any surface adjacent to the exit point, including the point of the stylus 68 at which the light exits the surface, a portion of which is scattered on the sensor array 20. Where light is detected by the sensor and associated sensing circuits described above. The system will operate in a totally dark ambient environment, such as in a lit interior or at night in a car. Although a fine tip shaped stylus is illustrated, where pointing accuracy is desired, such as when selecting multiple displayed graphical icons, a relatively larger pointing device, such as a human finger tip, may be used instead of the stylus 68. .

Accordingly, embodiments of the apparatus and method of the present invention may utilize a pixel sensor in combination with photometric or edge light that travels in a glass plate or polymer plate and touches the front glass or polymer plate to direct or scatter light back towards the sensing element. have. For example, the display and method may provide a first plurality of photon sensing elements configured to sense an amount of background luminance not associated with an input from an external user and a different amount of luminance associated with an input from a user, where the different The luminance amount may be a larger luminance amount (eg, an amount of luminance from a light source) or a smaller luminance amount (eg, an amount of luminance from a shadow). The greater amount of brightness may be generated from photon emitters located inside the display device having a higher brightness than the diffuse background brightness incident on the surface of the display. The photons emitted from the photon emitter located inside the display device may not impinge on the sensor element but may be completely confined within the first transmission medium (eg, glass plate or polymer plate) such that the tones exit the first transmission medium at the user input location. have. Photons are totally confined within the first transmission medium by total internal reflection in a plate located between the display emitter and the user, and the photons change the surface properties or properties of the plate or the plate surface interface in the second medium. By changing to the third medium, it is discharged from the first permeate medium.

In one embodiment, the second medium comprises a gaseous medium and the third medium comprises a non-gaseous medium. This second medium may be, for example, air, some other gas or fluid. The third medium may be a substantially opaque passive attenuating object such as, for example, an opaque object, a partially transparent object, or a substantially or partially opaque pointing stylus in a solid state, a pen shaped object, a pointing device, an external human finger, or the like. It may also include. In one embodiment, the photons exiting the first medium are scattered by objects external to the display such that at least a portion of the scattered photons are scattered and reflected back toward the display to impinge on the sensor element. Directing photons towards the display and into the sensor element may be accomplished by the surface of the object.

By describing various sensing structures and sensing methods, it will be clearly understood that the pixel sensors can be utilized in various ways to measure and control pixel brightness and sense touch or light input in the present invention. The first plurality of photon sensing elements of the display array are configured to sense an amount of luminance not associated with an input from an external user and another amount of luminance associated with an input from the external user. This other amount of brightness may be a large amount of brightness or a small amount of brightness. This large amount of brightness is generated from an external photon emitter located outside of the display device and the display device is a device having a luminance higher than the diffuse background brightness incident on the surface of the display, the small amount of brightness being near the surface of the display device. Produced by a passively attenuated object having a transmittance of less than 100% disposed, the display device generates a shadow or blocks or attenuates a portion of the diffuse background brightness incident on the surface of the display device.

The invention is applicable to both active and passive display types. Passive arrays are typically inexpensive and economical in commercial systems and devices because they can be configured without the complexity of configuring or providing TFTs, which typically do not require TFTs in passive displays. In order for the passive sensor and passive sensor array to operate as a penlight input or other input or photon sensing device, there must be a means of locating the light on the display panel of the penlight portion.

In one embodiment, the passive OLED display is line scanned so that only one line is scanned at a time. Since this operational feature scans lines in the order from top (first row) to bottom (last row), the functional principle is in the means for determining the one-dimensional position (eg vertical dimension or row position) of the input on the display. (functional basis). Of course, the reverse order or other order may be used, and the present invention may adopt such an order, but this description will focus on the normal operation. Recall that these sensors can be operated as part of a display pixel brightness feedback system and method.

Referring to the embodiment described in FIG. 6, each column 75 of display pixels 76 in the passive display 77 has a strip or ladder sensor 2V developed along the length of each column 75. Therefore, all the light falling on the ladder sensor 2V can only determine or identify the display thermal component of the position, but cannot determine the display thermal component of the position. When operating the passive display in image display mode, in contrast to the localization possible in the active display type, the complete row and column position is fixed by pairing the line (or row) scan position and the column position.

In the strip sensor configuration shown in Fig. 6, two strip sensors 2V and 2H are arranged at an angle of 90 degrees to each other. Therefore, there is one unique sensor strip pair per display pixel. (In the embodiment of the present invention, as in the embodiment in which only ten rows and columns provide the sensor element, when the pixel pointing accuracy does not reach the required accuracy, a sensor element or a ladder is attached to each row and column. Please note that when light is dropped on the display, at least two sensor lines (one vertical line and one horizontal line) are irradiated and the intersection of these sensor lines causes the correct (x, y) or (Row, column) Identifies or pin-points a coordinate location.

7 shows an embodiment of a passive display with a ladder sensor. Only one vertical input is shown and described here to avoid the complexity and confusion caused by showing both vertical and horizontal inputs. The configuration thus shown thus cannot find user input and can only function as a radioactive feedback system, requiring both a set of ladder sensors and a horizontal sensor as shown in the embodiment of FIG. 6. Understand that the strip sensor and the ladder sensor can be interchanged with each other. Until the rung of the ladder touches to form a continuous or necessarily continuous strip, the strip sensor may appear to be a ladder sensor with a thick rung of the ladder.

Pairing these row and column positions is not always useful for the input mode of the penlight operation, because every line (or row) of the display will enter data even if the number of columns is easily determined when light from the penlight falls on the sensor array. The number of lines cannot be determined because it is not in dark mode for the time (see above). To overcome this problem, a second set of horizontal strip sensors 2H is placed on the sensor glass or the substrate at right angles to the vertical sensor 2V. In one embodiment, the first and second sets of sensors 2V are separated by a dielectric layer (not shown). The first set of vertically facing sensors determines the column position of the input and the right or second set of horizontally facing sensors determines the vertical position of the input.

7 shows an embodiment of a passive array 15 comprising a sensor array element 2. Dotted lines 12 and 13 represent an array of OLEDs in one layer and several layers below the passive sensor array element, or an array as a separate structure aligned to the sensor array element. In the embodiment shown, each of the sensors 2 in a particular row is arranged in the form of a sensor ladder with sensor elements 2 connected between the first and second conductors 3 and 4. The conductor 3 is connected to the drive line of the drive line voltage (for example 10 volts or other predetermined voltage) and the conductor 4 is connected to the first terminal 22 of the divider register 23, and The divider register 23 has its second terminal 24 grounded to ground 27. There is one ladder per OLED emitter (indicated by crossed dashed lines). The sensor 2 as shown may be a discrete interconnect sensor element, or the width (and / or other dimensions) of the sensor 2 may be touched or practically touched by a run-like sensor 2. It should be appreciated that the touch may be increased until a continuous strip of sensor material is formed to extend the length of the row (see, for example, the embodiment shown in FIG. 6).

During the line address time for reading penlight input data, the voltage in the voltage divider register 23 is input from the data reader circuit 71 to the data buffer 70. As mentioned above, there is not enough information with the structure shown in FIG. 7 to actually locate the input data by both rows and columns. To achieve this, a complementary right angle set of sensors and circuits must be added. For this reason, the configuration shown in FIG. 2 only works as a feedback system for OLEDs and not as a complete penlight input system. The sensors and circuits shown in FIG. 6 represent configurations showing orthogonal components to provide a complete penlight input system and device structure.

FIG. 6 illustrates an embodiment for a configuration that operates as a complete penlight input system. In this configuration, the sensor ladder has been replaced by a plurality of cross perpendicular perpendicular and horizontal single strip sensors 2V and 2H, i.e. one horizontal sensor 2H for each row and one vertical sensor for each column ( 2V) was replaced. One side or terminal of the strip sensor is connected to a voltage source 3 of 10 volts, for example. The other side or terminal is connected to the voltage divider sensor 2H or the other voltage divider circuit 23. Both the vertical sensor 2V and the horizontal sensor 2H can be connected to equally configured voltage dividers 23, ie one voltage divider register 23 for each horizontal and vertical line.

In the embodiment shown in FIG. 6, columns 2 and rows 3 are activated by light beams 65 from penlights or other sources. In one embodiment, strip sensors 2V and 2H have an aspect ratio between width and length of about 1000 to 1 (1000: 1) while in other embodiments this aspect ratio is greater than about 40: 1. As used herein, the width dimension is a large dimension that extends along the row for the vertical sensor 2V and along the row dimension for the horizontal sensor 2H. Therefore, these dimensions are sensitive. Other aspect ratios may be used without limitation, as long as they have sufficient sensitivity to determine the location of the spot of light in both dimensions.

Note that one way of calculating the aspect ratio depends on one dimension, whether the height or width of the display is calculated for the horizontal sensor or for the vertical sensor. Other dimensions are determined by the size of the area of pixels to be darkened by the sensor. For example, for the sake of arbitrarily one simple calculation, suppose a display of 100 columns by 100 rows has 1 mm by 1 mm pixels and only wants to shade 20% of the pixel area. Since each sensor line occupies 1.1mm in width, the horizontal sensor line occupies 10% and the vertical sensor occupies 10% of the total 20% (because the area that crosses approximately twice). . Since the overall display height and width is 100mm and the sensor's width is only 0.1mm, the aspect ratio in this example is 1000: 1.

One important point in this configuration is that the number and direction of the strip sensors to locate the light spot on the display is sufficient. Conveniently, vertical horizontal and vertical sensor arrays allow for such localization. In the above embodiment, the sets of strip sensors are arranged at right angles to each other. Therefore, light 65 from penlight 60 falls to at least one vertical sensor 2V and at least one horizontal sensor 2H, which is where light 65 is located in the x-y matrix. All other types of inputs identified above work in this configuration. The readout process for this passive display device implementation is substantially the same as already described for the active display device. The data reading circuit 71 reads the voltage of the divider register 23 and stores it in the data buffer 70, and then the data from the data buffer is read so that the computer, processor, or other logic circuit associated with the data buffer 7 is read. Is analyzed by. When light falls or spreads on two different sensors, different logic circuits are used by the computer, processor or other logic circuits to select the location closest to the center of the spot based on the intensity of the sensor signal.

The data buffer 70 and data reader 71 may be implemented in a variety of ways and many circuit forms may be used by those skilled in the art and such circuits or other buffers or data reading means are not described herein in detail.

Referring to FIG. 8, an exemplary embodiment of a top-emitting OLED pixel 202 structure is shown. OLED emitter 204 consists of two transparent electrodes 205 and 206, which can be either cathodes or anodes. Light 208 generated by the OLED or electro-luminescent material 207 between the transparent electrodes emits substantially in all directions depending on Lambertian dispersion. Most of the light exits the top 209 of the pixel and some travels down (down arrow) 210 to hit the sensor 211. Because the OLED material 207 is transparent or at least partially transparent, the ambient light 212 also passes through the transparent electrodes 205 and 206 and the OLED material 207 and strikes the sensor 211. The raw sensor data is therefore a combination of the OLED emission luminance level and the ambient luminance level. To separate or distinguish two luminance data stream contributions (emitted and surrounding), the OLED emission 209 is turned off during reading of the ambient luminance 212. Note that OLED drive TFT 215 is a top gate structure, so that gate 216 protects TFT channel 217 from light emitted from the OLED. The advantage of this structure is that almost all pixel regions have an OLED emitting surface while the TFT circuitry is hidden underneath the OLED or other electro-luminescent emitter structure.

It will be apparent that the systems, devices, and methods of the present invention may use pixel sensors in either up-emitter or top-emitter structures. In this structure, each addressable pixel location comprises a photon emitter supported by the substrate surface and including a layer of emissive material sandwiched between the first transparent electrode and the second transparent electrode, the material being a first A portion of photons emitting upwardly through the transparent electrode and downwardly through the second transparent electrode and emitting toward the substrate, wherein the photon sensing element is disposed between the photon emitter and the substrate and is emitted downward from the photon emitter Intercept The emitters may include OLED emitters or other types of emitters.

9 illustrates a down-emitting or bottom-emitting OLED display pixel 302. In this embodiment, the top electrode 305 is opaque, and light generated by lambertial dispersion hits the opaque cathode electrode 305 and is reflected below or behind the OLED material 307, And exit from the bottom of the structure through the transparent lower electrode 306 to the rest of the downward or bottom emission light 309. Note that the OLED structure 302 in this embodiment does not extend beyond the current drive TFT channel 320 and the sensor 311 is in the direct path of the OLED emission light. However, the sensor has a dark shield 322 that protects the sensor 311 from ambient light entering through the substrate 324, and therefore, the dark shield may interfere with the generation and detection of suitable luminance feedback signals. While protecting the sensor from this structure, this structure may not be suitable for a touch screen system as described elsewhere herein.

An example of a drawback with the down emitter or bottom emitter pixel structure is that compared to the top emitting pixel structure, the emitting area of the pixel can be reduced substantially, so that a higher instantaneous emission level is achieved in order to obtain the same external luminance. The OLED must be driven, which shortens the lifetime of the OLED. Down emitters or bottom emitters are now the most commonly used structures for displays because they initially developed opaque cathodes, which made it difficult to form properly due to processing difficulties. We are currently in the development stage to create transparent cathodes and cathodes that can achieve the proper configuration. An embodiment of a down emitter suitable for use in a touch screen system is shown in FIG. 10 and described in this regard.

It will be appreciated that the system, apparatus and method of the present invention can utilize a pixel sensor in a down emitter or bottom emitter structure. In this configuration, each individually addressable pixel location is supported by a substantially transparent substrate and is interposed between the first opaque electrode and the second transparent electrode, through a transparent substrate and through a substantially transparent substrate. A light emitter comprising a material emitting light downwardly; And a photon sensing element disposed between the light emitter and the substrate to intercept a portion of the photons emitted from the light emitter. Such emitters may be composed of OLED emitters or other types of emitters.

A bottom-emitting or down-emitting OLED display pixel 362 is shown in FIG. 10, in which a hole, aperture, or other transparent or partially transparent area consists of a dark shield for the sensor. This structure may be substantially the same as the structure shown in FIG. 9 and described in this regard. Accordingly, similar reference numerals are used for similar configurations, except that holes, apertures, or other transparent or partially transparent areas 364 are constructed of dark shields in order to allow at least some ambient light to reach the sensor. It is different. In one embodiment, the hole 364 is provided to the dark shield 311 so that the maximum amount of ambient light reaches the sensor 311 (the size of the hole 364 is shown as measured relative to the size of the sensor). Not]. In one embodiment, the hole is formed such that the portion corresponding to the range of approximately 10% to 50% of the sensor is exposed, but this range is not a fixed value, but may vary in ratio.

Another embodiment that provides holes, apertures, or entirely transparent or partially transparent areas is to remove the dark shield 322 (achieved by the top emitter structure described above). Without the dark shield, the touch sensor or optical pen sensor has a sensor that reads something different from the surrounding pixels, thereby indicating the position where the shadowed part or the light spot is. However, there are several advantages associated with having a dark shield. That is, the advantage is that the metal material (if biasing is required), nonmetallic material, or a filter material that filters most of the ambient light but does not filter the wavelength of the pen's light or other light input is advantageous. Since the dark shield 322 is preferably biased, it has the characteristics of an optical transistor. If the dark shield 322 is made of metal, it can be biased to minimize the dark current of the sensor 311. It is well known that a TFT has the lowest leakage value at a voltage near zero (not zero). For example, the n-channel TFT has the lowest leakage value between approximately -3 volts and -10 volts, and the p-channel TFT has the lowest leakage value at positive values of approximately several volts.

11 shows a pixel configuration for using two sensors S1 and S2 in each pixel, and two separate charge amplifying transimpedance amplifiers associated with the pixel and the sensor. The sensor S1 is used to measure and generate a feedback signal for pixel OLED emission data in order to stabilize the display emission characteristics. Sensor S2 is used in touch screen systems. This means that it is possible to simultaneously measure ambient shadows for sensing OLED emission and touch data.

A circuit similar to the circuit and structure shown in FIG. 11 is a U.S. patent application Ser. / 015,638, which is described in connection with FIG. 8 of the above-mentioned US patent application. This US patent application is incorporated herein by reference.

Features of the structure and operation of this circuit are included herein so that the manner in which the OLED light-emitting sensor S1 and the touch / penlight sensor S2 operate can be clearly understood. It is to be understood that the present invention is not limited to the structure of any particular pixel emitter and emitter sensing structure, and that other pixel emitter and emitter sensing structures may be practiced in connection with the present invention.

One feature of the pixel structure of the present invention is that it provides a transition from high impedance to low impedance. This transition from high impedance to low impedance occurs at least in part by the structure, configuration and / or operation of the light emitting sensor capacitor C2. The operation of the sensor S1 for charging or discharging the sensor capacitor C2 becomes a high impedance operation because the sensor S1 has a resistance value of Gig-ohm (10 ⁹ ohms). During the time when charging or discharging is made, the sensor line is separated from the high impedance by the sensor S1 transistor T3. During the read time, sensor transistor T3 releases the connection of sensor capacitor C2 (separated from sensor line L4) to sensor line L4.

The impedance between sensor capacitor C2 and sensor line L4 is only affected by the resistance value of the sensor line, which would normally be approximately 3K ohms in a typical implementation. Thus, the impedance difference is approximately 1 million to 1 (10 ⁶ : 1). Interference caused by noise results in a current flow of nanoamps with approximately a few volts of noise in a Gig ohms impedance system, but with microvolts of noise in a kilo ohms impedance system. In a typical display implementation for extracting noise interference, since the length of the sensor line L4 is long, a measurement may not be desirable when the sensor line is connected to a high impedance system. When the sensor S1 is separated by the sensor TFT T3, any noise affecting the sensor S1 is extracted by a very short line of the pixel circuit, and therefore noise affecting the charging or discharging of the sensor capacitor. There is almost no. These switching and impedance characteristics contribute to the successful operation of the pixel and sensor circuits.

Although specific pixel emitters, sensors, and circuit configurations are disclosed in connection with these pixel embodiments, the present invention is not limited to these specific circuit or device structures, and design variations and specific electrical circuit devices The modification can be made by changing the type of control device to a specific transistor, TFT, diode or the like, and replacing any two or three terminal control or switching means. The transistor is represented by a TFT type transistor, but the present invention can be applied to other than the TFT type transistor. In addition, other configurations for the pixel circuit configuration, such as adding additional circuitry, may be implemented without departing from the scope of the present invention. The type of light emitting device can also be changed to something other than an OLED emitter, for example, an active emitter can be used for an inorganic photon light emitting device or structure, and in addition to a photoresist or photoconductive device, The characteristics of the sensor can be changed so that any sensor device can be used as a substitute if changed accordingly.

One of the advantages of the circuit of the present invention is to provide a system for converting high impedance to low impedance for flat panel displays with stabilized luminescence feedback, such as OLED displays. This is achieved by the circuit of the present invention from the high impedance of the sensor S1 in the pixel during the emitted photon flux integration operation occurring during the frame time (eg, from the display glass or substrate (e.g., voltage comparison amplifier VC1 and switching transistor TFT ( T4)] is achieved. By design of the circuit, the noise in the sensor line L4 is prevented as a result of the sensor line L4 being connected to the high impedance source.

In this regard, it is well known that conductive lines connected to high impedance are affected by electromagnetic interference in the surroundings. This is easily demonstrated from the operation of the positive and negative terminals of the volt meter in an open place. Voltage ranges from a few volts positive to a few volts negative due to radio and television interference. Since the sensor S1 has a resistance value of the Gig-ohm range or more, when the sensor line L4 is directly connected to the sensor S1 without the sensor capacitor C2, the sensor is connected to the sensor line L4. Act as an open circuit. During the photon flux integration time of the sensor S1, the sensor TFT T3 is powered off. In this particular pixel circuit configuration, the power supply line L1 is not separated from the sensor S1, but since the power TFT T2 operates in the saturation mode, the noise on the power supply line L1 is the operation of the pixel or the display. Does not affect. Thus, the change in voltage across the power TFT T2 due to noise does not change the current flowing through the TFT T2, whereby the emission of photons from the pixel diode emitter D1 for all the pixels of the display is stable. State is maintained.

In addition, noise collected by the power supply line L1 causes positive and negative fluctuations in the vicinity of zero volts (near zero volts) during the frame time when the sensor capacitor C2 is charged through the sensor S1. Since the noise is canceled and the voltage of the sensor capacitor C2 after the frame is timed out depends only on the discharge rate of the sensor S1 when the photons are blocked do. During the row address time during which the voltage of the line select voltage line L2 rises and powers the drive TFT T1 and the sensor TFT T3, the voltage of the light emitting sensor capacitor C2 is the voltage at the sensor input position P1. Read by comparison amplifier VC1. This sensor input at P1 is compared with the reference voltage at the other input position P2 to generate a difference or error voltage at the output position P3. The noise does not cause interference while reading the voltage present in the sensor capacitor C2 because the current induced by the noise is in the nanoamperes range and only causes a slight change in the charge in the capacitor C2. to be. However, since there is substantially no current passing through the high impedance, no voltage arises from low level noise interference.

This circuit is referenced to ground and the voltage at Vcap 355. The voltage of Vcap 355 is supplied or transferred to the sensor capacitor C2 327 through the sensor TFT T3 330 and TFT T4 340 transistors during the address time. A light emitting element (e.g., an OLED diode) connected to ground is driven by controlling a current source (e.g., TFT transistor T2). The value of the pixel data, expressed in voltage, is related to the integrated photon flux. The sensor S1 324 and the capacitor C2 327 are connected to the photon flux integrator 339 (with an auxiliary circuit) by a pixel light emitting element (OLED diode), thereby representing a representative, measurable number emitted from the emitter. Photons are incident on the sensor, and the combination of the sensor and capacitor generates a photon count. The combination of sensor S1 and capacitor C2 sums up the total number of photons collected for a specified period of time (in one embodiment, a display frame time of 16.7 milliseconds). This integrated photon flux is a useful measurement because it is more reliable than any instantaneous measurement, has no noise, and provides greater signal amplitude, and the integrated nature of the photon flux is due to the relatively slow response and latency of the human visual system. This results in a better representation of the integrated photons that the observer perceives.

The actual integrated pixel because the integrated reference photon flux is established and the sensor signal is transmitted to the control system and used as a reference for adjusting the data signal applied to the control device during the next calibration period (e.g., the next frame). Photon flux (photons that are effectively emitted by an OLED diode or other emitter) corresponds to the desired value of the integrated photon flux (the number of photons identified during calibration).

Description of some functional features of the example of the pixel circuit is a detailed description of the embodiment of the circuit of FIG. 11. An embodiment of a display pixel having an emitter, a light sensor, photo flux integration, and a control component is described with reference to FIG. In the pixel diode drive transistor T1 310, a drain D _T1 terminal 311 is connected to the image voltage line L3 301, and the first terminal 315 and the power control transistor TFT of the storage capacitor C1 314 are connected to each other. source to the gate terminal (G _T2) (323) of the T2 (320), the gate of the (S _T1) terminal, and 312 is connected, and a line selection voltage line L2 (302) or the control terminal (313) (G _T1) The terminal is connected. In the power TFT transistor T2 320, a drain terminal 321 is connected to a power supply voltage line L1 301. The second terminal 316 of the storage capacitor C1 324 is connected to the source terminal of the power TFT T2 320 and the input terminal 337 of the emitter (OLED diode) 336. The output terminal 338 of the OLED emitter 336 is connected to ground 305. The output terminal 338 of the OLED emitter 336 is also connected to the second terminal 326 of the sensor S1 324 which is connected to the second terminal 329 of the sensor capacitor C2 327. The calibration read voltage Vcal is measured or read at the node made by the connection of the input 325 of the sensor S1 and the sensor capacitor terminal 328. This read node is coupled to the source terminal 331 of the sensor TFT T3 330. The source terminal 332 of the sensor TFT T3 330 is connected to the sensor line L4 304 which provides an input signal at the input port P1 351 of the voltage comparator VC1 350. The voltage comparator 350 receives a reference voltage to the second input port 352 and generates a difference or error signal P3 353 calculated as the difference between the inputs of P1 351 and P2 352. In this embodiment, the sensor output applied as the input to the voltage comparator VC1 350 is also applied to the common node 351 as the drain terminal 341 input of the Vcap TFT T4 340. The source terminal 342 of the Vcap TFT T4 340 is connected to a capacitor charging voltage source (Vcap) 355, for example up to +10 volts, and receives a control signal 344 at the gate terminal 343. These transistors sometimes provide switching for connecting pixel elements and for disconnecting other pixel elements at the same time or at different times, thereby strict management, control and / or measurement of small amounts of voltage, current, charge and / or photon counts. This can be achieved accurately. Note that the characteristics of the source terminal and the drain terminal of the TFT may be reversed depending on the n type or p type material used for the TFT transistor.

Certain elements of the disclosed circuitry, in cooperation with each other, contribute to the operation of the pixel emitter and pixel photon flux integrator, the measurement and calibration operations, and to assist those skilled in the art in reading the specification in understanding the features of the present invention. Several approximate categories can be developed. However, these categories should not be applied to limit the scope of the present invention, as elements of the disclosed circuitry contribute to one or more categories at some time and at other times as specifically disclosed herein. . In this regard, the driving TFT (T1), the storage capacitor C1, the power control TFT T2, and the diode D1 mainly contribute to the operation of the OLED diode emitter. The sensor S1, the sensor capacitor C2, and the sensor TFT T3 mainly contribute to the operation of the determination and generation of the integrated photomagnetic flux measurement. The voltage comparators VC1 and Vcap TFT T4 340 of this embodiment mainly read the integrated photon flux measurements and contribute to determining the difference between these measurements and the reference, thereby emitting pixel as indicated by the measured integrated photon flux. The correction can be applied to adjust the brightness.

The general form and connection characteristics of the circuit elements of FIG. 11 have been described, with a focus on the operation to better understand further features and advantages of the present invention. A power supply voltage (VPS), typically in the range of 10 volts to 15 volts, is applied to line L1 301, where L1 functions as a power source for OLED D1 336 and a charge source for sensor capacitor C2 327. . The present invention is not limited to a specific range, and higher voltages and lower voltages may be used consistently with the device features. At the same time, the line select voltage V _LS is applied to the line L2 302 which turns on the data driving TFT T1 301. At the same time, an image voltage (V _IM ) representing an image to be displayed and which is a reference to the image voltage is applied to the line L3 303 and due to the data driving TFT T1 301 being turned on (conducting), the image voltage ( V _IM ) is transferred by the TFT T1 to the gate G _T2 323 and the storage capacitor C1 314 of the power control TFT T2 320. Thereby, the device current I _D1 is delivered to the OLED D1 336 by the TFT T2 320, and the specific emission level calculated to be the appropriate light emission E _CALC obtained by the image is determined by the OLED D1 ( 336). When the display is newly adjusted by the manufacturer, the image voltage produces accurate pixel / OLED emission values. In one embodiment, sensor S1 324 is physically positioned to contact the semiconductor anode side of OLED D1 336 for optimal light coupling, so that sensor S1 is at least a portion of the light emitted by the OLED during emission, Preferably, in order to improve the integrated photon count and signal strength, collect or block as much as possible the amount of photons emitted. Regarding the luminance, in this embodiment, the sensor S1 receives the same or substantially the same luminance emitted by the OLED pixel, which means that the magnetic flux density reaching the pixel (the sensor portion of the pixel) is, in general, the sensor portion and the emitter. Because the parts are in contact (but not required), they are equal to the magnetic flux density emitted by the pixel (the emitter part of the pixel) (in another embodiment, the sensor S1 is physically disposed in the vicinity of the OLED, thereby making it a useful sensor. Sufficient light to collect or intercept, but not in contact with the anode side of OLED D1]. In one embodiment, the sensor S1 is a photoresist (or photoconductive) sensor whose resistance value decreases with increasing photon flux density emitted by the OLED emitter.

At 60 frames per second (fps), for a frame period T _FR of 16.7 ms, the light emitted from OLED D1 336 acts on sensor S1 324, such that the resistance (R _S1 ) component of sensor S1 324 347 is reduced in proportion to the intensity of light (photon) emission. During the display frame period, the sensor capacitor C2 327 charged to a predetermined voltage through the sensor line by the TFT T4 340 and the capacitor charging voltage source (Vcap) 355 is discharged through the sensor S1 324. . During the frame period, the average resistance (R _ave ) 348 of the sensor S1 determines the amount of charge discharged by the sensor capacitor C2. The voltage at sensor capacitor C2 336 shifts to the ground voltage of G2 306. Since the amount of charge discharged by the sensor capacitor C2 controls or determines the voltage V _CAL at the read calibration voltage node connected between the sensor capacitor C2 328 and the sensor TFT T3 terminal 331, an important parameter is do. Thus, the larger the photon emission from OLED D1, the lower the resistance of sensor S1, and the larger the current during frame discharge time, the lower the voltage remaining on sensor capacitor C2 when sensor capacitor C2 is measured during read time. This readout calibration voltage is a readout value passed to a circuit or other logic circuit that determines the calibration used to calibrate and maintain the uniformity and color balance of the display during normal operation. [In another embodiment of the invention, Provide different read circuits disclosed elsewhere herein. Importantly, the lower the voltage measured at the read calibration voltage node between the sensor capacitor C2 and the sensor TFT T3, the larger the amount of photon flux (pixel luminance) detected or intercepted by the sensor S1.

In one embodiment, another sensor S2 374 is connected in parallel with the sensor capacitor C4 377 to form another separate photon flux integrator. The circuit combining the sensor S2 and the sensor capacitor C4 in parallel is connected to the ground G1 305 at the node 376 and to the drain of the TFT T5 310 at the other node 375. Gate 373 of transistor T5 receives an input from line L5 390, and source terminal 372 of T5 is connected to line L6 to transmit a sensed signal to the transimpedance amplifier circuit of touch circuit 386. . The output of the touch circuit (or light input detection circuit) is connected to the sample and hold circuit. This input touch or light sensing circuit 386 operates substantially the same as the feedback circuit 356, and is not described separately herein.

The circuit of FIG. 11 is different in that it has a feedback system with a photon integrator circuit in US patent application Ser. No. 11 / 015,638, and two photon integrator circuits. The second photon integrator circuit is not a single photon integrator circuit comprising an OLED emission sensor S1 and an OLED emission sensor, but a touch / penlight sensor capacitor C4 and a second touch / penlight sensor for touch / panlight sensors. S2 is included. The first photon integrator circuit provides a sensor for OLED emission behavior, and the second photon integrator circuit provides a sensor for touch or light sensing.

Another difference is that the horizontal line L5 is added and the control transistor T4 is independent of the transistors T1 and T3 for the control TFT T4 which enables the reading of the touch sensor S2. The vertical conductive line L6 is added as a dedicated read line for the touch sensor. The embodiment of FIG. 11 provides a charge amplifier used to read data from sensors S1 and S2.

In operation, 10 volts (or any other desired charging voltage) is applied to the positive lead terminals of charge amplifiers CA1 and CA2. This operation produces 10 volts in L4 and L5, as is well known. The voltages at nodes P3 and P4 are close to zero, which is called the offset voltage. When the voltage at the gate terminals of T3 and T4 rises, that is, when power is supplied to lines L2 and L5, transistors T3 and T4 are recharged (or reset) to 10 volts. The amount of charge necessary to achieve this is removed from the charge amplifier capacitors C3 and C5, which drops the voltage at the negative lead terminals of the charge amplifiers CA1 and CA2. Under these conditions, a voltage difference occurs between the positive lead terminal and the negative lead terminal between the charge amplifiers CA1 and CA2, and the voltage becomes equal to the difference obtained by adding the offset voltages appearing at the nodes P3 and P4. This voltage is sent to the sample and hold circuit (the sample and hold circuit is known, and therefore not described), and used to perform further processing.

As described above, the present invention provides the same sensor S1, sensor capacitor C2, and photo flux integrator circuit elements, which are used for feedback control of pixel emitter brightness and for sensing a touch or light input. Structures and methods. The invention also provides for the use of individual sensors S1, S2, sensor capacitors C2, C4, and individual photo flux integrator circuit elements to sense touch or light inputs and for feedback control of pixel emitter brightness. Examples are included. In these two sensor implementations, the apparatus and method of the present invention comprise: a plurality of first sensing elements for sensing display pixel photon emission and generating an integrated photon flux indicative of pixel brightness; A plurality of second sensing elements for sensing at least one of an external touch input and an external optical input and generating a signal representing the input are provided. Using two separate photon flux integrators provides an opportunity to provide additional flexibility in time of reading the voltage, current or charge associated with the accumulated photon flux. In a single sensor and sense capacitor embodiment, separate measurements can typically be made during periods of no overlap.

While many embodiments of the present invention have been disclosed, it is evident in light of the description herein that the present invention provides, in one embodiment, a type of light emitting pixel display device having a plurality of pixels. Here, each pixel includes a light emitting element and a driving circuit, the driving circuit generates a driving signal for driving the display pixel, and the light emitting pixel display device is characterized in that the at least one photon sensor is arranged in the display device pixel. By detecting the photons emitted by the source outside the display device and the photons emitted by the emitter in the pixel. Internally sensed emitted photons are for display luminance feedback control, and sensed ambient photons are used to detect one or more external light sources or to block input to the display.

In view of the description herein, it is clear that the present invention provides a method, a display, a pixel structure and a bladder pixel device having an integrated brightness and input sensor. Here, the pixel device includes a light emitting device, a pixel emitter driving circuit, at least one photon sensor, at least one voltage, current and charge reading circuit. The pixel emitter driving circuit generates a current for driving the light emitting device at a predetermined brightness corresponding to the image voltage, and applies a driving current to the light emitting device during the frame period. At least one optical sensor exhibits a change in electrical characteristics in response to a change in incident photon flux disposed in the vicinity of the light emitting device, thereby (i) intercepting the measurable photon flux when the light emitting device is in a light emitting state, (ii) When the light emitting device is not in a light emitting state, a photon flux that can be measured from an external source of pixels is detected. The at least one voltage, current, and charge reading circuit includes (i) a first voltage across the photon sensor device, a first current from the photon sensor device, at the end of the first portion of the non-light emitting period during the non-luminous state, Or measure a first charge generated by the photon sensor device, wherein the measured first voltage, first current, or first charge is emitted from a source outside the pixel during the first portion of the non-luminescing period. Indicates. In addition, the at least one voltage, current, and charge readout circuit further includes (ii) a second voltage across the photon sensor device, a second current from the photon sensor device, at the end of the second portion of the light emission period during the light emitting state, Or measuring a second charge generated by the photon sensor device, the measured second voltage, second current, or second charge representing the measured luminance emitted from the pixel during the second portion of the emission period.

12 shows a cross section of an OLED pixel 501, in which part of the OLED material is used as a reverse bias sensor or photodiode. The structure of an OLED pixel can be used as an inverse bias diode for measuring OLED pixel emission and ambient light for pixel brightness stabilization (the illustrated embodiment of FIG. 12 shows an emitter structure at the top, but an emitter at the bottom The structure may also be configured differently according to the structure and principles disclosed herein). The black cathode layer 510 is interrupted across the OLED diode structure 520, indicated by circles. As a result, the cathode 510 of the OLED diode 520 may be biased independently of the light emitting OLED unit 530.

In order for the OLED to emit light, the OLED pixel is biased in the forward direction, and by this forward biasing, the hole current flows into the hole transport layer HTL 514 (see FIG. 14), and the electron current flows in the electron transport layer. Flow to ETL 512 and is bonded at recombination layer 513. If electron current 540 and hole current 541 produce combined light in the form of photons 542, the wavelength (color) will depend on the energy difference between the hole and the electron.

In this embodiment, the top layer is the cathode 510, and in this example, the cathode 510 is biased with zero volts and is common to the detector 520 and the light emitter 530 of the pixel structure 501. do. The next ETL layer 512 is also common to both the light emitter 530 and the detector 520. The recombination layer 513 is located next to the electron transport layer, and the emission of light 542 is produced by the recombination of electrons from the electron transport layer TEL 512 and holes from the hole transport layer HTL 514. The next layer below is the hole transport layer HTL 514. In this embodiment, two separate indium tin oxide ITO layers 515 and 516 are provided. The ITO electrode 516 in the light emitting portion of the OLED 530 has a forward bias voltage (in this embodiment, a forward bias voltage of +6 volts) to forward bias the OLED to the light emitting mode, and the sensing portion of the OLED The ITO electrode 515 has a reverse bias voltage (in this embodiment, a reverse bias voltage of -10 volts) to reverse bias the sensing portion. When a reverse bias voltage is applied to any diode, a large space charge region is created. When a photon enters the space charge region, holes and electrons are generated, and due to the high electric field generated in the space charge region, there is a sudden sweep in the opposite direction. As a result of this, the magnitude of the photocurrent depends on the photon flux entering the space charge region. The current generated by these photons is described in the example of US patent application Ser. No. 11 / 016,372, filed December 17, 2004 under the name "Active-Matrix Display and Pixel Structure for Feedback Stabilized Flat Panel Display." Is used to change the flux integrating capacitor C2. The patent document is incorporated herein by reference.

FIG. 13 shows a pixel circuit configuration for an example of an OLED diode sensor, such as a sensor corresponding to pixel region 520 of FIG. 12. Thus, OLED devices can be used as both photon and photon sensors. In this case, sensor line 550 transfers a negative sensor voltage through TFT T3. In this embodiment, the negative voltage is -10 volts, but other voltages may be used. Since reverse diode D2 is connected across capacitor C2, diode D2 discharges capacitor C2 to ground. The rate at which D2 discharges capacitor C2 depends on the photons (luminance level) received by sense diode D2 from OLED light emitting diode D1. Thus, the voltage remaining on capacitor C2 after the frame integration time corresponds to the average luminance level of diode D1 (or other sensing element) during the frame period.

In order for the OLED to emit light, a forward bias voltage is applied to the OLED, which flows hole currents and electron currents into the light emitting layer of the OLED structure, as shown in FIG. This voltage application occurs in the OLED emitter portion of FIG. In the recombination region, light occurs when the hole current and the electron current combine. Since the photon emission is distributed almost randomly in all directions, part of it exits the recombination region on the side of the space charge region of the OLED sensor portion of FIG. As photons enter the space charge region, electron / hole pairs occur and are separated into individual hole photocurrents and electron photocurrents. Capacitor C2 is an optical integrator capacitor precharged to -10 volts. This is a charge for reverse biasing the OLED sensor. As the photocurrent is generated, the photocurrent reduces the charge across capacitor C2 because the positive photon hole current moves to the cathode side of capacitor C2 and the negative photoelectron current moves to the anode side of capacitor C2. Eventually, all the charge in capacitor C2 will be canceled by the current generated by the light. The size of capacitor C2 is generally designed such that the maximum brightness from diode D1 results in 90% discharge of capacitor C2. Thus, all levels of grayscale luminance emitted by diode D1 leave the charge of capacitor C2 between full charge of grayscale 0 and grayscale 255. In practical terms, this 90% discharge level works very well and may adopt other discharge levels, in which case it will produce a corresponding grayscale range.

15 shows an embodiment of a sensor pixel circuit having a biased dark shield gate and a dark shield bias line, in addition to a sensor, a photo flux integrator, and a charge amplifier circuit for sensor reading. While a single sensor implementation is shown, it can be seen that two or multiple sensor configurations can provide similar to the configuration of FIG. 11.

The above description is for the purpose of explanation, only specific names are used for understanding of the present invention, and those skilled in the art can recognize that no special explanation is required to practice the present invention. For example, well-known circuits and devices are shown as block diagrams or schematic diagrams in order to avoid unnecessarily distracting from the underlying invention. Thus, the foregoing description of specific embodiments of the present invention is for illustration and description only, and not for limiting the scope of the disclosed invention, it can be seen that many variations and modifications from the above description. Embodiments have been selected and described in order to best explain the principles of the invention and its applications, and those skilled in the art can use various embodiments and variations to suit particular applications. The scope of the invention is defined by the following claims and their equivalents.

Claims (128)

An emission pixel device having an integrated luminance and an input sensor, Light emitting element; A pixel emitter driving circuit for generating a voltage for driving the light emitting element to have a predetermined brightness corresponding to an image voltage, and applying the driving voltage to the light emitting element for a frame time; (i) intercept the measurable luminous flux when the light emitting element is in the emitting state; and (ii) in order to detect the luminous flux measurable from a source outside the pixel when the light emitting element is not in the emitting state. At least one photo sensor disposed to exhibit a change in electrical properties in response to a change in incident photon flux; And (i) a first voltage across the photosensor, a first current from the photosensor, or a first charge generated by the photosensor at the end of the first non-emission time period portion during the non-luminous state; (ii) at least measuring a second voltage across the photosensor, a second current from the photosensor, or a second charge generated by the photosensor at the end of the second emission time period portion during the luminous state; One voltage, current and charge readout circuit Including; The measured first voltage, first current or first charge is an indication of the measured luminance emitted from a source outside the pixel during the first time period portion, and the measured second voltage, second current or second The charge is an indication of the measured luminance emitted from the pixel during the second time period portion, Emissive pixel device. The method of claim 1, At least one charge storage element connected to the sensor for accumulating or releasing charge and simultaneously displaying a capacitance charge and a voltage proportional to the charge; And A control circuit for controlling charging and / or discharging of the at least one charge storage element in response to a change in electrical characteristics of at least one of the photosensors during at least one of an emission state time period and a non-emission state time period. Emissive pixel device further comprising. The method of claim 2, An emission pixel, wherein the control circuit controls the charging and / or discharging of at least one of the charge storage elements in response to a change in electrical characteristics of at least one of the photosensors during the emission state time period and the non-emission state time. Device. The method of claim 3, And the light sensor comprises a photoresponsive sensor. The method of claim 4, wherein And the photosensor further comprises at least one charge storage element. The method of claim 5, Emissive pixel device, wherein a first voltage across the photosensor, a first current from the photosensor, or a first charge generated by the photosensor is measured based on the state of charge of at least one of the charge storage elements. . The method of claim 6, Wherein the second voltage across the photosensor, the second current from the photosensor, or the second charge generated by the photosensor is measured based on the state of charge of the at least one charge storage element. . The method of claim 7, wherein Wherein the first emission time period is a portion of the display frame time, and the second non-emission time period is a portion of at least one row address time, a frame time different from the first time period, and for measuring luminance incident on the pixel. And a second set of time periods consisting of a portion of a second frame time dedicated, a portion of a time period for display vertical retrace time, and a portion of a time period for display horizontal retrace time. . The method of claim 8, At least one of the charge discharge elements provides a first charge storage element that provides an indication of the measured luminance emitted to the pixel during a portion of the first time period and an indication of the measured luminance that is incident on the pixel during the second time period. And a second charge storage element for providing a light emitting pixel device. The method of claim 8, Wherein the voltage across at least one said charge storage element, the current from this element and the charge of this element are indicative of an integrated luminous flux during a portion of the frame time at which said control circuit allows said charge storage element to charge or discharge, Emissive pixel device. The method of claim 9, Wherein the voltage across at least one said charge storage element, the current from this element and the charge of this element are indicative of an integrated luminous flux during a portion of the frame time at which said control circuit allows said charge storage element to charge or discharge, Emissive pixel device. The method of claim 11, The voltage, current or charge reading circuit, And a comparator circuit for receiving a voltage, current or charge reading, and a reference value corresponding to the target pixel brightness, and generating a differential signal representing a difference between the target pixel brightness and the measured brightness, Emissive pixel device. The method of claim 12, Wherein said voltage, current, or charge readout circuitry is configured as a charge amp / transimpedance amplifier with a charge amplifier circuit. The method of claim 8, And the light emitting device comprises a light emitting device selected from the group consisting of an organic light emitting diode (OLED) device, an electroluminescent device, a plasma emitting device, and a controllable photon emitting device. The method of claim 8, A second time for a plurality of pixels in the display to identify a point where the measured luminance in a region is a predetermined amount that is greater than the measured luminance for adjacent or peripheral pixels or a predetermined amount less than the measured luminance for adjacent or peripheral pixels And means for comparing the markers of the measured luminance entering the pixel during the period. The method of claim 8, And a light shield wherein the pixel attenuates at least a portion of photons from ambient light incident on the display from an external light source. The method of claim 16, And the light shield includes an aperture or hole that allows at least a portion of photons from ambient light incident on the display from an external light source to enter the pixel. A method of operating an emission pixel device having an integrated brightness and input sensor, Generating a current for driving the light emitting device to have a predetermined brightness corresponding to the image voltage, and applying the driving current to the light emitting device for a frame time; Connecting at least one charge storage element to the sensor to accumulate or release charge and simultaneously represent an electrostatic charge and a voltage proportional to the charge; Exposing a sensor that exhibits a change in electrical properties in response to a change in incident light flux to photons emitted by the light emitting element during a first time period and a second time period; The sensor includes means for controlling the rate of accumulation or release of charge during the first and second time periods, the charge being charged to or discharging charge from the at least one charge storage element connected to the sensor Making a step; Measuring the voltage or current raised by the charge present in the charge storage element at the end of the first time period portion and the second time period portion, wherein the voltage or current measured during the first time period portion is measured in the first time period. A measurement step, wherein the measurement is an indication of actual luminance emitted from the pixel during the portion and the voltage or current measured during the second time period portion is an indication of the actual luminance incident on the pixel sensor from an external source; Generating a difference value by comparing the actual luminance emitted from the pixel-related measurement voltage or current with the reference target pixel luminance for the pixel emitter image voltage and the pixel emitter drive current; Applying the difference value as a feedback input to a correction circuit that modifies the image voltage and drive current for the same pixel for subsequent frame times; And Comparing the actual brightness incident on the pixel sensor during the second time period portion with the actual brightness for at least one other pixel in the display to identify a touch input or penlight input location on the display. Method of operation of the emission pixel device comprising a. A method of detecting an input to a display device in which a plurality of separately addressable first image component (pixel) positions are arranged in a two-dimensional array, Providing photon sensing means in proximity to at least a portion of the first plurality of pixel positions of the separately addressable two-dimensional array; Detecting photons impinging on each of said sensing means for a predetermined detection time period; Generating a sensing signal for each of the photon sensing means, in accordance with the number or energy of photons detected; And Analyzing the sense signal to identify at least one pixel location receiving an input Input detection method for a display device comprising a. The method of claim 19, Wherein each of the plurality of sensing means has a corresponding OLED pixel aligned with the sensing means. The method of claim 19, A photon sensing means is provided in proximity to each of a plurality of separately addressable first pixel positions. The method of claim 19, And said sensing means provided in proximity to each of the pixel positions comprises sensing means provided in the structure of each pixel at the pixel position. The method of claim 19, Photon sensing means are provided proximate every Nth row and every Mth column of the first plurality of addressable pixel positions, where N and M are any amount between 1 and the maximum number of pixels in N rows and M columns. An input detection method for a display device, which can be independently selected as an integer. The method of claim 19, And the sensing means is provided every tenth pixel position in the row and column dimensions of the display. The method of claim 19, And said display is a color display having a plurality of different color pixels. The method of claim 19, And the sensing means operates as a photon flux integrator. The method of claim 19, And the sensing means is provided only for pixels having a predetermined specific emitter color. The method of claim 19, And the sensing means is provided in accordance with a predetermined or dynamically determined sensor interval, pixel color, or regular or non-rectified pattern. A method of operating an emission pixel device having an integrated brightness and input sensor, Generating a current for driving the light emitting element in each pixel to have a predetermined brightness corresponding to the image voltage, and applying the driving current to the light emitting element for a frame time; (i) intercept the measurable luminous flux when the light emitting element is in the emitting state; and (ii) detect the luminous flux measurable from a source outside the pixel when the light emitting element is not in the emitting state. Providing at least one optical sensor in the vicinity of the light emitting element, the optical sensor exhibiting a change in electrical properties in response to a change in incident photon flux; (i) a first voltage across the photosensor, a first current from the photosensor, or a first charge generated by the photosensor at the end of the first non-emission time period portion during the non-luminous state; (ii) a voltage representing a second voltage across the photosensor, a second current from the photosensor, or a second charge generated by the photosensor at the end of the second emission time period portion during the luminous state; Reading at least one of the current and charge measurements Method of operation of the emission pixel device comprising a. A method of detecting an input to a display device in which a plurality of separately addressable first image component (pixel) positions are arranged in a two-dimensional array, Providing photon sensing means in proximity to at least a portion of the first plurality of pixel positions of the separately addressable two-dimensional array; Detecting photons impinging on each of said sensing means for a predetermined detection time period; Generating a sensing signal for each of the photon sensing means, in accordance with the number or energy of photons detected; And Analyzing the sense signal to identify at least one pixel location receiving an input Input detection method for a display device comprising a. The method of claim 30, And the first plurality of photon sensing means is configured to detect an amount of background brightness not related to an input from an external user and a greater amount of different brightness related to an input from a user. The method of claim 31, wherein Wherein the greater amount of brightness is generated from a photon emitter located inside a display device having a brightness greater than a diffuse background brightness incident on the surface of the display. 33. The method of claim 32, Photons emitted from the photon emitter located inside the display device are completely contained within the first transmission medium such that they do not impinge on the sensing means and exit the first transmission medium at the user input position. For input detection method. The method of claim 33, wherein The photons are completely received in the first transmission medium by total internal reflection in a plate disposed between the display emitter and the user, and the photons alter the surface properties or properties of the plate or change the plate surface interface to the second medium. And exit from the first transmission medium by changing to a third medium in. The method of claim 34, wherein And the second medium comprises a gaseous medium and the third medium comprises a non-gaseous medium. 36. The method of claim 35 wherein And a second medium is air. 36. The method of claim 35 wherein And the third medium comprises a substantially opaque solid stylus. The method of claim 34, wherein Photons that exit the first transmission medium are scattered by objects external to the display such that at least some of the scattered photons are scattered or retroreflected towards the display and impinge on the sensing means to detect an input to the display device. Way. The method of claim 30, And the photon sensing means is configured to sense the photon wavelength (energy) and the amount of luminance emitted by the stylus mounted external photon emitter. The method of claim 30, And the photon sensing means is configured to sense an amount of luminance received from a stylus mounted external photon emitter that is greater than the amount of ambient background luminance received by the photon sensing means not irradiated by the external photon emitter. Input detection method. The method of claim 30, And the stylus mounted external photon emitter comprises a light pen. The method of claim 30, And the external photon emitter comprises a light emitting diode (LED). The method of claim 30, And the external photon emitter comprises an incandescent photon emitter. The method of claim 30, A spectrally selective filter is arranged in the optical path between the source of ambient light and the sensing means. The method of claim 44, And the spectroscopic method selection filter is a filter for transmitting red light. The method of claim 44, And the ambient light is light (photons) from the red side light received on the plate by total internal reflection and directed towards the sensing means by a change of the surface interface. The method of claim 44, The ambient light is light (photons) from a red laser light or a red light emitting diode directed to the sensing means. The method of claim 44, A spectroscopic selection filter is arranged in the optical path between the source of ambient light and the sensing means, the optical input device emits at a wavelength within the pass band of the spectroscopic selection filter, and the photon sensing means detects the sensor read during the display vertical retrace time. And an input detection method for the display device. The method of claim 30, And the photon sensing means is configured to sense the photon wavelength, photon energy and amount of luminance emitted by the stylus mounted external photon emitter. The method of claim 30, And the photon sensing means is configured to sense an amount of luminance received from a stylus mounted external photon emitter that is greater than the amount of ambient background luminance received by the photon sensing means not irradiated by the external photon emitter. Input detection method. 51. The method of claim 50, And the stylus mounted external photon emitter comprises a light pen. 51. The method of claim 50, And the external photon emitter comprises a light emitting diode (LED). 51. The method of claim 50, And the external photon emitter comprises an incandescent photon emitter. A device for detecting an input to a display device in which a plurality of separately addressable first image component (pixel) positions are arranged in a two-dimensional array, Photon sensing means proximate to at least a portion of the first plurality of pixel positions of the separately addressable two-dimensional array; At least one detection circuit for detecting photons impinging on each of said photon sensing means for a predetermined detection time period; At least one measuring circuit for generating a sensing signal for each of said photon sensing means in accordance with the number or energy of photons detected; And A comparison circuit for comparing and analyzing the sensed signals to identify at least one pixel location receiving an input Input detection device for a display device comprising a. The method of claim 55, And the first plurality of photon sensing means is configured to detect an amount of background luminance not related to an input from an external user and a greater amount of different luminance related to an input from a user. The method of claim 55, Wherein the greater amount of brightness is generated from a photon emitter located inside the display device having a brightness greater than the diffuse background brightness incident on the surface of the display. The method of claim 56, wherein Photons emitted from the photon emitter located inside the display device are completely contained within the first transmission medium such that they do not impinge on the sensing means and exit the first transmission medium at the user input position. For input detection instrument. The method of claim 57, The photons are completely received in the first transmission medium by total internal reflection in a plate disposed between the display emitter and the user, and the photons alter the surface properties or properties of the plate or provide a second plate surface interface. Changing the medium to the third medium to exit the first transmission medium. The method of claim 54, And the photon sensing means is configured to sense the photon wavelength (energy) and the amount of luminance emitted by the stylus mounted external photon emitter. The method of claim 54, And a spectrally selective filter is disposed in the optical path between the source of ambient light and the sensing means. The method of claim 54, A spectroscopic selection filter is arranged in the optical path between the source of ambient light and the sensing means, the optical input device emits at a wavelength within the pass band of the spectroscopic selection filter, and the photon sensing means detects the sensor read during the display vertical retrace time. And an input detection device for the display device. The method of claim 54, And the photon sensing means is configured to sense the photon wavelength, photon energy and amount of luminance emitted by the stylus mounted external photon emitter. The method of claim 54, And the photon sensing means is configured to sense an amount of luminance received from a stylus mounted external photon emitter that is greater than the amount of ambient background luminance received by the photon sensing means not irradiated by the external photon emitter. Input detection method. A method of detecting an input to a display device in which a plurality of separately addressable first image component (pixel) positions are arranged in a two-dimensional array, Providing photon sensing means in proximity to at least a portion of the first plurality of pixel positions of the separately addressable two-dimensional array; Detecting photons impinging on each of said sensing means for a predetermined detection time period; Generating a sensing signal for each of the photon sensing means, in accordance with the number or energy of photons detected; And Analyzing the sense signal to identify at least one pixel location receiving an input Input detection method for a display device comprising a. 65. The method of claim 64, The two-dimensional array is arranged as a frame having a plurality of rows and a plurality of columns, Each row has a row write address time at which one row of pixels is written, and a frame time at which all pixels of the display including a plurality of rows and columns are written, Sensing means in each row are read during a portion of each row write address time, Input detection method for display devices. 66. The method of claim 65, Wherein the portion of each row write address is any ratio between 0.001 and 0.9 of the row address time. 65. The method of claim 64, The two-dimensional array is arranged as a frame having a plurality of rows and a plurality of columns, Each row has a row write address time at which one row of pixels is written and a write frame time at which all pixels of the display including a plurality of rows and columns are written, Each row has a row read address time at which a row of sensing means is read, which row read address time occurs during a sensor read frame time separate from the pixel emitter write time, All rows of the sensing means are read out for a plurality of row read address times during the read frame time that do not overlap with the write frame time, and the read frame time is dedicated to reading of the plurality of sense means, Input detection method for display devices. 65. The method of claim 64, And said plurality of sensing means are read during a dedicated sensor reading frame, and the sensor reading frame time occurs only when the display screen receives a predetermined input. The method of claim 68, And said predetermined input comprises physical contact with a surface of a display screen. The method of claim 69, wherein And the physical contact comprises a physical touch by a finger. The method of claim 69, wherein And the physical contact comprises a physical touch by a tool. 65. The method of claim 64, And said predetermined input comprises a change in a predetermined amount of luminous flux or luminance on a portion of a surface of a display screen. 65. The method of claim 64, And said predetermined input comprises a non-contact change in a parameter proximate to a display screen surface. The method of claim 73, The contactless change is selected from a set of changes consisting of a local temperature change, a capacitance or charge concentration change, a magnetic flux change, a locally higher or lower luminous flux or luminance, and any combination of two or more thereof. Input detection method. 65. The method of claim 64, And said sensing means is read during a vertical retrace time period between successive display frames. 76. The method of claim 75, The sensing means is read by a sensor line separate from the sensor line used to read the pixel emission brightness, the reading of the sensor being controlled by a separate battery sensor line controlled through the gate terminal of the transistor, Input detection method for display devices. 65. The method of claim 64, And said sensing means is read during a display horizontal retrace time period between line writes. 65. The method of claim 64, A plurality of first sensing means for sensing display pixel photon emission and generating an integrated luminous flux representing pixel brightness, and a plurality of second sensing for sensing at least one of an external touch input and an external light input and generating a signal representing the input Providing a means for detecting an input to a display device. A device for detecting an input to a display device in which separately addressable image component (pixel) positions are arranged in a two-dimensional array, Photon sensing means proximate to at least a portion of a plurality of first pixel positions of a separately addressable two-dimensional array; At least one detection circuit for detecting photons impinging on each of said photon sensing means for a predetermined detection time period; At least one measuring circuit for generating a sensing signal for each of said photon sensing means in response to the number or energy of photons detected; And Comparison circuitry for comparing and analyzing the sense signals to identify at least one pixel location that may have received an input Input detection device for a display device comprising a. The method of claim 79, The two-dimensional array is arranged as a frame having a plurality of rows and a plurality of columns, Each row has a row write address time at which one row of pixels is written, and a frame time at which all pixels of the display including a plurality of rows and columns are written, Sensing means in each row are read during a portion of each row write address time, Input detection device for display device. The method of claim 79, The two-dimensional array is arranged as a frame having a plurality of rows and a plurality of columns, Each row has a row write address time at which one row of pixels is written and a write frame time at which all pixels of the display including a plurality of rows and columns are written, Each row has a row read address time at which a row of sensing means is read, which row read address time occurs during a sensor read frame time separate from the pixel emitter write time, All rows of the sensing means are read out for a plurality of row read address times during the read frame time that do not overlap with the write frame time, and the read frame time is dedicated to reading of the plurality of sense means, Input detection device for display device. The method of claim 79, And said plurality of sensing means are read during a dedicated sensor reading frame, wherein the sensor reading frame time occurs only when the display screen receives a predetermined input. 83. The method of claim 82, And said predetermined input comprises physical contact with a surface of a display screen. The method of claim 79, And said predetermined input comprises a change in a predetermined amount of luminous flux or luminance on a portion of the surface of a display screen. The method of claim 79, The predetermined input includes a non-contact change in a parameter proximate to the display screen surface, wherein the non-contact change includes a local temperature change, a capacitance or charge concentration change, a magnetic flux change, a locally higher or lower luminous flux or luminance, and two of them. An input detection device for a display device, wherein the input detection device is selected from a set of changes made of any combination of the above. The method of claim 79, The sensing means is read during a vertical retrace time period between successive display frames, the sensing means being read by a sensor line separate from the sensor line used to read the pixel emission brightness, the reading of the sensor Controlled by a separate battery sensor line controlled via a gate terminal, Input detection device for display device. The method of claim 79, And said sensing means is read during a display horizontal retrace time period between line writes. The method of claim 79, A plurality of first sensing means for sensing display pixel photon emission and generating an integrated luminous flux representing pixel brightness, and a plurality of second sensing for sensing at least one of an external touch input and an external light input and generating a signal representing the input Means for detecting an input to a display device. An emission pixel display device of the type having a plurality of pixels, wherein each pixel includes a driving circuit for generating a driving signal for driving a light emitting element and a display pixel. At least one photon sensor is disposed within the display device pixel, operative to detect photons emitted by emitters in the pixel and ambient photons emitted by sources external to the display device, wherein the sensed internal emission photons control display brightness feedback. Used to detect the shadow input or external light source for the display, Emissive pixel display device. 91. The method of claim 89 wherein At least one photon sensor of each pixel is a single sensor that senses both photons emitted by the internal emitter and ambient photons from the surrounding source. 91. The method of claim 90, The at least one photon sensor of each pixel comprises a first sensor for sensing photons emitted by the inner emitter and a second sensor for sensing peripheral photons from an external source. 92. The method of claim 91 wherein Wherein said emitter comprises an organic light emitting diode (OLED) and at least one sensor comprises an organic light emitting diode (OLED). 91. The method of claim 90, The at least one photon sensor comprises a photon sensor exhibiting a change in electrical resistivity or conductivity in response to a change in luminous flux impinging on the sensor. 95. The method of claim 93, At least one photon sensor is connected to a charge storage element, wherein the charge storage element is coupled to the resistivity or conductivity of the sensor such that measurements taken from the charge on the charge storage element provide an indication of the integrated luminous flux and luminance over a period of time. And charge or discharge at different rates according to the invention. In an emission type pixel display device having a plurality of pixels, each pixel having a light emitting element and receiving a drive signal from a driving circuit for driving the display pixel, in the method of operating the display device, Disposing at least one photon sensor within each display device pixel; Operating each display pixel such that at least one photon sensor senses photons emitted by the light emitting emitters in the pixel and ambient photons emitted by a source external to the display device; Controlling the brightness of each pixel using measurements for the internally emitted photons as a component of feedback control; And Detecting an external user input to the pixel display device using the measured value of the sensed external light source Method of operating a display device comprising a. 97. The method of claim 95, At least one photon sensor of each pixel is a single sensor that senses both photons emitted by the inner emitter and ambient photons from an external source. 97. The method of claim 96, At least one photon sensor of each pixel comprises a first sensor for sensing photons emitted by the inner emitter and a second sensor for sensing peripheral photons from an external source. 97. The method of claim 97, The emitter comprises an organic light emitting diode (OLED) and at least one sensor comprises an organic light emitting diode (OLED). 97. The method of claim 95, The at least one photon sensor comprises a photon sensor that exhibits a change in electrical resistivity or conductivity in response to a change in luminous flux impinging on the sensor. 99. The method of claim 98, At least one photon sensor is connected to a charge storage element, the charge storage element of which the resistivity or conductivity of the sensor is such that measurements taken from the charge on the charge storage element provide an indication of the integrated luminous flux and luminance over a period of time. Charging or discharging at different rates depending on the method of operation of the display device. An emission pixel display device, A plurality of light emitting elements as display screens, arranged in a two-dimensional array; A pixel emitter driving circuit for driving the plurality of light emitting elements to have a predetermined brightness; in relation to each of the light emitting elements in order to (i) intercept photons when the light emitting element is in an emitting state and (ii) detect photons from a source outside the pixel when the light emitting element is not in a light emitting state, At least one photon sensor exhibiting a change in electrical properties in response to a change in the incident photon; And (i) a first electrical parameter as an indicator of luminance emitted from a source external to the pixel and display, related to the photon sensor during the non-emission time; (ii) a second electrical parameter as an indication of the luminance emitted from the pixel and the pixel inside the display, related to the photon sensor during the emission time; A second voltage across the photosensor, a second current from the photosensor, or a second charge generated by the photosensor at the end of the second emission time period portion for measuring At least one voltage, current and charge readout circuit for measuring Emission pixel display device comprising a. A method of detecting an input to a display device in which a plurality of separately addressable first image component (pixel) positions are arranged in a two-dimensional array, Providing photon sensing means in proximity to at least a portion of the first plurality of pixel positions of the separately addressable two-dimensional array; Detecting photons impinging on each of said sensing means for a predetermined detection time period; Generating a sensing signal for each of the photon sensing means, in accordance with the number or energy of photons detected; And Analyzing the sense signal to identify at least one pixel location receiving an input Input detection method for a display device comprising a. 103. The method of claim 102, The separately addressable pixel includes a light shield that attenuates at least a portion of the photons from ambient light incident on the display from an external light source. 103. The method of claim 102, And said light shield comprises a metallic opaque layer. 103. The method of claim 102, The light shielding comprises correction means proximate to each of the photon sensing means such that the amount of attenuation of ambient light is less than at the periphery of the light shielding. 105. The method of claim 105, And said modifying means is an aperture in the light shield at each pixel position, which causes photons from an external source to impinge on said photon sensing means. 107. The method of claim 106, And the aperture is less than the area of the photon sensing means. 107. The method of claim 106, And the aperture comprises a hole in the light shield. 103. The method of claim 102, Each of the separately addressable pixel locations further comprises a photon emitter supported by the transparent substrate surface and including a layer of emitting material interposed between the first opaque electrode and the second transparent electrode, the emitting material being transparent Emitting light downward through an electrode and a transparent substrate, said photon sensing means interposed between the photon emitter and the substrate to intercept a portion of the emitted photons from the photon emitter. 109. The method of claim 109, And the emitter comprises an OLED emitter. 103. The method of claim 102, Each of the separately addressable pixel locations further comprises a photon emitter supported by the substrate surface and comprising a layer of emitting material interposed between the first transparent electrode and the second transparent electrode, wherein the emitting material comprises: a first emitter material; And emits light upward through the transparent electrode and the second transparent electrode toward the substrate, the photon sensing means being disposed between the photon emitter and the substrate to intercept a portion of the emitted photons downward from the photon emitter. For input detection method. 112. The method of claim 111, wherein Each of the separately addressable pixel locations further comprises a photon emitter supported by the substrate surface and comprising a layer of emitting material interposed between the first transparent electrode and the second opaque electrode, wherein the emitting material comprises a first Emitting light upward through the transparent electrode and the second opaque electrode, and retroreflecting through the first transparent electrode, wherein the photon sensing means is disposed adjacent to the photon emitter to intercept a portion of the side emitting photons from the photon emitter An input detection method for a display device. 112. The method of claim 112, And the emitter comprises an OLED emitter. 103. The method of claim 102, And the plurality of first photon sensing means is configured to sense a background luminance amount not related to an input from an external user and a different luminance amount related to an input from a user. 119. The method of claim 114, And wherein said different amount of brightness is a greater amount of brightness. 116. The method of claim 115, Wherein the greater luminance is generated from an external photon emitter located outside the display device having a brightness higher than the diffuse background latitude incident on the surface of the display. 116. The method of claim 115, Wherein said different amount of brightness is a smaller amount of brightness. 118. The method of claim 117 wherein The smaller amount of luminance is produced by a passive attenuating object having a transmittance of less than 100% disposed proximate to the surface of the display to produce shading and block or attenuate some of the diffuse background luminance incident on the surface of the display. Input detection method for display devices. 118. The method of claim 118 wherein And said passive attenuating object comprises a substantially opaque object. 118. The method of claim 118 wherein And said passive attenuating object comprises a stylus having a nearly opaque pointed tip. 118. The method of claim 118 wherein And the passive damping object comprises a pen shaped object. 118. The method of claim 118 wherein The passive damping object includes an external human finger. A device for detecting an input to a display device in which a plurality of separately addressable first image component (pixel) positions are arranged in a two-dimensional array, Photon sensing means proximate to at least a portion of the first plurality of pixel positions of the separately addressable two-dimensional array; At least one detection circuit for detecting photons impinging on each of said photon sensing means for a predetermined detection time period; At least one measuring circuit for generating a sensing signal for each of said photon sensing means in accordance with the number or energy of photons detected; And A comparison circuit for comparing and analyzing the sensed signals to identify at least one pixel location receiving an input Input detection device for a display device comprising a. 123. The method of claim 123, wherein The separately addressable pixel includes a light shield that attenuates at least some of the photons from ambient light incident on the display from an external light source, The light shield comprises a metallic substantially opaque layer and comprises correction means proximate each of the photon sensing means such that the amount of ambient light attenuation is less than at the periphery of the light shield, The correcting means is an aperture in the light shield at each pixel position, which causes photons from an external source to impinge on the photon sensing means, Input detection device for display device. 123. The method of claim 123, wherein Each of the separately addressable pixel locations further comprises a photon emitter supported by the transparent substrate surface and including a layer of emitting material interposed between the first opaque electrode and the second transparent electrode, the emitting material being transparent And emits light downward through an electrode and a transparent substrate, said photon sensing means being interposed between the photon emitter and the substrate to intercept a portion of the emitted photons from the photon emitter. 123. The method of claim 123, wherein Each of the separately addressable pixel locations further comprises a photon emitter supported by the substrate surface and comprising a layer of emitting material interposed between the first transparent electrode and the second transparent electrode, wherein the emitting material comprises: a first emitter material; And emits light upward through the transparent electrode and the second transparent electrode toward the substrate, the photon sensing means being disposed between the photon emitter and the substrate to intercept a portion of the emitted photons downward from the photon emitter. For input detection instrument. 123. The method of claim 123, wherein Each of the separately addressable pixel locations further comprises a photon emitter supported by the substrate surface and comprising a layer of emitting material interposed between the first transparent electrode and the second opaque electrode, wherein the emitting material comprises a first Emitting light upward through the transparent electrode and the second opaque electrode, and retroreflecting through the first transparent electrode, wherein the photon sensing means is disposed adjacent to the photon emitter to intercept a portion of the side emitting photons from the photon emitter An input detection device for a display device. 123. The method of claim 123, wherein The plurality of first photon sensing means is configured to detect a background luminance amount not related to an input from an external user and a different luminance amount related to an input from a user, And the different amount of brightness is a greater or less amount of brightness.

Images