CN113126789B - Electronic pen, display interaction device, interaction device and interaction system - Google Patents
Electronic pen, display interaction device, interaction device and interaction system Download PDFInfo
- Publication number
- CN113126789B CN113126789B CN202110424647.7A CN202110424647A CN113126789B CN 113126789 B CN113126789 B CN 113126789B CN 202110424647 A CN202110424647 A CN 202110424647A CN 113126789 B CN113126789 B CN 113126789B
- Authority
- CN
- China
- Prior art keywords
- infrared light
- light emitting
- interaction device
- emitting element
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 117
- 230000002452 interceptive effect Effects 0.000 claims abstract description 25
- 239000004973 liquid crystal related substance Substances 0.000 claims abstract description 15
- 239000000758 substrate Substances 0.000 claims description 24
- 230000033001 locomotion Effects 0.000 claims description 18
- 230000003287 optical effect Effects 0.000 claims description 13
- 229910021417 amorphous silicon Inorganic materials 0.000 claims description 12
- 230000000875 corresponding effect Effects 0.000 claims description 9
- 230000002596 correlated effect Effects 0.000 claims description 8
- 229910052751 metal Inorganic materials 0.000 claims description 4
- 239000002184 metal Substances 0.000 claims description 4
- 238000000034 method Methods 0.000 claims description 3
- 239000004033 plastic Substances 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 2
- 238000002360 preparation method Methods 0.000 abstract description 8
- 238000011165 process development Methods 0.000 abstract description 4
- 238000013459 approach Methods 0.000 abstract description 2
- 239000010410 layer Substances 0.000 description 88
- 239000000463 material Substances 0.000 description 17
- 239000010409 thin film Substances 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 229910052581 Si3N4 Inorganic materials 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- HQVNEWCFYHHQES-UHFFFAOYSA-N silicon nitride Chemical compound N12[Si]34N5[Si]62N3[Si]51N64 HQVNEWCFYHHQES-UHFFFAOYSA-N 0.000 description 4
- 238000005538 encapsulation Methods 0.000 description 3
- 238000002161 passivation Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000004397 blinking Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000012044 organic layer Substances 0.000 description 1
- 239000011368 organic material Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 229910052709 silver Inorganic materials 0.000 description 1
- 239000004332 silver Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/04162—Control or interface arrangements specially adapted for digitisers for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention relates to an electronic pen, display interaction equipment, interaction equipment and an interaction system. The interactive system comprises an electronic pen and display interactive equipment; the electronic pen comprises a pen container, an infrared light emitting element and a pen point; the infrared light emitting element is positioned in the pen container, and the infrared light emitted by the infrared light emitting element is emitted from one side of the pen container, which is close to the pen point. The display interaction device comprises a display panel and a touch control layer, wherein the display panel comprises a liquid crystal layer and a backlight module, the touch control layer is positioned between the liquid crystal layer and the backlight module and comprises a photosensitive element, and the photosensitive element is used for sensing infrared light, converting the sensed infrared light into an electric signal and generating a touch control instruction according to the electric signal. When the electronic pen approaches or contacts the display interaction device, the display interaction device generates a touch instruction according to the sensed infrared light. According to the embodiment of the invention, the preparation process of the display panel of the display device is not required to be adjusted and changed, additional process development is not required, and the yield of the display panel is not affected.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to an electronic pen, a display interaction device, an interaction device, and an interaction system.
Background
In the related art, with the continuous development of communication technology, electronic technology and display technology, a display device having a man-machine interaction function is increasingly paid attention to. In order to realize the interactive application of the display panel in the aspects of visible light and near infrared light, the up-conversion material is used for converting the visible light or the near infrared light into ultraviolet light, and the metal oxide transistor is used for responding the ultraviolet light to realize the positioning interaction of the interactive light. However, the man-machine interaction scheme described above cannot be applied to a liquid crystal display device because the active layer material of the transistor in the liquid crystal display device is amorphous silicon. Therefore, how to implement man-machine interaction on a liquid crystal display device is a technical problem to be solved.
Disclosure of Invention
The invention provides an electronic pen, display interaction equipment, interaction equipment and an interaction system, which are used for solving the defects in the related technology.
According to a first aspect of an embodiment of the present invention, there is provided an electronic pen including: the pen comprises a pen container, an infrared light emitting element, an elastic piece and a pen point;
the first end of the elastic piece is positioned in the pen container and connected with the pen container, the second end of the elastic piece is connected with the pen point, the infrared light emitting element is positioned in the pen container and positioned on one side of the pen container, which is close to the pen point, the infrared light emitted by the infrared light emitting element exits from one side of the pen container, which is close to the pen point, and the distance between the infrared light emitting element and the pen point is inversely related to the deformation amount of the elastic piece when the elastic piece is compressed.
In one embodiment, the electronic pen further comprises a substrate, wherein the substrate is positioned in the pen container and is fixedly connected with the pen container, and the infrared light emitting element is positioned on the substrate and is positioned on one side of the substrate facing the pen point; the surface of the substrate facing the infrared light emitting element is perpendicular to the extending direction of the pen container;
the first end of the elastic piece is propped against the substrate and is fixedly connected with the substrate.
In one embodiment, the elastic member is a spring, and the material of the elastic member is metal;
the pen point is made of rubber or plastic.
In one embodiment, the electronic pen further comprises an optical element located on a side of the infrared light emitting element facing the pen tip, the optical element configured to modulate a light emission angle of the infrared light emitting element;
the optical element is a convex lens or a reflective cavity.
In one embodiment, the electronic pen further comprises a control key, wherein the control key is connected with the infrared light emitting element and is configured to control the infrared light emitting element to be turned on and off.
In one embodiment, the electronic pen further comprises a control circuit, the control key is connected with the infrared light emitting element through the control circuit, and the control key is further configured to control the luminous intensity and the starting frequency of the infrared light emitting element.
According to a second aspect of an embodiment of the present invention, there is provided a display interaction device, including: the touch control device comprises a display panel and a touch control layer, wherein the display panel comprises a liquid crystal layer and a backlight module, the touch control layer is positioned between the liquid crystal layer and the backlight module, the touch control layer comprises a plurality of photosensitive elements which are arranged in an array, each photosensitive element is configured to sense infrared light, convert the sensed infrared light into an electric signal and generate a touch control instruction according to the electric signal;
the photosensitive element comprises an active layer, and the material of the active layer is amorphous silicon.
In one embodiment, when the infrared light emitting element is in a normally-on state, the touch control instruction is configured to control the display interaction device to display a gray image according to the electric signal, wherein the amplitude of the electric signal is related to the light intensity of the infrared light, and the gray of the gray image is related to the amplitude of the electric signal;
the touch control instruction is further configured to control the display interaction device to execute corresponding operation according to the frequency of the opening of the infrared light emitting element.
In one embodiment, the photosensitive element further comprises a first electrode and a second electrode, the active layer being located between the first electrode and the second electrode;
the thickness of the photosensitive element is 0.2-5 micrometers.
In one embodiment, the touch control layer of the display interaction device further comprises a light shielding layer, the light shielding layer is located on the light incident side of the photosensitive element, and the light shielding layer is configured to inhibit visible light from transmitting and allow infrared light to transmit.
According to a third aspect of an embodiment of the present invention, there is provided an interactive system comprising: the electronic pen and the display interaction device;
when the electronic pen is close to or contacts the display interaction device, the electronic pen emits infrared light, and the display interaction device senses the infrared light and generates a touch instruction according to the sensed infrared light.
In one embodiment, when the display interaction device displays a gray scale image, the gray scale image comprises a motion trail of the electronic pen on the display interaction device;
the width of the motion track is positively correlated with the distance between the infrared light emitting element and the surface of the display interaction device facing the electronic pen, and inversely correlated with the deformation amount of the elastic piece when the elastic piece is compressed.
In one embodiment, during the movement of the electronic pen on the display interaction device, the display interaction device acquires corresponding light spot images at each position of the electronic pen, and acquires the movement track according to the acquired light spot images, wherein the width of the movement track is the diameter of the light spot images;
the diameter of the light spot image and the distance between the infrared light emitting element and the surface of the display interaction device facing the electronic pen satisfy the following relation:
R＝R1-K*F
wherein R is the diameter of the light spot image when the pen point applies pressure to the display interaction device, R1 is the diameter of the light spot image when the pen point applies pressure to the display interaction device is 0, K is a first coefficient, and F is the pressure applied by the pen point to the display interaction device.
In one embodiment, the maximum gray value of the light spot image is inversely related to the distance between the infrared light emitting element and the surface of the display interaction device facing the electronic pen, and is in a linear relationship;
the average gray value of the light spot image and the distance between the infrared light emitting element and the surface of the display interaction device facing the electronic pen satisfy the following relation:
DN＝A-1/(B+C*F) 2
DN is the average gray value of the facula image, A is a constant, B is a constant, C is a second coefficient, and C is related to the stiffness coefficient of the elastic piece and the light emitting angle of the infrared light emitting element.
According to a fourth aspect of an embodiment of the present invention, there is provided an interaction device, including: the touch control device comprises a plurality of photosensitive elements arranged in an array, wherein each photosensitive element is configured to sense infrared light, convert the sensed infrared light into an electric signal and generate a touch control instruction according to the electric signal;
the photosensitive element comprises an active layer, and the material of the active layer is amorphous silicon.
According to a fifth aspect of an embodiment of the present invention, there is provided a display interaction device including: the display device is connected with the interaction device, and the interaction device outputs the touch instruction to the display device.
According to a sixth aspect of an embodiment of the present invention, there is provided an interactive system, including: the electronic pen and the display interaction device according to the fifth aspect of the embodiment of the present invention;
when the electronic pen is close to or contacts the interaction device, the electronic pen emits infrared light, the interaction device senses the infrared light, and a touch instruction is generated according to the sensed infrared light.
According to the above embodiment, since the display interaction device includes the display panel and the touch layer, the display panel includes the liquid crystal layer and the backlight module, and the touch layer is located between the liquid crystal layer and the backlight module, there is no need to adjust and change the manufacturing process of the display panel, no need to develop additional process, and the yield of the display panel is not affected.
Or, because the display equipment of the display interaction equipment is connected with the interaction equipment, the interaction equipment outputs the touch control instruction to the display equipment, so that the preparation process of the display panel of the display equipment does not need to be adjusted and changed, additional process development is not needed, and the yield of the display panel is not affected.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a schematic diagram of an interactive system, according to an embodiment of the present invention;
FIG. 2 is a schematic top view of a touch layer according to an embodiment of the present invention;
FIG. 3 is a schematic cross-sectional view of a touch layer according to an embodiment of the invention;
FIG. 4 is a schematic diagram of a spot image, according to an embodiment of the invention;
FIG. 5 is a schematic diagram showing the relationship between the diameter of a spot image and the infrared light emitting element and the electronic pen facing surface of the display interaction device, according to an embodiment of the present invention;
fig. 6 is a schematic diagram showing a relationship between a maximum gray value of a spot image and a distance between an infrared light emitting element and a surface of a display interaction device facing an electronic pen according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.
The embodiment of the invention provides an interactive system. As shown in fig. 1, the interactive system comprises an electronic pen 11 and a display interactive device 12.
In this embodiment, as shown in fig. 1, the electronic pen includes: the pen container 111, the base plate 112, the infrared light emitting element 113, an optical element (not shown), the elastic member 114, the pen point 115, the control circuit 116, and the control key 117.
In this embodiment, as shown in fig. 1, the infrared light emitting element 113 is located on the substrate 112, and the substrate 112 is located in the pen container 111 and fixedly connected with the pen container 111. The surface of the substrate 112 facing the infrared light emitting element 113 is perpendicular to the extending direction of the barrel 111. The infrared light emitting element 113 is located on a side of the substrate 112 facing the pen head 115. The infrared light emitting element 113 is located on the side of the barrel 111 near the nib 115.
In the present embodiment, the barrel 111 may be cylindrical, oval barrel-shaped, or chamfered square, but is not limited thereto.
In the present embodiment, the infrared light emitting element 113 may be a Light Emitting Diode (LED) that emits infrared light. The wavelength of the infrared light emitted from the infrared light emitting element 113 may be 800 to 1000nm, for example, the wavelength of the infrared light may be 800nm, 850nm, 900nm, 940nm, or 1000nm, but is not limited thereto. In this embodiment, the wavelength of infrared light is 940 nm.
In the present embodiment, the optical element is located on the side of the infrared light emitting element 113 facing the nib 115, and the optical element is configured to modulate the light emitting angle of the infrared light emitting element 113. The light emission angle of the infrared light emitting element 113 is 10 to 90 degrees after being modulated by the optical element, for example, the light emission angle of the infrared light emitting element 113 is 10 degrees, 30 degrees, 60 degrees, or 90 degrees after being modulated by the optical element, but is not limited thereto.
In this embodiment, the optical element may be a convex lens. In other embodiments, or the optical element may be a reflective cavity. The reflecting cavity is of a conical structure, and the inner surface of the reflecting cavity is a silver reflecting surface.
In this embodiment, as shown in fig. 1, a first end of the elastic member 114 is located in the pen container 111, and the first end of the elastic member 114 is pressed against the substrate 112 and fixedly connected to the substrate 112, and a second end of the elastic member 114 is connected to the pen point 115. The nib 115 may have a hollow structure, and the second end of the elastic member 114 is located in the nib 115.
In this embodiment, the elastic member 114 is a spring, and the material of the elastic member 114 is metal. Within the elastic limit, the elastic force of the spring is proportional to the deformation amount of the spring, and the relationship between the elastic force F1 and the compression amount Δx of the spring is f1=kΔx, where k is the stiffness coefficient of the spring.
In this embodiment, the nib 115 may be made of rubber. In other embodiments, the material of nib 115 may be plastic.
In the present embodiment, the control key 117 is connected to the infrared light emitting element 113 via the control circuit 116, and the control key 117 is configured to control the on and off of the infrared light emitting element 113, the light emission intensity, and the frequency of the on. The infrared light emitting element 113 includes a normally-on state, a normally-off state, and a blinking state. In the normally-on state, the infrared light emitting element 113 is turned on, and emits light until turned off. In the normally closed state, the infrared light emitting element 113 is turned off, and does not emit light until turned on. In the blinking state of the infrared light emitting element 113, the infrared light emitting element 113 alternately performs on and off, the frequency of the on being controlled by the control key 117.
In the present embodiment, the infrared light emitted from the infrared light emitting element 113 is emitted from the side of the pen container 111 near the pen tip 115, and the distance between the infrared light emitting element 113 and the pen tip 115 is inversely related to the deformation amount when the elastic member 114 is compressed. For example, when writing on the display interaction device 12 using an electronic pen, if pressure is applied to the display interaction device 12 by the electronic pen, the elastic member 114 in the electronic pen is compressed and deformed, the larger the deformation amount of the elastic member 114 when compressed, the smaller the distance between the infrared light emitting element 113 and the pen point 115, the smaller the deformation amount of the elastic member 114 when compressed, and the larger the distance between the infrared light emitting element 113 and the pen point 115.
In the present embodiment, the display interaction device 12 includes: the display panel and the touch control layer. The display panel comprises a driving circuit layer, a liquid crystal layer and a backlight module, and the touch control layer can be positioned between the liquid crystal layer and the backlight module.
In this embodiment, the driving circuit layer includes a pixel circuit, the pixel circuit includes a transistor, and the material of an active layer of the transistor is amorphous silicon.
In this embodiment, as shown in fig. 2, the touch layer may include a plurality of gate lines 21 extending along a first direction X, a plurality of data lines 22 extending along a second direction Y, a plurality of power lines 23 extending along the second direction, a plurality of photosensitive elements 24 and a plurality of thin film transistors 25 at intersections of the gate lines 21 and the data lines 22, the plurality of photosensitive elements 24 being arranged in an array, and the plurality of thin film transistors 25 being arranged in an array. The gate line 21 is used for providing a switching signal, the switching signal is used for controlling the opening and closing of the photosensitive element 24, the data line 22 is used for reading the electric signal sensed by the photosensitive element 24, the power line 23 is used for providing a power signal, and the voltage value of the power signal can be constant.
In this embodiment, each of the thin film transistors 25 may be an N-type transistor. As shown in fig. 3, each of the thin film transistors 25 may include a drain 251, a gate 252, and a source 253. The photosensitive element 24 includes a first electrode 241, an active layer 242, and a second electrode 243, and the active layer 242 is located between the first electrode 241 and the second electrode 243. The first electrode 241 is an anode, the material of the first electrode 241 is metal, the second electrode 243 is a cathode, the second electrode 243 is a transparent conductive layer, and the material of the second electrode 243 may be ITO, but is not limited thereto. The drain 251 of the thin film transistor 25 is connected to the data line 22, the source 253 is connected to the first electrode 241 of the photosensor 24, the gate 252 is connected to the gate line 21, and the second electrode 243 of the photosensor 24 is connected to the power line 23.
In this embodiment, the External Quantum Efficiency (EQE) of the photosensor 24 is about 0.03%.
In this embodiment, the thickness of the photosensitive element 24 is 0.2 to 5 microns. For example, the thickness of the photosensitive element 24 is 0.2 microns, 1 micron, or 5 microns, but is not limited thereto. The greater the thickness of the photosensitive element 24, the better the response to infrared light. When the thickness of the photosensitive element 24 is smaller than 0.2 micrometers, the leakage current is larger, the risk of short circuit between the first electrode 241 and the second electrode 243 of the photosensitive element 24 is larger, and when the thickness of the photosensitive element 24 is larger than 5 micrometers, the capacitance is smaller, the detectable range is smaller, and the risk of poor technology is higher. When the thickness of the photosensitive element 24 is 0.2-5 micrometers, the leakage current is smaller, the risk of short circuit between the first electrode 241 and the second electrode 243 of the photosensitive element 24 is smaller, the detectable range is larger, and the risk of poor technology is lower.
In this embodiment, the material of the active layer 242 is amorphous silicon. The thickness of the active layer 242 is 950 nm, the thickness of the first electrode 241 is 50nm, and the thickness of the second electrode 243 is 500 nm, but is not limited thereto. In the related art, amorphous silicon is not generally used as a material of the active layer of the photodiode for detecting infrared light, and the band gap of amorphous silicon is 1.6 to 1.8eV, and it is generally considered that amorphous silicon does not respond to infrared light, but the inventor has found that amorphous silicon can have a good detection effect for infrared light and near infrared light. Therefore, the technical scheme of the invention overcomes the technical prejudice.
In this embodiment, as shown in fig. 3, the touch layer may further include an inorganic insulating layer 31, a planarization layer 32, a passivation layer 33, a buffer layer 34, an encapsulation layer 35, a light shielding layer 36, a substrate 37, and a gate insulating layer 38. The gate 252 is located on the substrate 37, the gate insulating layer 38 is located on a side of the gate 252 away from the substrate 37, the drain 251 and the source 253 are located on a side of the gate insulating layer 38 away from the substrate 37, the inorganic insulating layer 31 is located on a side of the thin film transistor 25 close to the photosensitive element 24, and the passivation protecting layer 33 is located on a sidewall of the photosensitive element 24 and on the second electrode 243 for protecting the photosensitive element 24. The passivation layer 33 is made of silicon nitride, but is not limited thereto. The planarization layer 32 is located on one side of the inorganic insulating layer 31 near the photosensitive element 24, and the planarization layer 32 wraps the photosensitive element 24 to perform a planarization function. The buffer layer 34 is located between the power line 23 and the planarization layer 32, and is used to prevent the power line 23 from being peeled off from the planarization layer 32. Encapsulation layer 35 is located on the side of buffer layer 34 remote from photosensitive element 24. The material of the buffer layer 34 may be silicon nitride, the material of the encapsulation layer 35 may be an inorganic layer, and the material of the inorganic layer may be silicon nitride, or may be a structure in which inorganic layers and organic layers are alternately arranged, and the material of the inorganic layer may be silicon nitride. The light shielding layer 36 is located on the photosensitive side of the photosensitive element 24, and the light shielding layer 36 is configured to inhibit the transmission of visible light and allow the transmission of infrared light to avoid the interference of the visible light with the photosensitive element 24. The material of the light shielding layer 36 may be a black organic material.
In the present embodiment, when the electronic pen 11 approaches or contacts the display interaction device 12 to write, the electronic pen is turned on by the control key 117 and is in a normally open state. Each photosensor 24 in the display interaction device 12 senses infrared light and converts the sensed infrared light into an electrical signal, and generates a touch command from the electrical signal, the touch command configured to control the display interaction device 12 to display a grayscale image from the electrical signal, the magnitude of the electrical signal being related to the intensity of the infrared light and the grayscale of the grayscale image being related to the magnitude of the electrical signal. For example, the stronger the intensity of infrared light, the larger the amplitude of the electrical signal, and the larger the gradation of the gradation image.
In this embodiment, the grayscale image may include a motion profile of the electronic pen on the display interaction device 12. The width of the motion trajectory is positively correlated with the distance between the infrared light emitting element 113 and the surface of the display interaction device 12 facing the electronic pen, inversely correlated with the amount of deformation of the elastic member 114 when it is compressed. For example, the larger the distance between the infrared light emitting element 113 and the surface of the display interaction device 12 facing the electronic pen, the wider the width of the motion trajectory, and the smaller the distance between the infrared light emitting element 113 and the surface of the display interaction device 12 facing the electronic pen, the narrower the width of the motion trajectory.
In this embodiment, during the movement of the electronic pen 11 on the display interaction device 12, the display interaction device 12 acquires a corresponding spot image at each position of the electronic pen 11, and acquires a movement track according to the acquired spot image, where the width of the movement track is the diameter of the spot image. As shown in fig. 4, the interaction device 12 is shown to be able to capture a spot image 411 at a location of the electronic pen 11.
In the present embodiment, the diameter of the spot image and the distance between the infrared light emitting element 113 and the surface of the display-interaction device 12 facing the electronic pen satisfy the following relationship:
R＝R1-K*F
where R is the diameter of the spot image when the nib 115 applies pressure to the display interaction device 12, R1 is the diameter of the spot image when the nib 115 applies pressure to the display interaction device 12 at 0, K is a first coefficient, and F is the pressure applied by the nib 115 to the display interaction device 12. The greater the pressure applied by the nib 115 to the display interaction device 12, the smaller the diameter of the spot image. Namely, the diameter of the light spot image carries writing force information, and the width of the motion trail carries the writing force information.
In this embodiment, the larger the pressure applied by the pen tip 115 to the display interaction device 12, the larger the deformation amount of the elastic member 114 when compressed, and the smaller the distance between the infrared light emitting element 113 and the surface of the display interaction device 12 facing the electronic pen, the smaller the diameter of the flare image. I.e. the diameter of the spot image is positively correlated with the distance between the infrared light emitting element 113 and the surface of the display interaction device 12 facing the electronic pen.
In this embodiment, as shown in fig. 5, the diameter of the spot image is positively correlated with the distance between the infrared light emitting element 113 and the surface of the display-interaction device 12 facing the electronic pen. In fig. 5, the horizontal axis represents the distance between the infrared light emitting element 113 and the surface of the display interaction device 12 facing the electronic pen in cm, and the vertical axis represents the diameter of the spot image in pixels. The equation of the relation 51 between the diameter of the spot image and the distance between the infrared light emitting element 113 and the surface of the display interaction device 12 facing the electronic pen may be r=33.764 x s+40, where S is the distance between the infrared light emitting element 113 and the surface of the display interaction device 12 facing the electronic pen. For example, when s=0 cm, r=40 pixels, when s=1.5 cm, r=90 pixels, and when s=3 cm, r=140 pixels.
In the present embodiment, the maximum gray value of the spot image is inversely related to the distance between the infrared light emitting element 113 and the surface of the display-interaction device 12 facing the electronic pen, and approximately linearly related. The maximum gray value of the facula image is the maximum gray value of gray values of all pixels in the facula image.
In this embodiment, as shown in fig. 6, the maximum gray value of the spot image is inversely related to the distance between the infrared light emitting element 113 and the surface of the display-interaction device 12 facing the electronic pen. In fig. 6, the horizontal axis represents the distance between the infrared light emitting element 113 and the surface of the display interaction device 12 facing the electronic pen, the unit is cm, and the vertical axis represents the maximum gray value of the spot image. For example, when s=0 cm, the maximum gray value is 65535, when s=1.5 cm, the maximum gray value is 47640, and when s=3 cm, the maximum gray value is 44350.
In the present embodiment, the average gray value of the spot image and the distance between the infrared light emitting element 113 and the surface of the display-interaction device 12 facing the electronic pen satisfy the following relationship:
DN＝A-1/(B+C*F) 2
where DN is the average gray value of the flare image, a is a constant, B is a constant, C is a second coefficient, and C is related to the stiffness coefficient of the elastic member 114 and the light emitting angle of the infrared light emitting element 113. The larger the distance between the infrared light emitting element 113 and the surface of the display-interaction device 12 facing the electronic pen, the smaller the average gray value of the spot image. The average gray value of the spot image is the average value of gray values of all pixels in the spot image.
In this embodiment, the touch instruction is further configured to control the display interaction device 12 to perform a corresponding operation according to the frequency at which the infrared light emitting element 113 is turned on. For example, when the frequency at which the infrared light emitting element 113 is turned on is a first frequency, the touch instruction is configured to control the display interaction device 12 to perform a click operation, for example, a double click operation, and when the frequency at which the infrared light emitting element 113 is turned on is a second frequency, the touch instruction is configured to control the display interaction device 12 to perform an operation of increasing the diameter of the spot image. The frequency at which the infrared light emitting element 113 is turned on is smaller than the refresh frequency of the thin film transistor 25. The first frequency is different from the second frequency, for example, the refresh frequency of the thin film transistor 25 may be 120 hz, the first frequency is 30 hz, and the second frequency is 15 hz.
In this embodiment, the size of the display panel may be the same as the size of the touch layer.
In this embodiment, since the display interaction device includes the display panel and the touch layer, the display panel includes the liquid crystal layer and the backlight module, the touch layer is located between the liquid crystal layer and the backlight module, and since the active layer of the transistor in the display panel is made of amorphous silicon, the active layer of the photosensitive element in the touch layer is made of amorphous silicon, and the compatibility between the preparation process of the touch layer and the preparation process of the display panel is good, the preparation process of the display panel does not need to be adjusted and changed, additional process development is not needed, and the yield of the display panel is not affected.
The embodiment of the invention also provides an electronic pen which is used for the interaction system. The electronic pen in this embodiment is the same as the electronic pen in the above embodiment, and will not be described here again.
The embodiment of the invention also provides a display interaction device 12 for the interaction system. The display interaction device 12 in this embodiment is the same as the display interaction device 12 in the above embodiment, and will not be described here again.
The embodiment of the invention also provides an interaction system. The interactive system comprises a display interactive device 12 and the electronic pen described above. The interactive system in this embodiment is different from the interactive system in the above-described embodiment in that in this embodiment, the display interactive device 12 includes a display device and an interactive device, and the display device is connected to the interactive device. The interaction device is an external device of the display device. The interaction device may include the above-mentioned touch layer, where the touch layer includes a plurality of photosensitive elements 24 arranged in an array, and each photosensitive element 24 is configured to sense infrared light, convert the sensed infrared light into an electrical signal, and generate a touch command according to the electrical signal. The interaction device outputs the generated touch instruction to the display device, and the display device executes corresponding operations according to the touch instruction, for example, displaying a motion track, clicking operation and the like of the electronic pen on the interaction device.
In this embodiment, the size of the interactive device may be the same as the size of the display device.
In this embodiment, since the display interaction device includes a display device and an interaction device, the display device is connected with the interaction device, and the interaction device outputs a touch instruction to the display device, a preparation process of the interaction device can be independent of a preparation process of the display device, and adjustment and modification of a preparation process of a display panel of the display device are not required, and additional process development is not required, so that yield of the display panel is not affected.
Note that, the display device in this embodiment may be: electronic paper, mobile phone, tablet computer, television, notebook computer, digital photo frame, navigator and any other products or components with display function.
It is noted that in the drawings, the size of layers and regions may be exaggerated for clarity of illustration. Moreover, it will be understood that when an element or layer is referred to as being "on" another element or layer, it can be directly on the other element or intervening layers may be present. In addition, it will be understood that when an element or layer is referred to as being "under" another element or layer, it can be directly under the other element or intervening layers or elements may be present. In addition, it will be understood that when a layer or element is referred to as being "between" two layers or elements, it can be the only layer between the two layers or elements, or more than one intervening layer or element may also be present. Like reference numerals refer to like elements throughout.
In the present invention, the terms "first", "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. The term "plurality" refers to two or more, unless explicitly defined otherwise.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It is to be understood that the invention is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (9)
1. An electronic pen, comprising: the pen comprises a pen container, an infrared light emitting element, an elastic piece and a pen point;
the first end of the elastic piece is positioned in the pen container and is connected with the pen container, the second end of the elastic piece is connected with the pen point, the infrared light emitting element is positioned in the pen container and is positioned at one side of the pen container, which is close to the pen point, the infrared light emitted by the infrared light emitting element is emitted from one side of the pen container, which is close to the pen point, and the distance between the infrared light emitting element and the pen point is inversely related to the deformation amount of the elastic piece when the elastic piece is compressed;
the control key is connected with the infrared light emitting element and is configured to control the infrared light emitting element to be turned on and off;
the electronic pen further comprises a control circuit, wherein the control key is connected with the infrared light emitting element through the control circuit and is further configured to control the luminous intensity and the starting frequency of the infrared light emitting element;
when the infrared light emitting element is in a normally-bright state, the electronic pen is used for enabling the display interaction device to generate corresponding electric signals and generating touch control instructions according to the electric signals, the touch control instructions are configured to control the display interaction device to display gray images according to the electric signals, the amplitude of the electric signals is related to the light intensity of infrared light, and the gray of the gray images is related to the amplitude of the electric signals;
the touch control instruction is further configured to control the display interaction device to execute corresponding operation according to the frequency of the opening of the infrared light emitting element.
2. The electronic pen according to claim 1, further comprising a substrate, wherein the substrate is positioned in the pen container and is fixedly connected with the pen container, and the infrared light emitting element is positioned on the substrate and is positioned on a side of the substrate facing the pen point; the surface of the substrate facing the infrared light emitting element is perpendicular to the extending direction of the pen container;
the first end of the elastic piece is propped against the substrate and is fixedly connected with the substrate;
the elastic piece is a spring, and the elastic piece is made of metal;
the pen point is made of rubber or plastic.
3. The electronic pen of claim 1, further comprising an optical element located on a side of the infrared light emitting element facing the nib, the optical element configured to modulate a light emission angle of the infrared light emitting element;
the optical element is a convex lens or a reflective cavity.
4. A display interaction device, comprising: a display panel and a touch control layer, wherein the display panel comprises a liquid crystal layer and a backlight module, the touch control layer is positioned between the liquid crystal layer and the backlight module, the touch control layer comprises a plurality of photosensitive elements which are arranged in an array, each photosensitive element is configured to sense infrared light, the sensed infrared light emitted by the electronic pen of any one of claims 1 to 3 is converted into an electric signal, and a touch control instruction is generated according to the electric signal;
the photosensitive element comprises an active layer, wherein the active layer is made of amorphous silicon;
when the infrared light emitting element is in a normally-bright state, the touch control instruction is configured to control the display interaction device to display a gray image according to the electric signal, the amplitude of the electric signal is related to the light intensity of infrared light, and the gray of the gray image is related to the amplitude of the electric signal;
the touch control instruction is further configured to control the display interaction device to execute corresponding operation according to the frequency of the opening of the infrared light emitting element.
5. The display interaction device of claim 4, wherein the photosensitive element comprises a first electrode and a second electrode, the active layer being located between the first electrode and the second electrode;
the thickness of the photosensitive element is 0.2-5 micrometers.
6. An interactive system, comprising: the electronic pen of any one of claims 1 to 3 and the display interaction device of any one of claims 4 to 5;
when the electronic pen is close to or contacts the display interaction device, the electronic pen emits infrared light, and the display interaction device senses the infrared light and generates a touch instruction according to the sensed infrared light.
7. The interactive system of claim 6, wherein when the display interactive device displays a grayscale image, the grayscale image includes a motion trajectory of the electronic pen on the display interactive device;
the width of the motion track is positively correlated with the distance between the infrared light emitting element and the surface of the display interaction device facing the electronic pen, and inversely correlated with the deformation amount of the elastic piece when the elastic piece is compressed;
in the process that the electronic pen moves on the display interaction device, the display interaction device acquires corresponding light spot images at each position of the electronic pen, and acquires the movement track according to the acquired light spot images, wherein the width of the movement track is the diameter of the light spot images;
the diameter of the light spot image and the distance between the infrared light emitting element and the surface of the display interaction device facing the electronic pen satisfy the following relation:
R＝R1-K*F
wherein R is the diameter of the light spot image when the pen point applies pressure to the display interaction device, R1 is the diameter of the light spot image when the pen point applies pressure to the display interaction device is 0, K is a first coefficient, and F is the pressure applied by the pen point to the display interaction device.
8. The interactive system of claim 7, wherein a maximum gray value of the spot image is inversely related to a distance between the infrared light emitting element and a surface of the display interactive device facing the electronic pen and is in a linear relationship;
the average gray value of the light spot image and the distance between the infrared light emitting element and the surface of the display interaction device facing the electronic pen satisfy the following relation:
DN＝A-1/(B+C*F) 2
DN is the average gray value of the facula image, A is a constant, B is a constant, C is a second coefficient, and C is related to the stiffness coefficient of the elastic piece and the light emitting angle of the infrared light emitting element.
9. An interactive system, comprising: the electronic pen of any one of claims 1 to 3 and the display interaction device of claim 4;
when the electronic pen is close to or contacts the interaction device, the electronic pen emits infrared light, the interaction device senses the infrared light, and a touch instruction is generated according to the sensed infrared light.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110424647.7A CN113126789B (en) | 2021-04-20 | 2021-04-20 | Electronic pen, display interaction device, interaction device and interaction system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110424647.7A CN113126789B (en) | 2021-04-20 | 2021-04-20 | Electronic pen, display interaction device, interaction device and interaction system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113126789A CN113126789A (en) | 2021-07-16 |
| CN113126789B true CN113126789B (en) | 2024-01-26 |
Family
ID=76777980
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110424647.7A Active CN113126789B (en) | 2021-04-20 | 2021-04-20 | Electronic pen, display interaction device, interaction device and interaction system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113126789B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114779957A (en) | 2022-04-14 | 2022-07-22 | Tcl华星光电技术有限公司 | Light beam emitter and optical touch display system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102122216A (en) * | 2010-01-08 | 2011-07-13 | 剑扬股份有限公司 | Stylus and touch input system |
| CN202041915U (en) * | 2011-03-17 | 2011-11-16 | 广州视源电子科技有限公司 | Stylus |
| CN103955304A (en) * | 2014-05-21 | 2014-07-30 | 友达光电股份有限公司 | An electronic pen touch system |
| CN107850955A (en) * | 2015-08-21 | 2018-03-27 | 株式会社和冠 | Stylus and colouring information transfer approach |
| CN107976852A (en) * | 2017-11-22 | 2018-05-01 | 上海天马微电子有限公司 | Array substrate, display panel and display device |
| CN109445637A (en) * | 2018-11-07 | 2019-03-08 | 合肥禾斗技汇科技有限公司 | Handwriting processing method based on pen tip position |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109858398B (en) * | 2019-01-14 | 2023-06-06 | 京东方科技集团股份有限公司 | Display panel, manufacturing method thereof, display device, and fingerprint identification method |
-
2021
- 2021-04-20 CN CN202110424647.7A patent/CN113126789B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102122216A (en) * | 2010-01-08 | 2011-07-13 | 剑扬股份有限公司 | Stylus and touch input system |
| CN202041915U (en) * | 2011-03-17 | 2011-11-16 | 广州视源电子科技有限公司 | Stylus |
| CN103955304A (en) * | 2014-05-21 | 2014-07-30 | 友达光电股份有限公司 | An electronic pen touch system |
| CN107850955A (en) * | 2015-08-21 | 2018-03-27 | 株式会社和冠 | Stylus and colouring information transfer approach |
| CN107976852A (en) * | 2017-11-22 | 2018-05-01 | 上海天马微电子有限公司 | Array substrate, display panel and display device |
| CN109445637A (en) * | 2018-11-07 | 2019-03-08 | 合肥禾斗技汇科技有限公司 | Handwriting processing method based on pen tip position |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113126789A (en) | 2021-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11700752B2 (en) | Display device | |
| JP4767899B2 (en) | Liquid crystal display panel and related display device | |
| JP2024125325A (en) | Display | |
| US20190197944A1 (en) | Electroluminescence display device and driving method thereof | |
| US11803256B2 (en) | Display device and touch input system including the same | |
| US12216825B2 (en) | Display device | |
| US11335250B2 (en) | Pixel driving circuit and display panel | |
| KR20210012086A (en) | Display device | |
| US20210012078A1 (en) | Electronic device | |
| CN113126789B (en) | Electronic pen, display interaction device, interaction device and interaction system | |
| KR20220023850A (en) | Fingerprint sensor and display device including the same | |
| US20220262301A1 (en) | Display device with sensing unit | |
| KR20230025562A (en) | Display device and sensing system including the same | |
| KR102704825B1 (en) | Display device | |
| US12093477B2 (en) | Sensing system with code pattern and display device including the same | |
| US20230060443A1 (en) | Display device | |
| CN115707297A (en) | Display device and sensing system | |
| KR20210000766A (en) | Ultrasonic detection device and display device including the same | |
| KR20200115857A (en) | Display device | |
| US12201003B2 (en) | Display device and touch input system including the same | |
| KR20210060734A (en) | Electronic apparatus including the optical sensor and method of the manufacturing the same | |
| US20230221810A1 (en) | Touch input device and display device using the same | |
| US20230050455A1 (en) | Display device and sensing system including the same | |
| KR20190079488A (en) | Electorluminescence display apparatus and method for driving the same | |
| US20240233434A9 (en) | Display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |