CN117891359B

CN117891359B - Touch device and control method of touch device

Info

Publication number: CN117891359B
Application number: CN202410073658.9A
Authority: CN
Inventors: 向国威; 李远志
Original assignee: Shenzhen Hanwang Youji Technology Co ltd
Current assignee: Shenzhen Hanwang Youji Technology Co ltd
Priority date: 2024-01-18
Filing date: 2024-01-18
Publication date: 2025-02-18
Anticipated expiration: 2044-01-18
Also published as: CN117891359A

Abstract

The present disclosure relates to a touch device and a control method for the touch device, wherein the touch device comprises: a writing panel, the writing panel comprises a writing screen and a processing unit; a stylus, the stylus comprises at least one image capturing unit and a communication unit; the writing screen can display a plurality of characteristic graphics or be fixedly provided with a plurality of characteristic graphics; the communication unit is communicatively connected with the processing unit, the communication unit is used to transmit the captured image of the image capturing unit to the processing unit, and the processing unit is used to determine the position and/or posture of the stylus relative to the writing screen according to the captured image. The touch device provided by the present disclosure can realize the precise writing operation of the stylus on various writing screens, without adding a touch component to the writing screen, and there is no restriction on the type of stylus.

Description

Touch device and control method thereof

Technical Field

The disclosure relates to the field of touch technologies, and in particular, to a touch device and a control method of the touch device.

Background

Along with the rapid development of technology, various novel touch technologies are increasingly and widely applied to display equipment, and great convenience is provided for users. In the touch operation, a user may control the display device by performing a touch operation with a finger, for example, touching the touch screen and moving the finger located on the touch screen. Or the touch operation is performed through the touch pen, for example, the capacitive pen and the electromagnetic pen are used for performing the touch operation on the touch screen, so that better precision and resolution can be obtained, and some complicated touch operations are realized.

However, at present, the display screens of many display devices do not support the touch pen for touch operation, and as the touch assembly for supporting the touch pen is not arranged in the display screen, if the touch pen is supported, the display screen needs to be modified, and the overall cost is high. Or part of the display screen has requirements on the type of the touch pen, for example, only one type of capacitive pen or electromagnetic pen can be used, and the capacitive pen or the electromagnetic pen can not be compatible with the touch pen or the electromagnetic pen, so that the touch operation with higher operation precision can not be performed. Therefore, how to design a touch device that can support a touch pen on a display screen without adding a touch assembly and matching the type of the touch pen becomes a problem to be solved under the condition of low cost.

Disclosure of Invention

In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a touch device and a control method of the touch device.

In a first aspect, the present disclosure provides a touch device, including:

a writing panel including a writing screen and a processing unit;

A stylus comprising at least one image capturing unit and a communication unit;

the writing screen can display a plurality of characteristic graphs or is fixedly provided with a plurality of characteristic graphs;

The communication unit is in communication connection with the processing unit, the communication unit is used for transmitting the shot image of the image shooting unit to the processing unit, and the processing unit is used for determining the position and/or the gesture of the touch pen relative to the writing screen according to the shot image.

In some embodiments, the screen boundary of the writing screen is further provided with a plurality of boundary identifications, wherein the boundary identifications at different positions are different.

In some embodiments, the writing screen is rectangular, the boundary mark is a square with one side missing, an opening formed by the missing side faces into the writing screen, and a marking graph is arranged in the square.

In some embodiments, the stylus includes a first image capture device and a second image capture device, the first image capture device and the second image capture device being sequentially disposed along a length direction of the stylus, a distance between the first image capture device and a tip of the stylus being less than a distance between the second image capture device and the tip of the stylus.

In some embodiments, the stylus further comprises a pressure sensor, the communication unit is further configured to transmit a detection value of the pressure sensor to the processing unit, and the processing unit is configured to determine a pressure sensing value of the stylus according to the detection value of the pressure sensor.

In some embodiments, the processing unit is further configured to determine a pressure sensing value of the stylus according to a deformation of a tip of the stylus in the captured image.

In a second aspect, the present disclosure further provides a control method of a touch device, which is applicable to the touch device provided in the first aspect, and the method includes:

acquiring a shooting image of an image shooting unit;

And determining the position and/or the gesture of the touch pen relative to the writing screen according to the shot image.

In some embodiments, further comprising:

determining the pressure sensing value of the touch pen according to the deformation of the pen point of the touch pen in the shot image, or

And determining the pressure sensing value of the touch pen according to the detection value of the pressure sensor in the touch pen.

In some embodiments, the determining the position and/or posture of the stylus relative to the writing screen from the captured image comprises:

Determining that the shot image comprises a writing screen boundary, a pen point image of a touch pen and a no-feature graph, and determining the proportion of the shooting size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of an image shooting unit and the distance between the image shooting unit and the writing screen according to the shooting size of the writing screen boundary and the actual size of the writing screen boundary;

And determining the position and/or the gesture of the touch pen relative to the writing screen according to the pen point of the touch pen, the position of the writing screen boundary in the shot image, the proportion of the shooting size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

Determining that the shot image comprises a writing screen boundary and does not comprise the characteristic graph, and determining the proportion of the shooting size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of an image shooting unit and the distance between the image shooting unit and the writing screen according to the shooting size of the writing screen boundary and the actual size of the writing screen boundary;

And determining the position and/or the gesture of the touch pen relative to the writing screen according to the position relation between the pen point of the touch pen and the image shooting unit, the position of the writing screen boundary in the shot image, the proportion of the shooting size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

In some embodiments, the screen boundary of the writing screen is further provided with a plurality of boundary identifications, wherein the boundary identifications at different positions are different, and the determining the position and/or gesture of the stylus relative to the writing screen according to the photographed image comprises:

Determining that the shot image comprises a boundary mark, a pen point image of a touch pen and no characteristic graph, and determining the proportion of the shot size of the boundary mark to the actual size of the boundary mark, the shooting angle of an image shooting unit and the distance between the image shooting unit and the writing screen according to the shot size of the boundary mark and the actual size of the boundary mark;

And determining the position and/or the gesture of the touch pen relative to the writing screen according to the position of the pen point of the touch pen and the boundary of the writing screen in the shot image, the proportion of the shooting size of the boundary mark to the actual size of the boundary mark, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

Determining that the shot image comprises a boundary mark and no feature graph, and determining the proportion of the shot size of the boundary mark to the actual size of the boundary mark, the shooting angle of an image shooting unit and the distance between the image shooting unit and the writing screen according to the shot size of the boundary mark and the actual size of the boundary mark;

And determining the position and/or the gesture of the touch pen relative to the writing screen according to the position relation between the pen point of the touch pen and the image shooting unit, the position of the boundary of the writing screen in the shot image, the proportion of the shooting size of the boundary mark to the actual size of the boundary mark, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

In some embodiments, further comprising:

And determining at least partial images including the writing screen in the shot images, and controlling the writing screen to display characteristic patterns.

determining that the shot image comprises the characteristic graph and a pen point image of a touch pen, and determining the proportion of the shooting size of the characteristic graph to the actual size of the characteristic graph, the shooting angle of an image shooting unit and the distance between the image shooting unit and the writing screen according to the shooting size of the characteristic graph and the actual size of the characteristic graph;

and determining the position and/or the gesture of the touch pen relative to the writing screen according to the pen point of the touch pen, the position of the characteristic graph in the shot image, the proportion of the shooting size of the characteristic graph to the actual size of the characteristic graph, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

Determining that the shot image comprises the feature pattern, and determining the proportion of the shot size of the feature pattern to the actual size of the feature pattern, the shooting angle of an image shooting unit and the distance between the image shooting unit and the writing screen according to the shot size of the feature pattern and the actual size of the feature pattern;

And determining the position and/or the gesture of the touch pen relative to the writing screen according to the position relation between the pen point of the touch pen and the image shooting unit, the position of the characteristic graph in the shot image, the proportion of the shooting size of the characteristic graph to the actual size of the characteristic graph, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

In some embodiments, further comprising:

and determining that the pressure sensing value of the touch pen is larger than a pressure sensing threshold value, and controlling the writing screen to display handwriting characteristics.

In some embodiments, after determining that the pressure sensing value of the stylus is greater than the pressure sensing threshold, further comprising:

And controlling the writing screen to eliminate the characteristic graph.

In some embodiments, further comprising:

And determining the position and/or the gesture of the touch pen relative to the writing screen according to the handwriting characteristics in the shot image.

In some embodiments, the stylus comprises a first image acquisition device and a second image acquisition device, the first image acquisition device and the second image acquisition device are sequentially arranged along the length direction of the stylus, the distance between the first image acquisition device and the pen point of the stylus is smaller than the distance between the second image acquisition device and the pen point of the stylus, and the method further comprises:

and determining the position of the touch pen relative to the writing screen according to the boundary of the writing screen in the shot image, and controlling the touch pen to display the characteristic graph over against the region in the preset range of the position of the writing screen.

In some embodiments, the method further comprises the steps of arranging a multi-axis sensor on the touch control pen, and further comprising:

and determining that the shot image does not comprise a writing screen boundary and a characteristic pattern within a first preset time, and determining the position and/or the gesture of the touch pen relative to the writing screen according to the detection value of the multi-axis sensor.

In some embodiments, further comprising:

And determining that the shot image does not comprise a writing screen boundary and a characteristic graph in a second preset time, and controlling the writing screen to display the characteristic graph.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages:

The touch device comprises a writing panel, a touch pen, the communication unit and the processing unit, wherein the writing panel comprises a writing screen and a processing unit, the touch pen comprises at least one image shooting unit and a communication unit, the writing screen can display a plurality of characteristic graphs or is fixedly provided with the characteristic graphs, the communication unit is in communication connection with the processing unit, the communication unit is used for transmitting shooting images of the image shooting unit to the processing unit, and the processing unit is used for determining the position and/or the gesture of the touch pen relative to the writing screen according to the shooting images. Therefore, when the stylus is used for writing on the writing screen, the writing operation is equivalent to the touch operation, the image shooting unit shoots the writing screen image around the stylus when the writing operation is performed, the shot image is transmitted to the processing unit of the writing panel through the communication unit, and the processing unit can determine the position and/or the gesture of the stylus relative to the writing screen according to the shot image. Compared with the prior art, the touch device provided by the disclosure can realize accurate writing operation of the touch pen on various writing screens, does not need to add a touch component to the writing screen, and has no limitation on the type of the touch pen.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, the drawings that are required for the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

Fig. 1 is a schematic structural diagram of a touch device according to an embodiment of the disclosure;

Fig. 2 is a schematic structural diagram of a screen boundary with a mark of a touch device according to an embodiment of the disclosure;

fig. 3 is a schematic structural diagram of another touch device according to an embodiment of the disclosure;

fig. 4 is a flowchart illustrating a control method of a touch device according to an embodiment of the disclosure.

The device comprises 10 parts of a writing panel, 11 parts of a writing screen, 12 parts of a processing unit, 13 parts of a screen boundary, 14 parts of a feature graph, 15 parts of a boundary mark, 20 parts of a touch pen, 21 parts of an image shooting unit, 22 parts of a communication unit, 210 parts of a first image acquisition device, 211 parts of a second image acquisition device.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, a further description of aspects of the present disclosure will be provided below. It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein, and it is apparent that the embodiments in the specification are only some, rather than all, of the embodiments of the present disclosure.

Currently, a touch screen device is not arranged in a display screen of many display devices, so that a touch pen cannot be supported to perform touch operation, and if the touch operation is to be realized, the display screen needs to be modified, but the overall cost is higher. In addition, although some display screens are provided with touch screen devices, there is a requirement on the type of touch pen, for example, only one type of capacitive pen or electromagnetic pen can be used, the electromagnetic pen and the capacitive pen can not be used in a crossing manner, and the display screens can not be compatible with each other, so that the possibility that touch operation with higher operation precision can not be performed exists.

In order to solve the above-mentioned problems, an embodiment of the present disclosure provides a touch device, and fig. 1 is a schematic structural diagram of the touch device provided in the embodiment of the present disclosure, as shown in fig. 1, the touch device includes:

a writing panel 10, the writing panel 10 including a writing screen 11 and a processing unit 12;

A stylus 20, the stylus 20 including at least one image capturing unit 21 and a communication unit 22;

The writing screen 11 may display a plurality of feature patterns 14 or be fixedly provided with a plurality of feature patterns 14;

The communication unit 22 is communicatively connected to the processing unit 12, the communication unit 22 is configured to transmit the captured image of the image capturing unit 21 to the processing unit 12, and the processing unit 12 is configured to determine the position and/or posture of the stylus 20 relative to the writing screen 11 according to the captured image.

Referring to fig. 1, the touch device includes a writing panel 10 and a stylus 20, the writing panel 10 includes a writing screen 11 and a processing unit 12, an edge of the writing screen 11 further includes a screen boundary 13, and the stylus 20 can perform writing operations on the writing screen 11. The writing screen 11 may be a display screen with touch control, a common display screen, or a screen without display function, for example, a screen with silk-screen feature patterns. The stylus 20 may perform writing, clicking, etc. operations on a plane without a display function, but the screen is not displayed, but other electronic screens are controlled to be displayed. The processing unit 12 has continuous and fast image data processing capability, and is capable of extracting stylus characteristics, screen boundary characteristics, screen display content characteristics and the like from each captured image, calculating parameters such as a capturing angle, a capturing distance and the like, and acquiring the position and/or posture of the stylus 20 relative to the writing panel 10 according to various corresponding relations.

The stylus 20 serves as a writing tool, and includes at least one image capturing unit 21 for capturing images of the writing screen 11 around the stylus 20 when the stylus 20 performs a writing operation. The image capturing unit 21 is, for example, a camera, and is mounted inside the stylus 20, and is capable of capturing images continuously, clearly, and at high speed, and the captured image pixels of the camera are adjustable. For example, the photographing frame rate of the image photographing unit 21 is not less than 30 frames/second, preventing the photographing frame rate from being too low, resulting in a situation in which there are few photographed images, and the handwriting route of the stylus 20 cannot be accurately recognized. For example, when the stylus 20 is suspended or does not enter the area of the writing screen 11, the image capturing pixels of the camera can be raised to obtain more content on the captured image, and when writing is continuously performed, the writing screen 11 has display content, so that the features are rich, the image capturing pixels of the camera can be reduced, the transmission data amount is reduced, the condition of transmission blocking is avoided, and the purpose of improving the image capturing frame rate can be achieved by reducing the image capturing pixels, for example, the image capturing pixels are reduced, and the image capturing frame rate is improved to 120 frames/second or even higher frame rate, so that the handwriting route of the stylus 20 can be accurately identified. The shooting image pixels of the camera can be adjusted by adjusting the shooting view angle. When the camera shooting angle range is enlarged, the shooting image pixels are increased, more characteristics can be obtained, when the camera shooting angle range is reduced, the shooting image pixels are reduced, the data volume is reduced, and the transmission is smoother. It should be noted that in some other embodiments, there are other parameters affecting the pixels of the captured image, and the embodiment of the disclosure is not limited thereto, and the foregoing is merely illustrative. When the continuous writing state is identified, the current frame and the previous frame can be compared in a mode of comparing adjacent frames, whether the images are changed or not is judged, and if the images are changed, the stylus 20 is considered to be in the continuous writing state. It should be noted that, in some other embodiments, there are other ways of determining continuous writing, which the embodiments of the present disclosure do not limit.

The writing screen 11 may display a plurality of feature patterns 14 or be fixedly provided with a plurality of feature patterns 14, and the feature patterns 14 at different positions are different, for example, a plurality of sets of feature patterns 14 such as A1, A2, a.the.the.the.the.d., D4, D5, etc., and the feature patterns 14 corresponding to the respective positions are different, so that when the writing operation is performed using the stylus 20, the images of the writing screen 11 taken by the image taking unit 21 are different when the stylus 20 is at the different positions. The stylus 20 further includes a communication unit 22, and the communication unit 22 is communicatively connected to the processing unit 12 of the writing panel 10, so that the communication unit 22 can transmit the photographed image of the image photographing unit 21 to the processing unit 12. The communication unit 22 and the processing unit 12 may adopt a wired transmission mode or a wireless transmission mode, for example, a star flash (NearLink) wireless transmission mode, which is mainly used for short-distance data transmission and can achieve a low-delay effect. The processing unit 12 can analyze and recognize the position of the writing screen 11 corresponding to the feature pattern 14 and the angle at the time of shooting according to the received shot image, and further can determine the position and/or the gesture of the stylus 20 relative to the writing screen 11.

For example, the display background of the writing screen 11 is paper-like white, the screen boundary may be black, the user picks up the stylus 20 and moves the stylus 20 to the position where the writing screen is located until the writing position is moved, and the image capturing unit 21 is disposed on the stylus 20, and during the moving process, the image capturing unit 21 can continuously capture images, and the captured images obtained by capturing are transmitted to the processing unit 12 through the communication unit 22. While the stylus 20 is moving, there may be some images that cannot identify specific positions in the images captured by the image capturing unit 21, for example, images without the writing screen 11 may be caused by the fact that the stylus 20 is far from the writing screen 11, and when the stylus 20 is several tens of centimeters from the writing screen 11, the writing screen 11 appears in the images captured by the stylus 20 and the writing screen 11, but depending on the writing screen 11, it cannot be determined that the stylus is already close to the writing screen 11, and the position and/or posture of the stylus 20 relative to the writing screen 11 cannot be determined. Thus, the feature pattern 14 can be displayed on the writing screen 11, the display background of the writing screen 11 becomes the background of the feature pattern 14, and the processing unit 12 can determine the position and/or posture of the stylus 20 with respect to the writing screen 11 based on the different feature patterns 14. In some alternative embodiments, the display background of the writing screen may initially be the background with the feature pattern 14, with the feature pattern 14 displayed throughout use. It should be noted that, the color of the feature pattern 14 should be selected to be clear, but the contrast with the background color should not be too sharp, for example, the feature pattern 14 may be a gray-scale pattern when the background is white, black text or pattern.

In the embodiment of the disclosure, when the stylus is used for writing on the writing screen, the writing operation corresponds to the touch operation, the image shooting unit shoots an image of the writing screen around the stylus when the writing operation is performed, the shot image is transmitted to the processing unit of the writing panel through the communication unit, and the processing unit can determine the position and/or the gesture of the stylus relative to the writing screen according to the shot image. Compared with the prior art, the touch device provided by the disclosure can realize accurate writing operation of the touch pen on various writing screens, for example, the touch device can be a writing screen only comprising a display function, or a writing screen with a touch component, and can also be a writing screen without a display function, and the touch pen can perform accurate writing operation aiming at the various writing screens. For example, the writing screen is a capacitive screen, and in the prior art, touch components such as a touch electrode are additionally arranged on the writing screen, and in the touch device provided by the embodiment of the disclosure, accurate writing operation can be performed without additionally arranging the touch components. And the embodiment of the disclosure determines the position and/or the gesture of the touch pen relative to the writing screen according to the shot image, and does not need to limit the type of the touch pen.

In some embodiments, fig. 2 is a schematic diagram of a screen boundary marked structure of a touch device according to an embodiment of the present disclosure, and on the basis of fig. 1, in combination with fig. 2, a plurality of boundary marks 15 are further provided on a screen boundary 13 of a writing screen 11, where the boundary marks 15 at different positions are different.

The screen border 13 of the writing screen 11 is also provided with a plurality of border markers 15, the screen border 13 being the outer border of the writing screen 11, the edges of the writing screen 11. The boundary identifications 15 at different locations are not identical, so that from the boundary identifications 15 on the screen boundary 13, a specific location of the screen boundary 13 can be determined. When the stylus 20 is at the edge of the writing screen 11, the captured image captured by the image capturing unit 21 includes the boundary identifier 15, and the processing unit 12 can identify the current position range of the stylus 20 according to the boundary identifier 15. It should be noted that, the specific shape and number of the screen borders 13 are not limited in the embodiment of the present disclosure, but the number should not be too small, so as to avoid the situation that the border marks 15 are not recognized.

In some embodiments, with continued reference to FIG. 2, the writing screen 11 is rectangular, the boundary marker 15 is a square with one side missing, the opening formed by the missing side is directed into the writing screen 11, and the marking pattern is disposed in the square.

Illustratively, the writing screen 11 is rectangular, while the screen boundary 13 has a certain width, the specific width being set according to the actual requirements. The four boundaries are all provided with boundary marks 15, the boundary marks 15 are squares with one side missing, the squares are formed by three side lengths, an opening formed by one side missing faces towards the writing screen 11, a marking pattern is arranged in the squares, for example, marking numbers are arranged in the squares, the marking numbers of each side boundary are all increased from 1 and are increased along the X direction or the Y direction, and all the numbers face towards one direction in order to avoid the situation that a mirror image cannot be positioned. When the captured image captured by the image capturing unit of the stylus includes the boundary identifier 15, the processing unit may determine the position of the stylus relative to the writing screen according to the position of the boundary identifier 15 in the captured image. The position of the stylus relative to the writing screen can be understood as planar or spatial coordinates. In the embodiment of the present disclosure, the boundary mark 15 is a square with one missing side, so three sides are equal length lines, and the length of the sides can be stored in the processing unit in advance, and the gesture and the distance of the stylus relative to the writing screen can be positioned according to the photographed image. For example, the shape of the boundary mark 15 in the photographed image is deformed, and at this time, the processing unit can calculate the photographing angle of the image photographing unit, and the position of the image photographing unit in the stylus is fixed, so that the gesture of the stylus relative to the writing screen can be further determined. According to the lengths of three sides of the boundary mark 15 in the shot image and the actual side length of the boundary mark 15, the processing unit can calculate the distance between the image shooting unit and the boundary mark 15 according to the proportional relation of the three sides, so that the suspension position of the touch pen relative to the writing screen can be positioned, and whether the touch pen has a rotating action or not can be calculated. When there is a rotation action, the boundary markers 15 in the captured image captured by the image capturing unit will also change accordingly.

In some other embodiments, the boundary identifier 15 may be other types of identifiers, such as other shapes, numbers, letters, etc., which are not limited in this disclosure, and the foregoing is merely illustrative, and may be specifically set according to actual requirements.

In some embodiments, fig. 3 is a schematic structural diagram of still another touch device according to an embodiment of the present disclosure, as shown in fig. 3, the touch pen 20 includes a first image capturing device 210 and a second image capturing device 211, where the first image capturing device 210 and the second image capturing device 211 are sequentially disposed along a length direction of the touch pen 20, and a distance between the first image capturing device 210 and a pen point of the touch pen 20 is smaller than a distance between the second image capturing device 211 and the pen point of the touch pen 20.

In the embodiment of the disclosure, the stylus 20 includes two image capturing units 21, which are a first image capturing device 210 and a second image capturing device 211, respectively, and the first image capturing device 210 and the second image capturing device 211 can capture images. The first image capturing device 210 and the second image capturing device 211 are sequentially arranged along the length direction of the stylus 20, a certain distance exists between the first image capturing device 210 and the second image capturing device 211 so as to capture different captured images, and the distance between the first image capturing device 210 and the pen point of the stylus 20 is smaller than the distance between the second image capturing device 211 and the pen point of the stylus 20. The first image capturing device 210 is disposed on a side close to the tip of the stylus 20, such as a camera, and is capable of capturing images continuously, clearly and at high speed, and the captured images include the tip portion of the stylus 20, which may be understood as a local camera, due to the proximity to the tip of the stylus 20, while the second image capturing device 211 is disposed on a side far from the tip of the stylus 20, such as a camera, and is also capable of capturing images continuously, clearly and at high speed, and the captured images include more portions of the stylus 20, which may be understood as a global camera, due to the proximity to the tip of the stylus 20.

The first image acquisition device 210 and the second image acquisition device 211 are arranged to respectively shoot a local image and a global image, so that the position and the gesture of the stylus 20 from the writing screen 11 can be calculated more quickly and efficiently. Illustratively, the second image capture device 211 may capture the screen boundary 13 of the writing screen 11 while the first image capture device 210 is capable of capturing the writing area of the stylus 20 on the writing screen 11 when the stylus 20 is closer to the writing screen 11. The position of the stylus 20 can be roughly positioned according to the shot image shot by the second image acquisition device 211, and the position of the stylus 20 can be precisely positioned according to the shot image shot by the first image acquisition device 210.

It should be noted that, since the embodiment of the present disclosure includes the first image capturing device and the second image capturing device, the embodiment of the present disclosure does not limit whether the screen boundary is provided with the boundary identifier, and only needs to be selected according to actual requirements.

The touch pen is provided with a pressure sensor, the pressure sensor can collect the pressure sensing value generated by the pressure of the pen head of the touch pen, the communication unit of the touch pen can transmit the detection value obtained by the pressure sensor to the processing unit, and the processing unit determines the pressure sensing value of the touch pen according to the detection value of the pressure sensor. The different pressure sensing values may correspond to different writing operations, the pressure sensing values and the corresponding writing operations may be stored in the processing unit in advance, and the processing unit may determine the corresponding writing operations according to the pressure sensing values.

When the pen point of the touch pen is contacted with the writing screen, the touch pen is pressed, the pen point of the touch pen is deformed to different degrees, the deformation of the touch pen to different degrees corresponds to different pressure sensing values, the specific corresponding relation can be stored in the processing unit in advance, the processing unit analyzes and processes the shot image to obtain the deformation amount of the pen point of the touch pen, and then the pressure sensing value of the touch pen is determined according to the deformation of the pen point of the touch pen. The different pressure sensing values may correspond to different writing operations, the pressure sensing values and the corresponding writing operations may be stored in the processing unit in advance, and the processing unit may determine the corresponding writing operations according to the pressure sensing values.

The disclosure further provides a control method of a touch device, where the touch device is any one of the touch panel embodiments, and fig. 4 is a schematic flow chart of a control method of a touch device according to an embodiment of the disclosure, as shown in fig. 4, where the control method includes S100 to S200:

S100, acquiring a shooting image of an image shooting unit.

When the touch pen is used for writing on the writing screen, a user needs to pick up the touch pen and move the touch pen to the position where the writing screen is located until the touch pen moves to the writing position, and an image shooting unit is arranged on the touch pen and can continuously shoot images in the moving process. The writing screen of the touch device comprises a processing unit, the processing unit is connected with the communication unit on the touch pen, and the processing unit acquires the shooting image of the image shooting unit through the communication unit.

S200, determining the position and/or the gesture of the touch pen relative to the writing screen according to the shot image.

Each captured image may include various image features, such as a pen point image of the stylus, a boundary of the writing screen, and boundary identifiers, and the processing unit analyzes the image features due to the boundary identifiers of different positions of the writing screen, so as to obtain a position and/or an attitude of the stylus relative to the writing screen.

In some embodiments, the control method further comprises determining a pressure sensing value of the stylus according to the deformation of a pen head of the stylus in the shot image, or determining the pressure sensing value of the stylus according to the detection value of a pressure sensor in the stylus.

The shot image comprises a pen point part of the touch pen, and the processing unit can determine the pressure sensing value of the touch pen according to the deformation of the pen point of the touch pen. When the pen point of the touch pen is contacted with the writing screen, the pen point of the touch pen can deform to different degrees, and the deformation to different degrees corresponds to different pressure sensing values, wherein specific corresponding relations can be stored in a processing unit in advance or can exist at other positions, the processing unit processes a shot image, and the pressure sensing value of the corresponding touch pen is determined according to the deformation amount of the pen point of the touch pen in the shot image.

In some other embodiments, the stylus includes a pressure sensor, and a detection value of the pressure sensor of the stylus determines a pressure sensing value of the stylus. When the pen point of the touch pen is contacted with the writing screen, the pen point of the touch pen can deform to different degrees, the pressure sensor can collect the pressure sensing value generated by the pressed pen point of the touch pen and transmit the pressure sensing value to the processing unit, and the processing unit can determine the pressure sensing value of the touch pen according to the detection value of the pressure sensor of the touch pen.

The pressure sensing value may be formed by handwriting of writing or clicking a writing screen. The different pressure sensing values may correspond to different writing operations, the pressure sensing values and the corresponding writing operations may be stored in the processing unit in advance, and the processing unit may determine the corresponding writing operations according to the pressure sensing values.

In some embodiments, determining the position and/or attitude of the stylus relative to the writing screen from the captured image includes:

The method comprises the steps of determining that a shot image comprises a writing screen boundary, a pen point image of a touch pen and no characteristic graph, and determining the proportion of the shooting size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of an image shooting unit and the distance between the image shooting unit and the writing screen according to the shooting size of the writing screen boundary and the actual size of the writing screen boundary.

And determining the position and/or the gesture of the stylus relative to the writing screen according to the positions of the pen point and the writing screen boundary of the stylus in the shot image, the proportion of the shooting size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

When it is determined that the shot image includes a boundary of the writing screen, a pen point image of the stylus, and no feature pattern, it is understood that the stylus is located at the boundary of the writing screen, and at this time, the position and/or posture of the stylus relative to the writing screen need to be determined by the boundary of the writing screen and the pen point image of the stylus. The writing screen is rectangular, the screen boundaries of the writing screen have no boundary marks, the writing screen boundaries in the photographed image need to comprise at least three boundaries, and if only one or two boundaries are included, it is impossible to determine which position of the writing screen is specific. Comparing the shooting size of the boundary of the writing screen with the actual size of the boundary of the writing screen, and determining the proportion of the shooting size of the boundary of the writing screen to the actual size of the boundary of the writing screen, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen, wherein the angle can be determined according to the deformation condition of the shot image, and the distance can be determined according to the size change condition of the shot image.

The shot image also comprises a pen point image of the touch pen, the position relation between the pen point of the touch pen and the screen boundary in the shot image can be determined according to the position of the pen point of the touch pen and the screen boundary in the shot image, the proportion of the shot size of the screen boundary and the actual size of the screen boundary, the shooting angle of the image shooting unit and the distance between the image shooting unit and the screen, and furthermore, the position and/or the gesture of the touch pen relative to the screen can be directly determined according to the position relation between the pen point of the touch pen and the screen boundary.

Determining that the shot image comprises a writing screen boundary and no characteristic graph, and determining the proportion of the shooting size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen according to the shooting size of the writing screen boundary and the actual size of the writing screen boundary;

And determining the position and/or the gesture of the touch pen relative to the writing screen according to the position relation between the pen point of the touch pen and the image shooting unit, the position of the writing screen boundary in the shot image, the proportion of the shooting size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

When it is determined that the captured image includes a screen boundary and no feature pattern, it is understood that the stylus is located at the screen boundary, at which time the position and/or posture of the stylus relative to the screen needs to be determined by the screen boundary. Illustratively, similar to the above embodiment, the writing screen is rectangular, the screen boundary of the writing screen has no boundary identifier, the writing screen boundary in the photographed image needs to include at least three boundaries, and if only one or two boundaries are included, it cannot be determined which position of the writing screen is specified. Comparing the shooting size of the boundary of the writing screen with the actual size of the boundary of the writing screen, and determining the proportion of the shooting size of the boundary of the writing screen to the actual size of the boundary of the writing screen, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen, wherein the angle can be determined according to the deformation condition of the shot image, and the distance can be determined according to the size change condition of the shot image.

However, the captured image provided in the embodiment of the present disclosure only includes a boundary of the writing screen, and the positional relationship between the tip of the stylus and the writing screen needs to be determined according to the positional relationship between the image capturing unit and the tip. The image shooting unit and the pen point are arranged at the fixed position of the touch pen, so that the position relation between the pen point of the touch pen and the image shooting unit can be determined, and the angle of the pen point and the distance from the writing screen can be determined when an image is shot according to the shooting angle, the distance and the like of the image shooting unit and the writing screen. The position of the boundary between the pen head of the touch pen and the writing screen in the shot image can be determined according to the positions of the pen head of the touch pen and the image shooting unit. Therefore, the position and/or posture of the stylus relative to the writing screen is determined according to the positional relationship of the tip of the stylus and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the capturing size of the writing screen boundary to the actual size of the writing screen boundary, the capturing angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

In some embodiments, the screen boundary of the writing screen is further provided with a plurality of boundary identifications, wherein the boundary identifications at different positions are different, and determining the position and/or the gesture of the stylus relative to the writing screen according to the photographed image comprises:

Determining that the shot image comprises a boundary mark, a pen point image of a touch pen and no characteristic graph, and determining the proportion of the shot size of the boundary mark to the actual size of the boundary mark, the shooting angle of an image shooting unit and the distance between the image shooting unit and a writing screen according to the shot size of the boundary mark and the actual size of the boundary mark;

And determining the position and/or the gesture of the stylus relative to the writing screen according to the positions of the pen point of the stylus and the boundary of the writing screen in the shot image, the proportion of the shooting size of the boundary mark and the actual size of the boundary mark, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

In the touch device provided by the embodiment of the disclosure, the screen boundary of the writing screen is also provided with a plurality of boundary identifiers, wherein the boundary identifiers at different positions are different. Therefore, from the boundary identification on the screen boundary, a specific location of the screen boundary can be determined. When the touch control pen is on the boundary of the writing screen, the shot image shot by the image shooting unit comprises a boundary mark, and the processing unit can identify the current position of the touch control pen according to the boundary mark. It should be noted that, the embodiments of the present disclosure do not limit the specific shape and number of the screen boundaries, but the number should not be too small, so as to avoid the situation that no boundary mark is identified.

When it is determined that the photographed image includes a boundary identification and no feature pattern, it can be understood that the stylus is located at the boundary of the writing screen. The writing screen is rectangular, the boundary of the writing screen is provided with boundary marks, the boundary marks at different positions are different, the position relation between the image shooting unit and the writing screen can be roughly determined according to the boundary marks in the shot image, further the shooting size of the boundary of the writing screen is compared with the actual size of the boundary of the writing screen, the proportion of the shooting size of the boundary of the writing screen to the actual size of the boundary of the writing screen, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen are determined, wherein the angle can be determined according to the deformation condition of the shot image, and the distance can be determined according to the size change condition of the shot image.

The shot image also comprises a pen point image of the touch pen, the position relation between the pen point of the touch pen and the boundary mark in the shot image can be determined according to the position of the pen point image of the touch pen and the boundary of the writing screen in the shot image, the proportion of the shot size of the boundary mark and the actual size of the boundary mark, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen, and further, the position and/or the gesture of the touch pen relative to the writing screen can be directly determined according to the position relation between the pen point of the touch pen and the boundary mark.

And determining that the shot image comprises the boundary mark and no characteristic graph, and determining the proportion of the shot size of the boundary mark to the actual size of the boundary mark, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen according to the shot size of the boundary mark and the actual size of the boundary mark.

And determining the position and/or the gesture of the touch pen relative to the writing screen according to the position relation between the pen point of the touch pen and the image shooting unit, the position of the boundary of the writing screen in the shot image, the proportion of the shooting size of the boundary mark and the actual size of the boundary mark, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

In the touch device provided by the embodiment of the disclosure, a plurality of boundary marks are arranged on the screen boundary of the writing screen, wherein the boundary marks at different positions are different. Therefore, from the boundary identification on the screen boundary, a specific location of the screen boundary can be determined. When the touch control pen is on the boundary of the writing screen, the shot image shot by the image shooting unit comprises a boundary mark, and the processing unit can identify the current position of the touch control pen according to the boundary mark. It should be noted that, the embodiments of the present disclosure do not limit the specific shape and number of the screen boundaries, but the number should not be too small, so as to avoid the situation that no boundary mark is identified.

However, the captured image provided by the embodiment of the disclosure only includes the boundary identifier, so the positional relationship between the pen point and the writing screen of the stylus needs to be determined according to the positional relationship between the image capturing unit and the pen point. The image shooting unit and the pen point are arranged at the fixed position of the touch pen, so that the position relation between the pen point of the touch pen and the image shooting unit can be determined, and the angle of the pen point and the distance from the writing screen can be determined when an image is shot according to the shooting angle, the distance and the like of the image shooting unit and the writing screen. The position of the boundary between the pen head of the touch pen and the writing screen in the shot image can be determined according to the positions of the pen head of the touch pen and the image shooting unit. Therefore, the position and/or the gesture of the stylus relative to the writing screen is determined according to the position relation of the pen point of the stylus and the image shooting unit, the position of the boundary of the writing screen in the shot image, the proportion of the shooting size of the boundary mark and the actual size of the boundary mark, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

In some embodiments, the control method further comprises:

In the whole process of writing operation by using the touch pen, a user needs to pick up the touch pen and move the touch pen to the position of the writing screen until the touch pen moves to the writing position, and an image shooting unit is arranged on the touch pen. However, during the movement of the stylus, some photographed images photographed by the image photographing unit have contents which do not include the image of the writing screen, and according to the part of the photographed images, specific positions cannot be identified, for example, the image without the writing screen may be caused by the fact that the stylus is far away from the writing screen, and at this time, the writing screen does not display the feature pattern. When the touch control pen is close to the writing screen, at least part of the images including the writing screen in the shot image can be determined, and the processing unit controls the writing screen to display the characteristic patterns, so that the writing screen images in the shot image include the characteristic patterns, and the position and/or the gesture of the touch control pen relative to the writing screen can be rapidly determined. By adopting the control mode, when the writing screen is a display screen, the characteristic graph can be prevented from interfering the content displayed by the writing screen to the greatest extent.

Determining that the shot image comprises a characteristic pattern and a pen point image of the touch pen, and determining the proportion of the shot size of the characteristic pattern to the actual size of the characteristic pattern, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen according to the shot size of the characteristic pattern and the actual size of the characteristic pattern;

And determining the position and/or the gesture of the stylus relative to the writing screen according to the position of the pen point and the characteristic pattern of the stylus in the shot image, the proportion of the shooting size of the characteristic pattern and the actual size of the characteristic pattern, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

The writing screen of the touch device is provided with characteristic patterns, wherein the characteristic patterns at different positions are different. Therefore, from the feature pattern on the writing screen, the specific position of the writing screen can be determined. When the touch control pen is on the writing screen, the shooting image shot by the image shooting unit comprises a characteristic mark, and the processing unit can identify the current position of the touch control pen according to the characteristic mark. It should be noted that, the embodiment of the present disclosure does not limit the specific shape and number of the feature identifiers, but the number identifiers are different and should not be too small, so as to avoid a situation that no feature identifier is identified.

When it is determined that the photographed image includes the feature pattern and the pen head image of the stylus, it can be understood that the stylus is located in the writing area of the writing screen. The writing screen is rectangular, a plurality of feature patterns are arranged on the writing screen, the feature patterns at different positions are different, the position relation between the image shooting unit and the writing screen can be determined according to the feature marks in the shot images, the shooting size of the feature patterns is compared with the actual size of the feature patterns, and the proportion of the shooting size of the feature patterns to the actual size of the feature patterns, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen are determined. Wherein, the angle can be determined according to the deformation condition of the shot image, and the distance can be determined according to the size change condition of the shot image.

The shot image also comprises a pen point image of the touch pen, and according to the position of the pen point of the touch pen and the characteristic pattern in the shot image, the proportion of the shot size of the characteristic pattern and the actual size of the characteristic pattern, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen, the position relation between the pen point of the touch pen and the characteristic pattern in the shot image can be determined, and the position and/or the gesture of the touch pen relative to the writing screen can be determined.

Determining that the shot image comprises a feature pattern, and determining the proportion of the shot size of the feature pattern to the actual size of the feature pattern, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen according to the shot size of the feature pattern and the actual size of the feature pattern;

and determining the position and/or the gesture of the touch pen relative to the writing screen according to the position relation between the pen point of the touch pen and the image shooting unit, the position of the characteristic graph in the shot image, the proportion of the shooting size of the characteristic graph and the actual size of the characteristic graph, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen.

When it is determined that the photographed image includes the feature pattern, it can be understood that the stylus is located in the writing area of the writing screen. The writing screen is rectangular, a plurality of feature patterns are arranged on the writing screen, the feature patterns at different positions are different, the position relation between the image shooting unit and the writing screen can be determined according to the feature marks in the shot images, the shooting size of the feature patterns is compared with the actual size of the feature patterns, and the proportion of the shooting size of the feature patterns to the actual size of the feature patterns, the shooting angle of the image shooting unit and the distance between the image shooting unit and the writing screen are determined. Wherein, the angle can be determined according to the deformation condition of the shot image, and the distance can be determined according to the size change condition of the shot image.

However, the captured image provided by the embodiment of the disclosure only includes the feature pattern, so the positional relationship between the tip of the stylus and the writing screen needs to be determined according to the positional relationship between the image capturing unit and the tip. The image shooting unit and the pen point are arranged at the fixed position of the touch pen, so that the position relation between the pen point of the touch pen and the image shooting unit can be determined, and the angle of the pen point and the distance from the writing screen can be determined when an image is shot according to the shooting angle, the distance and the like of the image shooting unit and the writing screen. The position of the boundary between the pen head of the touch pen and the writing screen in the shot image can be determined according to the positions of the pen head of the touch pen and the image shooting unit. Therefore, the position and/or the gesture of the stylus relative to the writing screen is determined according to the position of the pen point of the stylus and the characteristic pattern in the photographed image, the proportion of the photographing size of the characteristic pattern and the actual size of the characteristic pattern, the photographing angle of the image photographing unit, and the distance between the image photographing unit and the writing screen.

In some embodiments, the control method further comprises:

And determining that the pressure sensing value of the touch pen is larger than the pressure sensing threshold value, and controlling the writing screen to display handwriting characteristics.

When the touch pen is used for writing, the pen point of the touch pen is acted by force to generate a certain pressure sensing value, the communication unit transmits the pressure sensing value to the processing unit, and when the pressure sensing value of the touch pen is larger than the pressure sensing threshold value, the processing unit controls the writing screen to display handwriting characteristics which can also be used as characteristic patterns.

Illustratively, the stylus includes a pressure sensor, and a detection value of the pressure sensor of the stylus determines a pressure-sensitive value of the stylus. When the pen point of the touch pen is contacted with the writing screen, the pen point of the touch pen can deform to different degrees, the pressure sensor can collect the pressure sensing value generated by the pressed pen point of the touch pen and transmit the pressure sensing value to the processing unit, and the processing unit can determine the pressure sensing value of the touch pen according to the detection value of the pressure sensor of the touch pen. Or determining the pressure sensing value of the touch pen according to the deformation of the pen point of the touch pen. When the pen point of the touch pen is contacted with the writing screen, the pen point of the touch pen can deform to different degrees, and the deformation to different degrees corresponds to different pressure sensing values, wherein specific corresponding relations can be stored in a processing unit in advance or can exist at other positions, the processing unit processes a shot image, and the pressure sensing value of the corresponding touch pen is determined according to the deformation amount of the pen point of the touch pen in the shot image.

In some embodiments, after determining that the pressure sensing value of the stylus is greater than the pressure sensing threshold, controlling the writing screen to eliminate the feature pattern is further included.

After the pressure sensing value of the touch control pen is larger than the pressure sensing threshold value, the processing unit controls the writing screen to display handwriting characteristics, so that the characteristic graph can be eliminated by controlling the writing screen, the handwriting characteristics displayed by the writing screen serve as new characteristic graphs, and the position and/or the gesture of the touch control pen relative to the writing screen can be determined according to the handwriting characteristics in the shot image because the handwriting characteristics are different. The original characteristic patterns are eliminated, so that the characteristic patterns can be prevented from interfering with the display of the display screen, and the power of the touch device can be reduced.

In some embodiments, determining the position and/or posture of the stylus relative to the writing screen based on handwriting features in the captured image is further included.

When the stylus performs writing operation on the writing screen, for example, continuous writing or micro-lifting of the stylus can generate handwriting features, which are different and are located at different positions of the writing screen, so that the handwriting features can be used as new feature patterns. When the touch control pen is on the writing screen, the shot image shot by the image shooting unit comprises handwriting characteristics, and the processing unit can identify the current position of the touch control pen according to the handwriting characteristics. According to handwriting characteristics in the shot image and by combining the pen point position of the touch pen, the position and/or the gesture of the touch pen relative to the writing screen can be corrected, and the more accurate position and/or gesture can be determined.

Illustratively, the disclosed embodiments set the pressure threshold to 0, with the writing screen background being paper-like white, but with the feature pattern displayed thereon. When the touch control pen is in contact with the writing screen, a pressure sensing value larger than 0 is transmitted to the processing unit, handwriting characteristics are displayed on the writing screen, the displayed handwriting characteristics serve as new characteristic graphs, and the position and/or the gesture of the touch control pen relative to the writing screen can be further corrected. For example, if the handwriting feature is not below the tip of the stylus, then the position and/or attitude of the stylus relative to the writing screen may need to be corrected. At this time, the writing screen is controlled to eliminate the characteristic patterns, and the characteristic patterns on the background of the writing screen disappear and only comprise handwriting characteristics. As the stylus moves through the writing screen, new handwriting features are left behind, again correcting the position and/or attitude of the stylus relative to the writing screen. Before the stylus is not far away from the writing screen, the stylus is continuously written or lifted slightly, and the handwriting features are new feature patterns. When the stylus moves too fast or is far away from the writing screen, for example, the image shooting unit of the stylus does not shoot the effective graph, the position cannot be judged, the processing unit can control the display of the original characteristic graph, and the steps are continuously repeated.

In some embodiments, the stylus includes a first image capturing device and a second image capturing device, the first image capturing device and the second image capturing device being sequentially disposed along a length direction of the stylus, a distance between the first image capturing device and a tip of the stylus being smaller than a distance between the second image capturing device and the tip of the stylus, the method further comprising:

and determining the position of the touch pen relative to the writing screen according to the boundary of the writing screen in the shot image, and controlling the touch pen to display the characteristic graph in a region within a preset range of the position of the touch pen facing the writing screen.

The first image acquisition device and the second image acquisition device are sequentially arranged along the length direction of the touch pen, and a certain distance exists between the first image acquisition device and the second image acquisition device, so that different shooting images can be shot. The distance between the first image acquisition device and the pen point of the touch pen is smaller than the distance between the second image acquisition device and the pen point of the touch pen, and the first image acquisition device can be understood to be closer to the pen point of the touch pen, so that the first image acquisition device is used for shooting local images, and the second image acquisition device is far away from the pen point of the touch pen and further away from the writing screen, so that global images can be shot. In the captured image of the first image capturing device, the tip portion of the stylus is included, while in the captured image of the second image capturing device, more portions of the stylus are included, and a larger range of writing screens is included.

Because the shooting image shot by the first image acquisition device is a local image, the effective images included in the shooting image are fewer, and the positioning possibly cannot be accurately performed, at the moment, the shooting image shot by the second image acquisition device can be combined to obtain a larger shooting range, and the position of the touch pen relative to the writing screen is determined according to the boundary of the writing screen in the shooting image. After the first image acquisition device is combined with the second image acquisition device, the position of the touch pen relative to the writing screen can be accurately determined, and then the touch pen is controlled to display the characteristic pattern in a preset range of the position of the writing screen just by controlling the touch pen to display the characteristic pattern in a full screen mode when the touch pen is matched with the characteristic pattern to position the writing screen, so that the positioning accuracy can be improved. The preset range is obtained according to the photographed images of the first image acquisition device and the second image acquisition device, and the writing screen area outside the preset range does not need to display characteristic patterns, so that the interference of the characteristic patterns to a user is reduced.

In some embodiments, the method further comprises the steps of providing a multi-axis sensor on the stylus, and further comprising:

And determining that the shot image does not comprise a boundary and a characteristic pattern of the writing screen within a first preset time, and determining the position and/or the gesture of the touch control pen relative to the writing screen according to the detection value of the multi-axis sensor.

If the shot images shot by the shot image unit do not include the boundary of the writing screen and the characteristic graph in the first preset time, the processing unit cannot acquire effective information from the shot images, so that the stylus cannot be positioned. To avoid the long-time incapacitation, and the normal use of a user is affected, the position and/or the gesture of the touch control pen relative to the writing screen can be determined through the detection value of the multi-axis sensor. Wherein the sensors having an axis number greater than 3 are collectively referred to as multi-axis sensors. The multi-axis sensor is mostly obtained by combining an Accelerometer (ACCELEROMETER), a Gyroscope (GYROSCOPE) and an electronic COMPASS (COMPASS). The accelerometer senses acceleration in any direction and results by measuring the force applied to the assembly in an axial direction, in terms of the magnitude and direction of the acceleration in the axial direction (X, Y, Z). The gyroscope determines the current motion state (forward, backward, leftward, rightward, upward, downward) of the device by measuring the rotational motion state (angular velocity) of itself. The electronic compass can measure the included angles between the current equipment and the directions of east, south, west and north. Therefore, the position and/or posture of the stylus relative to the writing screen can be determined based on the detection values of the various sensors.

It should be noted that, the embodiment of the disclosure does not limit the specific type of the multi-axis sensor, and may be selected according to actual requirements. In some other embodiments, there are other types of sensors that determine the position and/or posture of the stylus relative to the writing screen, and this is not repeated in the embodiments of the present disclosure.

In some embodiments, further comprising:

And in the second preset time, the shot image does not comprise the boundary and the characteristic graph of the writing screen, and the writing screen is controlled to display the characteristic graph.

To avoid that the feature pattern on the writing screen affects the user experience, in the embodiment of the disclosure, the feature pattern is not directly displayed on the writing screen, for example, the background of the writing screen is white. If the shot images shot by the shot image unit do not include the boundary of the writing screen and have no characteristic graph in the second preset time, the processing unit cannot acquire effective information from the shot images, so that the stylus cannot be positioned. In order to avoid the influence on normal use of a user due to incapacity of positioning for a long time, the writing screen is controlled to display characteristic patterns. At this time, the shot image includes a feature pattern, and the processing unit can determine the position and/or posture of the stylus relative to the writing screen according to the feature pattern. In some optional embodiments, after determining the position and/or gesture of the stylus relative to the writing screen, the writing screen may be further controlled to stop displaying the feature pattern, so as to reduce interference of the feature pattern on the user. And the handwriting characteristics are used as new characteristic patterns, so that the position and/or the gesture of the touch pen relative to the writing screen can be determined, and the use experience of a user can not be influenced.

It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.

The foregoing is merely a specific embodiment of the disclosure to enable one skilled in the art to understand or practice the disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown and described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A touch device, comprising:

A writing panel, the writing panel comprising a writing screen and a processing unit;

A stylus pen, the stylus pen comprising at least one image capturing unit and a communication unit;

The stylus pen comprises a first image acquisition device and a second image acquisition device, the first image acquisition device and the second image acquisition device are sequentially arranged along the length direction of the stylus pen, and the distance between the first image acquisition device and the pen tip of the stylus pen is smaller than the distance between the second image acquisition device and the pen tip of the stylus pen;

The writing screen can display multiple characteristic graphics or be fixedly provided with multiple characteristic graphics;

The communication unit is communicatively connected with the processing unit, the communication unit is used to transmit the captured image of the image capturing unit to the processing unit, the processing unit is used to determine the position and/or posture of the stylus relative to the writing screen according to the captured image, the processing unit is further used to determine that the captured image includes the writing screen boundary, the stylus pen tip image and no feature graphics, and according to the captured size of the writing screen boundary and the actual size of the writing screen boundary, determine the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the capturing angle of the image capturing unit, and the distance between the image capturing unit and the writing screen;

The position and/or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

2. The touch device according to claim 1 is characterized in that the screen boundary of the writing screen is also provided with a plurality of boundary markers; wherein the boundary markers at different positions are different.

3. The touch device according to claim 2 is characterized in that the writing screen is a rectangle, the boundary marker is a square with one side missing, and the opening formed by the missing side faces the inside of the writing screen; and a marking graphic is set in the square.

4. The touch device according to claim 1 is characterized in that the stylus pen also includes a pressure sensor, and the communication unit is further used to transmit the detection value of the pressure sensor to the processing unit; the processing unit is used to determine the pressure sensitivity value of the stylus pen according to the detection value of the pressure sensor.

5 . The touch control device according to claim 1 , wherein the processing unit is further configured to determine a pressure sensitivity value of the stylus pen according to a deformation of a tip of the stylus pen in the captured image.

6. A control method for a touch device, characterized in that it is applicable to the touch device according to any one of claims 1 to 5, and the method comprises:

Acquire an image captured by an image capturing unit;

Determining the position and/or posture of the stylus relative to the writing screen according to the captured image;

Determining the position and/or posture of the stylus relative to the writing screen according to the captured image includes:

Determine that the captured image includes a writing screen boundary, a stylus pen tip image and no feature graphics, and determine, based on the captured size of the writing screen boundary and the actual size of the writing screen boundary, a ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

Determine the position and/or posture of the stylus relative to the writing screen according to the positions of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary to the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen;

The stylus pen comprises a first image acquisition device and a second image acquisition device, the first image acquisition device and the second image acquisition device are sequentially arranged along the length direction of the stylus pen, and the distance between the first image acquisition device and the pen tip of the stylus pen is smaller than the distance between the second image acquisition device and the pen tip of the stylus pen; the method further comprises:

The position of the stylus relative to the writing screen is determined according to the writing screen boundary in the captured image, and the stylus is controlled to display the characteristic pattern in an area within a preset range facing the writing screen.

7. The control method according to claim 6, further comprising:

Determining the pressure sensitivity value of the stylus pen according to the deformation of the stylus pen tip in the captured image; or,

The pressure sensitivity value of the stylus pen is determined according to the detection value of the pressure sensor in the stylus pen.

8. The control method according to claim 6, wherein determining the position and/or posture of the stylus relative to the writing screen according to the captured image comprises:

Determining that the captured image includes a writing screen boundary and does not have the characteristic pattern, and determining, according to the captured size of the writing screen boundary and the actual size of the writing screen boundary, a ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

The position and/or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the writing screen boundary and the actual size of the writing screen boundary, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

9. The control method according to claim 6, characterized in that the screen boundary of the writing screen is further provided with a plurality of boundary markers; wherein the boundary markers at different positions are different; and determining the position and/or posture of the stylus relative to the writing screen according to the captured image comprises:

Determining that the captured image includes a boundary mark, a stylus pen tip image and no feature graphics, and determining, according to the captured size of the boundary mark and the actual size of the boundary mark, a ratio of the captured size of the boundary mark to the actual size of the boundary mark, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

The position and/or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the writing screen boundary in the captured image, the ratio of the captured size of the boundary marker and the actual size of the boundary marker, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

10. The control method according to claim 6, characterized in that the screen boundary of the writing screen is further provided with a plurality of boundary marks; wherein the boundary marks at different positions are different; and determining the position and/or posture of the stylus relative to the writing screen according to the captured image comprises:

Determining that the captured image includes a boundary mark and no characteristic pattern, and determining, according to the captured size of the boundary mark and the actual size of the boundary mark, a ratio of the captured size of the boundary mark to the actual size of the boundary mark, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

The position and/or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the writing screen boundary in the captured image, the ratio of the captured size of the boundary marker and the actual size of the boundary marker, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

11. The control method according to claim 6, further comprising:

Determine that the captured image includes at least a partial image of the writing screen, and control the writing screen to display a characteristic graphic.

12. The control method according to claim 6, wherein determining the position and/or posture of the stylus relative to the writing screen according to the captured image comprises:

Determine that the captured image includes the characteristic pattern and the image of the stylus pen tip, and determine, according to the captured size of the characteristic pattern and the actual size of the characteristic pattern, the ratio of the captured size of the characteristic pattern to the actual size of the characteristic pattern, the capturing angle of the image capturing unit, and the distance between the image capturing unit and the writing screen;

The position and/or posture of the stylus relative to the writing screen is determined based on the positions of the stylus tip and the characteristic graphic in the captured image, the ratio of the captured size of the characteristic graphic and the actual size of the characteristic graphic, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

13. The control method according to claim 6, wherein determining the position and/or posture of the stylus relative to the writing screen according to the captured image comprises:

Determining that the captured image includes the characteristic pattern, and determining, according to the captured size of the characteristic pattern and the actual size of the characteristic pattern, a ratio of the captured size of the characteristic pattern to the actual size of the characteristic pattern, a capturing angle of an image capturing unit, and a distance between the image capturing unit and the writing screen;

The position and/or posture of the stylus relative to the writing screen is determined based on the positional relationship between the stylus tip and the image capturing unit, the position of the characteristic pattern in the captured image, the ratio of the captured size of the characteristic pattern and the actual size of the characteristic pattern, the shooting angle of the image capturing unit, and the distance between the image capturing unit and the writing screen.

14. The control method according to claim 12 or 13, further comprising:

It is determined that the pressure sensitivity value of the stylus pen is greater than a pressure sensitivity threshold, and the writing screen is controlled to display handwriting features.

15. The control method according to claim 14, characterized in that after determining that the pressure sensitivity value of the stylus pen is greater than the pressure sensitivity threshold, it further comprises:

The writing screen is controlled to eliminate the characteristic pattern.

16. The control method according to claim 14, further comprising:

The position and/or posture of the stylus relative to the writing screen is determined according to the handwriting features in the captured image.

17. The control method according to claim 6, further comprising: providing a multi-axis sensor on the stylus pen; and further comprising:

It is determined that within a first preset time, the captured image does not include a writing screen boundary and a characteristic pattern, and the position and/or posture of the stylus relative to the writing screen is determined according to the detection value of the multi-axis sensor.

18. The control method according to claim 6, further comprising:

It is determined that within a second preset time, the captured image does not include a writing screen boundary and a characteristic pattern, and the writing screen is controlled to display the characteristic pattern.