CN115480659A - Handwriting pen editing gesture recognition method, medium and electronic device - Google Patents

Abstract

The application relates to the field of terminal technology, and discloses a method, medium and electronic equipment for recognizing gestures of editing gestures with a stylus. The method includes: when the electronic device detects that the gesture track generated by the user using a stylus on the screen of the electronic device overlaps with the characters displayed on the screen, determining the first character area and the gesture track of the overlapping character; The electronic device determines whether the overlapping relationship between the gesture trajectory and the first character area satisfies the first predetermined condition; if the first predetermined condition is satisfied, the electronic device determines that the editing operation corresponding to the written test trajectory is a deletion operation, and deletes the overlapping characters . Thus, to a certain extent, the problem of misrecognition of the deletion gesture that the stylus pen draws a wavy line on the selected target printed character as the selected gesture is avoided.

Description

A kind of stylus pen editing gesture recognition method, medium and electronic equipment

technical field

The present application relates to the field of terminal technology, in particular to a method, medium and electronic device for recognizing editing gestures with a stylus.

Background technique

With the continuous iterative update of touch electronic devices, many touch electronic devices are equipped with a stylus as a way to improve office efficiency. In addition to the basic character or graphic input functions of the stylus, some stylus products have added shortcuts. Features of Gesture Editing.

For example, after a user writes a handwritten character with a stylus, the handwritten character is immediately converted into a printed character. When the user uses the stylus to edit the printed character, the user can use the stylus to draw on the selected target printed character. The wavy line realizes the function of deleting the target printed character, and the function of selecting the target printed character can also be realized by drawing a straight line on the selected target printed character by using the stylus.

However, the current stylus pen deletion shortcut gesture judgment method still has certain recognition pain points: when the user wants to delete some characters in the printed characters, use the stylus to draw a wavy line on the selected target printed characters, and the electronic device It is easy to misidentify the deletion gesture of drawing a wavy line on the selected target printed character by the stylus as the selected gesture, and then select and display the target printed character selected by the stylus instead of deleting the target printed character. In this way, there is The situation where the stylus deletes the shortcut gesture is misrecognized, and the user's physical examination is poor.

Contents of the invention

Embodiments of the present application provide a stylus pen editing gesture recognition method, medium and electronic equipment.

In the first aspect, the embodiment of the present application provides a method for recognizing a stylus editing gesture, the method comprising:

When the electronic device detects that the gesture trajectory generated by the user using the stylus on the screen of the electronic device overlaps with the characters displayed on the screen, determine the overlapping first character area of the character and gesture trajectory;

The electronic device determines whether the overlapping relationship between the gesture track and the first character area satisfies a first predetermined condition;

If the first predetermined condition is satisfied, the electronic device determines that the editing operation corresponding to the gesture track is a deletion operation, and deletes the overlapping characters.

In terms of the rules for displaying gesture trajectories, the embodiment of the present application considers the writing and editing scene of real pen and paper writing, so as to achieve the perceptual consistency of character editing. For the gesture trajectory of the delete operation, in pen and paper writing, users often delete some characters by smearing, that is, using the psychological perception of "what you see is what you get". Therefore, in the writing process of electronic devices, the deletion function can be realized by covering the text characters, that is, drawing different line shapes on the text characters, such as horizontal lines, oblique lines, wavy lines, etc., as long as the coverage rate reaches a certain level. A parameter range can be quickly deleted. As for the selection function, the setting rule of character highlighting can be adopted, and the method of circle selection, horizontal line or wavy line under the character can be used, etc. Such a setting rule is more in line with the psychological expectation of the user's handwriting editor, and it is easier to learn and remember. Therefore, to a certain extent, the problem of misrecognition of the delete gesture that the stylus pen draws a wavy line on the selected target printed character as the selected gesture is avoided.

In a possible implementation of the above-mentioned first aspect, the above-mentioned method further includes: the first character area is two overlapping coordinates of the highest point and the lowest point in the height direction of all the characters that are parallel to the width direction. a straight line, and two straight lines that respectively include the leftmost coordinate and the rightmost coordinate in the width direction of the character and are parallel to the height direction, enclosing a rectangular area.

In a possible implementation of the first aspect above, the electronic device determines whether the overlapping relationship between the gesture trajectory and the first character area satisfies a first predetermined condition, including:

In the case where the gesture trajectory type is a curve type, the electronic device determines a first ratio of the area of the first trajectory region of the gesture trajectory to the area of the first character region; wherein, the first trajectory The areas are two straight lines that respectively contain the highest point coordinates and the lowest point coordinates of the character height direction of the gesture track in the first character area and are parallel to the width direction, and respectively contain the leftmost coordinates and the rightmost coordinates of the character width direction The rectangular area surrounded by two straight lines parallel to the height direction;

The electronic device determines that the first predetermined condition is met when it is determined that the first ratio is within the first parameter interval.

It can be understood that the first parameter interval may be a set parameter interval of the curve coverage ratio.

In a possible implementation of the above first aspect, the above method further includes: the electronic device determining whether the overlapping relationship between the gesture trajectory and the first character area satisfies a first predetermined condition, including: In the case where the gesture track type is a straight line type, the electronic device acquires the inclination angle between the straight line gesture track and the character width direction of the first character area;

When the electronic device determines that the inclination angle is in the second parameter interval, it obtains a third ratio of the area of the second trajectory area to the area of the second character area;

Wherein, the second character area is two straight lines that respectively include the highest point coordinate and the lowest point coordinate of the character height direction of the character and are parallel to the straight line direction, and respectively include the leftmost coordinate and the rightmost coordinate in the character width direction. The rectangular area surrounded by two straight lines with side coordinates and parallel to the normal direction of the straight line;

The second trajectory area is two straight lines parallel to the straight line direction where the highest point coordinate and the lowest point coordinate of the character height direction of the gesture trajectory in the first character area are located, and the leftmost coordinate and the lowest point coordinate in the character width direction. The rectangular area surrounded by two straight lines parallel to the normal direction of the straight line where the coordinates on the right are located;

The electronic device determines that the first predetermined condition is met when it is determined that the third ratio is in the third parameter interval.

It can be understood that the second parameter interval may be a set parameter interval of the straight line inclination, and the third parameter interval may be a set parameter interval of the straight line coverage.

In a possible implementation of the above first aspect, the above method further includes: the electronic device determining whether the overlapping relationship between the gesture trajectory and the first character area satisfies a first predetermined condition, including:

In the case that the gesture trajectory type is a broken line type, the electronic device determines a second ratio between the area of the first trajectory area and the area of the first character area; wherein, the first trajectory area contains the The coordinates of the highest point and the coordinates of the lowest point in the character height direction of the gesture track in the first character area and two straight lines parallel to the width direction, and the leftmost coordinates and rightmost coordinates in the character width direction respectively and parallel to the height The rectangular area surrounded by two straight lines in the direction;

The electronic device determines that the first predetermined condition is met when it is determined that the second ratio is within the fourth parameter interval.

It can be understood that the fourth parameter interval may be a set parameter interval of the polyline.

In a possible implementation of the above first aspect, the above method further includes: if the type of the gesture trajectory is a curve type, the electronic device adopts fast Fourier transformation to obtain the sine wave of the curved gesture trajectory gather;

The electronic device obtains the frequency of the preset sine waves in the sine wave set according to the frequency value from large to small;

When the electronic device determines that the frequency of the preset sine wave is within the fifth parameter interval, it determines that the first predetermined condition is satisfied.

It can be understood that the fifth parameter interval may be a set parameter interval in the frequency domain of the curve.

In a possible implementation of the above first aspect, the above method further includes: if the type of the gesture trajectory is a curve type, the electronic device acquires the height of the curved gesture trajectory in the first character area The highest point coordinates and the lowest point coordinates of the direction;

The electronic device determines an inclination angle between a line between the highest point and the lowest point and the height direction according to the coordinates of the highest point and the lowest point;

When the electronic device determines that the inclination angle is in the sixth parameter interval, it determines that the first predetermined condition is met.

It can be understood that the sixth parameter interval may be a set parameter interval of the curve angle.

In a possible implementation of the above-mentioned first aspect, the above-mentioned method further includes: the electronic device determines that the number of overlapping characters is multiple, and the electronic device determines that the gesture track and the first When the overlapping relationship between a character area satisfies the first predetermined condition, the overlapping relationship between the gesture trajectory on each character of the overlapping characters and the single first character area of each character is also judged Whether the second predetermined condition is satisfied, and if it is judged that the second predetermined condition is satisfied, delete the characters satisfying the second predetermined condition.

It can be understood that the electronic device can determine whether the coverage rate of the gesture track on each character meets the reference standard, thereby deleting characters meeting the reference standard (the second predetermined condition), reducing the rate of mistaken deletion, and achieving accurate identification of the deletion operation.

In a possible implementation of the above-mentioned first aspect, the above-mentioned method further includes: the first character area is two straight lines that respectively contain the coordinates of the highest point and the coordinates of the lowest point in the height direction of a single character and are parallel to the height direction, and Respectively contain the leftmost coordinates and rightmost coordinates of a single character in the width direction and are parallel to the width direction, a rectangular area surrounded by two straight lines.

In a possible implementation of the above-mentioned first aspect, the above-mentioned method further includes: judging the overlapping relationship between the gesture trajectory on each of the multiple overlapping characters and the single first character area of each character Whether the second predetermined condition is met, including:

The electronic device determines the width ratio of the width value of each character in the overlapping characters to the width value of the first character area, and the height value of each character in the overlapping characters and the width value of the first character area A height ratio of the height value, the electronic device determines that the first predetermined condition is satisfied when the electronic device determines that the width ratio is in the seventh parameter interval and the height ratio is in the eighth parameter interval.

It can be understood that the seventh parameter interval may be the setting parameter interval of the single character coverage in the horizontal direction, and the eighth parameter interval may be the setting parameter interval of the single character vertical coverage.

In a possible implementation of the above first aspect, the above method further includes: the electronic device determining whether the overlapping relationship between the gesture trajectory and the first character area satisfies a predetermined condition, including:

The electronic device determines whether the character is a first language character or a second language character;

If the electronic device determines that it is a character in the first language, it acquires a predetermined condition corresponding to the character in the first language, and determines whether the overlapping relationship between the gesture track and the first character area satisfies the a predetermined condition corresponding to the first language character;

In the case that the electronic device determines that it is a character in the second language, it acquires a predetermined condition corresponding to the character in the second language, and determines whether the overlapping relationship between the gesture trajectory and the first character area satisfies the The predetermined condition corresponding to the first language type.

At present, the short-cut gesture editing function of the stylus has not considered the difference in recognition parameters under the rendering effect of different characters. It can be understood that the embodiment of the present application judges the language type of the printed character selected in the editing operation, that is, Chinese or English , and then use differentiated gesture type parameter recognition for different languages, which improves the recognition accuracy of stylus shortcut gestures and improves user experience.

In a possible implementation of the first aspect above, the first language includes any one of Chinese, English, German, and French, and the second language includes any one of Chinese, English, German, and French. A sort of.

In a possible implementation of the first aspect above, the characters are printed characters converted from handwritten characters.

In a possible implementation of the first aspect above, the characters are displayed on the operation interface of a preset application program on the electronic device, and the preset application program is memo, pen calculator, Nebo for Huawei, Any kind of handwriting.

In the second aspect, the embodiment of the present application also provides a readable medium, and instructions are stored on the readable medium, and when the instructions are executed on the electronic equipment, the electronic equipment realizes any one of the above described in the first aspect. Stylus editing gesture recognition method.

In a third aspect, an embodiment of the present application further provides an electronic device, including: a memory configured to store instructions executed by one or more processors of the electronic device, and

The processor is one of the processors of the electronic device, configured to execute the method for recognizing editing gestures with a stylus according to any one of the first aspect.

Description of drawings

1A to 1J are schematic diagrams showing application scenarios of a method for recognizing editing gestures with a stylus according to some embodiments of the present application.

FIG. 2 shows a software structural block diagram of a tablet 100 implementing the technical solution of the present application according to an embodiment of the present application.

FIG. 3 shows a schematic diagram of an application scenario of a tablet using a stylus for quick gesture recognition.

Fig. 4 shows a schematic diagram of multi-character coverage for curved gesture trajectories according to an embodiment of the present application.

Fig. 5 shows a schematic diagram of changes in the frequency domain of a curve of a curve gesture trajectory according to an embodiment of the present application.

Fig. 6 shows a schematic diagram of a curve angle of a curve gesture trajectory according to an embodiment of the present application.

Fig. 7 shows a schematic diagram of single-character coverage according to an embodiment of the present application.

Fig. 8 shows a schematic flowchart of a method for recognizing Chinese characters when the trajectory of the user's delete gesture is a curve, according to some embodiments of the present application.

FIG. 9 shows a schematic diagram of multi-character coverage corresponding to a polyline gesture trajectory according to an embodiment of the present application.

Fig. 10 shows a schematic diagram of coverage of a single character corresponding to a polyline gesture trajectory according to an embodiment of the present application.

Fig. 11 shows a schematic flowchart of a method for recognizing Chinese characters when the trace of the user's delete gesture is a broken line, according to some embodiments of the present application.

Fig. 12 shows a schematic diagram of drawing a straight line on a "target character" and a parameter range of the inclination angle of the line according to some embodiments of the present application.

Fig. 13 shows a schematic diagram of drawing a straight line on a "target word" and the coverage of the straight line according to some embodiments of the present application.

Fig. 14 shows a schematic flowchart of a method for recognizing Chinese characters when the trace of the user's delete gesture is a straight line, according to some embodiments of the present application.

Fig. 15 shows a schematic flowchart of a method for recognizing English characters when the trajectory of the user's delete gesture is a curve, according to some embodiments of the present application.

FIG. 16 shows a possible structural block diagram of the electronic device 100 shown in FIG. 1 according to an embodiment of the present application.

detailed description

Illustrative embodiments of the present application include, but are not limited to, a stylus pen editing gesture recognition method, medium, and electronic device.

In order to solve the technical problems mentioned in the background art, an embodiment of the present application discloses a method for recognizing editing gestures of a stylus. Specifically, after the characters written by the user with a stylus are converted into printed characters, if the user draws a set line trajectory on the converted printed characters, for example, a horizontal line, an oblique line, a folded line, a wavy line, etc., the set If the specified line track overlaps with printed characters, then it can be determined whether the user's operation is a delete operation according to the coverage relationship between the line track and the character area where the printed character overlapping with the line track is located. If it is determined to be a delete operation, then Printed characters overlapping with line traces are deleted. Therefore, to a certain extent, the problem of misrecognition of the delete gesture that the stylus pen draws a wavy line on the selected target printed character as the selected gesture is avoided. The specific scheme will be described below.

The technical solutions of the embodiments of the present application will be described in further detail below with reference to the drawings and embodiments.

The stylus editing gesture recognition method provided in the embodiment of the present application is applied to various software with stylus writing and editing functions, such as memo, pen calculator, Nebo for Huawei, handwriting, etc. The embodiments of the present application are applicable to various input and editing scenarios such as global handwriting and handwriting transferred to printed form in an electronic device system.

The stylus gesture recognition method provided by the embodiment of the present application will be further described below by taking the software with stylus writing and editing functions as a memo and the scene of handwriting-to-printed input and editing in an electronic device system as an example.

1A to 1J are schematic diagrams showing application scenarios of a method for recognizing editing gestures with a stylus according to some embodiments of the present application.

This application scenario includes the electronic device 100. Assuming that the user wants to make notes in the memo in the electronic device 100, the user first needs to open the memo, then, the user creates a new memo, and after turning on the handwriting function of the memo, perform handwriting Note operation.

For example, as shown in FIG. 1A , the display interface of the electronic device 100 displays a memo control 10 , and the user can open the memo by clicking the memo control 10 . After the user clicks on the memo control 10, the electronic device 100 enters the operation interface of the memo. As shown in FIG. 1B , the operation interface of the memo includes a create button 11 . After the user clicks the create button 21, the electronic device 100 displays the newly created memo. As shown in FIG. 1C , the newly created memo interface includes a handwriting control 12 and a handwriting-to-print control 13 . When the user wants to use the handwriting function of the electronic device 100, the function of converting handwritten characters into printed characters, and the editing operation function of the printed characters directly converted from handwritten characters by the stylus, the user can click the handwriting control 12 and the handwriting Turn to the printed text control 13 , at this time, the electronic device 100 displays a handwriting interface, as shown in FIG. 1D , the handwriting interface includes a handwriting area 14 and a printed text display area 15 .

Continuing to refer to FIG. 1D, the application scenario also includes a stylus 200. In some application scenarios, the stylus 200 can establish a communication connection with the electronic device 100 through Bluetooth, so as to perform touch operations on the electronic device 100. The touch operations include Editing operations and handwriting operations, etc. In addition, in other application scenarios, the user can also directly turn on the power button of the stylus 200 to perform touch operations on the electronic device 100 , but it is not limited thereto.

In this application scenario, the characters written by the user in the handwriting area 14 with the stylus 200 can be converted into printed characters in real time and displayed in the printed display area 15 . The handwriting area 14 is floating on the print display area 15, or the handwriting area 14 partially overlaps the print display area 15, but not limited thereto.

When the user edits the printed characters on the printed display area 15, if he wants to delete part of the printed characters, he can directly use the hand-held stylus 200 to print the printed characters that he wants to delete in the printed display area 15. Draw a strikethrough on the block character, and the strikethrough can be a straight line or a curve, and the electronic device 100 detects this operation, that is, deletes the printed block character with the line drawn.

During the writing and editing process of the stylus 200 on the electronic device 100, the delete function can be realized by covering the text characters, that is, drawing different line shapes on the text characters, such as horizontal lines, oblique lines, wavy lines, etc. , which can realize the delete function. The following describes several operations for deleting Chinese characters.

For example, as shown in FIG. 1E , the handwriting operation interface includes Chinese characters 16 , and the stylus 200 draws wavy lines 17 on some of the characters 161 in the Chinese characters 16 , and performs a deletion operation on some of the characters 161 . The content of the partial character 161 may be "and the so-called". The electronic device 100 may determine whether the user's operation is a deletion operation according to the coverage of the wavy line 17 on the four characters "and the so-called", and determine that the deleted characters are the four characters "the so-called". If it is determined to be a deletion operation, some characters 161 are deleted. As shown in FIG. 1F , after the electronic device 100 deletes the partial character 161 , the cursor 18 stays on the right side of the character or punctuation before the partial character 161 , and the character behind the partial character 161 moves forward to the right side of the cursor.

For another example, as shown in FIG. 1G , the stylus 200 draws a broken line 19 on a part of the character 161 in the Chinese character 16, and performs a deletion operation on the part of the character 161. The content of the partial character 161 may be "and the so-called". The electronic device 100 may determine whether the user's operation is a deletion operation according to the coverage of the broken line 19 on the four characters "and the so-called", and determine that the deleted characters are the four characters "the so-called". If it is determined to be a deletion operation, some characters 161 are deleted. As shown in FIG. 1F , after the electronic device 100 deletes the partial character 161 , the cursor 18 stays on the right side of the character or punctuation before the partial character 161 , and the character behind the partial character 161 moves forward to the right side of the cursor.

For another example, as shown in FIG. 1H , the stylus 200 draws a straight line 20 on a part of the character 161 in the Chinese character 16 , and deletes the part of the character 161 . The content of the partial character 161 may be "and the so-called". The electronic device 100 may determine whether the user's operation is a deletion operation according to the coverage of the horizontal line 20 on the four characters "and the so-called", and determine that the deleted characters are the four characters "and the so-called". If it is determined to be a delete operation, part of the characters 161 are deleted. As shown in FIG. 1F , after the electronic device 100 deletes the partial character 161 , the cursor 18 stays on the right side of the character or punctuation before the partial character 161 , and the character behind the partial character 161 moves forward to the right side of the cursor.

For another example, as shown in FIG. 1I , the stylus 200 draws oblique lines 21 on part of the characters 161 in the Chinese characters 16 , and deletes the part of the characters 161 . The content of the partial character 161 may be "and the so-called". The electronic device 100 may determine whether the user's operation is a deletion operation according to the coverage of the slash 21 on the four characters "and the so-called", and determine that the deleted characters are the four characters "and the so-called". If it is determined to be a delete operation, part of the characters 161 are deleted. As shown in FIG. 1F , after the electronic device 100 deletes the partial character 161 , the cursor 18 stays on the right side of the character or punctuation before the partial character 161 , and the character behind the partial character 161 moves forward to the right side of the cursor.

The definitions of the coverage relationship between curves, straight lines, oblique lines, broken lines, and the character area where printed characters are located are different. It can be understood that the coverage rate of a curve is the ratio between the area surrounded by the curve and the character area where the target printed characters are located. degree of relationship. The coverage of the polyline is the degree of relationship between the area enclosed by the polyline and the area of the target typographic characters. The straight line and oblique line are based on the inclination angle between the straight line and oblique line and the width direction of the target printed body. It will be introduced in detail below.

Introduce a kind of deletion operation to English character font again below, for example, as shown in Fig. Character 221 performs a delete operation. The content of some characters 221 may be "implicit positive". The electronic device 100 detects the deletion operation, and deletes part of the characters 221 .

Due to the large difference in character font characteristics between English and Chinese, the thresholds for judging the coverage of curves, straight lines, oblique lines, and broken lines are also different. The upper limit of the English setting parameter range is less than or equal to the upper limit value of the Chinese setting parameter range. The following will Specific introduction.

The judging method of the stylus 200 drawing broken lines, straight lines, and oblique lines on some characters 221 of the English characters 22 is the same as that of the stylus 200 drawing broken lines, straight lines, and oblique lines on some characters of the Chinese characters, and will not be repeated here. repeat.

The electronic device 100 applicable to this embodiment is a variety of terminal devices with writing and editing functions with a stylus, such as a tablet, a mobile phone, a computer, etc., but is not limited thereto.

The stylus 200 applicable to the embodiment itself is various types of stylus with writing and editing functions on electronic devices, such as active capacitive pens and passive capacitive pens, etc., but not limited thereto.

For the convenience of explanation, the electronic device 100 is the tablet 100, and the software with writing and editing functions on the tablet is the memo as an example, and the technical solution of the present application will be introduced in detail with reference to the accompanying drawings.

Fig. 2 shows a software structure block diagram for implementing the technical solution of the present application tablet 100 according to the embodiment of the present application. As shown in Fig. 2, the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, which are application program layer, application program framework layer, system library and kernel layer from top to bottom.

The application layer can include a series of applications. For example the memo application 21 .

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer may include a window manager 22, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The view system 22 includes visual controls, such as controls for displaying text, for displaying pictures, and so on. The view system can be used to build applications. An interface can consist of one or more views. For example, an interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The system layer includes an Android Runtime (Android Runtime) 23, and the Android Runtime 23 is responsible for the scheduling and management of the Android system.

The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver 24 and a sensor driver 25 .

In the embodiment of the present application, when the user uses the stylus 200 to edit the printed characters converted from the handwritten characters in the display interface of the memo application 21, the sensor driver 26 of the electronic device 100 can drive the touch sensor to receive handwritten characters. The signal transmitted by the pen 200 in contact with the touch screen of the electronic device 100 is used to determine the coordinates corresponding to the gesture trajectory (may be referred to as gesture) formed by the stylus 200 on the touch screen for editing operations (such as sliding and clicking). data, according to the gesture track coordinate data to determine the gesture type of the editing operation of the stylus 200 on the selected target printed character. For example, the memo application 21 can perform a regression fitting prediction operation on the coordinates of the gesture operation of the selected target printed character according to the stylus 200 to identify the gesture type, for example, if the coordinates of the gesture operation are fitted into a straight line, then it is a straight line type, or curve type if there are peaks and troughs. For example, as shown in FIG. 1E , the memo application 21 determines that the wavy line 17 is a curve type according to the coordinates of the wavy line 17 .

The memo application 21 judges whether the touch operation of the stylus 200 is a delete operation according to the gesture type determined by the gesture trajectory coordinate data corresponding to the edit operation, and if it is judged that the touch operation of the stylus 200 is a delete operation, sends a message to the view system 22 Send the delete target printed character instruction, the view system 22 obtains the view data of the deleted target printed character according to the deleted target printed character instruction, and sends the view data of the deleted target printed character to the Android runtime 23, and the Android runtime 23. Send the view data of the deleted target printed character to the display driver 24 of the kernel layer, thereby driving the touch screen to display the display interface of the deleted target printed character. For example, as shown in FIG. 1F, the electronic device 100 displays part of the character After 161 is deleted, it is displayed that the cursor 18 stays on the position on the right side of the previous character or punctuation point of the part character 161, and the characters behind the part character 161 move forward to the display interface on the right side of the cursor.

It can be understood that Fig. 2 is only a block diagram of a software structure for implementing the technical solution of the present application, but is not limited to this block diagram, and each functional module in the software structure shown in Fig. 100 is the subject of execution of the steps, which specifically introduces the technical solution of the present application.

It can be understood that characters can include text characters, symbols, or both characters and symbols. The reference factor of cultural differences is added to the judgment of the gesture type in the embodiment of the present application, and the recognition of different languages is considered. There is a big difference between Chinese and English in text and character layout The difference is that a single Chinese character occupies a large space and the space between Chinese characters is narrow, while a single English letter occupies a small space, and English is composed of words, there are spaces between words, and there is a certain space between characters. In such a text character presentation mode, if the same parameter identification interval is used when editing text characters, it is easy to misuse. For example, when using a wavy line to delete, because there are spaces before and after the target text character (the character to be deleted) in English characters, a certain word can be accurately deleted, but the Chinese space is small, so it is easy to correct the text characters before and after the target text character. Carry out cross-line coverage, resulting in the phenomenon of accidental deletion.

For example, FIG. 3 shows a schematic diagram of an application scenario in which a tablet utilizes a stylus for quick gesture recognition. As shown in FIG. The touch interface includes a writing area 20 and a printed character display area 31. After the touch electronic device 200 detects that the user has input characters in the writing area 20, it immediately converts the handwritten characters into printed characters and displays them on the printed character display. District 31. Taking the English characters 32 and Chinese characters 35 displayed in the printed character display area 31 as an example, the content of the English characters 32 is: Culture difference in editing, and the content of the Chinese characters 35 is: Chinese and English characters show cultural differences.

Assume that the user uses the stylus 200 to draw a curved line 31 (wavy line) on an English word 321 (eg Culture) to delete the English word 321 (eg Culture). The user uses the stylus 200 to draw a curved line 37 (wavy line) on the Chinese word 351 (such as culture) to delete the Chinese word 351 (such as culture). Since the distance d1 between English words and words is relatively large, and the distance d2 between Chinese characters and characters is relatively small, when the wavy line part drawn by the user using the stylus 200 falls on the Chinese word 351 (such as culture) that the user wants to delete When the adjacent characters (such as shown) are on, there is a problem of mistakenly deleting the characters adjacent to the Chinese word 351, that is, the current stylus delete shortcut gestures are misrecognized, and the user's physical examination is poor.

At present, the short-cut gesture editing function of the stylus has not considered the difference in recognition parameters under the rendering effect of different characters. It can be understood that the embodiment of the present application judges the language type of the printed character selected in the editing operation, that is, Chinese or English , and then use differentiated gesture type parameter recognition for different languages, which improves the recognition accuracy of stylus shortcut gestures and improves user experience.

It can be understood that the language type of printed characters may be any one or more of Chinese, English, Japanese, etc., but is not limited thereto. Printed characters can include literal characters and formulas. This article will take Chinese and English as examples to illustrate the technical solution of this application.

For Chinese characters, when the gesture trajectory is a curved line, determining whether the curved gesture trajectory is a delete operation is different from when the gesture trajectory is a straight line, an oblique line or a broken line. In order to illustrate the coverage of the curve, first introduce the definition of the character area where the selected target printed characters are located. For example, as shown in Figure 4, assume that in the embodiment of this application, the content of the selected target printed characters is: " Target character", in the current xy coordinate system, the x direction refers to the width direction of the "target character" from left to right, and the y direction refers to the height direction of the "target character" from top to bottom.

Among them, firstly, according to the coordinate set of all points of the "target word" in the touch display screen, determine the coordinates of the highest point and the lowest point in the coordinate set in the y direction, and at the same time filter out the leftmost coordinates and the rightmost coordinates in the x direction. The coordinates of the side, and then determine the character area where the target printed character is located.

For example, the coordinates of the highest point of the "target word" in the y direction are (0,y ₁₁ ), the coordinates of the lowest point in the y direction are (0,y ₁₂ ), and the rightmost coordinates of the "target word" in the x direction is (x ₁₂ ,0), and the leftmost coordinate is (x ₁₁ ,0). The character area where the target print character is located is defined as: a straight line including coordinates (0,y ₁₂ ) and parallel to the x-axis, a straight line including coordinates (0,y ₁₁ ) and parallel to the x-axis, including coordinates (x ₁₁ , 0) and parallel to the y-axis, and the area enclosed by a line with coordinates (x ₁₂ ,0) and parallel to the y-axis.

Then, calculate the difference between the two ordinates (y ₁₂ -y ₁₁ ), and calculate the difference between the two abscissas (x ₁₂ -x ₁₁ ), and then use the product of the difference between the ordinate and the difference between the abscissa as character area 1 The area, that is, the "target word" area.

It can be understood that the higher the coverage rate of the curve corresponding to the curve drawn by the stylus 200 on the target printed character, the higher the probability that the editing operation is a deletion operation, and the lower the coverage rate of the curve, it indicates that the editing operation is a deletion operation. The probability of the selected operation under the font character is higher. Similarly, the higher the frequency domain of the curve corresponding to the curve drawn by the stylus 200 on the target printed character and the higher the curve angle, the higher the coverage of the curve corresponding to the curve drawn by the stylus 200 on the target printed character. Higher, it indicates that the probability that the editing operation is a deletion operation is higher. Therefore, in the embodiment of the present application, the curve coverage rate, curve frequency domain, and curve angle corresponding to the curve drawn by the stylus 200 on the target printed character can be used as the judgment method. Whether the edit operation is the basis for the delete operation, if at least one condition is satisfied, the edit operation is determined to be a delete operation.

In order to improve the accuracy of the deletion operation recognition, the following introduces the curve coverage and its judgment rule, the curve frequency domain and its judgment rule, the curve angle and its Judgment rules.

The following introduces the definition of curve coverage. First, according to the coordinate set of all points of the curve in the character area, filter out the coordinates of the highest point in the height direction of the curve gesture, the lowest point coordinate in the height direction, the rightmost coordinate in the width direction, The leftmost coordinate in the width direction, which determines the track area where the curve is located. For example, as shown in Figure 4, the coordinates of the lowest point of the curve in the y direction are (0, y ₂₂ ), the coordinates of the highest point in the y direction are (0, y ₂₁ ), and the “target word” is at the leftmost point in the x direction The side coordinates are (x ₂₁ , 0), and the rightmost coordinates are (x ₂₂ , 0). The trajectory area 2 where the curve is located is defined as: a straight line including coordinates (0, y ₂₂ ) and parallel to the y-axis, a straight line including coordinates (0, y ₂₁ ) and parallel to the y-axis, including coordinates (x ₂₁ , 0) and a straight line parallel to the x-axis, and an area enclosed by a straight line with coordinates (x ₂₂ , 0) parallel to the x-axis.

Then, the ordinate difference (y ₂₂ -y ₂₁ ) and the abscissa difference (x ₂₂ -x ₂₁ ) are calculated, and the product of the two is used as the coverage area of the curve.

The ratio of the curve coverage area to the "target word" area is taken as the area coverage rate S, and the coverage rate Q is defined as the minimum area coverage rate.

As shown in Figure 4, under this coordinate system, the coverage calculation method is:

The judgment rule of curve coverage is introduced below: if the curve coverage is within the set parameter interval, that is, the area coverage S of the curve gesture type is within the area coverage judgment interval Q, then the user's editing operation is determined to be a delete operation.

The following introduces the definition and judgment rules of the frequency domain of the curve. It can be understood that Fourier's principle shows that any continuous measurement sequence or signal can be expressed as an infinite superposition of sine wave signals of different frequencies. In the embodiment of the present application, FIG. 5 shows a schematic diagram of changes in the frequency domain of a curve of a curved gesture trajectory according to the embodiment of the present application. As shown in Figure 5, first determine the character area 1 of the "target word" according to the above method, then determine the curve in the character area 1, and use the Fast Fourier Transform (FFT) method to convert the curve into For some waveform sets with fixed regular periodic frequencies, the frequency interval range is used as the judgment standard in the periodic frequency sets, for example, 5Hz to 30Hz. If the cycle frequency of any branch in the waveform set of the gesture curve is within this interval, it is deemed to meet the judgment condition of deleting the gesture.

For example, Fig. 5 is a schematic diagram of decomposing an irregular waveform in the character area 1 on the left into waveforms of at least three cycles on the right using Fast Fourier Transformation, specifically, the trajectory coordinates on the periodically collected curve gestures The data is input into the FFT formula, and the output results include at least the waveform of the periodic frequency f1 in the FFT variation branch 1, the waveform of the periodic frequency f2 in the FFT variation branch 2, and the waveform of the periodic frequency f3 in the FFT variation branch 3. If the periodic frequency If any one of f1, period frequency f2 and period frequency f3 is within the set frequency range, it is deemed to meet the judgment condition of the delete gesture.

The following introduces the definition and judgment rules of the curve angle.

Fig. 6 shows a schematic diagram of a curve angle of a curve gesture trajectory according to an embodiment of the present application. As shown in Figure 6, first determine the character area 1 of the "target word" according to the above method, then determine the curve in the character area 1, judge according to all point sets of the curve gesture, and determine the highest point in the y direction of the curve gesture trajectory The coordinates (x ₀ , y ₀ ) of the lowest point and the coordinates of the lowest point (x ₁ , y ₁ ), the angle between the line connecting the coordinates of the highest point and the coordinates of the lowest point and the x direction is used as the curve angle, and positioning Q is the curve angle interval, if If the angle of the gesture curve is within this interval, it is considered to meet the judgment condition.

Table 1 exemplarily illustrates the setting parameter range corresponding to each parameter type:

As shown in Table 1, the setting parameter interval of the curve coverage rate can be 0.35 to 1, and the setting parameter interval of the curve angle parameter can be: the upper slash (the angle connecting the trough to the peak) is 0.27 to 10.83, and the lower slash (The angle between the peak and the trough is -0.24 to -10.15, and the setting parameter interval of the frequency domain of the curve can be 5Hz to 30Hz.

In order to reduce the rate of mistaken deletion and achieve accurate identification of deletion operations, it is also possible to judge the coverage of each character by the editing gestures of the editing operation. If the coverage of each character is greater than the set coverage or the set coverage interval, it is determined as the selected "target character" character of the editing gesture. For example, as shown in FIG. 3 , when the wavy line 37 drawn by the user with the stylus 200 partially falls on a character (such as "show") adjacent to the Chinese word 351 (such as "culture") that the user wants to delete , because the coverage of the wavy line 37 in the characters (such as shown) adjacent to the Chinese word 351 (such as "culture") that the user wants to delete is not in the preset interval, then the character adjacent to the Chinese word 351 will not be mistaken. Characters removed to improve user health.

The concepts of single-character horizontal coverage and single-character vertical coverage are introduced below. It can be understood that the horizontal and vertical directions refer to the width direction and the height direction of the characters. The horizontal and vertical coverage ratio of a single character refers to the horizontal and vertical coverage ratio of the gesture formed on each character in the target print character by the editing operation in the character area of each character.

Fig. 7 shows a schematic diagram of single-character coverage according to an embodiment of the present application. As shown in Figure 7, first determine the character area of each character in the "target word" according to the above method, and then determine the curve in each character area 1, as shown in Figure 7, determine the "target word" in the "target word" according to the above method The character area 1 of the "word" character, and the track area 2 of the curve in character area 1.

Horizontal coverage of a single character, that is, the abscissa difference (x ₂₂ -x ₁₁ ) between the rightmost coordinate and the leftmost coordinate of the curve gesture track on each character in the "target word" and each character in the "target word" The ratio of the abscissa difference (x ₁₂ −x ₁₁ ) between the rightmost coordinate and the leftmost coordinate on a character defines Qx as the judgment interval of the abscissa coverage rate of a single character. For example, Qx is 0.42 to 1.

In the same way, the vertical coverage of a single character, that is, the vertical coordinate difference (y ₁₂ -y ₁₁ ) of the highest point coordinates and the lowest point coordinates of the curve gesture trajectory on each character in a single "target word" is the same as that in the "target word" The ratio of the ordinate difference (y ₂₂ -y ₂₁ ) between the highest point coordinate and the lowest point coordinate of each character defines Qy as the judgment interval of the ordinate coverage rate of a single character. For example, Qy is 0.35 to 1.

Whether the single-character abscissa coverage is in the judgment interval Qx, that is, greater than or equal to the upper limit of the judgment interval Qx, less than or equal to the lower limit of the judgment interval Qx, and the single-character ordinate coverage is in the judgment interval Qy, that is, greater than or equal to The upper limit value of the judgment interval Qy is less than or equal to the lower limit value of the judgment interval Qy. If S≥Q, that is, the coverage rate of the single character abscissa is in the judgment interval Qx, and the coverage rate of the single character ordinate is in the judgment interval Qy, then it is considered The editing operation corresponding to the target printed character that meets the conditions is a deletion operation.

Embodiment one

Fig. 8 shows a schematic flowchart of a method for recognizing Chinese characters when the trajectory of the user's delete gesture is a curve, according to some embodiments of the present application. As shown in Figure 8, the method includes:

Step 801: Detect that the user uses the stylus 200 to edit the printed characters converted from the handwritten characters in the display interface of the memo application program, and identify the language type of the target printed characters selected by the editing operation.

It can be understood that the tablet 100 can obtain the coordinate set of the gesture trajectory drawn by the user with the stylus 200 on the target printed character, and the coordinate set of the target printed character, if the coordinate set of the gesture trajectory is consistent with each of the target printed characters If the coordinate sets of characters have partially identical coordinates (horizontal and vertical coordinate values), it is determined that the gesture track overlaps with the target printed character, thereby determining that the touch operation of the stylus 200 is an editing operation.

The tablet 100 collects the strokes of the target handwritten characters corresponding to the target printed characters to obtain the gesture trajectory coordinates of the target handwritten characters, and inputs the gesture trajectory coordinates of the target handwritten characters into the language type recognition model to obtain the language type of the target handwritten characters, namely Get the language type of printed characters. Language type recognition models can be implemented based on neural network models, such as convolutional neural network models, deep sparse convolutional neural network models, deep recurrent neural network models, etc. for data preprocessing, feature extraction, and text classification.

For example, as shown in FIG. 1F, the handwriting operation interface of the memo application program includes printed characters converted from handwritten characters, such as Chinese characters 16, and the stylus 200 performs editing operations on some characters 161 in Chinese characters 16, such as drawing wavy line17. The content of part character 261 can be "and the so-called". The tablet 100 recognizes that the language type of some characters 261 is Chinese.

Step 802: Identify the gesture type of the editing operation of the stylus 200 on the selected target print character.

As mentioned above, different gesture types correspond to different judgment criteria. Therefore, the tablet 100 needs to recognize the gesture type of the editing operation of the stylus 200 on the selected target print character. The gesture type can be curve, straight line, polyline, etc.

Step 803: If it is recognized that the gesture type of the editing operation of the stylus 200 on the selected target printed character is a curved gesture, then obtain the curve drawn by the stylus 200 on the target printed character at the location of the target printed character. Curve coverage, curve frequency domain, and curve angle for character regions.

For example, as shown in FIG. 1E , the tablet 100 judges the coverage rate of the wavy line 17 corresponding to the Chinese language on some characters 161, the coverage rate of the wavy line 17 on some characters 161, and the curve frequency of the wavy line 17 on some characters 161. Whether the domain parameter or the curve angle is within the setting parameter interval.

Step 804: Judging whether any one of the acquired curve coverage, curve frequency domain and curve angle is within the set parameter range. If yes, go to step 805. If not, go to step 806.

Step 805: The type of the editing operation cannot be determined, and a prompt message to perform the editing operation again is displayed to the user.

It can be understood that, in some embodiments, when the type of the editing operation cannot be determined, the tablet 100 will display a prompt message for the user to perform the editing operation again. After the user performs the editing operation again, the tablet 100 performs step 801 to step 805 again.

Step 806: Obtain the horizontal and vertical coverage ratio of a single character of a single character on the target printed character.

It can be understood that, in order to reduce the false deletion rate, it is necessary to obtain the horizontal and vertical coverage ratio of a single character of a single character on the target printed character.

Step 806: Judging whether the acquired horizontal and vertical coverage of a single character is within the set parameter range, if yes, go to step 808, if not, go to 809.

In addition, in some other embodiments, in order to reduce the rate of mistaken deletion, after performing step 803, the tablet 100 can also directly obtain and judge the coverage rate of the editing gesture formed by the editing operation on each character, if the selected target character If the coverage rate of the editing gesture on each character is greater than the set coverage rate or within the set coverage rate range, then it is determined as the target character selected by the editing gesture.

Step 808: Determine that the editing operation is a delete operation, delete the selected printed character, the cursor stays on the right side of the character before the selected printed character, and the text character behind the selected printed character moves forward to the cursor place.

Step 809: Delete the selected typographical characters that meet the single-character coverage.

Embodiment two

It can be understood that the broken line here is a zigzag connection composed of a plurality of line segments from top to bottom along the character font or formula connected in sequence from end to end. The difference from Embodiment 1 is that the basis for judging in Embodiment 2 in the polyline gesture operation is that the tablet 100 acquires the polyline coverage corresponding to the polyline drawn by the stylus 200 on the target printed character and the target printed character. The single-character polyline coverage rate. According to the polyline coverage rate and the single-character polyline coverage rate in the target printed character, it is determined that the editing operation is a deletion operation. For example, as shown in Figure 9, assume that in the embodiment of the present application, the content of the selected target printed character is: "target word", under the current xy coordinate system, the y direction refers to the "target word" from left to right In the width direction, the x direction refers to the height direction of the "target word" from top to bottom.

For example, the coordinates of the highest point of the "target word" in the y direction are (0, y ₁₁ ), the coordinates of the lowest point in the y direction are (0, y ₁₂ ), and the rightmost coordinates of the "target word" in the x direction is (x ₁₂ , 0), and the leftmost coordinate is (x ₁₁ , 0). The character area where the target print character is located is defined as: a straight line including coordinates (0, y ₁₂ ) and parallel to the x-axis, a straight line including coordinates (0, y ₁₁ ) and parallel to the x-axis, including coordinates (x ₁₁ , 0) and a straight line parallel to the y-axis, and the area surrounded by a line with coordinates (x ₁₂ , 0) and parallel to the y-axis.

Then, calculate the difference between the two ordinates (y ₁₂ -y ₁₁ ), and calculate the difference between the two abscissas (x ₁₂ -x ₁₁ ), and then use the product of the difference between the ordinate and the difference between the abscissa as character area 1 The area, that is, the "target word" area.

In order to improve the accuracy of the deletion operation recognition, the coverage ratio of the fold line drawn by the stylus 200 on the target printed character in the character area 1 and its judgment rules are introduced below.

The following introduces the definition of polyline coverage. First, according to the coordinate set of all points of the polyline in the character area, filter out the coordinates of the highest point in the height direction of the polyline gesture, the lowest point in the height direction, the rightmost coordinate in the width direction, The leftmost coordinate in the width direction, which determines the track area where the polyline is located. For example, as shown in Figure 4, the coordinates of the lowest point of the polyline in the y direction are (0, y ₂₂ ), the coordinates of the highest point in the y direction are (0, y ₂₁ ), and the "target word" is at the far left in the x direction The side coordinates are (x ₂₁ , 0), and the rightmost coordinates are (x ₂₂ , 0). The trajectory area 2 where the polyline is located is defined as: a straight line containing coordinates (0, y ₂₂ ) and parallel to the y-axis, a straight line containing coordinates (0, y ₂₁ ) and parallel to the y-axis, and a straight line containing coordinates (x ₂₁ , 0) and a straight line parallel to the x-axis, and an area enclosed by a straight line with coordinates (x ₂₂ , 0) parallel to the x-axis.

Then, the ordinate difference (y ₂₂ -y ₂₁ ) and the abscissa difference (x ₂₂ -x ₂₁ ) are calculated, and the product of the two is used as the coverage area of the polyline.

The ratio of the polyline coverage area to the "target word" area is taken as the area coverage S, and the coverage Q is defined as the minimum area coverage.

As shown in Figure 10, under this coordinate system, the coverage calculation method is:

The judgment rule of polyline coverage is introduced below: if the polyline coverage is within the set parameter interval, that is, the area coverage S of the polyline gesture type is within the area coverage judgment interval Q, then the user's editing operation is determined to be a delete operation.

In order to reduce the mistaken deletion rate, it is also possible to judge the coverage rate of the editing gesture of the editing operation on each character. If the coverage rate of the editing gesture on each character is greater than the set coverage rate, it is determined as the selected " target character".

It is the same concept as the single-character horizontal coverage and single-character vertical coverage of polylines mentioned above.

Fig. 10 shows a schematic diagram of single character coverage according to an embodiment of the present application. As shown in Figure 10, first determine the character area of each character in the "target word" according to the above method, and then determine the curve in each character area 1, as shown in Figure 10, determine the "target word" in the "target word" according to the above method The character area 1 of the "word" character, and the track area 2 of the curve in character area 1.

Horizontal coverage of a single character, that is, the abscissa difference (x ₂₂ -x ₁₁ ) between the rightmost coordinate and the leftmost coordinate of the curve gesture track on each character in the "target word" and each character in the "target word" The ratio of the abscissa difference (x ₁₂ -x ₁₁ ) between the rightmost coordinate and the leftmost coordinate on the character, and Qx is defined as the single-character abscissa coverage judgment interval. For example, Qx is 0.42 to 1.

In the same way, the longitudinal coverage of a single character, that is, the vertical coordinate difference (y ₁₂ -y ₁₁ ) of the highest point coordinates and the lowest point coordinates of the curve gesture trajectory on each character in a single "target word" is the same as that in the "target word". The ratio of the ordinate difference (y ₂₂ -y ₂₁ ) between the highest point coordinate and the lowest point coordinate of each character defines Qy as the judgment interval of the ordinate coverage rate of a single character. For example, Qy is 0.35 to 1.

Whether the single-character abscissa coverage is in the judgment interval Qx, that is, greater than or equal to the upper limit of the judgment interval Qx, less than or equal to the lower limit of the judgment interval Qx, and the single-character ordinate coverage is in the judgment interval Qy, that is, greater than or equal to The upper limit value of the judgment interval Qy is less than or equal to the lower limit value of the judgment interval Qy. If S≥Q, that is, the coverage rate of the single character abscissa is in the judgment interval Qx, and the coverage rate of the single character ordinate is in the judgment interval Qy, then it is considered The editing operation corresponding to the target printed character that meets the conditions is a deletion operation.

Fig. 11 shows a schematic flowchart of a method for recognizing Chinese characters when the trace of the user's delete gesture is a broken line, according to some embodiments of the present application. As shown in Figure 11, the method includes:

Step 1101 and step 1102 have the same technical means as steps 801 and 802 in Embodiment 1, and will not be repeated here.

Step 1103: When it is recognized that the gesture type of the editing operation of the stylus 700 on the selected target printed character is a folded line gesture, then obtain the fold line drawn by the stylus 700 on the target printed character in the target printed character. The polyline coverage of the character area where the character is located.

Step 1104: Determine whether the obtained polyline coverage is within the set parameter range. If not, go to step 1105. If yes, go to step 1106.

Step 1105: The type of the editing operation cannot be determined, and a prompt message to perform the editing operation again is displayed to the user.

It can be understood that, in some embodiments, if the type of the editing operation cannot be determined, the tablet 110 will display a prompt message for the user to perform the editing operation again. After the user performs the editing operation again, the tablet 110 performs steps 1101 to 1104 again.

Steps 1106 to 1109 have the same technical means as steps 306 and 309 in Embodiment 1, and will not be repeated here.

In this way, since the coverage rate of the broken line in the character adjacent to the character that the user wants to delete is not within the preset range, the character adjacent to the character that the user wants to delete will not be deleted by mistake, which improves the user experience.

In addition, in other embodiments, in order to reduce the rate of mistaken deletion, after step 1102 is executed, the horizontal and vertical coverage of the editing gestures on each character in the target character selected by the editing operation can be directly judged, if the selected If the coverage rate of the editing gesture on each character in the target character is within the set coverage range, then it is determined as the target character selected by the editing gesture.

Embodiment Three

The user may draw a set line track on the converted printed character, for example, a horizontal line or an oblique line, so that the set line track overlaps the printed character, which is set as a delete operation. In the following, the horizontal line and the oblique line are collectively referred to as a straight line, and the method for judging the deletion operation will be described.

It can be understood that if the inclination angle of the straight line tends to 90 degrees, it is to extend the vertical line in the height direction of the printed character instead of deleting the gesture. Therefore, it can be judged first whether the inclination angle of the straight line is within the straight line interval, and to a certain extent, the case of tending to the vertical line can be ruled out.

For example, according to some embodiments of the present application, Fig. 12 shows a schematic diagram of drawing a straight line on the "target character" and the parameter range of the inclination angle of the line. As shown in Fig. 12, it is assumed that in the embodiment of the present application, the selected target The content of the printed characters is: "target word". Under the current xy coordinate system, the y direction refers to the width direction of the "target word" from left to right, and the x direction refers to the height direction of the "target word" from top to bottom.

Determine the character area 1 of the "target word" according to the above description. Then determine the coordinates (x ₃ , y ₃ ) and (x ₄ , y ₄ ) of the two ends of the straight line in the character area 1, and calculate the ordinate difference (y ₄ -y ₃ ) and the abscissa difference (x ₄ -x ₃ ), then calculate the ratio of the ordinate difference (y ₄ -y ₃ ) to the abscissa difference (x ₄ -x ₃ ), and then determine the inclination angle of the straight line in the character area 1 according to the arc tangent of the ratio. y means, x means. The range Y used for the inclination of the line may be -45° to 45°, -50° to 50°, -55° to 55°, or -75° to 75°, etc.

The following describes the definition of straight line coverage:

Figure 13, according to some embodiments of the present application, shows a schematic diagram of drawing a straight line on the "target word" and the coverage of the straight line, as shown in Figure 13, assuming that in the embodiment of the present application, the selected target printed character The content is: "target character", under the current xy coordinate system, the x direction refers to the width direction of the "target character" from left to right, and the y direction refers to the height direction of the "target character" from top to bottom. D direction is the direction of the straight line, F is the normal direction of the gesture trajectory of the straight line, as shown in Figure 13, the coordinates (x ₃ , y ₃ ) and (x ₄ , y ₄ ) of the two ends of the straight line in the character area 1, The coordinates of the highest point of the "target word" in the y direction are (x ₅ , y ₅ ), and the coordinates of the lowest point in the y direction are (x ₆ , y ₆ ). The leftmost coordinate of the "target word" in the x direction is (x ₇ , y ₇ ), and the rightmost coordinate in the x direction is (x ₈ , y ₈ ).

The character area 3 where the "target word" is located is defined as: a straight line including coordinates (x ₅ , y ₅ ) parallel to the D direction, a straight line including coordinates (x ₆ , y ₆ ) and parallel to the D direction, including the coordinates ( x ₇ , y ₇ ) and a straight line parallel to the F direction, including the rectangular area enclosed by the coordinates (x ₈ , y ₈ ) and parallel to the F direction.

The character area 4 where the straight line is located is defined as: a straight line including the coordinates (x ₅ , y ₅ ) parallel to the D direction, a straight line including the coordinates (x ₆ , y ₆ ) and parallel to the D direction, including the coordinates (x ₃ , y ₃ ) and parallel to the F direction, including the rectangular area enclosed by the coordinates (x ₄ , y ₄ ) and parallel to the F direction.

The ratio of the area of the character area 4 to the area of the character area 3 is taken as the area coverage J. The judgment interval of the area coverage ratio is K, and if the area coverage ratio J is in the judgment interval K, it is judged that the editing operation is a deletion operation.

Similarly, the definition of single-character coverage of straight lines and straight lines is the same as that of the above-mentioned curves and polylines. Single-character horizontal coverage refers to the difference between the maximum and minimum abscissa difference of the curve on each character and the The ratio of the maximum and minimum abscissa difference. The vertical coverage of a single character refers to the ratio of the maximum and minimum ordinate difference of each character on the curve to the maximum and minimum ordinate difference of each character. The judgment rule is also the same as above. I won't go into details here.

Fig. 14 shows a schematic flowchart of a method for recognizing Chinese characters when the trace of the user's delete gesture is a straight line, according to some embodiments of the present application. As shown in Figure 14, the method includes:

The technical means of step 1401 and step 1402 are the same as those of step 701 and step 702 in the second embodiment, and will not be repeated here.

Step 1403: When it is recognized that the gesture type of the editing operation of the stylus 200 on the selected target printed character is a straight line gesture, obtain the straight line drawn by the stylus 200 on the target printed character. The inclination angle between the character area where it is located and the left and right horizontal direction of the printed characters.

Step 1404: Determine whether the acquired inclination angle is within a preset inclination angle interval. If not, go to step 1405. If yes, go to step 1406.

When it is judged to be a straight line, call out the corresponding straight line inclination parameter range. If the recognition result is within the parameter range, it is judged that the current editing operation is a deletion operation. Otherwise, the operation fails, the gesture line disappears, and the user can perform the operation again.

Step 1406: Obtain the straight line coverage rate of the straight line drawn by the stylus 200 on the target printed character in the character area where the target printed character is located;

1407: Determine whether the acquired straight line coverage is within the set parameter interval, if yes, go to step 1408, if not, go to step 1405.

Steps 1408 to 1410 have the same technical means as steps 706 and 709 in Embodiment 1, and will not be repeated here.

Embodiment Four

Different from Embodiment 1, since there is no space between the words in the Chinese characters, but there is a space between the words (words) in the English characters, the upper limit of the English setting parameter interval is less than or equal to the Chinese setting parameter The upper limit of the interval.

Fig. 15 shows a schematic flowchart of a method for recognizing editing gestures with a stylus according to some embodiments of the present application. As shown in Figure 15, the method includes:

Steps 1501 to 1509 have the same technical means as steps 701 to 709, except that the value range of the set parameter interval in step 304 of the embodiment is different, that is, if it is recognized that the written language is English, each of the above parameter intervals According to the font size and spacing of English characters, select the corresponding differentiated interval range for operation judgment.

Similarly, it can be understood that the judging method of the stylus 200 for drawing broken lines, straight lines, and oblique lines on some characters in English characters is the same as that of the stylus 200 for drawing broken lines, straight lines, and oblique lines on some characters of Chinese characters. Refer to the technical means in Embodiment 2 and Embodiment 3. It is just that the upper limit value of the English setting parameter interval is less than or equal to the upper limit value of the Chinese setting parameter interval. For example, as shown in Figure 6, in the case of Chinese and English being the same font size and equal spacing, determine the width value of a single English word, and the ratio of the width value of a single Chinese word to the sum of the width values of a single word 1, determine the Chinese The width value of a single character, and the ratio 2 of the width value of a single Chinese character to the sum of the width values of a single character, the ratio 1 and the ratio 2 are divided to obtain a ratio 3, and the ratio 3 is multiplied by the lower limit value of Chinese to obtain the lower limit of English limit.

Table 1 exemplifies the setting parameter intervals corresponding to each parameter type in Chinese and English:

FIG. 16 shows a possible structural block diagram of the electronic device 100 shown in FIG. 1 according to an embodiment of the present application. The electronic device 100 can execute the method for recognizing a stylus editing gesture provided by the embodiment of the present application. Specifically, as shown in FIG. 16 , the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 111, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, and a power management module 141 , battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192 , a camera 193, a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.

It can be understood that, the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor ( image signal processor (ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver (universal asynchronous receiver) /transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and/or A universal serial bus (universal serial bus, USB) interface, etc.

The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . The MIPI interface includes a camera serial interface (camera serial interface, CSI), a display serial interface (displayserial interface, DSI), and the like. In some embodiments, the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the electronic device 100 . The processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the electronic device 100 .

The USB interface 130 is an interface conforming to the USB standard specification, specifically, it may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.

It can be understood that the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The charging management module 140 is configured to receive a charging input from a charger. The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 111 , the display screen 194 , the camera 193 , and the wireless communication module 160 . The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).

The wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.

A modem processor may include a modulator and a demodulator. Wherein, the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is passed to the application processor after being processed by the baseband processor. The application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 . In some embodiments, the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide wireless local area network (wireless local area networks, WLAN) (such as Wi-Fi network), Bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS) applied on the electronic device 100. , frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation. In the embodiment of the present application, the electronic device 100 can establish a communication connection with the stylus 200 through Bluetooth (BT) in the wireless communication module 160 .

In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (codedivision multiple access, CDMA), wideband code Wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM , and/or IR technology, etc. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou satellite navigation system (beidounavigation satellite system, BDS), a quasi-zenith satellite system (quasi- zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

The electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light emitting diode). AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

The electronic device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.

The internal memory 111 may be used to store computer-executable program codes including instructions. The internal memory 111 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like. The storage data area can store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.) and the like. In addition, the internal memory 111 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 111 and/or instructions stored in a memory provided in the processor. The internal memory 111 can be used to store the Overlay configuration file corresponding to the application program.

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be set in the processor 110, or some functional modules of the audio module 170 can be set in the processor 110.

The touch sensor 180K is also called "touch device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 , which is different from the position of the display screen 194 . In the embodiment of the present application, the electronic device 100 can receive the signal transmitted by the stylus 200 in contact with the touch display screen of the electronic device 100 through the touch sensor 180K, so as to know the coordinates of the stylus 200 on the touch display screen, and the electronic device 100 According to the coordinate data corresponding to the trajectory of the stylus 200 on the touch display screen, it is judged whether the user operation of the hand is a deletion operation, and if so, the character drawn by the line is deleted.

The keys 190 include a power key, a volume key and the like. The key 190 may be a mechanical key. It can also be a touch button. The electronic device 100 can receive key input and generate key signal input related to user settings and function control of the electronic device 100 .

The motor 191 can generate a vibrating reminder. The indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like. The SIM card interface 195 is used for connecting a SIM card.

The essence of the technical solution of the embodiment of the present application or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions It is used to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods in the various embodiments of the present application. The above-mentioned storage medium includes: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk, and other various media that can store program codes.

Although this application has been shown and described with reference to certain preferred embodiments thereof, those skilled in the art will understand that various changes in form and details may be made therein without departing from this disclosure. The spirit and scope of the application.

Claims (16)

1. A stylus editing gesture recognition method, applied to electronic equipment, is characterized in that the method comprises: When the electronic device detects that the gesture trajectory generated by the user using the stylus on the screen of the electronic device overlaps with the characters displayed on the screen, determine the overlapping first character area of the character and gesture trajectory; The electronic device determines whether the overlapping relationship between the gesture track and the first character area satisfies a first predetermined condition; If the first predetermined condition is satisfied, the electronic device determines that the editing operation corresponding to the gesture track is a deletion operation, and deletes the overlapping characters. 2. The method according to claim 1, wherein the first character area is two straight lines that respectively include the highest point coordinates and the lowest point coordinates of all overlapping characters in the height direction and are parallel to the width direction, And a rectangular area surrounded by two straight lines that respectively include the leftmost coordinate and the rightmost coordinate in the width direction of the character and are parallel to the height direction. 3. The method according to claim 2, wherein the electronic device determines whether the overlapping relationship between the gesture trajectory and the first character area satisfies a first predetermined condition, comprising: In the case where the gesture trajectory type is a curve type, the electronic device determines a first ratio of the area of the first trajectory region of the gesture trajectory to the area of the first character region; wherein, the first trajectory The areas are two straight lines that respectively contain the highest point coordinates and the lowest point coordinates of the character height direction of the gesture track in the first character area and are parallel to the width direction, and respectively contain the leftmost coordinates and the rightmost coordinates of the character width direction The rectangular area surrounded by two straight lines parallel to the height direction; The electronic device determines that the first predetermined condition is met when it is determined that the first ratio is within the first parameter interval. 4. The method according to claim 2, wherein the electronic device determines whether the overlapping relationship between the gesture trajectory and the first character area satisfies a first predetermined condition, comprising: In the case where the gesture track type is a straight line type, the electronic device acquires an inclination angle between the straight line gesture track and the character width direction of the first character area; When the electronic device determines that the inclination angle is in the second parameter interval, it obtains a third ratio of the area of the second trajectory area to the area of the second character area; Wherein, the second character area is two straight lines that respectively include the highest point coordinate and the lowest point coordinate of the character height direction of the character and are parallel to the straight line direction, and respectively include the leftmost coordinate and the rightmost coordinate in the character width direction. The rectangular area surrounded by two straight lines with side coordinates and parallel to the normal direction of the straight line; The second trajectory area is two straight lines parallel to the straight line direction where the highest point coordinate and the lowest point coordinate of the character height direction of the gesture trajectory in the first character area are located, and the leftmost coordinate and the lowest point coordinate in the character width direction. The rectangular area surrounded by two straight lines parallel to the normal direction of the straight line where the coordinates on the right are located; The electronic device determines that the first predetermined condition is met when it is determined that the third ratio is in the third parameter interval. 5. The method according to claim 2, wherein the electronic device determines whether the overlapping relationship between the gesture track and the first character area satisfies a first predetermined condition, comprising: In the case that the gesture trajectory type is a broken line type, the electronic device determines a second ratio between the area of the first trajectory area and the area of the first character area; wherein, the first trajectory area contains the The coordinates of the highest point and the coordinates of the lowest point in the character height direction of the gesture track in the first character area and two straight lines parallel to the width direction, and the leftmost coordinates and rightmost coordinates in the character width direction respectively and parallel to the height The rectangular area surrounded by two straight lines in the direction; The electronic device determines that the first predetermined condition is met when it is determined that the second ratio is within the fourth parameter interval. 6. The method according to claim 2, characterized in that the method comprises: In the case where the gesture trajectory type is a curve type, the electronic device acquires a sine wave set of the curved gesture trajectory by using a fast Fourier transform; The electronic device obtains the frequency of the preset sine waves in the sine wave set according to the frequency value from large to small; When the electronic device determines that the frequency of the preset sine wave is within the fifth parameter interval, it determines that the first predetermined condition is satisfied. 7. The method according to claim 2, characterized in that the method comprises: In the case where the gesture track type is a curve type, the electronic device acquires the highest point coordinates and the lowest point coordinates of the curved gesture track in the height direction of the first character area; The electronic device determines an inclination angle between a line between the highest point and the lowest point and the height direction according to the coordinates of the highest point and the lowest point; When the electronic device determines that the inclination angle is in the sixth parameter interval, it determines that the first predetermined condition is satisfied. 8. The method according to any one of claims 1 to 7, wherein the electronic device determines that the number of overlapping characters is multiple, and the electronic device determines the gesture trajectory and the When the overlapping relationship between the first character regions satisfies the first predetermined condition, it is also determined whether the gesture track on each of the overlapping characters and the single first character region of each character Whether the overlapping relationship satisfies the second predetermined condition, and if it is judged that the second predetermined condition is satisfied, delete the characters satisfying the second predetermined condition. 9. The method according to claim 8, wherein the first character area is two straight lines that respectively contain the highest point coordinate and the lowest point coordinate of a single character height direction and are parallel to the height direction, and respectively contain a single character The leftmost coordinate and the rightmost coordinate in the width direction are two straight lines parallel to the width direction, enclosed by a rectangular area. 10. The method according to claim 9, wherein judging whether the overlapping relationship between the gesture trajectory on each character in the overlapping characters and the single first character region of each character satisfies the first 2. Predetermined conditions, including: The electronic device determines the width ratio of the width value of each character in the overlapping characters to the width value of the first character area, and the height value of each character in the overlapping characters and the width value of the first character area A height ratio of the height value, the electronic device determines that the first predetermined condition is satisfied when the electronic device determines that the width ratio is in the seventh parameter interval and the height ratio is in the eighth parameter interval. 11. The method according to any one of claims 1 to 10, wherein the electronic device determines whether the overlapping relationship between the gesture track and the first character area satisfies a predetermined condition, comprising: The electronic device determines whether the character is a first language character or a second language character; If the electronic device determines that it is a character in the first language, it acquires a predetermined condition corresponding to the character in the first language, and determines whether the overlapping relationship between the gesture track and the first character area satisfies the a predetermined condition corresponding to the first language character; In the case that the electronic device determines that it is a character in the second language, it acquires a predetermined condition corresponding to the character in the second language, and determines whether the overlapping relationship between the gesture trajectory and the first character area satisfies the The predetermined condition corresponding to the first language type. 12. The method according to claim 11, wherein the first language includes any one of Chinese, English, German, and French, and the second language includes Chinese, English, German, and French. any of the 13. The method according to any one of claims 1 to 10, characterized in that the characters are printed characters converted from handwritten characters. 14. The method according to any one of claims 1 to 7, characterized in that, the characters are displayed on the operation interface of a preset application program on the electronic device, and the preset application program is memo, pen writing, etc. Any one of Calculator, Nebo forHuawei, and Handwriting. 15. A readable medium, characterized in that instructions are stored on the readable medium, and when the instructions are executed on the electronic device, the electronic device realizes the stylus editing gesture according to any one of claims 1 to 14 recognition methods. 16. An electronic device comprising: a memory for storing instructions to be executed by one or more processors of the electronic device, and The processor is one of the processors of the electronic device, configured to execute the method for recognizing editing gestures with a stylus according to any one of claims 1-14.

Images