[go: up one dir, main page]

WO2010102553A1 - Method and apparatus for handwriting input - Google Patents

Method and apparatus for handwriting input Download PDF

Info

Publication number
WO2010102553A1
WO2010102553A1 PCT/CN2010/070929 CN2010070929W WO2010102553A1 WO 2010102553 A1 WO2010102553 A1 WO 2010102553A1 CN 2010070929 W CN2010070929 W CN 2010070929W WO 2010102553 A1 WO2010102553 A1 WO 2010102553A1
Authority
WO
WIPO (PCT)
Prior art keywords
segment
handwriting
pattern
unit
covering
Prior art date
Application number
PCT/CN2010/070929
Other languages
French (fr)
Inventor
Yanming Zou
Shijun Yuan
Yingfei Liu
Kongqiao Wang
Original Assignee
Nokia Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Corporation filed Critical Nokia Corporation
Publication of WO2010102553A1 publication Critical patent/WO2010102553A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/32—Digital ink
    • G06V30/36—Matching; Classification
    • G06V30/373—Matching; Classification using a special pattern or subpattern alphabet
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/28—Character recognition specially adapted to the type of the alphabet, e.g. Latin alphabet
    • G06V30/287—Character recognition specially adapted to the type of the alphabet, e.g. Latin alphabet of Kanji, Hiragana or Katakana characters

Definitions

  • the present invention relates to information input technology, and more particularly, to a method and device for handwriting input.
  • a method for handwriting input which method may comprise: receiving an input of handwriting; segmenting the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and covering each of the segment units with a segment pattern.
  • an apparatus for handwriting input which device may comprise: receiving means configured to receive an input of handwriting; segmenting means configured to segment the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and covering means configured to cover each of the segment units with a segment pattern.
  • an electronic device comprising the aforesaid apparatus for handwriting input.
  • a mobile device which may comprise: a memory having computer instructions stored therein; a processor configured to, when executing the stored instructions, perform the steps of receiving an input of handwriting; segmenting the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and covering each of the segment units with a segment pattern .
  • a computer storage medium having computer instructions stored therein.
  • the computer instructions are executed to receive an input of handwriting; segment the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and cover each of the segment units with a segment pattern .
  • each segment unit obtained when the continuously-inputted handwriting is segmented is covered by a segment pattern.
  • Each segment pattern may be presented in different colors, brightness, flicker and so on.
  • the segment unit may be selected and highlighted and then is subjected to various operations.
  • Fig. 1 is a flowchart of a method for handwriting input according to an embodiment of the present invention
  • Figs. 2a and 2b are schematic views of the method for handwriting input according to the embodiment illustrated in Fig. 1;
  • Fig. 3 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • Figs. 4a and 4b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 3;
  • Fig. 5 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • Figs. 6a and 6b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 5;
  • Fig. 7 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • Figs. 8a to 8c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 7;
  • FIG. 9 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention
  • Figs. 10a to 10c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 9;
  • Fig. 11 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • Figs. 12a to 12c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 11;
  • Fig. 13 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • Figs. 14a and 14b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 13;
  • Fig. 15 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • Fig. 16 is a block diagram of a device for handwriting input according to another embodiment of the present invention.
  • Handwriting is one or more markings that are input by users on a touch screen. It may be, for example, characters of eastern words, characters of western words, punctuation marks, symbols in formulae, user-defined graphics or a table, etc.
  • Handwriting may consist of one or more points, each of which may be represented using a variety of known technigues including Cartesian coordinate (e.g. (x,y)), polar coordinate (e.g. (r, ⁇ )), three dimensional coordinate (e.g. (x,y,z), (r, ⁇ ,t), (x, y, t (time) , etc.), four dimensional coordinate (e.g. (x,y,z,t), (r, ⁇ ,p,t) , etc.), and other known technigues in the art.
  • Cartesian coordinate e.g. (x,y)
  • polar coordinate e.g. (r, ⁇ )
  • three dimensional coordinate e.g. (x,y,z), (r, ⁇ ,t), (x, y, t (time) , etc.
  • four dimensional coordinate e.g. (x,y,z,t), (r, ⁇ ,p,t) , etc.
  • the position of handwriting may include the two-dimensional, three-dimensional or three-dimensional coordinates of all points constituting the handwriting, and may comprise the size of an area determined by seguentially linking the outmost points of the handwriting, which area may be in a shape of, for example, a smallest rectangle, a smallest circle, a smallest ellipse, etc. which is capable of covering all points of the handwriting.
  • a segment unit is defined as a group of handwriting which have real meaning and may be obtained through segmenting and recognizing handwriting using a variety of segmenting algorithms . There are many practical algorithms that segment and recognize input handwriting to obtain one or more segment units of real meaning in the art.
  • the present invention may use any existing or future segmenting algorithm to segment and recognize input handwriting, and details thereof are omitted here in order not to confuse the focal point of the present invention . After the handwriting in a segment unit are deleted, this segment unit may be empty.
  • a segment pattern is graphics that is capable of at least partially covering handwriting, and preferably, it is graphics that entirely covers handwriting.
  • a segment pattern may be determined in dependence upon the position of handwriting. For example, it is possible to determine the coordinate of a segment pattern in dependence upon the coordinates of points constituting the handwriting and to determine the size of a segment pattern in dependence upon an area capable of covering all points of the handwriting.
  • a segment pattern may be in various shapes, such as a circle, an ellipse, a triangle, a rectangle, a polygon, an irregular shape, or any other shape.
  • a segment pattern may be presented in different colors, brightness, flicker, or a combination thereof. When a segment pattern is selected, it may be highlighted in the foregoing manner (s) or other available manner.
  • a device for handwriting input may be an arbitrary device with handwriting input capability, such as a handwriting-input pad, and may be used for mobile telephones, personal digital assistants, personal computers, and other electronic devices .
  • Fig. 1 is a flowchart of a method for handwriting input according to an embodiment of the present invention.
  • Figs. 2a and 2b are schematic views of the method for handwriting input according to the embodiment illustrated in Fig. 1.
  • the input handwriting may be, for example, a group of handwriting that is continuously input by a user to the touch screen of a mobile device using fingers or a stylus .
  • handwriting may be input to means that supports continuous input of handwriting in the embodiments of the present invention.
  • the handwriting input by the user may be " ⁇ C
  • step 102 the received handwriting is segmented into one or more segment units.
  • any handwriting segmenting methods in the prior art may be utilized to segment handwriting that is received continuously on the touch screen, so as to obtain one or more segment units of real meaning.
  • segmenting algorithms already in the prior art details thereof are omitted.
  • the received handwriting " ⁇ C ⁇ ? "b IM ⁇ t Ib " is segmented into six segment units containing "£,” “ ⁇ ,” n -fc , " " IM , “ "£,” and “Ib,” respectively.
  • each segment unit is covered by a segment pattern.
  • the position of handwriting in a segment unit is first obtained.
  • the position of handwriting in a segment unit may be obtained in dependence upon the coordinates of points of the handwriting in the segment unit containing " ⁇ C.”
  • a segment pattern is determined based on the obtained position.
  • a segment pattern for covering the segment unit can be obtained.
  • a segment pattern may be in a shape of a circle, an ellipse, a triangle, a rectangle, a polygon, an irregular shape, and so on that at least partially covers each segment unit.
  • a segment pattern is graphics that entirely covers the handwriting in a segment unit.
  • the segment units are covered using the determined segment patterns .
  • a segment pattern covering a segment unit does not mean the user certainly can see the covering procedure. On the contrary, this covering step may be performed in background and only used for associating a segment unit with its segment pattern.
  • the method for handwriting input of the present invention may further comprise step of presenting a segment pattern.
  • a segment pattern may be presented in different colors, brightness, flicker, or a combination thereof.
  • the segment pattern covering each segment unit may be shown as a blue ellipse .
  • the first segment unit may be selected automatically as a selected segment unit.
  • the user may also select a segment unit covered by a segment pattern by clicking on the segment pattern according to his own needs.
  • the segment pattern it may be highlighted. For example, if the segment unit containing " ⁇ C" is selected, it is presented in pink so as to indicate more clearly and explicitly that this segment unit is selected.
  • the method for handwriting input according to the embodiments of the present invention may further comprise step of modifying a segment unit using a segment pattern .
  • modifying a segment unit may be adopted.
  • Figs. 3, 5, 7, 9, 11, and 13 illustrate embodiments in which a segment unit is modified using a segment pattern, which will be described in detail below.
  • Fig. 3 is a flowchart of a method for modifying a segment unit according to an embodiment of the present invention.
  • original handwriting in a segment unit is replaced by new handwriting that is input directly to the segment pattern of this segment unit.
  • Figs. 4a and 4b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 3.
  • step 301 an input of handwriting in a segment pattern is received.
  • step 302 the handwriting in the segment unit is deleted.
  • step 303 the received handwriting is used as handwriting in the segment unit.
  • the original handwriting (" ⁇ :”) in the segment unit is replaced with the new handwriting (" ⁇ F”) .
  • the flow of Fig. 3 ends.
  • the user is allowed to modify the handwriting in a segment unit covered by a segment pattern, by directly inputting handwriting to the segment pattern without clicking on other functional key to perform complex operation, at any time. In this way, convenience is provided for the user to perform operation, and the user experience is improved.
  • Fig. 5 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • determination is made as to whether to delete existed handwriting in a segment unit covered by a segment pattern, by determining whether handwriting received at the segment pattern is a deletion identifier.
  • the deletion identifier is a symbol indicative of a delete operation. If it is determined that a deletion identifier is received at a segment pattern, then the handwriting in a segment unit covered by the segment pattern is deleted.
  • the deletion identifier may be predefined and stored in a memory that is accessible by the apparatus for handwriting input of the present invention.
  • the deletion identifier may be an arbitrary symbol including a punctuation mark such as cross ("x") , check mark (" V ”) and slash (V" or " ⁇ ”) , a character such as a character of eastern or western words, user-defined graphics and so on.
  • Figs . 6a and 6b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 5.
  • step 501 an input of handwriting in a segment pattern is received.
  • step 502 determination is made as to whether the received handwriting matches the predefined deletion identifier .
  • the predefined deletion identifier is a cross ("x") .
  • whether the received handwriting as shown in Fig. 6a matches the predefined deletion identifier ("x") needs to be determined.
  • there are various methods for determining whether handwriting matches a symbol such as methods used in handwriting recognition, character matching and handwriting identification, so details thereof are omitted.
  • step 503 the received handwriting and the handwriting in the segment unit is deleted.
  • step 503 the handwriting (" ⁇ :") in the segment unit is deleted, and the user-input handwriting (the cross) being received is also deleted. In this way, no handwriting will be present in the segment pattern covering this segment unit, and the segment unit is empty at this moment, as shown in Fig. 6b.
  • step 504 the handwriting in the segment unit is deleted.
  • step 505 the received handwriting is used as handwriting in the segment unit. Like steps 302 and 303, after steps 504 and 505 are performed, the handwriting originally contained in the segment unit is replaced with the received handwriting.
  • Fig. 7 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • a segment unit is empty, if the user inputs new handwriting to the segment pattern covering the segment unit, a new segment unit and its corresponding segment pattern may be obtained by segmenting the handwriting. That is, the previous segment unit and segment pattern are replaced with the newly obtained segment unit and segment pattern.
  • FIG. 8a to 8c are schematic views of the method for segmenting a segment unit according to the embodiment illustrated in Fig. 7.
  • Fig. 8a illustrates a scenario before the method of Fig. 7 is performed, in which two segment patterns covering two segment units are illustrated.
  • the first segment unit is empty, and the second one contains the handwriting "H ⁇ .”
  • the handwriting "H ⁇ " is presented in the segment pattern covering the second segment unit.
  • step 701 an input of handwriting in a segment pattern is received.
  • the user wants to obtain and the user has inputted the handwriting as shown in Fig. 8b to the segment pattern covering the first segment unit. Then the handwriting in the segment pattern covering the first segment unit, as shown in Fig. 8b, is received in step 701.
  • step 702 the segment unit and segment pattern are deleted.
  • the original segment unit and the segmented pattern covering this segment unit are no longer needed; instead, a new segment unit is obtained by segmenting the received handwriting, and the corresponding segment pattern is determined. Hence, the original segment unit and its corresponding segment pattern are deleted in this step.
  • step 703 the received handwriting is segmented into obtain one or more new segment units .
  • the received handwriting may be segmented using various methods for segmenting handwriting in the prior art.
  • the received handwriting is segmented into two segment units containing " ⁇ " and "IS,” respectively.
  • step 704 a segment pattern for covering the new segment units is determined.
  • step 705 the new segment units are covered using the determined segment pattern.
  • the segment pattern covering the new segment unit is determined by obtaining the position of the handwriting in the segment unit and the segment unit is covered by the determined segment pattern in steps 704 and 705, just like step 103.
  • Segmentation approaches may be determined using various approaches. For example, it may be determined based on the position of handwriting in a segment unit. Specifically, the coordinate of a segment pattern may be determined in dependence upon the coordinates of points constituting the handwriting, and the size of the segment pattern can be determined in dependence upon an area that covers all of the points constituting the handwriting.
  • step 706 the segment pattern that covers the new segment units is presented.
  • the method for modifying a segment unit of the present invention may further comprise the step of setting a logical relation, which may be precedence order or other logical relation (e.g. the relation expressed by a mathematical formula) .
  • the step of setting a logical relation may be, specifically, using the logical relation between the deleted segment unit and the unmodified segment unit as the logical relation between the new segment unit and the unmodified segment unit.
  • the two new segment units containing " ⁇ " and "IS” are in such a logical relation to the segment unit containing "H ⁇ " that they precede the latter, and a result from recognizing handwriting in each segment unit is "4 ⁇ "—*
  • Fig. 9 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • Figs. 10a to 10c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 9.
  • the user has inputted the handwriting "ic ⁇ f" "t-lMifetb", the handwriting has been segmented into several segment units using the method for handwriting input of the present invention and the segment patterns for covering each segment unit have been determined.
  • Fig. 10a illustrated six segment units that are covered a respective segment pattern. Among them, the first segment unit contains the handwriting " ⁇ C, " and the second segment unit contains the handwriting "-f.”
  • step 901 input handwriting is received.
  • the handwriting inputted by the user is a curve similar to a circle that may be a non-closed or closed curve.
  • step 902 determination is made as to whether the received handwriting encircles handwriting in at least two segment units or not.
  • the term "encircle” means when received handwriting is a closed curve, the closed curve at least contains part of the points of the handwriting in a segment unit.
  • this step it is first judged whether the closed curve contains the handwriting in a segment unit when the received handwriting is closed. Then it is judged whether the contained handwriting separately belong to two or more segment units. If the received handwriting encircles handwriting in at least two segment units, the flow then goes to step 903; otherwise, the flow ends.
  • the received handwriting entirely encircles the handwriting " ⁇ C" and nZ f" which separately belong to different segment units. Therefore, it is determined that the received handwriting encircles the handwriting in two segment units.
  • the received handwriting may be encircles part of the handwriting " ⁇ C” and part of the handwriting “ ⁇ ” .”
  • part of the handwriting " ⁇ C” and part of the handwriting nZ f" belong to different segment units, it is determined that the received handwriting encircles the handwriting in two segment units .
  • step 903 the segment patterns that cover the at least two segment units are deleted.
  • step 904 the encircled handwriting are merged into a new segment unit.
  • step 905 a segment pattern for covering the new segment unit is determined.
  • the segment pattern covering the new segment unit is determined by obtaining the positions of the handwriting in the segment units and the new segment unit is covered by the determined segment pattern in steps 904 and 905, just like step 103.
  • step 906 the new segment unit is covered by the determined segment pattern.
  • step 907 the segment pattern that covers the new segment unit is presented.
  • the segment pattern covering the new segment unit containing "#J" is presented as an ellipse and presented to be selected currently.
  • Fig. 11 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • Figs. 12a to 12c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 11.
  • the user has inputted the handwriting "ic ⁇ f" -blMifetb", the handwriting has been segmented into several segment units using the method for handwriting input of the present invention and the segment patterns for covering each segment unit have been determined.
  • Fig. 12a illustrated five segment units that are covered by corresponding segment patterns respectively. Among them, the first segment unit contains the handwriting
  • step 1101 an input of handwriting is received.
  • handwriting inputted by the user is a curve similar to a circle that may be a non-closed or closed curve, as shown in Fig. 12b.
  • step 1102 determination is made as to whether the received handwriting encircles only part of handwriting in one segment unit or not. In this step, it is first judged whether the closed curve contains the handwriting when the received handwriting is closed. Then it is judged whether the contained handwriting belongs to only one segment unit. If the received handwriting encircles only part of handwriting in one segment unit, the flow then goes to step 1103; otherwise, the flow ends.
  • the received handwriting entirely encircles the left half of the handwriting " ⁇ C” and only belongs to the segment unit that contains the handwriting " ⁇ C.” Therefore, it is determined that the received handwriting encircles only part of handwriting in one segment unit.
  • step 1103 the segment pattern that covers the segment unit is deleted.
  • step 1104 the segment unit is divided into two new segment units, one of which contains the part of handwriting and the other of which contains the remaining handwriting .
  • the first new segment unit contains the handwriting " ⁇ C”
  • the second new segment unit contains the handwriting " ⁇ p” .
  • step 1105 the segment pattern for covering each of the new segment unit is determined.
  • step 1106 each of the new segment unit is covered by the determined segment pattern.
  • step 1107 the segment pattern that covers each of the new segment unit is presented.
  • the segment pattern that covers the new segment unit containing " ⁇ C" is presented as an ellipse
  • the segment pattern that covers the new segment unit containing nZ f" is presented as another ellipse .
  • Fig. 13 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • one or more segment units covered by one of more segment patterns associated with handwriting received at one segment pattern are selected by determining whether the handwriting is a selection identifier or not, so as to make centralized modifications to handwriting in these segment units .
  • the selection identifier is a symbol indicative of a selection operation. When it is determined that a selection identifier is received at a segment pattern, then one or more segment units covered by one of more segment patterns associated with the handwriting are selected.
  • the selection identifier may be predefined and stored in a memory that is accessible by the device for handwriting input of the present invention. It may be an arbitrary symbol including a punctuation mark such as break line (" "), underline (" ”) and double underline
  • Figs. 14a and 14b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 13.
  • step 1301 an input of handwriting is received. Assume that in this embodiment there are six segment units containing "&,” “ ⁇ V' “- 3 G,” “M,” “£,” and “Ib,” respectively. If the user wants to select four segment units containing n i ⁇ ,” “ ⁇ ?,” “"b, “ and “Ij ⁇ ” at one time, he may directly input special handwriting that matches a predefined selection identifier to the segment pattern covering these four segment units without clicking on or selecting other functional key to perform this deletion. The handwriting being received in this step is as shown in Fig. 14a.
  • step 1302 determination is made as to whether the received handwriting matches the predefined selection identifier.
  • the predefined deletion identifier is an underline (" ") .
  • the predefined selection identifier (_)
  • step 1303 If a match is determined, i.e., the user wants to perform a selection operation, the flow then goes to step 1303; otherwise, the flow ends.
  • step 1303 it is determined that which segment pattern is selected in dependence upon the received handwriting.
  • the handwriting inputted by the user passes through four segment pattern covering four segment units that contain n i ⁇ ,” “ ⁇ ?,” nJ C,” and “Ij ⁇ ,” respectively. It is thus determined what are selected are these four segment patterns, as shown in Fig. 14b.
  • step 1304 the received handwriting is deleted.
  • step 1305 centralized modifications are made to the handwriting in segment units covered by the selected segment patterns. Then the flow ends.
  • the flow then ends.
  • the user-input handwriting being received may not come into contact with the segment patterns.
  • the coordinates of the start point and end point of the received handwriting may form a set range with any of the upper, lower, left and right sides of the handwriting.
  • the position of handwriting in each segment unit is compared with the set range; if the coordinate of a point of handwriting in a segment unit falls within the range, it is determined that the segment unit containing the handwriting is selected.
  • Fig. 15 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
  • segment units covered by one or more segment patterns are selected by determining the one or more segment patterns associated with the received handwriting.
  • a selection identifier needs to be defined in advance nor received handwriting needs to match the selection identifier in this embodiment.
  • step 1501 an input of handwriting is received.
  • step 1502 segment patterns that are associated with the received handwriting are determined. There may be various implementations of "association.” For example, if the position of a point contained by received handwriting falls within the area of a segment pattern, the handwriting is then associated with the segment pattern; or if the shortest distance from the position of a point contained in received handwriting to a segment pattern is less than a predefined threshold, the handwriting is then associated with the segment pattern; or if the received handwriting intersects with handwriting in a segment unit covered by a segment pattern, the handwriting is then associated with the segment unit. In step 1503, centralized modifications are made to segment units covered by the associated segment patterns .
  • Fig. 16 is a block diagram of an apparatus 1600 for handwriting input according to another embodiment of the present invention.
  • the apparatus 1600 may comprise receiving means 1610, segmenting means 1620, and covering means 1630.
  • Receiving means 1610 may be used for receiving input handwriting.
  • the handwriting may be input from any area of a handwriting-input pad or from a segment pattern. It may be characters of eastern words, characters of western words, punctuation marks, symbols in formulae, user-defined graphics or tables.
  • Segmenting means 1620 may be used for segmenting the received handwriting into one or more segment units, each of which being defined as a group of handwriting having a real meaning.
  • Covering means 1630 may be used for covering each segment unit with a segment pattern.
  • the covering means may comprise: means for obtaining the position of handwriting in the segment unit; means for determining graphics, which is capable of at least partially covering the handwriting, as the segment pattern based on the position; and means for covering the segment unit with the determined segment pattern .
  • the segment pattern may be a graphics entirely covering the handwriting .
  • the apparatus 1600 may further comprise presenting means 1640.
  • Presenting means 1640 may present a segment pattern in different colors, brightness, flicker or a combination thereof. Further, the presenting means may be used for highlighting the selected segment pattern.
  • a segment pattern may be presented as a circle, an ellipse, a triangle, a rectangle, a polygon, or an irregular shape .
  • the apparatus 1600 may further comprise modifying means 1650.
  • Modifying means 1650 may be used for modifying a segment unit by selecting a segment pattern that covers this segment unit.
  • Modifying means 1650 may comprise means for deleting handwriting in the segment unit and means for using received handwriting as handwriting in the segment unit.
  • Modifying means 1650 may comprise means for determining whether received handwriting matches a predefined deletion identifier or not and means for deleting the received handwriting and handwriting in the segment unit if matching.
  • Modifying means 1650 may comprise: means for deleting the segment unit and the segment pattern; means for segmenting the received handwriting into one or more new segment units; means for determining a segment pattern for covering the new segment units; means for covering the new segment units with the determined segment pattern; and means for presenting the segment pattern that covers the new segment units.
  • the modifying means may comprise means for using the logic relation of the deleted segment unit to the unmodified segment unit as the logical relation of the new segment unit to the unmodified segment unit
  • Modifying means 1650 may comprise means for, in case that received handwriting encircles handwriting in at least two segment units, deleting the segment patterns that cover the at least two segment units, merging the encircled handwriting into a new segment unit, determining a segment pattern for covering the new segment unit, covering the new segment unit with the determined segment pattern covering and presenting the segment pattern that covers the new segment unit.
  • Modifying means 1650 may comprise means for performing the following operations in case that received handwriting encircles part of handwriting in one segment unit: deleting the segment pattern that covers the segment unit; dividing the segment unit into two new segment units, one of which contains the part of handwriting and the other of which contains the remaining handwriting; determining segment patterns for covering each of the new segment unit; covering each of the new segment unit with the determined segment patterns; presenting the segment patterns that cover each of the new segment unit.
  • Modifying means 1650 may comprise: means for determining whether received handwriting matches a predefined selection identifier; and means for, in case of a match, determining which segment pattern is selected based on the received handwriting, deleting the received handwriting and making centralized modifications to handwriting in segment units covered by the selected segment pattern.
  • Modifying means 1650 may comprise: means for determining which segment patterns are associated with received handwriting; and means for making centralized modifications to segment units covered by the associated segment patterns.
  • the present invention further relates to a handwriting-input mobile terminal, which comprises a storage medium having the following program codes stored therein: a program code for receiving an input of handwriting; a program code for segmenting the received handwriting into one or more segment units, each of which is defined as a group of handwriting having a real meaning; and a program code for covering each of the segment units with a segment pattern.
  • the present invention further provides an electronic device comprising the apparatus for handwriting input.
  • the present invention further provides an electronic device, which may comprise: a memory having computer instructions stored therein; a processor configured to, when executing the stored instructions, perform the steps of receiving an input of handwriting, segmenting the received handwriting into one or more segment units, each of which is defined as a group of handwriting having a real meaning, and covering each segment unit with a segment pattern.
  • the present invention further provides a computer storage medium having computer instructions stored therein and performing the steps of , when the computer instructions are executed, receiving inputted handwriting, segmenting the received handwriting into one or more segment units, each of which is defined as a group of handwriting having a real meaning, and covering each segment unit with a segment pattern.
  • the disclosed methods of the present invention may be implemented in software, hardware or a combination of software and hardware.
  • the hardware part may be implemented using a dedicated logic, and the software part may be stored in a memory and be implemented by a proper instruction implementing system, such as a microprocessor, a personal computer (PC) or a mainframe.
  • a proper instruction implementing system such as a microprocessor, a personal computer (PC) or a mainframe.
  • the present invention may also be embodied in a computer program product arranged on a signal carrier medium to be used for any proper data processing system.
  • signal carrier medium can be a transmission medium or a recordable medium used for machine readable information, including a magnetic medium, optical medium or other proper medium.
  • Examples of a recordable medium include a floppy or magnetic disc in a hard disc drive, an optical disc for an optical drive, a magnetic tape, and other medium those skilled in the art can conceive.
  • any communication terminal with proper programming means can perform steps of the method of the present invention as embodied in a program product for example.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Character Discrimination (AREA)

Abstract

Disclosed is a method and an apparatus for handwriting input. The method may comprise: receiving an input of handwriting; segmenting the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and covering each of the segment units with a segment pattern.

Description

METHOD AND APPARATUS FOR HANDWRITING INPUT
FIELD OF THE INVENTION
The present invention relates to information input technology, and more particularly, to a method and device for handwriting input.
BACKGROUND OF THE INVENTION
Nowadays most touch devices (e.g. mobile devices with a touch screen) have a large touch screen and can detect and show the positions of continuously-input handwriting. This means users can write more than one word on the screen each time. This continuous input is usually called continuous handwriting input, compared to character-by-character input. To get the real meaning of those continuously-input handwriting, they need to be segmented and then recognized as one or more segment units of real meaning. In the prior art, there are already many technigues for segmenting and recognizing continuously-input handwriting.
According to the prior art, when a user performs handwriting on a handwriting-input device, he/she however does not know what kind of segmentation is performed by the device to input handwriting, so that he/she cannot edit, delete, copy or paste results of the segmentation conveniently.
Therefore, there is a need in the art for a technical solution capable of presenting to users a result of segmentation of continuously-input handwriting so as to make it convenient for a user to modify the result of segmentation.
SUMMARY OF THE INVENTION
In view of the problems discussed above, the present invention is intended to provide a method and device for handwriting input. According to a first aspect of the present invention, there is provided a method for handwriting input, which method may comprise: receiving an input of handwriting; segmenting the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and covering each of the segment units with a segment pattern.
According to a second aspect of the present invention, there is provided an apparatus for handwriting input, which device may comprise: receiving means configured to receive an input of handwriting; segmenting means configured to segment the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and covering means configured to cover each of the segment units with a segment pattern.
According to a third aspect of the present invention, there is provided an electronic device comprising the aforesaid apparatus for handwriting input.
According to a fourth aspect of the present invention, there is provided a mobile device, which may comprise: a memory having computer instructions stored therein; a processor configured to, when executing the stored instructions, perform the steps of receiving an input of handwriting; segmenting the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and covering each of the segment units with a segment pattern .
According to a fifth aspect of the present invention, there is provided a computer storage medium having computer instructions stored therein. The computer instructions are executed to receive an input of handwriting; segment the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and cover each of the segment units with a segment pattern .
According to an embodiment of the present invention, each segment unit obtained when the continuously-inputted handwriting is segmented is covered by a segment pattern. Each segment pattern may be presented in different colors, brightness, flicker and so on. When there is a need to modify a segment unit, the segment unit may be selected and highlighted and then is subjected to various operations. Other features and advantages of the present invention will become apparent from the description of the preferred embodiments explaining the principles of the present invention, when taken in conjunction with the figures . BRIEF DESCRIPTION ON THE DRAWINGS
As the present invention is better understood, other objects and effects of the present invention will become more apparent and easy to understand from the following description, taken in conjunction with the figures wherein :
Fig. 1 is a flowchart of a method for handwriting input according to an embodiment of the present invention;
Figs. 2a and 2b are schematic views of the method for handwriting input according to the embodiment illustrated in Fig. 1;
Fig. 3 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention;
Figs. 4a and 4b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 3; Fig. 5 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention;
Figs. 6a and 6b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 5;
Fig. 7 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention;
Figs. 8a to 8c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 7;
Fig. 9 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention; Figs. 10a to 10c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 9;
Fig. 11 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention;
Figs. 12a to 12c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 11;
Fig. 13 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention;
Figs. 14a and 14b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 13; Fig. 15 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention; and
Fig. 16 is a block diagram of a device for handwriting input according to another embodiment of the present invention.
Like reference numerals designate the same, similar, or corresponding features or functions throughout the drawings . DESCRIPTION OF THE PREFERRED EMBODIMENTS
The embodiments of the present invention will be explained and described in more detail with reference to the figures. It is to be understood that the figures and embodiments of the present invention are for illustration only and not limiting the protection scope of the present invention . For the purpose of clarity, the terms employed in the present invention are explained first. 1. Handwriting
Handwriting is one or more markings that are input by users on a touch screen. It may be, for example, characters of eastern words, characters of western words, punctuation marks, symbols in formulae, user-defined graphics or a table, etc.
Handwriting may consist of one or more points, each of which may be represented using a variety of known technigues including Cartesian coordinate (e.g. (x,y)), polar coordinate (e.g. (r,θ)), three dimensional coordinate (e.g. (x,y,z), (r,θ,t), (x, y, t (time) , etc.), four dimensional coordinate (e.g. (x,y,z,t), (r,θ,p,t) , etc.), and other known technigues in the art. The position of handwriting may include the two-dimensional, three-dimensional or three-dimensional coordinates of all points constituting the handwriting, and may comprise the size of an area determined by seguentially linking the outmost points of the handwriting, which area may be in a shape of, for example, a smallest rectangle, a smallest circle, a smallest ellipse, etc. which is capable of covering all points of the handwriting.
2. Segment unit
A segment unit is defined as a group of handwriting which have real meaning and may be obtained through segmenting and recognizing handwriting using a variety of segmenting algorithms . There are many practical algorithms that segment and recognize input handwriting to obtain one or more segment units of real meaning in the art. The present invention may use any existing or future segmenting algorithm to segment and recognize input handwriting, and details thereof are omitted here in order not to confuse the focal point of the present invention . After the handwriting in a segment unit are deleted, this segment unit may be empty.
3. Segment pattern
A segment pattern is graphics that is capable of at least partially covering handwriting, and preferably, it is graphics that entirely covers handwriting. A segment pattern may be determined in dependence upon the position of handwriting. For example, it is possible to determine the coordinate of a segment pattern in dependence upon the coordinates of points constituting the handwriting and to determine the size of a segment pattern in dependence upon an area capable of covering all points of the handwriting.
A segment pattern may be in various shapes, such as a circle, an ellipse, a triangle, a rectangle, a polygon, an irregular shape, or any other shape. A segment pattern may be presented in different colors, brightness, flicker, or a combination thereof. When a segment pattern is selected, it may be highlighted in the foregoing manner (s) or other available manner. It is to be understood that a device for handwriting input according to the embodiment of the present invention may be an arbitrary device with handwriting input capability, such as a handwriting-input pad, and may be used for mobile telephones, personal digital assistants, personal computers, and other electronic devices .
Fig. 1 is a flowchart of a method for handwriting input according to an embodiment of the present invention. Figs. 2a and 2b are schematic views of the method for handwriting input according to the embodiment illustrated in Fig. 1.
To being with, in step 101, handwriting being input is received. The input handwriting may be, for example, a group of handwriting that is continuously input by a user to the touch screen of a mobile device using fingers or a stylus .
Specifically, handwriting may be input to means that supports continuous input of handwriting in the embodiments of the present invention. This the current embodiment, the handwriting input by the user may be "^C
"f-hM±nt" as illustrated in Fig. 2a.
In step 102, the received handwriting is segmented into one or more segment units.
Any handwriting segmenting methods in the prior art may be utilized to segment handwriting that is received continuously on the touch screen, so as to obtain one or more segment units of real meaning. As there are existed segmenting algorithms already in the prior art, details thereof are omitted. In the current embodiment, the received handwriting " ^C ~? "b IM ^t Ib " is segmented into six segment units containing "£," "^," n -fc , " " IM , " "£," and "Ib," respectively.
In step 103, each segment unit is covered by a segment pattern.
According to an illustrative embodiment of the present invention, the position of handwriting in a segment unit is first obtained. For example, the position of handwriting in a segment unit may be obtained in dependence upon the coordinates of points of the handwriting in the segment unit containing "^C."
Next, a segment pattern is determined based on the obtained position.
For example, it is possible to determine edges and gravity center of the handwriting, the smallest rectangle or ellipse capable of covering the handwriting, and so on in dependence upon the points constituting the handwriting in a segment unit. Hence, graphics capable of at least partially covering the handwriting in the segment unit can be determined, and the graphics' coordinate can be determined in dependence upon the coordinates of the points constituting the handwriting. In this way, a segment pattern for covering the segment unit can be obtained. Alternatively, a segment pattern may be in a shape of a circle, an ellipse, a triangle, a rectangle, a polygon, an irregular shape, and so on that at least partially covers each segment unit. Preferably, a segment pattern is graphics that entirely covers the handwriting in a segment unit.
Afterwards, the segment units are covered using the determined segment patterns .
It is to be understood that a segment pattern covering a segment unit does not mean the user certainly can see the covering procedure. On the contrary, this covering step may be performed in background and only used for associating a segment unit with its segment pattern.
Then the flow of Fig. 1 ends.
Alternatively, the method for handwriting input of the present invention may further comprise step of presenting a segment pattern. A segment pattern may be presented in different colors, brightness, flicker, or a combination thereof. For example, the segment pattern covering each segment unit may be shown as a blue ellipse . After the handwriting input ends, the first segment unit may be selected automatically as a selected segment unit. The user may also select a segment unit covered by a segment pattern by clicking on the segment pattern according to his own needs. In addition, after the segment pattern is selected, it may be highlighted. For example, if the segment unit containing "^C" is selected, it is presented in pink so as to indicate more clearly and explicitly that this segment unit is selected.
Alternatively, the method for handwriting input according to the embodiments of the present invention may further comprise step of modifying a segment unit using a segment pattern . Various approaches may be adopted for modifying a segment unit. For example, Figs. 3, 5, 7, 9, 11, and 13 illustrate embodiments in which a segment unit is modified using a segment pattern, which will be described in detail below.
Fig. 3 is a flowchart of a method for modifying a segment unit according to an embodiment of the present invention. In this embodiment, original handwriting in a segment unit is replaced by new handwriting that is input directly to the segment pattern of this segment unit. Figs. 4a and 4b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 3. To being with, in step 301, an input of handwriting in a segment pattern is received.
Assume that in this embodiment there are six segment units containing "£," "^V' "-fc, " "M1" "£," and "Ib," respectively. If the user wants to modify the segment unit containing " ^ , " he may directly input new handwriting, e.g. "^F," to the segment pattern of this segment unit without firstly deleting the original handwriting in the segment unit. At this moment, the new handwriting is received, i.e., the newly-input handwriting "^" is received, as shown in Fig. 4a.
In step 302, the handwriting in the segment unit is deleted.
In step 303, the received handwriting is used as handwriting in the segment unit. As shown in Fig. 4b, after steps 302 and 303 are performed, the original handwriting ("^:") in the segment unit is replaced with the new handwriting ("^F") . Then the flow of Fig. 3 ends.
With the embodiment illustrated in Fig. 3, the user is allowed to modify the handwriting in a segment unit covered by a segment pattern, by directly inputting handwriting to the segment pattern without clicking on other functional key to perform complex operation, at any time. In this way, convenience is provided for the user to perform operation, and the user experience is improved.
Fig. 5 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention. In this embodiment, determination is made as to whether to delete existed handwriting in a segment unit covered by a segment pattern, by determining whether handwriting received at the segment pattern is a deletion identifier.
The deletion identifier is a symbol indicative of a delete operation. If it is determined that a deletion identifier is received at a segment pattern, then the handwriting in a segment unit covered by the segment pattern is deleted. The deletion identifier may be predefined and stored in a memory that is accessible by the apparatus for handwriting input of the present invention. The deletion identifier may be an arbitrary symbol including a punctuation mark such as cross ("x") , check mark (" V ") and slash (V" or "\") , a character such as a character of eastern or western words, user-defined graphics and so on. Figs . 6a and 6b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 5.
To being with, in step 501, an input of handwriting in a segment pattern is received.
Assume that in this embodiment there are six segment units containing "£," "^V' "-fc, " "M1" "£," and "Ib," respectively. If the user wants to delete the handwriting " ^k ," he may directly input special handwriting that matches a predefined deletion identifier to the segment pattern covering a segment unit containing the handwriting "^:, " without clicking on or selecting other functional key to perform this deletion.
In this step, the handwriting received at the segment pattern covering a segment unit containing "^:" is as shown in Fig. 6a.
In step 502, determination is made as to whether the received handwriting matches the predefined deletion identifier . Assume that in this embodiment, the predefined deletion identifier is a cross ("x") . In this step, whether the received handwriting as shown in Fig. 6a matches the predefined deletion identifier ("x") needs to be determined. In the prior art, there are various methods for determining whether handwriting matches a symbol, such as methods used in handwriting recognition, character matching and handwriting identification, so details thereof are omitted.
If it is determined that the received handwriting matches the predefined deletion identifier, this means the operation the user desires is a delete operation, and the flow goes to step 503. Otherwise, it is determined that the user wants to replace the original handwriting in a segment unit covered by a segment pattern with the newly-input handwriting, and the flow goes to step 504.
In step 503, the received handwriting and the handwriting in the segment unit is deleted.
After step 503 is performed, the handwriting ("^:") in the segment unit is deleted, and the user-input handwriting (the cross) being received is also deleted. In this way, no handwriting will be present in the segment pattern covering this segment unit, and the segment unit is empty at this moment, as shown in Fig. 6b.
As described above, if it is determined that the received handwriting does not match the predefined deletion identifier, the flow goes to step 504 in which the handwriting in the segment unit is deleted.
In step 505, the received handwriting is used as handwriting in the segment unit. Like steps 302 and 303, after steps 504 and 505 are performed, the handwriting originally contained in the segment unit is replaced with the received handwriting.
Then the flow of Fig. 5 ends.
With the embodiment illustrated in Fig. 5, the user is allowed to delete the handwriting in a segment unit covered by a segment pattern, by directly inputting specific handwriting to the segment pattern without clicking on other functional key to perform complex operation. In this way, it is convenient for a user to perform operations, and the user experience is improved. Fig. 7 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention. In this embodiment, when a segment unit is empty, if the user inputs new handwriting to the segment pattern covering the segment unit, a new segment unit and its corresponding segment pattern may be obtained by segmenting the handwriting. That is, the previous segment unit and segment pattern are replaced with the newly obtained segment unit and segment pattern. Figs. 8a to 8c are schematic views of the method for segmenting a segment unit according to the embodiment illustrated in Fig. 7. Fig. 8a illustrates a scenario before the method of Fig. 7 is performed, in which two segment patterns covering two segment units are illustrated. In a breakdown, the first segment unit is empty, and the second one contains the handwriting "HΦ." Hence, no handwriting is presented in the segment pattern covering the first segment unit, and the handwriting "HΦ"is presented in the segment pattern covering the second segment unit.
In step 701, an input of handwriting in a segment pattern is received.
Assume in this embodiment the user wants to obtain
Figure imgf000016_0001
and the user has inputted the handwriting as shown in Fig. 8b to the segment pattern covering the first segment unit. Then the handwriting in the segment pattern covering the first segment unit, as shown in Fig. 8b, is received in step 701.
In step 702, the segment unit and segment pattern are deleted. In this embodiment, the original segment unit and the segmented pattern covering this segment unit are no longer needed; instead, a new segment unit is obtained by segmenting the received handwriting, and the corresponding segment pattern is determined. Hence, the original segment unit and its corresponding segment pattern are deleted in this step.
In step 703, the received handwriting is segmented into obtain one or more new segment units . Like step 102, in step 703 the received handwriting may be segmented using various methods for segmenting handwriting in the prior art. In this embodiment, the received handwriting is segmented into two segment units containing "^" and "IS," respectively. In step 704, a segment pattern for covering the new segment units is determined.
In step 705, the new segment units are covered using the determined segment pattern.
The segment pattern covering the new segment unit is determined by obtaining the position of the handwriting in the segment unit and the segment unit is covered by the determined segment pattern in steps 704 and 705, just like step 103.
Segmentation approaches may be determined using various approaches. For example, it may be determined based on the position of handwriting in a segment unit. Specifically, the coordinate of a segment pattern may be determined in dependence upon the coordinates of points constituting the handwriting, and the size of the segment pattern can be determined in dependence upon an area that covers all of the points constituting the handwriting.
In step 706, the segment pattern that covers the new segment units is presented.
As shown in Fig. 8c, the segment pattern covering two new segment units that contain " ^ " and " IS , " respectively, are presented as two ellipses. The flow of Fig. 7 then ends.
The method for modifying a segment unit of the present invention may further comprise the step of setting a logical relation, which may be precedence order or other logical relation (e.g. the relation expressed by a mathematical formula) . The step of setting a logical relation may be, specifically, using the logical relation between the deleted segment unit and the unmodified segment unit as the logical relation between the new segment unit and the unmodified segment unit. Thus, the two new segment units containing "^" and "IS" are in such a logical relation to the segment unit containing "HΦ" that they precede the latter, and a result from recognizing handwriting in each segment unit is "4^"—*
"IS" → "¥$," instead of "H$"→ "^" → "IS" obtained in order of writing time.
Fig. 9 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention.
Figs. 10a to 10c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 9. Before the method of Fig. 9 is performed, the user has inputted the handwriting "ic^f" "t-lMifetb", the handwriting has been segmented into several segment units using the method for handwriting input of the present invention and the segment patterns for covering each segment unit have been determined. Fig. 10a illustrated six segment units that are covered a respective segment pattern. Among them, the first segment unit contains the handwriting "^C, " and the second segment unit contains the handwriting "-f."
In step 901, input handwriting is received. In this embodiment, as shown in Fig. 10b, the handwriting inputted by the user is a curve similar to a circle that may be a non-closed or closed curve.
In step 902, determination is made as to whether the received handwriting encircles handwriting in at least two segment units or not.
In the embodiments of the present invention, the term "encircle" means when received handwriting is a closed curve, the closed curve at least contains part of the points of the handwriting in a segment unit. In this step, it is first judged whether the closed curve contains the handwriting in a segment unit when the received handwriting is closed. Then it is judged whether the contained handwriting separately belong to two or more segment units. If the received handwriting encircles handwriting in at least two segment units, the flow then goes to step 903; otherwise, the flow ends. In this embodiment, the received handwriting entirely encircles the handwriting "^C" and nZf" which separately belong to different segment units. Therefore, it is determined that the received handwriting encircles the handwriting in two segment units.
In another embodiment, the received handwriting may be encircles part of the handwriting "^C" and part of the handwriting "^" ." In this case, since part of the handwriting "^C" and part of the handwriting nZf" belong to different segment units, it is determined that the received handwriting encircles the handwriting in two segment units .
In step 903, the segment patterns that cover the at least two segment units are deleted.
In step 904, the encircled handwriting are merged into a new segment unit.
In step 905, a segment pattern for covering the new segment unit is determined. The segment pattern covering the new segment unit is determined by obtaining the positions of the handwriting in the segment units and the new segment unit is covered by the determined segment pattern in steps 904 and 905, just like step 103. In step 906, the new segment unit is covered by the determined segment pattern.
In step 907, the segment pattern that covers the new segment unit is presented.
As shown in Fig. 10c, the segment pattern covering the new segment unit containing "#J" is presented as an ellipse and presented to be selected currently.
The flow of Fig. 9 then ends.
Fig. 11 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention. Figs. 12a to 12c are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 11. Before the method of Fig. 11 is performed, the user has inputted the handwriting "ic^f" -blMifetb", the handwriting has been segmented into several segment units using the method for handwriting input of the present invention and the segment patterns for covering each segment unit have been determined. Fig. 12a illustrated five segment units that are covered by corresponding segment patterns respectively. Among them, the first segment unit contains the handwriting
"&" •
In step 1101, an input of handwriting is received. In this embodiment, handwriting inputted by the user is a curve similar to a circle that may be a non-closed or closed curve, as shown in Fig. 12b.
In step 1102, determination is made as to whether the received handwriting encircles only part of handwriting in one segment unit or not. In this step, it is first judged whether the closed curve contains the handwriting when the received handwriting is closed. Then it is judged whether the contained handwriting belongs to only one segment unit. If the received handwriting encircles only part of handwriting in one segment unit, the flow then goes to step 1103; otherwise, the flow ends.
In this embodiment, the received handwriting entirely encircles the left half of the handwriting "^C" and only belongs to the segment unit that contains the handwriting "^C." Therefore, it is determined that the received handwriting encircles only part of handwriting in one segment unit.
In step 1103, the segment pattern that covers the segment unit is deleted. In step 1104, the segment unit is divided into two new segment units, one of which contains the part of handwriting and the other of which contains the remaining handwriting .
In the embodiment, the first new segment unit contains the handwriting "^C", and the second new segment unit contains the handwriting "^p" .
In step 1105, the segment pattern for covering each of the new segment unit is determined.
In step 1106, each of the new segment unit is covered by the determined segment pattern.
In step 1107, the segment pattern that covers each of the new segment unit is presented.
As shown in Fig. 12c, the segment pattern that covers the new segment unit containing "^C" is presented as an ellipse, and the segment pattern that covers the new segment unit containing nZf" is presented as another ellipse .
The flow of Fig. 11 then ends.
Fig. 13 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention. In this embodiment, one or more segment units covered by one of more segment patterns associated with handwriting received at one segment pattern, are selected by determining whether the handwriting is a selection identifier or not, so as to make centralized modifications to handwriting in these segment units .
The selection identifier is a symbol indicative of a selection operation. When it is determined that a selection identifier is received at a segment pattern, then one or more segment units covered by one of more segment patterns associated with the handwriting are selected. The selection identifier may be predefined and stored in a memory that is accessible by the device for handwriting input of the present invention. It may be an arbitrary symbol including a punctuation mark such as break line (" "), underline (" ") and double underline
("^") , a character such as a character of eastern or western words, user-defined graphics and so on. Figs. 14a and 14b are schematic views of the method for modifying a segment unit according to the embodiment illustrated in Fig. 13.
In step 1301, an input of handwriting is received. Assume that in this embodiment there are six segment units containing "&," "^V' "-3G," "M," "£," and "Ib," respectively. If the user wants to select four segment units containing niζ," "■?," ""b, " and "Ij^" at one time, he may directly input special handwriting that matches a predefined selection identifier to the segment pattern covering these four segment units without clicking on or selecting other functional key to perform this deletion. The handwriting being received in this step is as shown in Fig. 14a.
In step 1302, determination is made as to whether the received handwriting matches the predefined selection identifier.
Assume that in this embodiment, the predefined deletion identifier is an underline (" ") . In this step, whether the received handwriting as shown in Fig. 14a matches the predefined selection identifier ("_") needs to be determined. In the prior art, there are various methods for determining whether handwriting matches a symbol, so details thereof are omitted.
If a match is determined, i.e., the user wants to perform a selection operation, the flow then goes to step 1303; otherwise, the flow ends.
In step 1303, it is determined that which segment pattern is selected in dependence upon the received handwriting. In this embodiment, the handwriting inputted by the user passes through four segment pattern covering four segment units that contain niζ," "■?," nJC," and "Ij^," respectively. It is thus determined what are selected are these four segment patterns, as shown in Fig. 14b. In step 1304, the received handwriting is deleted.
In step 1305, centralized modifications are made to the handwriting in segment units covered by the selected segment patterns. Then the flow ends.
As described above, if it is determined that the received handwriting does not match the predefined selected symbol, the flow then ends.
In other embodiments, the user-input handwriting being received may not come into contact with the segment patterns. The coordinates of the start point and end point of the received handwriting may form a set range with any of the upper, lower, left and right sides of the handwriting. The position of handwriting in each segment unit is compared with the set range; if the coordinate of a point of handwriting in a segment unit falls within the range, it is determined that the segment unit containing the handwriting is selected.
Fig. 15 is a flowchart of a method for modifying a segment unit according to another embodiment of the present invention. In this embodiment, segment units covered by one or more segment patterns are selected by determining the one or more segment patterns associated with the received handwriting. Different from the embodiment illustrated in Fig. 13, neither a selection identifier needs to be defined in advance nor received handwriting needs to match the selection identifier in this embodiment.
In step 1501, an input of handwriting is received. In step 1502, segment patterns that are associated with the received handwriting are determined. There may be various implementations of "association." For example, if the position of a point contained by received handwriting falls within the area of a segment pattern, the handwriting is then associated with the segment pattern; or if the shortest distance from the position of a point contained in received handwriting to a segment pattern is less than a predefined threshold, the handwriting is then associated with the segment pattern; or if the received handwriting intersects with handwriting in a segment unit covered by a segment pattern, the handwriting is then associated with the segment unit. In step 1503, centralized modifications are made to segment units covered by the associated segment patterns .
The flow of Fig. 15 then ends.
Fig. 16 is a block diagram of an apparatus 1600 for handwriting input according to another embodiment of the present invention. The apparatus 1600 may comprise receiving means 1610, segmenting means 1620, and covering means 1630.
Receiving means 1610 may be used for receiving input handwriting. The handwriting may be input from any area of a handwriting-input pad or from a segment pattern. It may be characters of eastern words, characters of western words, punctuation marks, symbols in formulae, user-defined graphics or tables. Segmenting means 1620 may be used for segmenting the received handwriting into one or more segment units, each of which being defined as a group of handwriting having a real meaning.
Covering means 1630 may be used for covering each segment unit with a segment pattern. The covering means may comprise: means for obtaining the position of handwriting in the segment unit; means for determining graphics, which is capable of at least partially covering the handwriting, as the segment pattern based on the position; and means for covering the segment unit with the determined segment pattern . Preferably, the segment pattern may be a graphics entirely covering the handwriting .
The apparatus 1600 may further comprise presenting means 1640. Presenting means 1640 may present a segment pattern in different colors, brightness, flicker or a combination thereof. Further, the presenting means may be used for highlighting the selected segment pattern.
A segment pattern may be presented as a circle, an ellipse, a triangle, a rectangle, a polygon, or an irregular shape .
The apparatus 1600 may further comprise modifying means 1650. Modifying means 1650 may be used for modifying a segment unit by selecting a segment pattern that covers this segment unit. Modifying means 1650 may comprise means for deleting handwriting in the segment unit and means for using received handwriting as handwriting in the segment unit.
Modifying means 1650 may comprise means for determining whether received handwriting matches a predefined deletion identifier or not and means for deleting the received handwriting and handwriting in the segment unit if matching.
Modifying means 1650 may comprise: means for deleting the segment unit and the segment pattern; means for segmenting the received handwriting into one or more new segment units; means for determining a segment pattern for covering the new segment units; means for covering the new segment units with the determined segment pattern; and means for presenting the segment pattern that covers the new segment units. Further, the modifying means may comprise means for using the logic relation of the deleted segment unit to the unmodified segment unit as the logical relation of the new segment unit to the unmodified segment unit Modifying means 1650 may comprise means for, in case that received handwriting encircles handwriting in at least two segment units, deleting the segment patterns that cover the at least two segment units, merging the encircled handwriting into a new segment unit, determining a segment pattern for covering the new segment unit, covering the new segment unit with the determined segment pattern covering and presenting the segment pattern that covers the new segment unit.
Modifying means 1650 may comprise means for performing the following operations in case that received handwriting encircles part of handwriting in one segment unit: deleting the segment pattern that covers the segment unit; dividing the segment unit into two new segment units, one of which contains the part of handwriting and the other of which contains the remaining handwriting; determining segment patterns for covering each of the new segment unit; covering each of the new segment unit with the determined segment patterns; presenting the segment patterns that cover each of the new segment unit.
Modifying means 1650 may comprise: means for determining whether received handwriting matches a predefined selection identifier; and means for, in case of a match, determining which segment pattern is selected based on the received handwriting, deleting the received handwriting and making centralized modifications to handwriting in segment units covered by the selected segment pattern.
Modifying means 1650 may comprise: means for determining which segment patterns are associated with received handwriting; and means for making centralized modifications to segment units covered by the associated segment patterns.
The present invention further relates to a handwriting-input mobile terminal, which comprises a storage medium having the following program codes stored therein: a program code for receiving an input of handwriting; a program code for segmenting the received handwriting into one or more segment units, each of which is defined as a group of handwriting having a real meaning; and a program code for covering each of the segment units with a segment pattern.
The present invention further provides an electronic device comprising the apparatus for handwriting input. The present invention further provides an electronic device, which may comprise: a memory having computer instructions stored therein; a processor configured to, when executing the stored instructions, perform the steps of receiving an input of handwriting, segmenting the received handwriting into one or more segment units, each of which is defined as a group of handwriting having a real meaning, and covering each segment unit with a segment pattern.
The present invention further provides a computer storage medium having computer instructions stored therein and performing the steps of , when the computer instructions are executed, receiving inputted handwriting, segmenting the received handwriting into one or more segment units, each of which is defined as a group of handwriting having a real meaning, and covering each segment unit with a segment pattern.
The disclosed methods of the present invention may be implemented in software, hardware or a combination of software and hardware. The hardware part may be implemented using a dedicated logic, and the software part may be stored in a memory and be implemented by a proper instruction implementing system, such as a microprocessor, a personal computer (PC) or a mainframe.
Those skilled in the art will recognize that the present invention may also be embodied in a computer program product arranged on a signal carrier medium to be used for any proper data processing system. Such signal carrier medium can be a transmission medium or a recordable medium used for machine readable information, including a magnetic medium, optical medium or other proper medium. Examples of a recordable medium include a floppy or magnetic disc in a hard disc drive, an optical disc for an optical drive, a magnetic tape, and other medium those skilled in the art can conceive. Those skilled in the art will further recognize that any communication terminal with proper programming means can perform steps of the method of the present invention as embodied in a program product for example.
It should be noted that in order to make the present invention easier to be understood, the foregoing description omits some technical details that are well known to those skilled in the art but might be essential to the implementation of the present invention.
The specification of the present invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and alterations will be apparent to those of ordinary skill in the art. Therefore, the embodiments were chosen and described in order to better explain the principles of the invention, the practical application, and to enable others of ordinary skill in the art to understand that all modifications and alterations made without departing from the spirit of the present invention fall into the protection scope of the present invention as defined in the appended claims.

Claims

WHAT IS CLAIMED IS:
1. A method for handwriting input, comprising: receiving an input of handwriting; segmenting the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and covering each of the segment units with a segment pattern .
2. The method according to Claim 1, further comprising : presenting the segment pattern by means of color, brightness, flicker or a combination thereof.
3. The method according to Claim 1, further comprising : highlighting a segment pattern when the segment pattern is selected.
4. The method according to Claim 1, wherein covering each segment unit with a segment pattern comprises: obtaining the position of handwriting within each segment unit; determining, based on the position, a graphics that is capable of at least partially covering the handwriting as a segment pattern; and covering the segment unit with the determined segment pattern.
5. The method according to Claim 4, wherein the segment pattern is a graphics entirely covering the handwriting .
6. The method according to any one of Claims 1 to 5, wherein the segment pattern is in a shape of a circle, an ellipse, a triangle, a rectangle, a polygon or an irregular shape.
7. The method according to Claim 1, further comprising: modifying a segment unit by selecting the segment pattern covering the segment unit.
8. The method according to Claim 7 , wherein modifying of a segment unit comprises: receiving an input of handwriting in the segment pattern; deleting handwriting in the segment unit; and using the received handwriting as handwriting in the segment unit.
9. The method according to Claim 7, wherein modifying of a segment unit comprises : receiving an input of handwriting in the segment pattern; determining whether the received handwriting matches a predefined deletion identifier or not; and if matching, deleting the received handwriting and handwriting in the segment unit.
10. The method according to Claim 7, wherein modifying of a segment unit comprises : receiving an input of handwriting in the segment pattern; deleting the segment unit and the segment pattern; segmenting the received handwriting into one or more new segment units; determining segment patterns for covering the new segment units; covering the new segment units with the determined segment patterns; and presenting the segment patterns that covers the new segment units .
11. The method according to Claim 10, further comprising : maintaining a logic relation between the deleted segment unit and the unmodified segment unit as the logical relation between the new segment unit and the unmodified segment unit.
12. The method according to Claim 7, wherein modifying a segment unit comprises: receiving an input of handwriting; if the received handwriting encircles handwriting in at least two segment units, then deleting segment patterns covering the at least two segment units, merging the encircled handwriting into a new segment unit, determining a segment pattern for covering the new segment unit, covering the new segment unit with the determined segment pattern, and presenting the segment pattern that covers the new segment unit.
13. The method according to Claim 7, wherein modifying a segment unit comprises: receiving an input of handwriting; if the received handwriting encircles only part of handwriting in one segment unit, then deleting the segment pattern that covers the segment unit; dividing the segment unit into two new segment units, wherein one of which contains the part of handwriting and the other of which contains the remaining handwriting; determining segment pattern for covering each of the new segment units; covering each of the new segment units with the determined segment patterns; and presenting the segment patterns that cover each of the new segment unit.
14. The method according to Claim 7, wherein modifying a segment unit comprises: receiving an input of handwriting; determining whether the received handwriting matches a predefined selection identifier; if matching, then determining which segment pattern is selected based on the received handwriting, deleting the received handwriting, and making centralized modifications to handwriting in the segment unit covered by the selected segment pattern.
15. The method according to Claim 7, wherein modifying a segment unit comprises: receiving an input of handwriting; determining which segment patterns are associated with the received handwriting; and making centralized modifications to segment units covered by the associated segment patterns.
16. The method according to Claim 1, wherein the handwriting is characters of eastern words, characters of western words, punctuation marks, symbols in formulae, or user-defined graphics or tables.
17. An apparatus for handwriting input, comprising: receiving means configured to receive an input of handwriting; segmenting means configured to segment the received handwriting into one or more segment units, each of the segment units being defined as a group of handwriting having a real meaning; and covering means configured to cover each of the segment units with a segment pattern.
18. The apparatus according to Claim 17, further comprising: presenting means configured to presenting the segment pattern by means of color, brightness, flicker or a combination thereof.
19. The apparatus according to Claim 17, further comprising: presenting means configured to highlight a segment pattern when the segment pattern is selected.
20. The apparatus according to Claim 17, wherein the covering means comprises: means for obtaining the position of handwriting within the segment unit; means for determining a graphics that is capable of at least partially covering the handwriting as a segment pattern based on the position; and means for covering the segment unit with the determined segment pattern.
21. The apparatus according to Claim 20, wherein the segment pattern is a graphics entirely covering the handwriting .
22. The apparatus according to any one of Claims 17 to 21, wherein the segment pattern is in a shape of a circle, an ellipse, a triangle, a rectangle, a polygon or an irregular shape.
23. The apparatus according to Claim 17, further comprising: modifying means for modifying a segment unit by selecting the segment pattern that covers the segment unit.
24. The apparatus according to Claim 23, wherein the receiving means comprises means for receiving an input of handwriting in the segment pattern, and the modifying means comprises : means for deleting handwriting in the segment unit; and means for using the received handwriting as handwriting in the segment unit.
25. The apparatus according to Claim 23, wherein the receiving means comprises means for receiving an input of handwriting in the segment pattern, and the modifying means comprises : means for determining whether the received handwriting matches a predefined deletion identifier or not; and means for deleting the received handwriting and handwriting in the segment unit if matching.
26. The apparatus according to Claim 23, wherein the receiving means comprises means for receiving an input of handwriting in the segment pattern, and the modifying means comprises : means for deleting the segment unit and the segment pattern; means for segmenting the received handwriting into one or more new segment units; means for determining a segment pattern for covering the new segment units; means for covering the new segment units with the determined segment patterns; and means for presenting the segment patterns that covers the new segment units.
27. The apparatus according to Claim 26, wherein the modifying means further comprises: means for maintaining a logic relation between the deleted segment unit and the unmodified segment unit as the logical relation between the new segment unit and the unmodified segment unit.
28. The apparatus according to Claim 23, wherein the receiving means comprises means for receiving an input of handwriting, and the modifying means comprises: means for, if the received handwriting encircles handwriting in at least two segment units, performing the operations of: deleting segment patterns that cover the at least two segment units, merging the encircled handwriting into a new segment unit, determining a segment pattern for covering the new segment unit, covering the new segment unit with the determined segment pattern, and presenting the segment pattern that covers the new segment unit.
29. The apparatus according to Claim 23, wherein the receiving means comprises means for receiving an input of handwriting, and the modifying means comprises: means for, if the received handwriting encircles only part of handwriting in one segment unit, performing the operations of: deleting the segment pattern that covers the segment unit; dividing the segment unit into two new segment units, wherein one of which contains the part of the handwriting and the other of which contains the remaining handwriting; determining segment patterns for covering each of the new segment units; covering each of the new segment units with the determined segment patterns; and presenting the segment patterns that cover each of the new segment unit.
30. The apparatus according to Claim 23, wherein the receiving means comprises means for receiving an input of handwriting, and the modifying means comprises: means for determining whether the received handwriting matches a predefined selection identifier; and means for, if matching, determining which segment pattern is selected based on the received handwriting, deleting the received handwriting, and making centralized modifications to handwriting in the segment unit covered by the selected segment pattern.
31. The apparatus according to Claim 23, wherein the receiving means comprises means for receiving an input of handwriting, and the modifying means comprises: means for determining which segment patterns are associated with the received handwriting; and means for making centralized modifications to segment units covered by the associated segment patterns .
32. The apparatus according to Claim 23, wherein the handwriting is characters of eastern words, characters of western words, punctuation marks, symbols in formulae, or user-defined graphics or tables.
33. An electronic device, comprising an apparatus according to Claim 17.
34. The electronic device according to Claim 33, wherein the electronic device is a mobile device.
PCT/CN2010/070929 2009-03-09 2010-03-09 Method and apparatus for handwriting input WO2010102553A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200910127458.2A CN101833411B (en) 2009-03-09 2009-03-09 For the method and apparatus of person's handwriting input
CN200910127458.2 2009-03-09

Publications (1)

Publication Number Publication Date
WO2010102553A1 true WO2010102553A1 (en) 2010-09-16

Family

ID=42717497

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/070929 WO2010102553A1 (en) 2009-03-09 2010-03-09 Method and apparatus for handwriting input

Country Status (2)

Country Link
CN (1) CN101833411B (en)
WO (1) WO2010102553A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9710155B2 (en) 2010-12-08 2017-07-18 Nokia Technologies Oy User interface
JP5349645B1 (en) * 2012-05-11 2013-11-20 株式会社東芝 Electronic device and handwritten document processing method
CN104111914B (en) * 2013-04-16 2017-09-12 北大方正集团有限公司 A kind of document examines and revises method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1131773A (en) * 1994-12-29 1996-09-25 夏普公司 Handwritten character input display device
CN1138909A (en) * 1994-11-14 1996-12-25 摩托罗拉公司 Method of splitting handwritten input
CN1260526A (en) * 1999-01-13 2000-07-19 国际商业机器公司 Hand written information processing system with user's interface for cutting characters
JP2003337921A (en) * 2003-06-23 2003-11-28 Sharp Corp Method for correcting recognized handwriting character
JP2004272377A (en) * 2003-03-05 2004-09-30 Ricoh Co Ltd Device of character editing, character input/display device, method of character editing, program of character editing, and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100585623C (en) * 2007-03-30 2010-01-27 无敌科技(西安)有限公司 Method and system for discriminating handwriting characters
CN101183283A (en) * 2007-12-04 2008-05-21 哈尔滨工业大学深圳研究生院 A Method of Writing Handwritten Information Directly

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1138909A (en) * 1994-11-14 1996-12-25 摩托罗拉公司 Method of splitting handwritten input
CN1131773A (en) * 1994-12-29 1996-09-25 夏普公司 Handwritten character input display device
CN1260526A (en) * 1999-01-13 2000-07-19 国际商业机器公司 Hand written information processing system with user's interface for cutting characters
JP2004272377A (en) * 2003-03-05 2004-09-30 Ricoh Co Ltd Device of character editing, character input/display device, method of character editing, program of character editing, and storage medium
JP2003337921A (en) * 2003-06-23 2003-11-28 Sharp Corp Method for correcting recognized handwriting character

Also Published As

Publication number Publication date
CN101833411A (en) 2010-09-15
CN101833411B (en) 2015-09-16

Similar Documents

Publication Publication Date Title
US20020141643A1 (en) Method for creating and operating control systems
US8643605B2 (en) Gesture based document editor
US11402991B2 (en) System and method for note taking with gestures
US20180121074A1 (en) Freehand table manipulation
US9423908B2 (en) Distinguishing between touch gestures and handwriting
CN103324674B (en) Web page contents choosing method and device
US20160328372A1 (en) Information processing apparatus, information processing method, and program
CN102455869B (en) Method and device for editing characters by using gestures
AU2014312473A1 (en) Apparatus and method for displaying chart in electronic device
WO2014147716A1 (en) Electronic device and handwritten document processing method
CN107656693A (en) A kind of method and device that cursor position is determined in touch-screen
US9733826B2 (en) Interacting with application beneath transparent layer
CN104995591A (en) Image processing device and program
CN105549850A (en) Image blurring method and device
Panwar Hand gesture based interface for aiding visually impaired
JP2004046325A (en) Data input device, data input program, and recording medium recorded with the data input program
WO2010102553A1 (en) Method and apparatus for handwriting input
CN107665087B (en) Image display device, image display method, and image display system
JP2021135911A (en) Display device
CN105787335A (en) Password input interface switching control method and device
KR20150097250A (en) Sketch retrieval system using tag information, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor
JP2018026117A (en) Image display device, image display system and program
CN107341259B (en) Searching method and device
US20180211027A1 (en) Password setting method and device
CN107169333A (en) File management method, mobile terminal and storage medium based on fingerprint

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10750349

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10750349

Country of ref document: EP

Kind code of ref document: A1