JP5661279B2 - User interface system and method for text editing and menu selection - Google Patents

Description

Priority Claim This application is a continuation of application number 11 / 533,714 filed on September 20, 2006, claiming the benefit of provisional application number 60 / 718,984. This application also claims the benefit of provisional application number 60 / 806,522 filed on July 3, 2006 and provisional application number 60 / 917,849 filed on May 14, 2007, Incorporated into the text by reference.

The present invention relates to computer system graphical and gesture user interfaces, and more particularly, a user performs an input operation using one or more input devices, and the data generated by the input operation is a computer. It relates to various computer systems that are analyzed to be recognized as one or more user input actions corresponding to text data input to the system. The present invention also provides for two or more such menus that can be selected with a simple gesture that is quick and easy to execute, as part of a text input method or for menu choices performed for other control functions of a computer system. Also relevant to the graphical approach presented to the user.

  There are a wealth of text input systems designed to allow users to enter text faster. In general, increasing the speed of text input is often a criterion required by comparable systems because a given sequence of actions can be performed faster when less accuracy is required. This is possible by allowing the user to perform less accurate operations. In general, this is done by defining a dictionary of text objects generated by the system and on the principle that input actions performed by the user are mapped to one or more of these text objects in the dictionary. Achieved. The system then analyzes the input action (s) performed by the user, determines the text object that is most likely the object intended by the user by performing the input action, and determines the determined object Is generated as a text corresponding to the input operation. One example is the system disclosed by Robinson et al in US Pat. No. 6,801,190, which is based on a virtual keyboard that allows the user to enter text with an incorrect tap. Another example is a “ShapeWriter” system that recognizes word patterns based on the shape of a trace path on a virtual keyboard by comparing it to a library of shape prototypes associated with words (US Patent Publication US 2004-0120583 A1). (Disclosed by Zhai). Yet another example is the system disclosed by Kushler et al in US Pat. No. 7,098,896.

  In other systems (eg, speech recognition and handwriting recognition systems), users do not perform less accurate actions the same way (as with the Robinson et al virtual keyboard). Thus, text input by information input using an alternative “means” (that is, speaking in the case of a speech recognition system, writing in cursive in the case of a handwritten character recognition system) is possible. In this "alternative means" system, user input actions (spoken words in the case of speech recognition, cursive text in the case of handwritten character recognition) correspond to one or more text objects in the system dictionary Similarly, mapping (“recognition”) is performed. Other systems inherently introduce ambiguity in the text input operations performed by the user, and thus need to map the text input operations performed by the user to one or more text objects in the dictionary. A well-known example is the input system commercially known as “T9” (disclosed by Grover et al in US Pat. No. 5,818,437). This is commonly used for mobile phone keypads with a limited number of keys, where each key in a subset of standard telephone keys is associated with a plurality of individual characters, and the key sequence entered by the user is within that input sequence. An input system that is mapped to one or more words corresponding to the characters associated with the key.

  In these various systems (hereinafter referred to as “input motion recognition system”), regardless of the nature of the input operations performed by the user and the differences in how these input operations are mapped to text objects in the system dictionary. There are many features that motion recognition systems generally have in common.

  1) Text objects identified by the input motion recognition system are most commonly implemented as text display systems (display device areas where text is displayed) so that the user can further edit the generated text ) Is output.

  2) A given input action (or sequence of input actions) is mapped to one or more corresponding specific text objects, and the specific text object that is determined to most closely correspond to that input action results in that text presentation system May be output automatically.

  3) The system maintains a record of one or more alternative text objects (at least limited recently generated text objects) that are determined to be reasonably close to the input behavior, and the actual text generated for output Objects can be associated (at least temporarily) with these alternative text objects. Instead or in addition, the system records specific data or information about the input action and associates this data with the associated alternative text interpretation record, or later on this input action to identify the alternative text object. The recorded data can be reprocessed.

  4) Ensure that the specific text object that is determined to most closely match the input behavior and output through the text presentation system correctly corresponds to the text that the user intended to generate, not the text object that the user intended to generate. , The generated text may need to be edited by the user.

  5) There is a text insertion location (or position) in the text presentation system where the next text object generated by the user is inserted. This is commonly referred to as the “cursor” (sometimes “caret”) position (hereinafter “text insertion position”).

  6) There is a text editing operation (or “gesture”) that is a means by which the user can change the text insertion position to a new location in the text presentation system. In the majority of systems, the text presentation system consists of a text output area on the display. For example, in a mouse-based system, this action is probably a single click of the mouse that is performed within the text output area without exception. In stylus-based touch screen systems, this action is also a single tap of the stylus that is performed in the text output area, perhaps without exception.

  7) There are generally two character classes for character classification processed by the system. The first class consists of characters that can be used effectively with one or more text objects generated by the system (hereinafter "text object characters"). The second class consists of one or more characters or character types that are processed by the system as delimiter characters not included in text objects generated by the system (hereinafter “delimiters”). The class of delimiter characters very commonly includes “blank” characters (spaces, tabs, newlines, etc.) and often includes other punctuation characters.

  Another feature that tends to be shared by the majority of users across these disparate input motion recognition systems is that users are more accelerating (and as a result) input motion until a certain number of "errors" begin to occur. As more inaccurate). In this case, an error is when the text object output by the system to the text presentation system is not the text object intended by the user. Another feature common to almost all text editing systems is that any editing action that the user performs (if any text displayed in the text presentation system is modified by the user's action) is the location of the edited text The result is that the text insertion position is rearranged. This behavior was reasonable (and in some ways unavoidable) in the original mouse and keyboard model for text editing, but in many cases in the input motion recognition system described above, this behavior is no longer desirable. Absent. In the case of “text editing” required in these scenarios, the user generally tries to input specific text one after another. At some point in the process, one or more text objects that were not intended by the user were placed somewhere before the text output area because one or more of the user's type-ahead actions were “incorrectly recognized” by the system. Due to the fact that it appears, the user notices that the text generated by looking at the text output area (or checking the text presentation system) is somehow different from the text that the user intended to generate. In most cases, the user corrects the misrecognized text (in other words, "remaps" or "reedits" the system interpretation of the original input action performed by the user when the text object was created) Simply wish to continue entering new text at the insertion position. However, in the existing system, there is a problem that it is impossible to edit any erroneously recognized text unless the text insertion position is relocated to the edited text.

  Standard desktop computer systems are almost always equipped with full-size desktop keyboards and mice (or mouse equivalents such as trackballs or graphic tablet digitizers). As a result, the majority of users are accustomed to using keyboards and mice on desktop systems and are relatively clever. For portable, handheld devices, desktop keyboards and mice are impractical because of their size and the need for a flat and relatively stable surface (in the case of standard mice). Thus, many of the above input motion recognition text input systems have been developed specifically for use in portable, handheld devices, or are often considered particularly useful for use in such devices. .

  Portable computing devices continue to become more powerful and more useful. Touch screens have proven to be a very convenient, flexible and easy-to-use interface for portable devices. Touch screen interfaces are used in a wide range of portable devices, including large devices such as tablet PCs, but have proven to be particularly effective in small devices such as PDAs and mobile phones. The development of the device is mainly focused on two contradictory goals: further miniaturization of the device and making it easier, faster and easier to use.

  One user interface element commonly used in a wide range of systems is to present options to the user so that he can select the desired answer from among the alternatives presented. Because you often need to present the user with a list of possible alternative text interpretations for one or more input actions so that the user can select the correct interpretation that reflects the user ’s intention when performing that input action, This user interface element is frequently used in the above input motion recognition text input system. In a system that uses a touch screen interface, the most natural way to navigate the menus on the screen is to simply touch and select the desired option with a stylus or finger. In many cases, it is preferable to minimize the display area required for the menu display so that other displayed elements are not hidden. On the other hand, assuming that the user touches and selects a desired menu selection item, the smaller the menu, the more accurate the user must perform the selection operation, and thus the menu becomes difficult to use.

  Therefore, there is inevitably a tension between these usability points of view. The second similar consideration is that another well-desired design goal requires the user to use a touch screen system with their fingers, rather than requiring the use of a stylus or other special instrument for screen operation Stems from the fact that it is in making it possible. A fingertip is generally less accurate than a stylus, and the design of a menu that can perform a selection with the user's finger requires a much larger display menu, so the same tension arises here.

  As described above, in the prior art, in order to select an item from the touch screen menu, the user has to directly touch a desired option. In some embodiments, the user needs to control the placement of the stylus so that the first touch to the screen with the stylus (or finger) occurs in the area associated with the desired option. In another approach, the user can make initial contact with the screen in a series of active selection areas and lift the stylus into the area associated with the desired selection (without interrupting contact with the screen) Slide without. In the first approach, the first contact location must be carefully controlled to select the desired item, and in the second approach, the final contact location must be controlled as well. Each menu choice is displayed as a given two-dimensional area of the display menu, so in either approach, the user can place the contact with the screen in two dimensions to activate the desired menu choice. Need to control. The smaller each two-dimensional menu area, the more accurately the user must perform its touching action, and generally more time is required to make a menu item selection.

  The method and system of the present invention addresses the above-described problems with input motion-aware text input systems by allowing a user to edit misrecognized text without repositioning the text insertion position at the edited text location. To solve. In one aspect, when generating text to be inserted into a text output area, the text editing system of the present invention tracks and records the text insertion position in the text output area, immediately after "reediting" the misrecognized text. The text insertion position can be automatically restored at this position.

  In yet another aspect, the system defines a user action (or “gesture”) that edits text that is different from that used to change the text insertion position to a new location in the text output area. This unique text editing user behavior is that the user wants to change a previously generated (but incorrectly recognized) text object to one of the alternative text objects associated with the actual text object generated for output. (Hereinafter referred to as a “reedit” gesture). For example, in a touch screen system using a stylus that changes the text insertion position to a new location in the text output area by tapping the stylus once, the unique re-edit gesture is the previously output text in the text output area. It can be defined as a stylus "double tap" (two taps within a threshold time interval that does not exceed the threshold maximum time interval between two consecutive taps) that occurs near the object. When the system detects that the user has performed a re-edit gesture within the area associated with a previously output text object, the text object is either the original text object (either the default selection or the selection performed by the user) ) Is replaced in the text output area by the selected one of the alternative text objects associated with the one or more input actions that generated the text, and the text insertion position is automatically set to the previous position (before re-editing gesture detection) To be restored.

  When an alternative text object that replaces the original text object is selected by the user, the most effective user interface often presents the user with a menu of alternative text objects for selecting the desired text object. The present invention further provides speed and ease by allowing the user to select from the selection menu without controlling the screen touch action to begin or end within the two-dimensional menu area associated with the desired menu selection. Increased sex. Instead, the menu choices that are enabled by the user's screen touch action are determined by the outermost border segment of the menu that the touch action path intersects, where each segment of the menu border is one of the menu choices. Related to one. In this approach, the first touch can occur anywhere in the display menu, and the start (or end) is in an area associated with (or likely to be associated with) a particular desired text object. Not limited. Whenever it is necessary to choose between two or more possible choices, it will be more effective using the menu selection system of the present invention.

Embodiments of the present invention will be described in detail below with reference to the following drawings.
FIG. 1 is a system block diagram illustrating exemplary hardware components of a system embodying the method of text editing and menu selection system of the present invention shown in FIGS. 2A, 2B and 2C and FIGS. 3A, 3B and 3C. It is. FIG. 2A is a diagram illustrating an example of a text object that has been re-edited according to an aspect of the method of the present invention. FIG. 2B is a diagram illustrating an example of two linked text objects, one of which has been re-edited according to an aspect of the method of the present invention. FIG. 2C is a diagram showing an example of a result of re-editing one of the two linked objects shown in FIG. 2B according to an aspect of the method of the present invention. FIG. 3A is a diagram illustrating an example of a menu configured in one way that has the advantages of the method of the present invention. FIG. 3B shows an example of a menu organized in one way that has the advantages of the method of the present invention, and the two choices presented here have a low prior probability corresponding to the choice intended by the user . FIG. 3C is a diagram illustrating an example of a menu organized in one way that has the advantages of the method of the present invention, where the menu's border segment associated with each of the presented choices is related to the presented choice and associated Boundary segment background color, tint, or texture usage is shown. FIG. 4 is a diagram illustrating an example of a touch action on a menu configured in one way that has the advantages of the method of the present invention. FIG. 5 is a diagram illustrating an example of a menu configured in one way that has the advantages of the method of the present invention, allowing an increase in the number of selections presented. FIG. 6 shows an example of a menu constructed in the manner shown in FIG. 5, where a similar background color is used to indicate a set of menu choices that can be selected by a similar selection gesture.

  The system of the present invention allows the user to achieve the goal of correcting text that is misrecognized by the input motion recognition system without unnecessarily hindering the user process of text input and editing. If the intended word or phrase is misrecognized (one or more input actions are “mapped” to text that was not intended by the user who performed the input action), the user may misrecognize the system Although it must be corrected, this correction does not reflect the user's intention to change or edit the user's intended text, or rather the original input action performed by the user when the text object was created. This is for performing "remapping" or "reediting" of system interpretation (s). If the user is concerned about misrecognition of one or more previous input actions by the system, the system of the present invention allows the user to correct the misrecognized text and then automatically inserts the text into the original position. This allows the user to continue to enter text at the original text insertion position with minimal effort.

  In one aspect, as the user generates text to be inserted into the text output area, the system can change the text input position in the text output area so that the text input position can automatically return to this position, if appropriate. Track and record. In another aspect, the system defines a text editing user action (or “gesture”) that is different from that used to change the text input position to a new location in the text output area, and this The unique text editing user behavior is that the user wants to change a previously generated (but incorrectly recognized) text object to one of the alternative text objects associated with the text object actually generated for output (Hereinafter referred to as a “reedit” gesture). For example, on a stylus-based touchscreen where a stylus single tap is performed to change the text input position to a new location in the text output area, a unique re-edit gesture is near the previous output text object in the text output area. Can be defined as a double tap on the stylus. When the system detects that the user has performed a re-edit gesture on an area associated with a previously output text object, the text object is replaced in the text output area with one of the associated alternative text objects (as shown below) ), And the text input position is automatically restored to the previous position (before detection of the re-edit gesture).

  In the following description and embodiments of the various aspects of the invention, particular aspects or embodiments are often described and illustrated in the context of implementation in a stylus-based touch screen. However, these various aspects and embodiments may be used in systems where input operations are performed using a standard mouse and keyboard, touch screen systems that do not require the use of a stylus, alternative forms of mice (e.g., To track the user's eye movements to determine the screen position they are in, automatically position the system mouse cursor at that position, and perform various mouse clicks to the user with blink monitoring or other mechanisms A “line-of-sight” system), a voice command-based system, or other means that allow the user to perform input actions to generate text and / or perform edit actions on text that has already been entered It will be clear to those skilled in the art that the present invention is equally applicable to the system used Will.

  In another aspect, the system highlights the word to be edited by the user (or indicates the text insertion position adjacent to or within the word boundary) in the text output for re-editing. Enables the selected word and then activates the specified "reedit" editing function key (in this case, the system previously repositioned the text insertion position performed to activate the function In order to restore such a recognition error correction process as efficiently as possible, the system must keep track of the previous two placements of the text insertion position. Recognizes whether a re-edit gesture is performed in the output text area and performs a predetermined stylus action or gesture The word in the output text region that is closest to where it was placed is identified as the target word for re-editing, In one embodiment, as noted in the previous example, the predetermined editing action is performed on the touch screen. A “double tap” of the stylus on the word displayed in 2. In another embodiment (eg, when the system operates using a cursor movement control device such as a mouse), the predetermined editing action is ( For example, temporarily pause the mouse over the word being edited and then quickly move the mouse back and forth once (this is just an example gesture and many such gestures can be defined).

  In another embodiment, a re-editing gesture may be defined so that a plurality of words can be selected with one gesture. For example, recognition errors in a speech recognition system typically affect one or more words in the generated output. For example, the user may say “It is difficult to recognize speech”, but the output generated by the system is “It is difficult to delegate and command”. In such a system, a re-edit gesture is defined, for example, by underlining a series of words. In the example above, the phrase “Mix hybrid” is underlined. This same approach, in which the system then generates one or more alternative interpretations associated with the utterance, without changing the interpretation of the utterance corresponding to “difficult to do” applies to handwritten character recognition systems. The Even in this system, many recognition errors occur due to mistakes in the handwriting of the user's handwriting and interpretation of one word into two or more words. Of course, other re-editing gestures can be defined, such as circles of a series of words to be re-edited, and these are not considered outside the scope of the present invention. For example, in a speech recognition system, a re-edit “gesture” can be defined by uttering a command. In the above example, it is pronounced as “re-editing: commanding mixed voice”.

  In one aspect, the system stores a list of alternative text objects determined to best match one or more input actions of the most recently output text object. Upon detecting a re-edit gesture, the system displays a text object selection list that includes alternative text objects. This alternative text object is a text object that has been determined to most closely match the input operation by the user, resulting in the output of the text object to be re-edited. In another embodiment, the first output text object is not displayed in the text object selection list. This is because the re-editing procedure (usually) is performed only for replacement. In another aspect, the text object to be re-edited is automatically replaced with an alternative text object having the second highest matching score. This is selected from the list of alternative text objects determined to best match the input action that generated the text object to be re-edited (does not require the user to select a text object from the displayed text object selection list) . This approach is advantageous in systems where the text object originally intended by the user is in most cases an alternative text object with the second highest match. In another aspect, if the text object that has already been re-edited and the next candidate alternative text object with the second highest match automatically replaced the first output text object is re-edited again, the system Displays a selection list of text objects and allows the user to select an alternative text object.

  FIG. 1 shows a simplified block diagram of hardware components of an exemplary device <100> that implements a user interface system and method for text editing and menu selection. The device <100> includes one or more input devices <120>, and sends an input signal based on an operation performed by the user to a CPU (processor) <110>. Typically, the hardware controller goes into coordination, interprets the raw signal received from the input device, and sends that information to the CPU <110> using a known communication protocol via an available data port. An example of the input device <120> is a touch screen. This provides an input function for notifying the CPU <110> of a touch event when the user touches the touch screen. Similarly, CPU <110> communicates with the hardware controller of monitor <130> to draw on monitor <130>. An example of a monitor <130> is a touch screen monitor that provides visual feedback of graphics and characters. As an option, a CPU <140> is combined with the CPU to guide the user with an appropriate audio signal (mostly an error signal), and a microphone <141> is combined with the CPU to input with the voice of the user (mostly user text It is also possible to receive an input motion recognition system that implements voice input as an input method. CPU <110> has access to memory <150>. This includes a combination of temporary and / or fixed storage, readable / writable memory (random access memory or RAM), read only memory (ROM), flash memory, hard drive, flexible disk, etc. Possible non-volatile memory is included. The memory <150> includes a program memory <160> including all programs and software such as an operating system <161>, input operation recognition system software <162>, and other application programs <163>. In the program memory <160>, text editing system software <164> for recording and restoring the text insertion position according to the method of the present invention, and a plurality of options are graphically displayed according to the method of the present invention, and displayed graphically. At least one menu selection system software <165> for selecting one of the selected options is included. The memory <150> also includes a data memory <170>, which contains a text object database <171> required by the input motion recognition system software <162>, as well as a record of user settings and favorites. Optional storage <172> and other data <173> required by the component <100>.

  FIG. 2A shows the re-edit function key <208> displayed on the monitor <130> of the system <100>, or the text object intended by the user that has previously been output with a predetermined re-edit gesture. It shows how the re-editing procedure is enabled by running on the missing text object ("great" 200 in Figure 2A). In another embodiment, if the re-edit function key <208> is enabled and there is no highlighted text object, the system identifies the text object that contains or is adjacent to the current text insertion position and automatically As the target of the re-editing procedure.

  FIG. 2A shows the text object selection list <202> displayed as a result. In this example, “heat”, which is the text object originally intended by the user, is displayed as the first text object candidate <204> in the text object selection list <202>. This is because this text object is determined to be the second text object that matches the input action that was originally performed (after the word “great” that was first output as a text object that matches the original input action). Match). When the text object <204> in the text object selection list <202> is selected using the input device <120>, the CPU <110> displays the highlighted text object “great” in the text output area <206> of the monitor. "<200> is automatically replaced with the text object" heat "that the user originally intended.

  In another aspect, the re-editing process inserts or deletes spaces in the same way that the input motion recognition system software <162> automatically generates spaces. When the input motion recognition system automatically generates a space between text objects, the setting that automatically generates a space between all adjacent text objects will cause the user to be forced to delete unnecessary auto-generated spaces. become. For example, in English, when making a noun possessive, “'s” (Apostrophe-s) is added to the end of the text object. In French, if an article “le” or “la” is preceded by a phrase that begins with a vowel, it is written “l '” (l-Apostrophe), and a space is inserted between the first letter of the following phrase and the apostrophe. do not do. In languages such as German, it is common to create a long “compound” word by concatenating two or more words. There are other approaches to solving this problem, which are not outside the scope of the present invention, but flagging certain text objects as a simple approach to solving this problem in input motion recognition systems. There is a way to specify an exception to the normal rule of automatically inserting a space between adjacent text objects. For example, in English, the text object '' s' (Apostrophe-s) in the system's text object database is flagged and there is a space between this word and the next word, but this word and the previous word Specifies that there should be no spaces between. Conversely, in French, the text object "l '" (l-Apostrophe) in the system text object database is flagged and there is a space between this word and the previous word, but this word and the next word Specifies that there should be no spaces between. In another aspect, text objects are usually separated by a space, but also to languages such as German that typically combine separate text objects to produce long "composite" text objects, so usually between the words you insert The function to turn off automatic generation of the next time is installed in the input motion recognition system (this allows two text objects to be generated in succession without generating a space in between). Alternatively, a function of turning off the automatic generation function of a normally generated space may be installed until the automatic generation function of the space is re-enabled. Alternatively, a function for deleting the most recently automatically generated space can be added to the input motion recognition system. As explained below, the re-editing process of the present invention accommodates these various exceptions in automatic space generation, so the re-editing process replaces text objects with text objects to which different auto-spacing rules apply. The text is generated with the correct space settings.

  In another aspect, the re-editing gesture is defined so that a part of a character string constituting a continuous character string of text object characters can be selected with one gesture. As shown in the example of FIG. 2B, the word “of ’s” <210> is made up of “of” <212> and “’ s ”<214>. Note that in this example, the two text objects were created corresponding to two separate input actions that were executed in succession. Another point to note is that this text is generated by the input motion recognition system that automatically outputs a space between text objects that are generated continuously by default, but the text object “'s” <214> is a system Is flagged as an exception to this default behavior, so no space was generated before the output of '' s' <214>, so it merges into the previous text object and is correctly owned The case is made. However, in the example shown in FIG. 2B, the text object “′ s” <214> is not the text object originally intended by the user when the corresponding input operation is executed.

  In another aspect, it is associated with a text string (in the example of Figure 2B, "of's" <210>) that consists of multiple text object characters and one or more delimiters. When a re-editing gesture is detected in the region, the system first determines whether the entire text string ("of's" <210> in the example in Figure 2B) was generated for one user input action. And if so, the system responds in the manner described above based on the alternative text object identified in the input action. In another aspect, the identified text string (in this example, “of's” <210>) is generated by two or more separate user input actions that each generate a substring of the text object. The system identifies the substring of the text object that is closest to the re-edit gesture that was performed, for example, highlights the identified substring and substitute text that matches the user input action that generated the substring Displays a list of objects so that the user can select them. In FIG. 2B, the position <216> associated with the detected re-edit gesture (eg, a double tap at position <216>) is closest to the substring “'s” <214>, so this substring Is identified as the “target” for re-editing and is highlighted in the text output area <206>. In the example of FIG. 2B, the user has just finished entering the entire sentence, and before the re-editing gesture is detected at position <216>, the text insertion position is at position <218>, which is the end of the sentence where input has been completed. The user is ready to enter the next sentence.

  In this example, “Oz”, which is the text object originally intended by the user, is displayed as the first candidate text object <220> in the text object selection list <202>. This is because this word is determined as a text object that is the second closest to the original input action (the text object “'s” <214 that is output first as the text object that most closely matches the original input action). Followed by>). FIG. 2C shows that the text object “Oz” <220> is selected in the text object selection list <202>, and the text object “Oz” <220> is automatically highlighted by the text editing system software <164> in the output text area <206>. It shows a state where “s” <214> is replaced with a text object “Oz” <220> originally intended by the user. Note also that the text editing system software <164> has inserted a space <222> between the immediately preceding text objects “of” <212> and “Oz” <220>. As described above, the text object “'s” <214> is flagged with an exception flag for the default behavior of automatically creating a space between successfully generated text objects in the system text object database <171>. Therefore, originally, no space is generated before outputting “'s” <214> in FIG. 2B. Since the selected replacement text object “Oz” <220> is not flagged as such in the system text object database <171>, the system replaces the text object “'s” <214> with the text object “Oz”. "<220> replaces the space before inserting the replacement text, and the space <222> is inserted between the words" of "<212> and" Oz "<220>. The reverse case is processed in the same way. That is, when the text object “Oz” <220> is generated first and then replaced by the text object “'s” <214> by the re-editing procedure, the space <222> is generated first and the text object “Oz” is generated. Although placed before <220>, when replacing "Oz" <220> with "'s" <214>, the preceding space is deleted and "' s" <214> is the previous text object. Combine directly with. Thus, in another aspect, if one text object is replaced with another object as a result of the re-editing process, and two text objects have different space insertion behavior associated with them, before and after the replacement text object The space is adjusted to reflect the difference in the space setting behavior of the two text objects.

  In another embodiment, the text editing system software <164> records the text insertion position in the text output area <206>, so that the text insertion position is automatically set immediately after replacing the reedited text object with the alternative text object. Restored and returns to the position of the output text before executing the re-editing procedure. In the example of FIG. 2C, after the text object “'s” <214> is replaced with the text object “Oz” <220>, the text insertion position automatically returns to the original position <218>, that is, the sentence end position. (Place before re-editing gesture detection at position <216>). Therefore, the user can continue to insert text without manually moving the cursor to the text insertion position. In another aspect, if the generated text object selection list is canceled without selecting a replacement text object, the identified text object remains highlighted (selected) and the text is inserted. Since the position does not return to the original position in the output text, another action can be performed on the identified text object that remains highlighted. In another aspect, if one or more additional input actions are performed before selecting an alternative text object from the generated text object selection list, the text object selection list is automatically canceled and the text insertion position is , Do not return to the original position in the output text. The text generated by the one or more additional input operations is then sent to the text output area and, as a result, replaces the previously output text object according to the standard operation of the word processing program. This is because the previously output text object is currently highlighted (selected) in the text area. In another aspect, performing an input operation corresponding to the generation of the control character results in sending the control character to the target text application. For example, when executing an input operation corresponding to the generation of Ctrl-B, the target application receives Ctrl-B and formats the previously output text object that is highlighted in bold. In another aspect, when the user scrolls the displayed text area and executes the re-editing gesture with the system detecting that the text insertion position is no longer displayed on the monitor screen, the automatically generated text object selection list The text insertion position does not return to the original location of the output text (which is not already displayed). In another aspect, by selecting from the system settings, a re-edit gesture predetermined by the system and the subsequent operation (for example, returning the text insertion position to the original position of the output text) can be set.

  These features of the system greatly improve text input efficiency. Input motion recognition systems inherently involve many incorrectly generated text objects, which are usually randomly distributed throughout the previously generated text. In many cases, the user simply needs to modify the incorrectly generated text object, and after modification, continues to input where the text was previously output. The function of recording and automatically returning the text insertion position is a great merit for the user because it eliminates the troublesome work of moving the text insertion position back to the original position. By significantly improving the efficiency of the error repair procedure, the overall efficiency of the system is greatly improved in two ways. First, accidental error correction is facilitated and time is reduced, improving overall effective input speed. Secondly, the error repair process is so simple and easy that many users are less concerned about the possibility of recognition errors, resulting in faster input actions and less concern about accuracy. In many input motion recognition systems, this has an overall effect on improving input speed.

  In another aspect, when the user moves the cursor in the text output area, the text editing system software <164> detects it and automatically operates the system according to the situation of the new text insertion position where the cursor is placed. To change. In one aspect, when automatically outputting a space between generated words, if the system detects that the text insertion position has moved to a new context, the system automatically outputs a space until it outputs the first word in the new context. Turn off. In another aspect, if the system detects that the text insertion position has moved to a new context and such automatic space setting is turned on, the system examines the character to the left of the new text insertion position and If the character to the left of the insertion position is a “blank” character, and / or if the text insertion position is at the beginning of the text field, and / or if the text field is a password input field, the system will first enter the new context. Turn off automatic space output until the word is output.

  In another aspect, when the user re-edits the text object, a list of one or more alternative text objects is presented to the user so that the user can select the originally intended text object. These alternative text objects correspond to alternative “mappings” by the input action recognition system of one or more input actions initially mapped by the system for the text object to be re-edited. In another aspect, the list of alternative text objects that the user can select is presented by a special graphical display so that the user can specify the desired choice with a simple and intuitive gesture. Normally, this gesture does not require the accuracy required for the menu selection methods used in the prior art, and speeds up the re-editing procedure by reducing the time required for the intended object selection process. In another aspect, this same special graphical menu display is also used elsewhere in the user interface, reducing the time required to select from two or more alternative options elsewhere in the system as well. The The selection method by the graphical display and the gesture display of the present invention is particularly effective when the presented one or more alternative choices are higher than the average of the prior probabilities that the user intends the choices. This is true in many cases where the user is provided with choices.

  FIG. 3A shows an example of a menu 300 configured in one way that has the advantages of the method of the present invention. The example shown in FIG. 3A includes the following six selected sub-regions. These are five selection sub-regions 301 to 305 for option 1 to option 5 and a sixth sub-region 306 with an icon indicating that this selection is an operation for canceling the menu 300. Each of the six selection sub-regions 301-306 is associated with a segment 311-316 corresponding to the peripheral border of menu 300. In the present invention, menu selection is performed by first touching an arbitrary place in the area surrounded by the outermost peripheral border of the menu on the screen. Follow the path exiting the menu area through the menu boundary segment associated with the desired option while maintaining contact with the screen. Next, the contact operation is terminated by releasing the contact with the screen (eg, releasing the stylus) at a location outside the boundary line around the menu 300. Alternatively, menu selection is effectively performed as soon as the contact operation leaves the menu area. In this case, it is not necessary to end the contact operation. The end of the touch action is required to make the menu selection effective, so the user can re-enter the menu area without releasing the touch, modify the pending selection, and change the menu border The contact operation can be terminated after passing through the segment. The example described here includes the use of a touch screen, where the control point determined by the position of the stylus (or finger or other contact means) by the action of touching and releasing the screen. Although effectively “valid” or “invalid”, other approaches are not considered outside the scope of the present invention. For example, the control point can be a cursor controlled by mouse movement. In this case, the control point becomes “valid” or “invalid” by clicking or releasing the mouse button.

  In FIG. 3A, the peripheral border segment of the menu 300 associated with the menu selection sub-region is the peripheral border segment of the menu that is also part of the peripheral border of the menu selection sub-region itself. In the menu example shown in FIG. 3A, option 1 in the selection sub-region 301 is associated with the menu peripheral boundary segment 311 that constitutes the entire upper boundary of the menu 300. To select option 1, touch the screen at any location in menu 300, move upward, exit the menu area at the top, and release the contact with the screen. FIG. 4 shows an example of the contact operation 400 that starts from the contact position 401 as the starting point, exits the menu from the exit position 402 on the peripheral boundary line segment 311, and ends at the final contact position 403. As a result of the contact action 400, the menu option 301 (“option 1”) is selected even though the initial touch position is in the menu selection sub-region 303 associated with “option 3”.

  One advantage of the present invention is that the contact action does not require much accuracy, so it is performed very quickly and generally speeds up menu selection by the user. The benefits are even greater if the prior likelihood that a particular menu option will be selected is high. For example, in the menu shown in FIG. 3A, the probability that one of the menu options 301 (“option 1”) and 305 (“option 5”) will be selected is one of the options 302, 303, or 304. Assume that it is known in advance that it is more than twice the probability. In the example of the menu shown in FIG. 3A, the entire upper boundary segment 311 of the menu peripheral boundary is associated with the selection sub-region 301 of “Option 1”, and the lower boundary segment 315 of the menu peripheral boundary is “Option 5”. It is designed to be associated with the selected subregion 305. In this example menu, the length of both segments 311 and 315 is approximately three times the length of segments 312, 313, and 314 (respectively associated with selection subregions 302, 303, and 304). In other words, it is very easy to select “Option 1” and “Option 5” because there is a large tolerance for error when quickly following the path of exiting the menu through the corresponding segment. Because the various menu selection sub-regions can be easily designed, the relative lengths of the relevant peripheral border segments approximate the relative expected probabilities of the various menu selections within reasonable tolerances.

  Another important advantage of the present invention is that the touching action that starts within the area surrounded by the outermost menu perimeter border and never exits the menu past the perimeter border is To be regarded as a menu selection. That is, it is regarded as a selection by “tap” in the menu selection sub-region. This allows the improved menu selection approach to be introduced by the present invention in systems where no explanation or information regarding this new menu selection approach is provided to the user. Users who are completely unaware of the new selection approach can continue to use the traditional menu selection “tapping” until a new menu selection method is discovered or introduced. This allows flexibility in menu design because menu choices with very low prior probabilities can be displayed as “no border” menu choices that do not include any menu outer border segments in the menu choice's perimeter border. Will also improve. As a result, the length of the usable menu peripheral boundary line increases, and it becomes possible to assign to other menu options with high probability. For example, FIG. 3B shows an example of a menu arrangement using the same set of options as shown in FIG. 3A. However, the menu arrangement of the menu option set shown in FIG. 3B indicates that the prior probability that “option 2” (322) is selected is much higher than the probability in FIG. 3A. In the example of FIG. 3B, the entire 332 on the right side of the menu is related to “Option 2”, and both “Option 3” and “Option 4” are screened within the relevant menu selection sub-regions 323 and 324. It is necessary to make a selection by directly touching and to cancel the contact without leaving the desired menu selection sub-region (eg, using the conventional menu selection “tapping”).

  Similar design principles can be effectively used for menus with more options by combining two submenus. FIG. 5 shows a menu 500 having eight selection subregions 501-508. The selected sub-areas 501 to 504 together constitute a first sub-menu area 521, and the sub-areas 505 to 508 together constitute a second sub-menu area 522. Selected subregions 501-504 are associated with submenu 521 peripheral boundary segments 511-514, and selected subregions 505-508 are associated with submenu 522 peripheral boundary segments 515-518. Submenu 521 perimeter border segment 514 and submenu 522 perimeter border segment 515 are not along the outer perimeter border of menu 500, but are themselves the same line segment (514/515) inside menu 500 Should be noted. Although this is not a problem, the selection actions of menu selections 504 and 505 differ in the direction in which the line segments (514/515) intersect and the submenu area where the first contact is made. A touch action that has an initial touch location in the area of submenu 521 and crosses line segment (514/515) downward is a unique choice of menu selection 504, while the first action in the area of submenu 522 The contact action having the contact location and crossing the line segment (514/515) upward is a unique selection of the menu selection 505. In other embodiments, the submenu containing the first touch location is visually highlighted upon detection of the first touch in the submenu area, and the path present in the submenu is crossed by crossing the perimeter of the submenu. Displays a set of menu choices (contained within submenus) that can be traced and selected.

  The most direct way of associating a menu perimeter segment with a menu option is to associate a menu perimeter segment that itself is also part of the menu option perimeter (as described above). Other methods are possible and should not be considered outside the scope of the present invention. For example, the area associated with each menu selection is displayed with a different characteristic background (or font) color, and the peripheral border segment of the associated menu is displayed with a corresponding associated (or identical) color. For example, in Figure 3C, the six menu choices 341-346 are displayed with a background color of orange (341), yellow (342), green (343), blue (344), purple (345), and red (346), respectively. The corresponding menu peripheral boundary segments are displayed as orange (351), yellow (352), green (353), blue (354), purple (355), and red (356) segments, respectively. Alternatively, each of the six menu choices 341-346 can be displayed with a light orange, light yellow, light green, light blue, light purple, light red background color (to make each menu item easier to read due to the light background color) ), The corresponding menu peripheral boundary segments can be displayed as clear orange (351), yellow (352), green (353), blue (354), purple (355), and red (356) segments, respectively. The combination of the two approaches can use fewer colors in places where it is clear which menu selection sub-regions are related by the neighborhood of the color and the peripheral border segment. In this way, the menu can be displayed as in the example shown in FIG. 3C, and each menu selection sub-region is represented as a conventional rectangle, rather than the more complex polygon shown in FIG. 3A. In another aspect, patterns or shades may be used instead of colors to distinguish the various menu sub-regions and associate the sub-regions with corresponding menu peripheral boundary segments.

  As further shown in FIG. 6, the menu structure 500 can use a consistent four-color scheme to make the menu selection operations required in each case simple and intuitive. For example, menu selection sub-regions 501 and 505 can be displayed with a blue background, sub-regions 502 and 506 with a red background, sub-regions 503 and 507 with a yellow background, and sub-regions 504 and 508 with a green background. Then the user only has to remember the following: Blue background-tap down and stroke upwards. Red background-tap near and stroke right. Yellow background-tap near and stroke left. Green background-tap up and stroke downwards. This particular scheme is also like a simple memory symbol. Blue-"towards the sky", green-"towards the earth", "red to the right", and "yellow to the left". In this modular approach, menus with any number of choices can be constructed using the principles of the present invention.

While embodiments of the invention have been illustrated and described, as noted above, many changes can be made without departing from the spirit and scope of the invention. Accordingly, the scope of the method should be determined not by the specific embodiments described above, but by the appended claims and their legal equivalents.
Hereinafter, the invention described in the scope of claims of the present application will be appended.
[1]
An input and editing method on an electronic device having a user interface comprising at least one input system that detects a user input action to generate and edit text, and at least one text display system that displays the text to the user There,
A record of the text insertion position in the text display system where the next generated text object is output,
Detection of characteristic input actions to identify one or more of the text object outputs to the text display system;
Identification of previous output of one or more of the text objects based on the detected characteristic input behavior;
Determining one or more alternative text objects corresponding to one or more input actions, wherein one or more such specific text objects have been previously determined;
Replacing one or more of the determined alternative text objects with one or more of the particular text objects previously output;
A method comprising: restoring the text insertion position to a recording location before detecting the input operation.
[2]
In the method of [1], the one or more determination alternative text objects on the text display system are further displayed to the user for the replacement of the one or more previously output text objects. A method comprising selecting one of the displayed text objects.
[3]
In the method of [1], a location in the text display system related to the characteristic input operation is further determined, and a text object output previously for the text display system closest to the determined location is specified. A method comprising:
[4]
The method of [1], further comprising automatically generating one or more spaces between the one or more output text objects.
[5]
The method of [4], further comprising specifying two or more text objects belonging to two or more classes of text object classes, wherein each of the two or more text object classes is a text belonging to the class. A method that differs from other classes in a way to automatically generate one or more spaces before or after the output of an object.
[6]
In the method of [5], at least one of automatically inserting or deleting a space positioned at least before or after a text object to be replaced with a text object belonging to a different class of the text object class. A method comprising:
[7]
In the method of [5], the change of the text insertion position is further detected, and the text insertion position is directly input to the changed text insertion position before or after the next text object output. Changing the manner in which one or more spaces are automatically generated for the text object class associated with adjacent text objects and for all spaces immediately adjacent to the modified text insertion location. .
[8]
In the method of [4], furthermore, a characteristic user input action is detected, and automatic generation of the space related to the output of the next generated text object is disabled, and the generated next A method comprising automatically re-enabling such automatic space generation following the output of the text object.
[9]
[4] The method according to [4], further comprising detecting a characteristic user input action and deleting the most recently generated and generated space among the automatically generated spaces.
[10]
The method of [1] further includes displaying two or more determined alternative text objects on the text display system and detecting a user selection to identify an alternative text object that replaces the intended text object. The method to comprise.
[11]
In the method of [10], before the alternative text object displayed as an alternative to the designated text object is selected, the user performs one or more other input operations to restore the text insertion position. Otherwise, the identified text object has been selected as the text insertion location, and the result of one or more other input actions includes modifying or replacing the intended text object.
[12]
In the method of [1], one or more of the determined alternative text objects for replacing the specified text object are determined as the next best text object for the detected input action. A method comprising automatically identifying an alternative text object.
[13]
In the method of [1], when the text insertion position is not in a position that is visible in the text display system, the text insertion in the text display system is performed at the position recorded before the characteristic input operation is detected. A method comprising not restoring a position.
[14]
A device for entering and editing text,
One or more input devices that detect the input action of one or more users generating and editing text;
An output device that displays the generated text to the user,
A processor connected to the input device and the output device, the processor comprising:
A first part for recording a text insertion position from which a generated text object is output;
A second portion for detecting a characteristic input action that identifies one or more of the text objects previously output to the output device;
A third part identifying one or more previously output text objects based on the detected characteristic input action;
A fourth part for determining one or more alternative text objects corresponding to one or more detected input actions that previously determined one or more intended text objects;
A fifth part for replacing one or more of the previously output text objects with one or more determined alternative text objects;
An apparatus comprising a sixth part for restoring a text insertion position to a location recorded before a characteristic input motion is detected.
[15]
[14] In the apparatus of [14], the processor further includes a processor for selecting one of the displayed text objects to replace one or more previously identified text objects. An apparatus comprising a seventh portion for displaying one or more determined alternative text objects.
[16]
[14] In the device of [14], the processor further includes a seventh part for determining a place in the output device related to the characteristic input operation,
And an eighth portion that identifies the text object previously output to the output device that is closest to the determined location.
[17]
[14] The apparatus according to [14], further comprising a seventh portion for automatically generating one or more spaces between the one or more output text objects.
[18]
[17] In the apparatus of [17], the processor further includes an eighth portion that specifies two or more text objects belonging to two or more classes of text objects, and each of the two or more text objects includes: A device that differs from other classes in that when a text object belonging to the class is output, one or more spaces are automatically generated and at least one is generated before or after output.
[19]
[18] In the apparatus of [18], the processor further includes:
An eighth part for automatically inserting or deleting a space located in at least one of the text objects replacing a text object belonging to another class within the text object class; ,apparatus.
[20]
[18] In the apparatus of [18], the processor further includes:
Changes to the text insertion position can be detected and for a class of text objects associated with a text object that is close to the changed text insertion position, or for a space that is close to the changed text insertion position A method in which at least one or more spaces are automatically generated, i.e., at least one automatically generated space before or after the next text object at the changed text insertion position is output. An apparatus comprising a ninth part to be modified.
[21]
In the apparatus of [17], the processor further includes:
It is impossible to detect characteristic user input actions and generate automatic space associated with the next generated text object, and automatically as soon as the next generated text object is output A device comprising an eighth part which automatically enables again to create a space.
[22]
In the apparatus of [17], the processor further includes:
An apparatus comprising: an eighth portion that detects characteristic user input actions and deletes the most recently generated automatically generated space.
[23]
In the apparatus of [14], the processor further includes:
A seventh portion displaying two or more determined alternative text objects in the output device; and
An apparatus comprising an eighth portion for detecting a selection made by a user to identify an alternative text object that replaces the intended text object.
[24]
In the apparatus of [23], the processor further includes:
A ninth part for detecting one or more other input actions of the user before selecting an alternative text object displayed as an alternative to the indicated text object; and
A tenth portion for selecting a text object identified as a text insertion position to be modified or replaced as a result of one or more other input operations without restoring the text insertion position to a previous location; Do the equipment.
[25]
In the apparatus of [14], the processor further includes:
Alternative text determined as the next best matching text object for the detected input action that generated the specified text object among the determined alternative text objects to replace the specified text object An apparatus comprising a seventh portion for automatically identifying an object.
[26]
In the apparatus of [14], the processor further includes:
A seventh part that determines that the location of the previous text insertion position where the characteristic input action was recorded is not in the text that is currently visible to the output device; and
If it is determined that the place where the seventh part was recorded is not actually in the text that is visible to the output device, the sixth part is the text where it was recorded before the characteristic input action was detected. An apparatus comprising an eighth portion that prevents restoring the insertion position.
[27]
In a method for displaying two or more video options in a display where a user can position, move, enable, and disable control points within a limited area pointed out on an electronic display.
Presenting two or more video options in a limited area,
Defining one or more segments for a limited area boundary;
One or more designated segments independently associated with a particular one of the video options;
Detecting the activation of control points within a limited area;
Detecting the action of an activated control point, such as an activated control point coming out of a limited area,
Identifying one of the unique boundary segments through which the activated control point went out of the limited area,
Determining a video-displayed option based on the identified boundary segment.
[28]
[27] In the method of [27], each of the options is further displayed in a uniquely defined sub-region in a limited region, and the specified segment in the boundary is a boundary segment in one sub-region. A method defined in a boundary segment that also serves as a gap, and the options displayed in a sub-region are specifically related to the region of that border.
[29]
[27] In the method of [27], one or more options are displayed graphically using one or more colors, video patterns, or shades, and the uniquely associated boundary segment is equal or higher A method that is displayed using different colors, visual patterns, or shades.
[30]
[27] The method according to [27], further comprising correcting the visual display of the defined limited area when the control point is activated in the limited area.
[31]
[27] In the method of [27], for two or more limited lengths of the region, the relationship is visually displayed so that the user is uniquely associated with the two or more defined boundary segments. A method associated with the determined probability relationship of selecting each option.
[32]
A device,
An output device that visually presents two or more options to be selected,
An input device for detecting two or more input operations for positioning, moving, valid and invalid control points on the display;
A processor connected to the input device and the output device;
A first portion that visually displays two or more options in a defined and defined area on the display;
A second portion designating two or more specific segments of the limited region boundary;
A third part that independently associates one or more defined segments with a particular one of each of the visually displayed options;
A fourth part for detecting a state in which the control point is activated in a limited area;
A fifth part for detecting a gradual movement such that an activated control point exits within a limited area;
A sixth part that identifies a defined boundary segment that has passed when the activated control point exits within a limited area;
An apparatus comprising: a sixth portion for determining a video-displayed option under a specified boundary segment.
[33]
In the apparatus of [32], the processor further includes:
A seventh part displaying the options in their own limited sub-areas,
An eighth part defining a specified boundary segment as a boundary segment that also serves as a boundary segment of one sub-region;
An apparatus comprising: a ninth portion associating an option displayed in a sub-region with a region of its bounded boundary segment.
[34]
In the apparatus of [32], the processor further includes:
Display one or more choices in one or more colors, video patterns, or shades, and also display their uniquely associated boundary segments in equivalent or higher color or video patterns , An apparatus comprising a seventh portion for displaying it in shading.
[35]
In the apparatus of [32], the processor further includes:
An apparatus comprising: a seventh portion for correcting a visual display of a defined limited area when detecting a state in which the control point is activated in the limited area.
[36]
[32] In the apparatus of [32], further, for two or more limited area lengths, the relationship is a choice that is visually displayed by the user uniquely associated with the two or more defined boundary segments A device related to the determined probability relationship of selecting each of the.

Claims (6)

And at least one input system for a user to input and edit text, enter and edit Oite text to an electronic device with a user interface comprised of a minimum of one text display system for displaying the text to the user A way to
The first component of the electronic device, to detect one or more input actions that we row by the user,
The second component of the electronic device, to determine one or more text objects corresponding to one or more input actions taken by the user, one made by the user or more Process input actions,
Identifying one of the determined text objects by a third component of the electronic device;
By the fourth component of the electronic device outputs a text object that the identified fixed text insertion point within the text display system,
Records the location of the text insertion position in the text display system where the next identified text object is output by the fifth component of the electronic device;
By the sixth component of the electronic device detects the specific input action made by the user, shown refers to one or more of the text object previously outputted to the text display system,
The seventh component of the electronic device, without the user to perform further input action, one or more alternate text objects to identify, wherein said one or text object of a plurality of alternative, It is also determined to correspond to the detected one or more input actions, and the one or more indicated text objects are determined from the detected one or more input actions. Is
In order to replace one or more of the pointed text objects by the eighth component of the electronic device, the user identifies one or more of the identified alternative text objects for selection of an alternative text object. Displayed on the
If the user performs one or more other input actions before selecting any of the displayed alternative text objects to replace the pointed text object,
Selecting the pointed text object as the text insertion position such that the ninth component of the electronic device changes or replaces the pointed text object by the one or more other input actions And
Otherwise,
Wherein the tenth component of the electronic device, by replacing one or more of the one pointed to text objects or more of said identified alternate text objects within the text display system,
By the 11 components of the electronic device, the text insertion point in the text display system, to restore the location where the particular input action is recorded before it is detected,
Comprising
The method wherein the particular input action performed by the user is not an action used to change the location of the text insertion location. By said electronic device, wherein the determining the location of the text display system, the text object previously outputted to the nearest the text display system in the determined location related to a specific input line made by the user the method of claim 1, further comprising identifying a as one or more of the pointed to text objects. Wherein the electronic device, one or more of the output methods of claim 1, further comprising automatically generating the one or more spaces between the text object. By said electronic device, and identifying the two or more text objects belonging to two or more groups consisting of text objects, where the text objects belonging to one or more groups of pre-Symbol Group One or more spaces are automatically generated immediately before and / or immediately after the output of each of the groups so that each of the two or more groups of text objects The group and space settings are different .
And be automatically inserted or deleted immediately before and / or the space immediately after the text object to replace the text objects that belong to different groups of out of the group consisting of before Symbol text object,
4. The method of claim 3 , further comprising: The method of claim 1, further comprising automatically identifying an alternative text object that replaces the indicated text object by the electronic device. A text input device,
One or a plurality of input devices that detect one or more input actions taken me by the user,
An output device that displays the generated text to the user;
A processor coupled to the input device and the output device, the processor comprising:
A first component for detecting one or more input actions that we row by the user,
To determine one or more text objects corresponding to one or more input actions taken by the user, one made by the user or more input action a second for processing Components ,
A third component for identifying one of the determined text objects;
A fourth component for outputting the identified text object to a predetermined text insertion position of the output device;
A fifth component for recording the location of the text insertion position where a text object to be identified next is output;
Detecting a specific input action made by the user, and the sixth component of Me indicates static refers to one or more of the text object previously outputted to the output device, wherein the line by the user The specific input action is not an action used to change the location of the text insertion position ,
Without the user to perform further input actions, and one or more alternate seventh component of for a text object that identifies the, wherein said one or text object of a plurality of alternative, the detection One or more input actions that are determined, and the one or more indicated text objects are determined from among the detected one or more input actions. Is,
To replace can one or place the plurality of said pointed to text objects, the one or text object of a plurality of the identified alternative for the selection of alternate text objects for display to the user 8 And the components of
If the user performs one or more other input actions before selecting any of the displayed alternative text objects to replace the pointed text object,
A ninth component for selecting the pointed text object as the text insertion position so that the pointed text object is changed or replaced by the one or more other input actions;
Otherwise,
A tenth component for replacing one or more of the pointed text objects of the output device with one or more of the identified alternative text objects;
The text insertion position of the output device, and a second 11 components to restore the place where the specific input action is recorded before it is detected,
Comprises a, and a processor,
A text input device comprising:

Images