KR102206373B1 - Contents creating method and apparatus by handwriting input with touch screen - Google Patents

Abstract

The present invention provides a method for creating content through a handwriting input on a touch screen; In the handwriting mode, displaying the handwriting input content according to the detection of the handwriting input, and checking whether there is a preset correction mode operation; When there is a correction mode operation, it enters the correction mode, displays the handwriting input according to the detection of the handwriting input, checks the preset correction code from the handwritten input contents, and applies the edited contents preset to the correction code. Carry out the process of correcting your handwriting.

Description

Content creation method and device through handwriting input on touch screen {CONTENTS CREATING METHOD AND APPARATUS BY HANDWRITING INPUT WITH TOUCH SCREEN}

The present invention relates to a technology for providing a user interface environment using a touch screen that senses a user's body (eg, a finger, etc.) or a touch state of an electronic pen such as a stylus pen as an input, In particular, it relates to a method and apparatus for creating contents through handwriting input on a touch screen.

Recently, portable terminals manufactured to be possessed by users, such as smartphones, mobile phones, Portable Multimedia Players (PMPs), MP3 players, tablet PCs, personal navigation devices, and portable game consoles, can move vertically and horizontally due to their limited size. A method of providing a user interface by providing an input device (ie, a touch screen) capable of a user's screen touch input without having a four-way button for receiving manipulation has been widely provided.

The user interface method using a touch screen detects a touch input using a user's finger or an electronic pen. The touch input method at this time includes a touch input method by contacting a user's body or a touchable input means (eg, an electronic pen), and an input method in a non-contact state such as hovering. The touch input method provides a convenient user interface. Particularly, the touch input method using the electronic pen can be more precise than the touch input method using a finger, and thus can be more usefully applied when performing applications related to handwriting input or sketching.

On the other hand, the writing method of content (e.g., memo, message, general document, etc.) through handwriting input has a higher degree of freedom of content creation compared to the conventional method of writing contents through keyboard input, and is more intuitive and quick input. It is possible, and also, due to the improvement of character recognition technology for handwritten content, its utility is greatly increased.

However, the content being created (or created) in the content creation method through handwriting input is usually processed as an image file or as a text file through character recognition, and the technology for editing the content of such content is based on recognized characters. It stays at a level that provides a simple degree of correction.

Accordingly, an object of the present invention is to provide a method and apparatus for creating content through handwriting input on a touch screen in order to provide an editing function that is more useful to a user when creating content through handwriting input, and that the user can use more easily. In the offering.

Another object of the present invention is to provide a method and apparatus for creating content through handwriting input on a touch screen to provide an editing function based on handwriting input when creating content through handwriting input.

In order to achieve the above object, according to an aspect of the present invention, there is provided a method for creating content through a handwriting input on a touch screen; In the handwriting mode, displaying the handwriting input content according to the detection of the handwriting input, and checking whether there is a preset correction mode operation; When there is a correction mode operation, it enters the correction mode, displays the handwriting input according to the detection of the handwriting input, checks the preset correction code from the handwritten input contents, and applies the edited contents preset to the correction code. It is characterized by including a process of correcting the handwritten content.

In the above, the process of entering the correction mode and correcting the handwritten content may include displaying the handwriting input content according to detection of the handwriting input; Checking whether there is a matching correction code among preset correction codes in the handwriting input, and checking handwriting contents other than the checked correction codes as contents for correction; Correcting a current handwriting input content according to a correction function preset according to the checked correction code and the contents for correction; And displaying the corrected handwriting input content.

In the above, the checking of the preset calibration code is characterized in that when entering the calibration mode, the preset initial N (for example, 1) strokes are identified as the calibration code.

In the above, the correction code is a'insertion correction code' indicating content insertion, a'replacement correction code' indicating content replacement, and correction of the inclination of a portion corresponding to a character string composed of a plurality of characters among handwritten contents. It includes at least one selected from the'tilt correction code' indicated and the'paragraph alignment correction code' indicating paragraph alignment, and the size or slope of the corrected content to be inserted or replaced in case of another correction operation in the insertion or replacement correction code At least one of a size or a slope of the corrected content content is converted to match the previously input handwriting content.

In the above, the preset correction mode operation is selection of a menu item prepared in advance to enter the correction mode from a menu bar preset on the screen for handwriting input, or input of an operation button of the electronic pen or the input of the electronic pen. It is characterized in that the input of the operation button is maintained.

As described above, the method of creating content through handwriting input on the touch screen according to the present invention is more useful to the user when creating content through handwriting input, can be used more easily by the user, and provides an editing function based on handwriting input. can do.

1 is a schematic external perspective view of a content creation device through handwriting input on a touch screen to which an embodiment of the present invention is applied
2 is a block diagram of a content creation device through handwriting input on a touch screen to which an embodiment of the present invention is applied
3 is a flowchart of a content creation operation through a handwriting input on a touch screen according to an embodiment of the present invention
4 is an exemplary view comparing a handwriting input screen and a conventional handwriting input screen in a touch screen to which an embodiment of the present invention is applied.
5 is an exemplary screen for editing handwriting content when writing content through handwriting input on a touch screen according to an embodiment of the present invention.
6A, 6B, and 7 are exemplary screens for'insertion correction' during handwriting editing in FIG. 5
8A and 8B are exemplary screens for'replacement (delete and insert) correction' during handwriting editing in FIG. 5
9A, 9B, 10A, and 10B are exemplary screens for'tilt correction' during handwriting editing in FIG. 5
11A and 11B are exemplary screens for'paragraph alignment correction' in FIG. 5
12 is a detailed example screens for editing handwriting content of FIG. 5
13 is an example of screens in which a correction area enlargement operation is performed in FIG. 5
14 is an exemplary diagram of a table in which correction code information is recorded when content is created through handwriting input on a touch screen according to an embodiment of the present invention

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, specific matters such as specific constituent elements are shown, but these are provided only to help a more general understanding of the present invention, and these specific matters may be modified or changed within the scope of the present invention. It will be said that it is self-evident to those with ordinary knowledge.

1 is a schematic external perspective view of a content creation device through handwriting input on a touch screen to which an embodiment of the present invention is applied, and FIG. 2 is a schematic view of a content creation device through handwriting input on a touch screen to which an embodiment of the present invention is applied. As a block diagram, for example, the device according to the present invention is a portable terminal.

1 and 2, a portable terminal 1 to which an embodiment of the present invention is applied includes a control unit 10, a wireless communication unit 11, a touch screen 12, a key input unit 14, and a storage unit 15. ) And an audio processing unit 16.

The touch screen 12 may include a display panel 120 that performs a display function for output information output from the portable terminal 1 and an input detection panel 130 that performs various input functions by a user. . In this case, the display panel 120 may be generally composed of a liquid crystal display (LCD) or a PMOLED or AMOLED as organic light emitting diodes (OLED) screen, and may be structurally integrated with the input sensing panel 130. The display panel 120 may display various screens according to various operation states, menu states, application execution and services of the corresponding portable terminal 1.

On the other hand, the input detection panel 130 is a single or multi-touch input, drag input, handwriting input, drawing input by a user using various objects such as a finger, an electronic pen (2; hereinafter, abbreviated as'pen'). It may be implemented with at least one or more panels capable of detecting various inputs such as. For example, the input detection panel 130 may be implemented using a single panel capable of detecting both a finger input and an electronic pen input, or the hand detection panel 134 capable of detecting a finger input and an electronic pen input detection. It may be implemented using two panels, such as the pen sensing panel 132 as possible.

The hand detection panel 134 may detect a user's touch input. The hand detection panel 134 may have a shape of, for example, a touch film, a touch sheet, and a touch pad. The hand detection panel 134 detects a touch input and outputs a touch event value corresponding to the detected touch signal. In this case, information corresponding to the sensed touch signal may be displayed on the display panel 120. The hand detection panel 134 may receive a manipulation signal by a user's touch input through various input means. For example, the hand detection panel 134 may detect a touch input including a user's human body (eg, a finger) as well as a physical tool. Specifically, the hand detection panel 134 may be configured as a capacitive touch panel. In the case of a capacitive touch panel, the hand detection panel 134 is coated with a thin metal conductive material (eg, ITO (Indium Tin Oxide) film) on both sides of the glass to allow current to flow on the glass surface. It is composed of a dielectric material that can be used to store electrical charges. When the surface of the hand detection panel 134 is touched by an object, a certain amount of electric charge is moved to the contact position by static electricity, and the hand detection panel 134 recognizes the amount of change in current due to the movement of electric charge and determines the touched position. It detects and tracks touch events. Here, the touch event occurring in the hand detection panel 134 may be mainly generated by a human finger, but other objects capable of applying capacitance change, for example, an object made of a conductive material capable of applying capacitance change. Can be created.

The pen detection panel 132 senses a proximity input or a touch input of the electronic pen according to the operation of the electronic pen 2 (eg, a stylus pen, a digitizer pen), and outputs the detected electronic pen proximity event or electronic pen contact event. . The pen sensing panel 132 may be implemented in an Electro-Magnetic Resonance (EMR) method, and may sense a touch or proximity input according to the proximity of the pen or a change in the strength of an electromagnetic field due to the touch. Specifically, the pen detection panel 132 includes an electromagnetic induction coil sensor (not shown) and an electromagnetic induction coil sensor having a grid structure in which a plurality of loop coils are disposed in a predetermined first direction and a second direction crossing the first direction. It may be configured to include an electronic signal processing unit (not shown) for sequentially providing an AC signal having a predetermined frequency to each of the loop coil. When the electronic pen 2 having a resonant circuit in the vicinity of the loop coil of the pen sensing panel 132 is present, a magnetic field transmitted from the loop coil generates a current based on mutual electromagnetic induction in the resonant circuit in the electronic pen. Based on this current, an induced magnetic field is generated from the coil constituting the resonance circuit in the electronic pen, and the pen detection panel 132 detects this induced magnetic field from the loop coil in the signal reception state, and the approach position of the pen Or the touch position is detected. Through the pen detection panel 132, any object capable of generating a current based on electromagnetic induction can detect proximity and touch. The pen detection panel 132 may have an activated state according to occurrence of a specific event or by default. In addition, the pen sensing panel 132 may be provided under the display panel 120 to have a predetermined area, for example, an area capable of covering the display area of the display panel 132.

An exemplary structure of the configuration of the electronic pen 2 according to the EMR method will be described in more detail. In order to generate a different signal according to a contact or hovering state on the touch screen, the electronic pen 2 is a main source that generates a reference resonance signal. A resonant circuit and a contact variable resonant circuit connected to the main resonant circuit to vary a resonant frequency of the main resonant circuit are provided. The variable contact resonance circuit is implemented as a variable inductor component having an inductance value that varies according to the contact pressure, such as when the tip of the electronic pen in contact with the touch screen in the electronic pen 2 contacts the touch screen, or Alternatively, it may be implemented with a variable capacitor component having a capacitance value that varies according to the contact pressure.

By such a variable contact resonance circuit, the resonance frequency generated in the main resonance circuit is somewhat different depending on the contact or hovering state on the electronic pen 2 and the touch screen 12, and the pen sensing panel 132 By detecting the difference in resonance frequency, it is possible to distinguish whether the electronic pen 2 is in contact with the touch screen 12 or in a hovering state.

In addition, the electronic pen 2 may be provided with an operation button 21 separately provided to allow user input operation to the outside, and the resonance frequency of the main resonance circuit is additionally further variable according to the input state of the operation button 21 A button input variable resonance circuit may be further provided. The button input variable resonance circuit may be implemented with a variable inductor component or a variable capacitor component that varies according to a button input.

By such a button input variable resonance circuit, the pen detection panel 132 (or a separate sensor) grasps the input state of the electronic pen 2 operation button 21, and according to the input of the operation button 21 It is possible to perform a preset additional operation. In this case, the input state of the manipulation button 21 may be identified to be classified according to the contact or hovering state of the electronic pen 2 and the touch screen 12.

Next, the wireless communication unit 11 is a component that may be included when the mobile terminal 1 supports a wireless communication function. In particular, when the mobile terminal 1 supports a mobile communication function, the wireless communication unit 11 may be configured as a mobile communication module. Specifically, in order to perform radio signal transmission/reception and processing operations for mobile communication functions, an antenna, an RF unit, and a modem (MODEM) may be included. The RF unit includes an RF transmitter for up-converting and amplifying a frequency of a transmitted signal, and an RF receiver for low-noise amplifying a received signal and down-converting a frequency. The modem includes a transmitter that encodes and modulates a signal to be transmitted, and a receiver that demodulates and decodes a signal received from the RF unit. The wireless communication unit 11 may perform specific functions of the mobile terminal 1 requiring a communication function, for example, a chat function, a message transmission/reception function, a call function, and the like.

The key input unit 14 is provided with keys for a plurality of operation manipulations that are mechanically provided on the exterior housing of the mobile terminal 1 or the like to receive a user's manipulation. As such a key, it may be composed of a side key or a separately provided touch pad. In addition, the key input unit 14 may include a button key for performing turn-on or turn-off of the portable terminal 1, a home key for supporting return to a basic screen supported by the portable terminal 1, and the like. have.

The audio processing unit 130 may include at least one of a speaker for outputting an audio signal of the portable terminal 1 and a microphone for collecting an audio signal. The audio processing unit 130 includes a speaker, a microphone, and a voice codec for processing audio signals input/output through the speaker and microphone, and inputs a user's voice when performing a phone call according to a mobile communication function. It receives or outputs an audible sound to the user, and also outputs a processing sound corresponding to various operations, various digital audio contents, and sound corresponding to video contents.

The storage unit 15 is a component for storing various programs and data required for operation of the portable terminal 1. For example, the storage unit 15 may be composed of program memory and data memories for storing various application programs and related contents, data related to operation processing, and the like. The program memory stores a program for controlling general operations of the portable terminal. It is shown that the storage unit 15 further stores a writing application 150, which is an operation program for writing content through a handwriting input on a touch screen, according to a feature of the present invention. In the writing application 150, a correction code table 152, which will be described later, used for editing handwriting content is stored in advance.

The control unit 10 controls the overall operation of the mobile terminal 1 by collectively controlling each of the functional units, and according to a user input input through the touch screen 12 or the key input unit 14, the mobile terminal 1 You can switch and control the operation of Further, according to a feature of the present invention, the controller 10 controls various related operations for receiving and displaying a handwritten image using the electronic pen 2. Particularly, the control unit 10 checks a preset correction code in the handwriting input content for editing content based on handwriting input according to a feature of the present invention, and corrects the handwriting content by applying the preset edit content to the corresponding correction code. Control. Detailed operations of the control unit 10 according to an embodiment of the present invention will be described in more detail through an embodiment of the present invention to be described later.

3 is a flowchart of a content creation operation through a handwriting input on a touch screen according to an embodiment of the present invention, and may be performed under the control of the controller 10 illustrated in FIG. 2. Referring to FIG. 3, when the handwriting mode operation is started by confirming the input operation of a menu selection item set in advance for content creation through handwriting input, first, in step 300, the handwriting input content in the normal mode according to pen detection Perform the operation to display. That is, in the general mode operation, an appropriate handwriting image according to the trajectory of the pen detection position is generated and displayed on the screen according to the pen detection. Of course, in this case, the thickness and color of each stroke in the handwritten image may also be adjusted in a separate menu environment.

If there is a preset operation in order to perform the correction mode operation according to the characteristics of the present invention while performing the display operation of the handwriting input content in the 300-step normal mode, it is checked in step 302 and then proceeds to step 310. The preset operation for performing the calibration mode operation is, for example, in a menu bar properly set at the top of the screen for handwriting input, in an embodiment of the present invention, in the calibration mode according to an embodiment of the present invention. It may be set in advance by selecting a menu item called'calibration mode' for entering. The menu bar may be configured to list a plurality of menu items for setting various writing environments, including a calibration mode menu item installed according to the features of the present invention.

Alternatively, in another embodiment of the present invention, in step 302, a preset operation for performing the calibration mode operation may be preset as an input of the operation button 21 of the electronic pen 2. That is, in the handwriting mode, when the operation button 21 of the electronic pen 2 is input, it may be determined that the user enters the calibration mode. In addition, according to another embodiment of the present invention, in advance for performing the calibration mode operation The set operation can be set in advance as the input state of the operation button 21 of the electronic pen 2 is continuously maintained. That is, in a state in which the input of the operation button 21 of the electronic pen 2 is maintained in the handwriting mode, when there is a handwriting input, the corresponding handwriting input may be regarded as a correction code. The operation of the other embodiments of the present invention may be performed in parallel with the operation of the above embodiment.

Step 310 is a correction mode operation for performing a handwriting-based correction operation according to a feature of the present invention. In the handwriting input content, preset correction codes (or correction codes) are checked, and preset edits are applied to the corresponding correction codes. To correct the handwriting. The calibration mode operation in step 310 can be divided into detailed steps of steps 311 to 319. First, in step 311, a handwriting input according to pen detection is displayed, and in step 313, from among the preset correction codes in the handwriting input. Check whether there is a matching correction code. In this case, the handwritten content other than the confirmed correction code can be confirmed as the content content to be added or changed. Alternatively, in another embodiment of the present invention, in step 313, if there is no matching correction code, the corresponding handwritten content is deleted, and the process returns to step 311 to repeat the above process to input, display, and You can also perform the verification operation again.

Thereafter, in step 315, a correction function set in advance according to the checked correction code is checked to correct the current handwriting input content, and in step 317, the corrected handwriting input content is displayed.

Subsequently, in step 319, it is checked whether there is a pre-set calibration mode end operation. If there is no calibration mode end operation, the process returns to step 311 and the above calibration mode operation is repeatedly performed. If there is a calibration mode end operation, the calibration mode After the operation ends, the process proceeds to step 320. In this case, the calibration mode termination operation may be preset to input the calibration mode menu item of the menu bar again in an embodiment of the present invention. That is, the operation of entering and releasing the calibration mode may be performed through the input and re-input of the calibration mode menu item.

Alternatively, in another embodiment of the present invention, the calibration mode termination operation in step 319 may be preset to be a re-input of the operation button 21 of the electronic pen 2. That is, in the calibration mode, when the operation button 21 of the electronic pen 2 is input, it is regarded as a calibration mode termination operation, and the user may reenter the writing mode.

In addition, in another embodiment of the present invention, the calibration mode termination operation is that the input state of the operation button 21 of the electronic pen 2 is released, that is, the operation button 21 is not input. have. That is, in the calibration mode, if the input of the operation button 21 of the electronic pen 2 is not maintained and is released, the handwriting mode may be immediately re-entered. Looking at this operation, it can be seen that when the user wants to input the correction code in the handwriting mode, the user inputs the correction code while pressing the operation button 21.

As described above, when the calibration mode operation in step 310 is terminated, in step 320, it is checked whether there is a preset writing mode end operation, and if there is no writing mode end operation, the process returns to step 300 and the above process. Repeatedly proceeds, and if there is a handwriting mode end operation, the handwriting mode is terminated. The handwriting mode termination operation may be an input operation of a preset menu selection item in order to terminate the content creation operation through handwriting input, and in addition, the operation date of performing a linkage operation with other applications such as saving the created content or sending a message. May be.

FIG. 4 is an exemplary diagram showing a comparison between a handwriting input screen and a conventional handwriting input screen on a touch screen according to an embodiment of the present invention. FIG. 4A shows, for example, when writing a message. An example is shown, and FIG. 4B shows an example of a handwriting input screen to which the present invention is applied. Referring to FIG. 4A, according to an example of a conventional handwriting input method, when a handwriting input is performed in a preset handwriting input area 400 on the full screen, the text is recognized and the recognized text is displayed as a message. It is displayed in the area 420. At this time, a menu bar 410 equipped with a plurality of menu items is provided at the top of the handwriting input area 400, and the menu items include a so-called'offset' menu item 410a and ' There may be a'change row' menu item 410b. When a menu item for this correction operation is selected during handwriting input, the input position of the next character in the characters recognized in the message display area 420 is changed.

As such, it can be seen that it is difficult to apply various correction items in the method shown in FIG. 4A, and a method in which a user utilizes the applied correction items is also inconvenient. In the present invention, as shown in (b) of FIG. 4, while freely performing a handwriting input (a relatively large amount corresponding to a plurality of rows), it provides a method for simply performing a correction operation.

FIG. 5 is an exemplary screen for editing handwriting content when writing content through a handwriting input on a touch screen according to an embodiment of the present invention. In FIG. 5(a), handwriting as shown in FIG. 4(b) An example of a screen in which the same handwriting input as the content is received is shown, and FIG. 5B shows an example of a screen in which a correction code and contents added or changed according to the characteristics of the present invention are input to the corresponding handwritten content. In FIG. 5C, an example of a screen on which the handwriting content in a state in which the calibration is completed is displayed is shown. As shown in FIG. 5, it can be seen that in the present invention, a correction code can be freely written on the handwriting input screen of a touch screen, similar to the content input method, and the handwritten content is corrected according to the handwritten correction code. At this time, in (b) of FIG. 5, it is shown that the correction operation is performed after all of the plurality of correction codes and the contents to be corrected are input, but (of course, this operation is also possible) in the embodiment of the present invention. Correction operation according to the input of the correction code of is performed sequentially. Hereinafter, the calibration operation according to each calibration code will be described in more detail.

6A and 6B are exemplary screens for'insertion correction' during handwriting editing in FIG. 5, and a correction code for'insertion correction' and contents to be corrected are input to the input handwriting content in (a) of FIG. An example of a screen in a state in which the correction has been completed is shown, and FIG. 6A(b) shows an example of a screen displaying the handwriting content in a state in which the correction according to the inserted correction code is completed. Figure 6b (a), (b) shows a handwriting input screen area among the screens of (a) and (b) of Figure 6a, respectively, and (c) and (d) of Figure 6b, respectively. Among (a) and (b), the handwritten content to be corrected and an enlarged image of the corrected handwritten content are shown.

In FIG. 6A, in addition to the handwriting input screen area 600 of the entire screen, a menu bar 610 including a plurality of menu items is provided at the top of the handwriting input screen area 600, and the menu items include features of the present invention. According to the menu item 610a for manipulating the entry/exit of the correction mode, the menu item 610b for selecting a specific pen from among a plurality of pen types each having different writing characteristics, and the erase menu item for erasing the handwriting input In addition to 610c, a menu item for returning the handwriting input to a previous state, a menu item for restoring a state returned to the previous handwriting input state, a picture file insertion menu item, and the like may be further provided.

On the other hand, in other embodiments of the present invention, it is also possible to enter/release the calibration mode by checking the input or input holding state of the operation button 21 of the electronic pen 2, and in that case, the calibration The menu item 610a for manipulating entry/exit to the mode may not be provided. Alternatively, even in such a case, a menu item 610a for manipulating the entry/exit of the calibration mode may be provided to assist the user's manipulation.

6A and 6B, in the calibration mode according to an embodiment of the present invention, a calibration code may be recognized by using N strokes input by a user. Here, N denotes the number of gesture strokes defining the correction code, and N is set to 1, so that the first stroke input in the correction mode can be recognized as a correction code. That is, in this case, all of the preset correction codes can be configured to be formed with only one stroke. In this way, the first stroke is regarded as a correction code, and the shape of the first input stroke is compared with a shape corresponding to a plurality of preset correction codes to check which correction code has been input. Of course, in addition to this, it may be possible to recognize a correction code of a preset shape only by a character recognition method without distinction of the stroke input order.

6A and 6B, the'v'-shaped correction code is preset as a so-called'insert' correction code 601, and when the insertion correction code 601 is recognized, the insertion correction The inflection point 601a of the reference numeral 601 is checked, and in the examples of Figs. 6A and 6B, a position to insert the additional content 602 as indicated by'perpetual sphere' is confirmed. Thereafter, the input characters written from the N+1 stroke are regarded as additional content 602 to be inserted, and are inserted at the insertion position. Of course, in this case, the existing handwritten contents at the position to be inserted (for example, the contents at the right position,'Youngtong-dong' in the examples of Figs. 6A and 6B) are moved so that they do not overlap with the additional contents 602 to be inserted ( For example, to the right) to display.

At this time, since the size of the existing handwritten characters may be different from the size of the characters to be inserted, according to whether or not the size of the characters to be inserted, the reference height (l) and the reference line for the characters around the insertion location are extracted, The content 602 is enlarged/reduced at the same ratio at the insertion position based on the reference height l and the reference line and inserted. In the examples of FIGS. 6A and 6B, a state in which the content of'Yeongtonggu' is expanded and inserted so as to match the height of the surrounding characters is shown. In this case, an operation of narrowing the width or spacing of the characters may be performed.

Meanwhile, since the characters around the location to be inserted may have their own inclination, the input characters may be inserted at the same angle as the reference line.

FIG. 7 is another example screen for a so-called “insertion correction” during handwriting editing in FIG. 5, and shows an example of inserting the handwritten content to be inserted in accordance with the slope of the reference line of surrounding characters. 7A and 7B illustrate a handwriting input screen area in a state in which a correction code and content to be corrected are input, and a state in which the correction is completed, respectively.

As shown in FIG. 7, in the case of recognizing the'inserted' correction code 701 in the form of a'v', the inflection point 701a of the inserted correction code 701 is checked, as indicated by '031)'. The same additional content 702 is inserted. At this time, after extracting a reference height (l) and a reference line for characters around the insertion position, the additional content 702 to be inserted is added to the insertion position at the same ratio based on the reference height (l) and the reference line. In addition to expanding/reducing the insertion, the characters around the location to be inserted may have their own inclination, so that the input characters are inserted at the same angle as the reference line.

8A and 8B are exemplary screens for'substitute (delete and insert) correction' during handwriting editing in FIG. 5, and in (a) of FIG. 8A, correction codes and corrections for'substitute correction' in the input handwriting content An example of a screen in which the content to be processed is input is shown, and FIG. 8A(b) shows an example of a screen on which the handwriting content in the state in which the correction according to the corresponding correction code is completed is displayed. Figure 8b (a), (b) shows a handwriting input screen area among the screens (a) and (b) of Figure 8a, respectively, and Figure 8b (c) shows the handwriting content to be corrected and the corrected handwriting. An enlarged image of the content is shown.

8A and 8B, the correction code in the form of a circle ('ㅇ') is preset as a so-called'substitute' correction code 801, and when the replacement correction code 801 is recognized, the replacement correction code The occupied area of 801 is checked, and in the examples of Figs. 8A and 8B, the handwritten content indicated by'Yeongtong-dong' in the occupied area is replaced with the substitute content 802 indicated by'Maetan-dong'.

At this time, similar to the insertion correction method, after extracting the reference height (l) and the reference line for the characters to be replaced, the replacement content 802 is equal to the insertion position based on the reference height (l) and the reference line. Insert by expanding/reducing ratio.

9A and 9B are exemplary screens for so-called'tilt correction' during handwriting editing in FIG. 5. The'tilt correction' is to correct the inclination of a portion of the handwritten contents corresponding to a character string composed of multiple characters. In this case, in FIGS. 9A and 9B, an example of a screen in which the inclination is corrected in a so-called'horizontal alignment' method in which the inclination of the character string faces '0' is shown.

Fig. 9a(a) shows an example of a screen in which a correction code for'tilt correction' is input to the input handwriting content, and Fig. 9a(b) shows the handwriting contents in a state in which the correction according to the corresponding correction code is completed An example of the displayed screen is shown. 9B (a) to (g) illustrate examples of states of each of the detailed conversion steps for tilt correction.

9A and 9B, when checking the correction code in the handwritten content, it is checked whether there is a form in which a character string composed of a plurality of characters is connected by a single line, and this is recognized as a tilt correction code. At this time, each character is moved and rotated in a direction where the inclination is 0 degrees using the stroke of the correction code as a guide line.

In this case, an approximate curve is extracted using the center of gravity values of the characters corresponding to the guideline. The center of gravity of the characters corresponds to the average value of the pixel values corresponding to the stroke of the character for each character.

In the method of converting each character's movement and rotation, the tilt of the tangent line in the approximate curve corresponding to the x-coordinate of the center position of each character is calculated as an angle to move and rotate. Assuming that the approximate curve is a combination of several stroke coordinates, the tilt angle can be calculated from the neighboring points to the stroke coordinate corresponding to the x-coordinate of the center position of the characters.

In Figure 9b (a), a character string to be tilted is shown, in (b) of FIG. 9b, the center of gravity of each character of the character strings is displayed, and in (c) of FIG. 9b, these centers of gravity values The state in which the approximate curve of the liver is extracted is shown. In Fig. 9b(d), a reference line with a slope of 0 is extracted as shown by a dotted line, and in Fig. 9b(e), the position of each character is moved according to the reference line, and rotation conversion is performed. The final state is shown.

In addition, in (d) and (e) of FIG. 9B, an example of a state in which the reference line is set based on the lower portion of the character string is shown, as shown in (f) and (g) of FIG. 9B, which are corresponding states. , The reference line may be set based on the center of the character string.

Meanwhile, it will be understood that the approximate curve, the center of gravity, and the reference line shown in FIG. 9B are shown for convenience of description and are not displayed on an actual screen.

10A and 10B are still other exemplary screens for a so-called'tilt correction' during handwriting editing in FIG. 5, in particular, in tilt correction, in which the inclination of the string faces the average approximate slope of the corresponding string, so-called'approximate. An example of a screen in which the tilt is corrected in the'tilt alignment' method is shown.

Fig. 10a(a) shows an example of a screen in which a correction code for'tilt correction' is input to the input handwriting content, and Fig. 10a(b) shows the handwriting contents in a state in which correction according to the corresponding correction code is completed. An example of the displayed screen is shown. In FIGS. 10B (a) to (e), examples of the state of each of the detailed conversion steps for tilt correction are shown.

Referring to FIGS. 10A and 10B, when checking the correction code in the handwritten content, it is checked whether there is a form in which a character string consisting of a plurality of characters is connected by a single line, and this is recognized as a tilt correction code. At this time, each character is moved and rotated to match the approximate slope of the guideline using the stroke of the correction code as a guide line.

At this time, an approximate curve is extracted by using the center of gravity values of characters corresponding to the guideline, and an approximate straight line is extracted based on the end point of the approximate curve. Thereafter, the inclination of the tangent line in the approximate curve corresponding to the x-coordinate of the center position of each character is calculated as an angle to move and rotate. Unlike the inclination correction method illustrated in FIGS. 9A and 9B, the movement transformation at this time moves by the corresponding approximate curve and the approximate straight line based on the center position x of the characters.

In (a) of FIG. 10b, a character string to be tilted is shown, in (b) of FIG. 10b, the center of gravity of each character of the character strings is displayed, and in (c) of FIG. 10b, these centers of gravity values are shown. The state in which the approximate curve of the liver is extracted is shown. In Fig. 10b(d), the state in which the approximate straight line is extracted as shown by the dotted line is shown, and in Fig. 10b(e), the position of each character is moved according to the slope of the approximate straight line, and the final state in which rotation transformation is performed Is being shown.

Meanwhile, it will be appreciated that the approximate curve, the center of gravity, and the approximate straight line shown in FIG. 10B are also shown for convenience of description and are not displayed on an actual screen.

11A and 11B are exemplary screens for a so-called'paragraph alignment correction' in FIG. 5, and in FIGS. 11A and 11B, an example of a screen in a state in which paragraphs are arranged in a'outdented writing' method among paragraph alignment correction. Are shown. Figure 11a (a) shows an example of a screen in which a correction code for'paragraph alignment correction' is input to the input handwriting content, and FIG. 11a (b) is a handwriting in a state in which correction according to the corresponding correction code is completed. An example of a screen on which content is displayed is shown. In (a) to (d) of FIG. 11B, examples of the state of each of the detailed conversion steps for correcting paragraph alignment are shown.

Referring to FIGS. 11A and 11B, when checking the correction code in the handwritten content, a form corresponding to a preset paragraph alignment is checked, and this is recognized as a paragraph alignment correction code 1101 to confirm the corresponding paragraph (line). Align the position. In detail, the inflection points are extracted from the stroke constituting the correction code 1101 for paragraph alignment, the area of the paragraph (line) to be aligned based on the horizontal position (x) of the inflection points is detected, and then the horizontal position is adjusted for each paragraph.

In (a) of FIG. 11B, the state of confirming the paragraph alignment correction code 1101 is shown, and in (b) of FIG. 11B, the state of extracting the inflection points from the paragraph alignment correction code 1101 is shown, and (c) of FIG. In Fig. 11B, (d) shows a state in which an area corresponding to a paragraph (line) to be aligned is extracted according to the extracted inflection points, and a final state in which the position of the corresponding area is corrected is shown.

As shown in FIGS. 6A to 11B, each of the correction codes may be input and a correction operation according to the input may be performed. In (a) to (k), in (a) to (k), detailed example screens corresponding to each step are sequentially shown in the case where the input of a plurality of correction codes and the respective steps of the correction operation accordingly are sequentially performed. .

As described above, a content creation operation may be performed through a handwriting input on a touch screen according to an embodiment of the present invention. Meanwhile, in the above description of the present invention, a specific embodiment has been described, but various modifications are made to the scope of the present invention. It can be done without deviating.

For example, when a calibration code is detected during operation of the calibration mode as described above, as shown in FIG. 13, a preset area around the detected calibration code is set as the calibration area 1200a, and the corresponding area is By enlarged and displayed, the user may be configured to make correction work easier.

13A shows an example of a screen in which the calibration area 1200a is set in a state in which the calibration code is input in the calibration mode, and FIG. 13B shows the corresponding calibration area 1200a as the entire handwriting input area. An example of a screen to be enlarged and output is shown, and in (c) of FIG. 13 is an example of a screen for inputting additional handwriting to be corrected in the enlarged correction area, and in (d) of FIG. An example in which the size has returned to its original state is shown.

In addition, in the above description, the correction codes and related correction functions have been described with examples such as'insertion correction','alternative correction','tilt correction', and'paragraph alignment correction', but in addition, various correction codes and Related calibration functions can be set in various ways as needed. 14 shows an example of a table in which correction code information is recorded. For example, as a correction code and related correction functions, so-called'spacing','spacing','changing lines', and the like may be set.

In addition, in the above description, it has been described that the handwriting input and correction operations according to the present invention are performed during a touch screen input operation using an electronic pen, but in addition, a handwriting input operation using a finger or the like is currently being performed. Needless to say, the present invention can be applied even when a handwriting input operation using is performed.

In addition, in the above description, it has been described that the correction operation according to the present invention is performed in a state where handwriting is input in the handwriting input mode, but it is also applicable to various documents including text recognized as text or text input according to a keyboard input method. While displaying the document on the screen, it may be possible to perform the handwriting-based correction operation of the present invention.

In addition, it will be appreciated that the embodiments of the present invention can be realized in the form of hardware, software, or a combination of hardware and software. Any such software, for example, whether erasable or rewritable, may be a volatile or nonvolatile storage device such as a storage device such as a ROM, or a memory device such as a RAM, memory chip, device or integrated circuit Or, for example, it may be optically or magnetically recordable, such as a CD, DVD, magnetic disk or magnetic tape, and stored in a machine (eg, computer) readable storage medium. It will be appreciated that the memory that may be included in the portable terminal is an example of a program including instructions for implementing the embodiments of the present invention or a machine-readable storage medium suitable for storing programs. Accordingly, the present invention includes a program including code for implementing the apparatus or method described in any claim of the present specification, and a machine-readable storage medium storing such a program.

Claims (14)

In the method of creating content through handwriting input on a touch screen,
In the handwriting mode, the process of displaying the handwriting input content according to the handwriting input detection and checking whether there is a preset correction mode operation, and
When there is a correction mode operation, it enters the correction mode, displays the handwriting input according to the detection of the handwriting input, checks the preset correction code from the handwritten input contents, and applies the edited contents preset to the correction code. It includes the process of correcting the handwritten content,
The correction code includes a'tilt correction code' indicating correcting the inclination of a portion corresponding to a character string composed of a plurality of characters among handwritten contents,
Correction operation according to the slope correction code,
In the handwritten content, the form of connecting a string consisting of a plurality of characters with a single line is recognized as the slope correction code, and the entire slope of the character string is approximation of the guide line using the stroke of the recognized slope correction code as a guide line. Content creation method through handwriting input, characterized in that the movement and rotation of each character to match the inclination.
The method of claim 1, wherein the process of correcting the handwritten content by entering the proofing mode comprises:
Displaying handwriting input content according to detection of handwriting input;
Checking whether there is a matching correction code among preset correction codes in the handwriting input;
Correcting the current handwriting input content according to the correction function and contents for correction set in advance according to the checked correction code,
And displaying the corrected handwriting input content.
The method of claim 2, wherein checking the preset calibration code,
Content creation method through handwriting input, characterized in that when entering the correction mode, the initial N strokes set in advance are checked as correction codes.
4. The method of claim 3, wherein N is 1.
The method of claim 1, wherein the correction code further includes at least one selected from a'insertion correction code' indicating content insertion, a'replacement correction code' indicating content replacement, and a'paragraph alignment correction code' indicating paragraph alignment. Content creation method through handwriting input, characterized in that.
The method of claim 5,
In case of a correction operation different from the insertion correction code, at least one of the size or slope of the correction content content is converted to match the size or slope of the inserted correction content content with the previously input handwriting content. How to write content.
The method of claim 5,
In case of a correction operation different from the replacement correction code, at least one of the size or slope of the correction content content is converted to match the size or slope of the replacement correction content content with the previously input handwriting content. How to write content.
delete delete The method according to any one of claims 2 to 7,
The content creation method through handwriting input, characterized in that when checking whether there is a matching correction code among preset correction codes in the handwriting input, a preset area around the checked correction code is set and enlarged and displayed.
The method according to any one of claims 2 to 7, wherein the preset correction mode operation is a selection of a menu item prepared in advance to enter the correction mode from a menu bar preset on a screen for handwriting input. How to write content through handwriting.
The method according to any one of claims 2 to 7, wherein the preset correction mode operation is input of an operation button of an electronic pen or an input maintenance of an operation button of the electronic pen. .
A machine-readable non-transitory storage medium recording a program for execution in the content creation method through handwriting input on the touch screen according to any one of claims 1 to 7.
A portable terminal comprising the machine-readable non-transitory storage medium of claim 13.

Images