KR101631730B1 - Apparatus and method for playing handwriting message using handwriting data - Google Patents

Abstract

A method of reproducing a handwritten message using handwritten data, the method comprising: receiving a handwritten message, generating handwritten data including positional information and time information of the handwritten message, and a still image using the positional information; The method comprising the steps of: receiving and decoding a handwritten image including the handwritten data and transmitting the encoded handwritten image; and extracting the handwritten data included in the decoded handwritten image, And sequentially reproducing the contents of the handwritten message according to the order in which the contents of the handwritten message are input.

Description

[0001] APPARATUS AND METHOD FOR PLAYING HANDWRITING MESSAGE USING HANDWRITING DATA [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a handwritten message reproduction, and more particularly, to an apparatus and method for sequentially reproducing a handwritten message using handwritten data including positional information and time information of a handwritten message.

The functions of mobile terminals have been further enhanced as various technologies such as wire or wireless communication technology, multimedia technology, hardware such as central processing unit and memory, and power charging technology have been developed. For example, an existing mobile terminal transmits contents to the other party using a voice call, but when a text message can be transmitted and received, a voice call can not be made, or when simple contents are to be transmitted, (Short Message Service: SMS), which is a mobile communication service, can be easily transmitted to the other party.

Such a short message service has developed into a multimedia message service (MMS) including a multimedia file such as an image or a video as a long message service (LMS) including long text contents of SMS, As a result of the development, it is possible to provide users with more various benefits. In particular, unlike SMS or LMS, which transmits only text contents, in the case of MMS that transmits multimedia files, the demand of users is gradually increasing due to the scalability of the expression. A method of transmitting desired contents using the MMS will be described as follows.

1 is an exemplary diagram illustrating information transmission using an existing MMS.

Referring to FIG. 1, a user can input a desired character in a handwriting recognition area or create an MMS by attaching a desired image. In the case of the handwriting recognition area on the MMS input screen shown in FIG. 1, there are three single recognition areas for recognizing one character at a time, and the character information desired by the user is input by an input tool such as a finger or a stylus pen. Also, the image stored in the memory can be called up using the file attachment field located at the bottom of the text input window to transmit the image.

However, the currently used MMS carries out transmission including only pre-stored images. If the sender wishes to transmit the handwritten handwriting using MMS, the handwritten content must be changed to an image file using a separate program, and then transmitted. In addition, when changing to an image file, the image is changed to a still image, so that sequential time information that the user has handwritten is not included.

That is, when receiving the image included in the MMS at the receiving side, only one still image is displayed, and since the writing process of the sending side can not be sequentially reproduced, the handwriting or the emotion of the transmitting side can not be transmitted There is a problem that the feeling of liveliness disappears.

The present invention proposes an apparatus and method for sequentially reproducing a handwritten message to a receiver using handwritten data including position information and time information of a handwritten message.

According to one aspect of the present invention, there is provided a method for reproducing a handwritten message using handwriting data, the handwritten message including a handwritten message, a handwritten data including position information and time information of the handwritten message, A step of encoding and transmitting a handwritten image including the handwritten data to the still image, a step of receiving and decoding the handwritten image, a step of extracting the handwritten data included in the decoded handwritten image, And sequentially reproducing the contents of the handwritten message according to the order in which the contents of the handwritten message are input using the extracted handwritten data.

According to another aspect of the present invention, there is provided an apparatus for playing a handwritten message using handwriting data, the apparatus comprising: an input / output unit for inputting a handwritten message by a user and outputting a handwritten image to be received; A handwritten data including information and time information, a still image using the position information, encoding the generated still image as a handwritten image, transmitting the handwritten image, decoding the received handwritten image, A control unit for extracting positional information and time information of handwritten data and sequentially reproducing the contents of the handwritten message, and a wireless communication unit for transmitting and receiving the handwritten image.

According to the present invention, since a handwritten message is sequentially reproduced using handwritten data including time information and position information of one or more points constituting a handwritten message, a handwritten message containing emotion of a sender can be displayed.

1 is an exemplary diagram illustrating information transmission using an existing MMS,
FIG. 2 is a diagram illustrating a handwriting message generating process according to an embodiment of the present invention. FIG.
FIG. 3 is an internal configuration diagram of a mobile terminal for transmitting and receiving a handwriting image according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating a process of generating a handwriting image including handwriting data according to an embodiment of the present invention.
5 is a flowchart illustrating a handwritten image reproduction process including handwritten data according to an embodiment of the present invention.
FIGS. 6-8 illustrate fields in which handwritten data is stored according to an embodiment of the present invention;
9 is a block diagram showing an internal structure of point sequence data according to an embodiment of the present invention.
10 is a view illustrating a process in which handwritten messages are sequentially reproduced by handwriting data according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It will be appreciated that those skilled in the art will readily observe that certain changes in form and detail may be made therein without departing from the spirit and scope of the present invention as defined by the appended claims. To those of ordinary skill in the art.

2 is a view illustrating an example of a handwritten message generating process according to an embodiment of the present invention.

Referring to FIG. 2, a transmitting user uses a mobile terminal to create a handwritten message using an input tool such as a finger or a stylus pen. The mobile terminal generates handwritten data including positional information and time information of one or more points constituting the handwritten message using the written handwritten message, and generates a still image using the handwritten data location information.

The still image is composed of a plurality of fields, and pixel values when a handwritten message is imaged are stored in any one of a plurality of fields. These pixel values are defined as still image data, and the still image data does not include time information or position information for one or more points constituting the handwritten message. Thereafter, the handwriting data is contained in one of the plurality of fields constituting the still image and compressed.

In the present invention, an image in which handwritten data is stored in a specific field of a still image including still image data is defined as a handwritten image, and a handwritten image is formatted in a format such as Joint Photographic Experts Group (JPEG), Graphic Interchange Format The compressed and compressed handwritten image is transmitted to the receiving side.

The internal structure of the mobile terminal performing the FIG. 2 will now be described.

FIG. 3 is an internal configuration diagram of a mobile terminal for transmitting and receiving a handwriting image according to an embodiment of the present invention. The mobile terminal includes an input / output unit 31, a control unit 33, and a wireless communication unit 35 for transmitting / receiving a handwritten image. The input / output unit 31 includes a touch screen input unit 301 and a touch screen output unit 303. The control unit 33 includes an event processing unit 305, a first image processing unit 307, a second image processing unit 313, An attached image processing unit 315 and a handwriting message processing unit 317. The wireless communication unit 35 includes an MMS transmitting unit 309 and an MMS receiving unit 311. [

Referring to FIG. 3, the input / output unit 31 receives a handwriting message input by a user and reproduces a handwriting image received from the control unit 33. The touch screen input unit 301 plays a role of receiving a handwritten message by a user, and the touch screen output unit 303 plays a role of reproducing a handwritten message. The input / output unit 31 transmits the input handwritten message to the control unit 33.

The control unit 33 analyzes handwritten messages received from the input / output unit 31 to generate handwriting data including position information and time information, and generates a still image using the generated handwriting data position information . The still image is composed of a plurality of fields, and one of the fields stores still image data composed of pixel values when a handwritten message is imaged. Since the pixel values constituting the still image data are intended to represent the handwritten message as it is, the position information and the time information of the one or more points constituting the handwritten message are not included.

The control unit 33 also includes a function of encoding the handwritten data in a specific field of the still image and transmitting the encoded data to the wireless communication unit 35 and detecting the handwritten data included in the handwritten image received from the wireless communication unit 35 To the input / output unit (31).

More specifically, the event processing unit 305 of the control unit 33 analyzes handwritten messages received from the input / output unit 31 and generates handwritten data including position information and time information of one or more points constituting the handwritten message And generates a still image using the position information. The still image is composed of a plurality of fields, and still image data, which are pixel values obtained by imaging a handwritten message in one of a plurality of fields, are stored. The still image data does not include position information and time information of one or more points constituting a handwritten message. The event processing unit 305 transmits the handwritten image including the handwriting data to the first image processing unit 307 in a specific field of the still image.

The handwritten data is stored in any one field other than the field in which the still image data is stored. Also, if a handwritten message is created with a specific image as the background, the still image data stores the pixel values of the specific image including the handwritten message.

The first image processing unit 307 encodes a handwritten message to transmit a handwritten image.

The second image processing unit 313 decodes the image received from the wireless communication unit 35. [ If decoding is performed and interpreted, if the image does not contain the handwritten data, it is determined that the handwritten message is not a general attached image and the image is sent to the attached image processing unit 315. If the handwritten data is included, it is determined as a handwritten image and transmitted to the handwritten message processing unit 317.

The attached image processing unit 315 transmits the image to the touch screen output unit 303 so that it can output the image without the handwriting data. The handwritten message processing unit 317 processes handwritten messages sequentially using time information and positional information using the handwriting data included in the handwritten image, and transmits the processed handwritten messages to the touch screen output unit 303.

The wireless communication unit 35 transmits and receives various images including a handwritten image. The MMS transmission unit 309 plays a role of transmitting an image, and the MMS reception unit 311 plays a role of receiving an image.

4 is a flowchart illustrating a process of generating a handwriting image including handwriting data according to an embodiment of the present invention.

Referring to FIG. 4, in step 401, the transmitting user creates a handwritten message using the mobile terminal. The handwritten message is inputted through the touch screen input unit 301, and an input tool such as a finger or a stylus pen can be used. In addition, the sending user can create a handwritten message in an empty space or write a handwritten message in the background of a specific image.

In step 403, the touch screen input unit 301 transmits the received handwritten message to the event processing unit 305, and the event processing unit 305 analyzes the received handwritten message to extract the location information of the handwritten message. In step 405, the event processing unit 305 extracts time information from the received handwritten message, and generates handwritten data including the extracted location information and time information. The generated handwritten data includes positional information and time information of one or more points constituting the handwritten message.

In step 407, the event processing unit 305 generates a still image using the location information, and transmits the handwritten image including the handwriting data to a specific field of the still image to the first image processing unit 307. The first image processing unit 307 encodes the image data. The handwritten data is stored in any one field other than the field in which the still image data is stored, and the corresponding field may be an image header field or a separate field at the tail of one or more fields constituting the still image to include handwritten data You may. The encoded handwritten image is transmitted to the MMS transmitting unit 309 in step 409, and is transmitted to the receiving mobile terminal.

5 is a flowchart illustrating a handwritten image reproduction process including handwriting data according to an embodiment of the present invention.

Referring to FIG. 5, in step 501, the mobile terminal receives an image from the transmitting mobile terminal using the MMS receiver 311. The MMS receiving unit 311 transmits the received image to the second image processing unit 313. In step 503, the second image processor 313 decodes the received image to check whether the handwriting data is included. The handwritten data is stored in one of a plurality of fields constituting the image.

If the handwritten image is not a general attached image, the process proceeds to step 509 where the attached image is directly output through the attached image processing unit 315 and the touch screen output unit 303. If it is a handwritten image including handwritten data, the process proceeds to step 505 and the handwritten message processing unit 317 transmits the handwritten image decoded by the second image processing unit 313. In step 507, the handwritten message processing unit 317 processes the handwritten message in order to sequentially reproduce the handwritten message using the time information and the position information of the handwritten data included in the received handwritten image, transmits the handwritten message to the touch screen output unit 303, The screen output unit 303 sequentially reproduces the handwritten message.

As described above, the handwritten data is included in any one of the plurality of fields constituting the still image. However, if the handwritten data is stored in the field for storing the still image data, the still image data itself may be damaged in the process of storing the handwritten data. Therefore, the handwritten data is stored in a field other than the field in which the still image data is stored. The details are as follows.

FIGS. 6-8 illustrate fields in which handwritten data is stored according to an embodiment of the present invention. FIG. 6 schematically shows EXIF (Exchangeable Image File Format) information field of JPEG in which handwritten data is stored, FIG. 7 shows handwritten data stored in the image header field in detail, and FIG. And handwritten data stored in other fields are shown in detail. 6-8, it is assumed that one handwritten image is composed of a plurality of fields and is largely composed of an image start field, an image header field, an image data field, and an image end field.

Referring to Fig. 6, the handwritten data is stored in the EXIF information field, and the still image data is stored in the image data field. The EXIF information field can be included in the image header field and is an area for storing various information of the handwritten image, and is not displayed on the output screen of the mobile terminal when the handwritten message is actually reproduced. The image data field is a field containing still image data. The image data field contains only pixel values when the handwritten message is imaged, but does not include time information or position information.

In the present invention, the transmitting mobile terminal stores handwritten data in the EXIF information field and transmits the handwritten data. When the receiving mobile terminal receives the image, it checks whether the handwritten data is stored in the EXIF information area of the received image, If handwritten data is stored, handwritten messages can be sequentially reproduced on the output screen. Here is a closer look.

Referring to FIG. 7, the image header field includes an application field App1. The application field is composed of an application header field, an EXIF information field, a thumbnail image field, etc. The application header field stores the configuration and information of the application field, the thumbnail image field stores a thumbnail image, Is stored. More specifically, the handwritten data is stored in the user comment area included in the EXIF information field. The handwritten data may consist of a point sequence symbol, a length of the sequence data, a point sequence data, etc. The point sequence symbol may be a symbol representing a handwritten image including a specific image and a symbol representing a handwritten image including no specific image . The point sequence data means respective handwritten data, and the sequence data length means the total length of handwritten data. In addition, although not shown in the drawings, the color and thickness information of the handwritten message may be included and may be compressed as necessary.

8 illustrates handwritten data stored in fields other than the image header field. Referring to FIG. 8, only a part of the handwritten data is stored in the image header field, and the remaining fields are generated and stored at the tail end of the image end field . In this figure, the point sequence symbol and the data length of the sequence are stored in the EXIF information field, and the point sequence data is stored in the space after the image end filter, but this may vary according to the user setting. For example, the image header field may store all the information constituting the handwritten data in the space after the image end filter without storing any information constituting the handwritten data.

Figs. 6-8 illustrate the JPEG format as an example, but they can be converted into other formats. For example, a still image can be converted to a GIF format and stored in a specific field of the GIF. Handwritten data including time information and position information can be stored in the header of the GIF or stored after the terminator to convert the handwritten image into the GIF format .

9 is a block diagram showing an internal structure of point sequence data according to an embodiment of the present invention. The point sequence data shown in FIG. 9 means time information of consecutively input point coordinates, and may be composed of a handwriting data header, decoding information, stroke start, stroke attribute, stroke point, and data end.

Referring to FIG. 9, the handwritten data header includes a number of points constituting the entire handwritten message or a marker character, and includes the number of all points. The decoding information includes version information and other information. The stroke start and stroke attribute tags and stroke points can be divided into one stroke, and the size can be changed according to the number of the whole strokes. The end of data means the end of the handwritten message. 9 is only an example, and the internal structure of the point sequence data may be changed according to the type and the size of the time information.

Next, a process of reproducing a handwritten message using handwritten data using the configuration diagram of the mobile terminal will be described.

FIG. 10 is a diagram illustrating a process in which handwritten messages are sequentially reproduced by handwriting data according to an embodiment of the present invention.

Referring to FIG. 10, the second image processor 313 of the control unit 33 checks whether the handwritten data is included in the received image, and if the handwritten data is included, And sequentially reproduces the handwritten message on the touch screen output unit 303 by using the touch screen output unit 303. [ For example, when the handwritten message "Let's become a person to be impressed!" Is received, the touch screen output unit 303 (or 303) using one or more time information and position information generated according to the coordinate values of the points constituting the handwritten message ). The handwritten data is stored in a specific field of the image and is not displayed on the output screen. However, in the case of a mobile terminal not equipped with a function of detecting handwriting data included in an image, since the handwriting data can not be confirmed, the image is directly displayed on the touch screen output section 303.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention. Accordingly, the scope of the present invention should not be limited by the illustrated embodiments, but should be determined by equivalents of the claims and the claims.

Claims (33)

A handwritten message transmission method using handwritten data,
Receiving a handwritten message input;
Generating a handwritten image including a handwritten data field including position information and time information of the handwritten message and a still image data field including pixel values associated with the handwritten message;
And transmitting the handwritten image,
Wherein the handwritten data included in the handwritten image is for sequentially reproducing the handwritten message at the receiving end. delete delete delete delete delete delete The method according to claim 1,
Wherein the still image data and the handwritten data are separately stored in the handwritten image. delete delete The method of claim 1,
Wherein at least one point constituting the handwritten message is generated time information. A handwritten message transmission device using handwritten data,
An input / output unit for receiving a handwritten message from a user,
A control unit for generating a handwritten image including a handwritten data field including positional information and time information of the received handwritten message and a still image data field including pixel values associated with the handwritten message;
And a wireless communication unit for transmitting the handwritten image,
Wherein the still image data and the handwritten data are separately stored in the handwritten image, and the handwritten data included in the handwritten image is for sequentially reproducing the handwritten message at the receiving end. 13. The apparatus of claim 12, wherein the input /
And a touch screen input unit for transmitting the handwritten message to the control unit. 13. The method of claim 12,
Wherein the still image data and the handwritten data are separately stored in the handwritten image. delete delete delete delete 13. The apparatus of claim 12, wherein the control unit
Analyzing the handwritten message to generate handwritten data including positional information and time information of the handwritten message, generating the still image using the positional information, and storing the handwritten data in a specific field of the still image An event processing unit for transmitting a handwritten image,
And an image processing unit for encoding the handwriting image received from the event processing unit. 20. The apparatus of claim 19, wherein the image processing unit
Wherein the image output unit outputs the image without extracting additional information when an image including no time information is received. delete 20. The apparatus of claim 19, wherein the control unit
Wherein the handwriting message generating unit generates the handwriting message by generating a specific image including the handwriting message as a still image if the handwriting message is created based on a specific image as a background. delete delete delete delete A method of playing a handwritten message using handwritten data,
Receiving a handwritten image including a handwritten data field including positional information and time information of the handwritten message and a still image data field including pixel values associated with the handwritten message;
And sequentially reproducing the handwritten message according to the handwritten data if the handwritten image includes handwritten data. 28. The method of claim 27,
Wherein the still image data and the handwritten data are separately stored in the handwritten image. 28. The method of claim 27,
Wherein the location information is calculated using coordinates of at least one or more points forming the handwritten message. A handwritten message reproducing apparatus using handwritten data,
A wireless communication unit for receiving a handwritten image including a handwritten data field including position information and time information of the handwritten message and a still image data field including pixel values related to the handwritten message;
A controller for sequentially controlling the handwritten message according to the handwritten data;
And an input / output unit for reproducing the handwritten message. 31. The method of claim 30,
Wherein the still image data and the handwriting data are separately stored in the handwriting image. 31. The method of claim 30,
Wherein,
An image processor for decoding the received handwritten image;
And a handwritten message processor for sequentially reproducing the handwritten message using positional information and time information received from the image processor. 31. The method of claim 30,
Wherein the input / output unit comprises a touch screen unit for sequentially reproducing the handwritten message.

Images