KR100487446B1 - Method for expression of emotion using audio apparatus of mobile communication terminal and mobile communication terminal therefor - Google Patents

Abstract

The present invention relates to a method of expressing emotions using an audio device of a mobile communication terminal, which enables the mobile communication terminal to express emotions in an auditory manner in place of the text of a message.

The present invention includes an instant messenger module, a message processing module for recognizing an emotion expression string included in text of an instant message so that the emotion expression string can be audibly expressed through voice output, and an audio unit for voice input / output. A emotion expression method in a mobile communication terminal, wherein the instant messenger module transmits text of an instant message received from a conversation partner through a messenger server to the message processing module, and the message processing module expresses an emotion expression string in the received text. A first step of determining whether it is included; A second step of outputting a voice file of the emotional expression string through the audio unit when the received text includes the emotional expression string; There is a technical feature made to include.

Description

Method for Expression of Emotion Using Audio Apparatus of Mobile Communication Terminal and Mobile Communication Terminal therefor}

The present invention relates to a method for expressing emotion using an audio device of a mobile communication terminal and a mobile communication terminal for the same. More particularly, when a message is displayed in a mobile communication terminal, a word representing an emotion included in a text sentence is recognized and audited. The present invention relates to an emotion expression method using an audio device of a mobile communication terminal and to a mobile communication terminal.

Instant messenger is software that allows two or more users to send a small amount of text data in real time. A user can register a contact and send and receive messages with the contact on the contact list displayed on the messenger screen. In recent years, the use of messenger has become possible not only in PC but also in mobile communication terminal, and its use is increasing rapidly.

The instant messenger communicates mainly on texts, and currently displays graphic emoticons instead of displaying texts directly in order to overcome the limitation of expressing a user's expression in text only when a doctor or emotion is transmitted. When sending messages using mobile phones or PDAs, images and emoticons are used as means of communication.

In addition, even in the case of a short message which occupies the largest portion of the mobile communication terminal in addition to the voice call, only text or emoticons are used as a means of communication.

However, such a communication method using an image or an emoticon has a limitation in that only visual emotional expression is possible.

Accordingly, the present invention is to solve the above-mentioned disadvantages and problems of the prior art, an audio device of a mobile communication terminal capable of expressing the emotions emotionally unlike an emoticon in the form of a conventional visual emotion display. It is an object of the present invention to provide a method for expressing emotions used and a mobile communication terminal for the same.

The above object of the present invention is an instant messenger module for transmitting and receiving instant messages between mobile communication terminals through a messenger server that provides an instant messaging service, and an emotion expression string is recognized by recognizing an emotion expression string included in text of an instant message. An emotional expression method in a mobile communication terminal comprising a message processing module and an audio unit for voice input and output through the output, an instant message received by the instant messenger module from a conversation partner through a messenger server Transmitting the text of the message to the message processing module, and determining whether the received text includes an emotional expression string in the received text; A second step of outputting a voice file of the emotional expression string through the audio unit when the received text includes the emotional expression string; It is achieved by the emotion expression method using the audio device of the mobile communication terminal comprising a.

In addition, the above object of the present invention is an instant messenger module for the instant message transmission and reception between the mobile communication terminal through a messenger server providing an instant messaging service, and to express the emotion expression by recognizing the emotion expression string contained in the text of the instant message; A mobile communication terminal comprising a message processing module and an audio unit for voice input and output, so that a string can be expressed audibly through voice output, wherein the instant messenger module is configured to display text of an instant message received through the messenger server. An emotion expression string recognition unit configured to determine whether an emotion expression string is included in the received text when text is received from the instant messenger module; And an audio output controller configured to output a voice file for the emotion expression string through the audio unit. It is achieved by a mobile communication terminal comprising a.

Details of the above object and technical configuration of the present invention and the resulting effects thereof will be more clearly understood from the following detailed description based on the accompanying drawings.

First, Figure 1 is a block diagram of a mobile communication system for explaining the present invention.

As shown, the mobile communication system performs a base station 10 (BTS) performing wireless section communication with the mobile communication terminal 100 (100 '), a base station controller 20 (BSC) controlling the base station, and a call exchange. Switch 30 (MSC) in charge, Short Message Service Center 40 (SMSC) providing short message service, Packet data service node 50 (PDSN) and data core network for data service to mobile communication terminal 100 60, DCN.

In addition, the mobile communication system is connected to a messenger server 300 for providing a messenger service to the mobile communication terminal 100, and provides an instant message between the mobile communication terminals 100 and 100 ′ through the messenger server 300. Allows for transmission and reception.

That is, the instant messenger service in the mobile communication terminal 100 is a messenger for providing a messenger service through the mobile communication system by the mobile communication terminals 100 and 100 ′ of each user in which an instant messenger module (not shown) is installed. It is executed as it is connected to the server 300.

As the messenger is driven through a user login, the mobile communication terminal 100 (100 ') receives a list of users registered as a contact and a connection state from the messenger server 300 and displays them through a messenger window. It is possible to transmit and receive a message through the messenger server 300 between the mobile communication terminal (100, 100 ') of the users.

In the present invention, when the mobile communication terminal 100 receives a text message from another user such as a contact person through the short message service center 40 or the messenger server 300 that provides a short message service, the text message. And visually display the emotions or feelings desired to be expressed by the emotion expression strings included in the text message through the driving of the audio device.

2 is a block diagram of a mobile communication terminal according to an embodiment of the present invention.

As shown, the mobile communication terminal 100 of the present invention is a control unit 110 for controlling the overall operation of the mobile communication terminal 100, such as call attempt, text message transmission, instant message transmission according to the user's instructions and the user An input unit 120 for outputting corresponding data to the controller 110 according to an input, a memory 130 for storing various data, key data generated from the input unit 120, and various types of the controller 110. And a display unit 140 for receiving and displaying an information signal, an audio unit 150 for processing voice signals input and output through a speaker and a microphone, and a wireless transceiver unit 160 for transmitting and receiving wireless signals with a base station. do.

The mobile communication terminal 100 may include an instant messenger module 170 for transmitting and receiving instant messages between mobile communication terminals, and a short message management module for managing short messages transmitted and received through the short message service center 40. 180) and a message processing module 190 for processing an instant message or a short message received through the instant messenger module 170 and the short message management module 180.

The instant messenger module 170 is installed in the mobile communication terminal 100 to transmit / receive a message between mobile communication terminals 100 of users registered in advance as a conversation partner through a messenger server 300 for providing an instant messaging service. In order to enable the user to log in, by displaying the contact list registered from the messenger server 300 and the login status information of the contact on the display unit 140 of the mobile communication terminal 100 through the messenger window, Allows instant messages to be communicated between logged in users.

The message processing module 190 recognizes an emotion expression string included in the short message or the instant message received by the mobile communication terminal 100, and an audio file corresponding to the emotion expression string is the audio unit 150. It is responsible for playing through.

The message processing module 190 is described in more detail with reference to FIG. 3 as follows.

3 is a block diagram of a message processing module according to an embodiment of the present invention, as shown, a voice file storage unit 191, an emotion expression string recognition unit 192, a voice file search unit 193, and voice synthesis A unit 194, an audio output controller 195, and a voice file manager 196 for expressing a specific emotion in text received from the other party through the instant messenger module 170 or the short message management module 180. By recognizing a string (eg, / laugh /) and playing the voice file set for the corresponding emotional expression string, the emotional expression through the voice is possible.

The voice file storage unit 191 stores a voice file for each emotion expression word. The voice file stored in the voice file storage unit 191 may be a voice or sound effect file initially stored and set in a terminal, a voice file generated by a user directly inputting a voice, or a voice file generated by synthesizing text, from an external source. Various voice files such as a received voice or sound effect file may be included.

The emotional expression string recognition unit 192 is responsible for determining whether the emotional expression string is included in the text of the instant message received through the messenger server 200 or the short message received through the short message service center 40. do. If the text includes the emotion expression string, the emotion expression string recognition unit 192 transfers the emotion expression string to the voice file searcher 193.

The voice file searcher 193 searches the voice file storage 191 for a voice file corresponding to the emotion expression string recognized by the emotion expression string recognizer 192, and the audio output controller 195 detects the searched voice file. The audio file is output through the audio unit 150.

In this case, the emotion expression string is a string for expressing emotions in an auditory manner, words representing emotions such as '/ laugh /', '/ tear /', arranged before and after the words, emotion expression string recognition unit ( 192 may include a special character for distinguishing the emotion expression string from the text received from the conversation counterpart.

The emotion expression string may further include setting information such as the number of repetition of playing the corresponding voice file, so that the number of playing of the voice file may be specified. For example, when the emotion expression string includes an emotion expression word (laugh), a delimiter (,), and the number of repetitions (3), such as '/ laugh, 3 /', the audio output control unit 195 generates a corresponding voice. Control the file to play three times repeatedly.

The voice file storage unit 191 should store a voice file for words representing emotions such as 'laugh', 'tear', and if not, delivers the emotion expression word to the voice synthesis unit 194. The voice file may be output through the function of the voice synthesizer 194.

The speech synthesizer 194 performs a text to speech (TTS) function for analyzing text and converting the text into speech data, and a speech file for the emotional expression word is stored in the speech file storage 191. If not, the voice file search unit 193 receives the emotion expression word, synthesizes the emotion expression word into a voice to generate a voice file, and stores the generated voice file in the voice file storage unit 191. In response to the expression word, the synthesized and stored voice file is output through the audio unit 150.

The voice file generated by the voice synthesizer 194 may be temporarily stored in the voice file storage 191 to be used for one-time use or may be permanently stored to be reproduced instead of the corresponding emotional expression word.

Meanwhile, in the above description, when the voice file for a specific emotional expression word does not exist in the voice file storage unit 191, the voice synthesis unit 194 is used, but the voice file storage unit 191 is previously described. The voice file is not stored, and the voice file for all the emotion expression words may be generated and used by the voice synthesizer 194 in real time.

In addition, the message processing module 190 may include a voice file management unit 196 in which a user inputs a voice directly and stores the voice file in the voice file storage unit 191 so that the stored voice file may be output in place of an expression word. It may further include.

That is, the voice file manager 196 allows a user to input a voice for the emotion expression word through the audio unit 150 of the mobile communication terminal 100, and inputs the voice file input by the user to the emotion expression specified by the user. By matching and matching the word with the voice file storage unit 191, the voice file set by the user for the emotional expression word may be played.

In addition, in the present invention, instead of displaying the emotion expression string, it is possible to express the emotion emotionally output through the audio unit 150, the output of the voice through the audio unit 150 is a graphic for expressing the emotion It can be done simultaneously with displaying emoticons (pictograms) and text.

Meanwhile, in the case of the instant messenger service, as the text is transmitted and received in real time with the other party, the message processing module 190 should be driven as the text is received through the instant messenger module 170, and in the case of the short message service, the short message is received from the other party. Rather than being driven by receiving the message, the mobile communication terminal user who receives the message should be driven by performing a predetermined key input for confirmation of the short message.

In addition, in the above description, the separate message processing module 190 recognizes the emotion expression string from the text received through the instant messenger module 170 or the short message management module 180 and controls the audio unit 150. The message processing module 190 may be included in the instant messenger module 170 or the short message management module 180.

In addition, in the above description, the emotion expression string recognition unit 192 is included in the message processing module 190, so that the text received by the instant messenger module 170 or the short message management module 180 is transmitted to the message processing module 190. Although the description has been made to recognize the emotion expression string, the instant messenger module 170 or the short message management module 180 recognizes the emotion expression string directly from the received text, and the emotion expression string is present in the text. In this case, the corresponding emotion expression string or emotion expression word or text may be delivered to the message processing module 190.

Referring to the emotion expression method of the present invention to express the emotion through the reproduction of the voice file as described above with reference to the flow chart of FIG.

First, FIG. 4 is a flowchart for explaining a method of delivering an emotion of an instant message according to an embodiment of the present invention.

As shown, when the instant messenger module 170 of the mobile communication terminal 100 is driven in response to a user login (S101), and a text is received from the other party through the instant messenger module 170 (S102), a message is displayed. The processing module 190 determines whether the received text includes an emotion expression string (eg, / laugh) (S103).

As a result of the determination, when the received text includes the emotion expression string, the message processing module 190 searches for a voice file for the emotion expression word included in the emotion expression string (S104) and the corresponding emotion expression. It is determined whether a voice file designated for a word exists (S105).

If the voice file exists as a result of the determination, the message processing module 190 outputs the corresponding voice file through the audio unit 150 of the mobile communication terminal 100 and receives the received file through the display unit 140. A text other than the emotion expression string and an emoticon corresponding to the emotion expression string are displayed in one text, and the message transmitted by the conversation partner is transmitted to the user (S106).

On the other hand, when it is determined in step S105 that the voice file for the corresponding emotional expression word does not exist in the voice file storage unit 191, the message processing module 190 uses the voice synthesis unit 194 to express the emotional expression word. The voice synthesizer 194 generates a voice file by analyzing and synthesizing the corresponding emotional expression word (S107).

Therefore, when the voice file for the emotion expression word does not exist in the voice file storage unit 191, the message processing module 190 may convert the voice file generated by the voice synthesizer 194 into the audio unit 150. To be output via

In addition, when it is determined in step S103 that the text received from the conversation counterpart does not include the emotion expression string, the message processing module 190 performs the mobile communication terminal 100 without outputting a voice through the audio unit 150. The received text is displayed through the display unit 140 (S108).

Next, FIG. 5 is a flowchart illustrating a method of transmitting emotions in a short message according to another embodiment of the present invention.

As shown, a short message is received from the short message service center 40 through the short message management module 180 of the mobile communication terminal 100 (S201), and according to a user's key input, the short message is received. When the confirmation is requested (S202), the message processing module 190 of the mobile communication terminal 100 receives the short message from the short message management module 180 and expresses an emotional expression string (eg, / laugh / ) Is determined (S203).

As a result of the determination, when the received text includes the emotion expression string, the message processing module 190 searches for a voice file for the emotion expression word included in the emotion expression string (S204). In operation S205, if the voice file is present, the message processing module 190 determines that the voice file is received through the audio unit 150 of the mobile communication terminal 100. In addition to the output, the display unit 140 displays a text other than the emotion expression string and an emoticon corresponding to the emotion expression string and transmits the message transmitted by the conversation counterpart to the user (S206). .

On the other hand, if it is determined in step S205 that the voice file for the corresponding emotional expression word does not exist in the voice file storage unit 191, as described with reference to FIG. 4, the message processing module 190 may include a voice synthesizer ( In operation 1207, the emotion expression word is transmitted, and the speech synthesis unit 194 generates a speech file by analyzing and synthesizing the emotion expression word (S207).

Therefore, when the voice file for the emotion expression word does not exist in the voice file storage unit 191, the message processing module 190 may convert the voice file generated by the voice synthesizer 194 into the audio unit 150. To be output via

In operation S203, when it is determined that the text of the short message does not include the emotion expression string, the message processing module 190 may display the display unit of the mobile communication terminal 100 without outputting audio through the audio unit 150. The received short message text is displayed through 140 (S208).

In the above embodiment, the message processing module 190 checks whether a voice file for the emotion expression string exists, and if it does not, synthesizes the voice through the voice synthesizer 194 and outputs the voice file. It is possible that all emotion expression words are generated and output in real time by the voice synthesizer 194 without storing the voice file and determining whether the voice file exists.

As those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features, the embodiments described above should be understood as illustrative and not restrictive in all aspects. Should be. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

Accordingly, the emotion expression method using the audio device of the mobile communication terminal of the present invention and the mobile communication terminal for this movement, unlike a conventional emoticon in the form of text and visual emotion when the user talks to the other party through a messenger By using the voice output function of the communication terminal, there is an advantage in that it is possible to express and transmit a change in emotion such as sadness and joy in more depth and in various ways.

1 is a block diagram of a mobile communication system for explaining the present invention;

2 is a block diagram of a mobile communication terminal according to an embodiment of the present invention;

3 is a block diagram of a message processing module according to an embodiment of the present invention;

4 is a flowchart illustrating a method of delivering emotion of an instant message according to an embodiment of the present invention;

5 is a flowchart illustrating a method of transmitting emotions in a short message according to another embodiment of the present invention.

<Description of Symbols for Main Parts of Drawings>

10: base station (BTS) 20: base station controller (BSC)

30 Switchboard (MSC) 40: Short Message Service Center (SMSC)

50: packet data service node (PDSN) 60: data core network (DCN)

100, 100 ': mobile communication terminal 110: control unit

120: input unit 130: memory

140: display unit 150: audio unit

160: wireless transceiver 170: instant messenger module

180: short message management module 190: message processing module

191: Voice file storage unit 192: Emotion expression string recognition unit

193: Speech file search unit 194: Speech synthesis unit

195: audio output control unit 196: voice file management unit

200: messenger server

Claims (16)

An instant messenger module for transmitting and receiving instant messages between mobile communication terminals through a messenger server that provides an instant messaging service, and an emotional expression string included in the text of the instant message. An emotional expression method in a mobile communication terminal comprising a message processing module and an audio unit for voice input and output, which can be expressed, A first step in which the instant messenger module delivers the text of the instant message received from the conversation partner through the messenger server to the message processing module, and the message processing module determines whether the received text includes an emotional expression string. ; A second step of outputting a voice file of the emotional expression string through the audio unit when the received text includes the emotional expression string; Emotional expression method using an audio device of a mobile communication terminal, characterized in that comprises a. delete delete The method of claim 1, The message processing module includes a voice file storage unit for storing a voice file for each word of emotion expression, The emotional expression string includes an emotional expression word and special characters arranged before and after the word to distinguish the emotional expression string from the received text. The second step, Extracting an emotion expression word included in the emotion expression string; Searching a voice file for the extracted word by referring to the voice file storage unit; And Outputting the searched voice file through an audio unit; Emotional expression method using an audio device of a mobile communication terminal, characterized in that comprises a. The method of claim 4, wherein The mobile communication terminal further comprises a speech synthesis unit for converting text to speech, After searching the voice file, Generating a voice file by synthesizing the extracted words into voice when there is no voice file for the corresponding word as a result of the search; And Outputting the generated voice file through an audio unit; Emotional expression method using an audio device of a mobile communication terminal, characterized in that further comprises. The method of claim 1, The mobile communication terminal comprises a speech synthesizer for converting text to speech, The emotional expression string includes an emotional expression word and special characters arranged before and after the word to distinguish the emotional expression string from the received text. The second step, Extracting an emotion expression word included in the emotion expression string; Generating a speech file by synthesizing the emotional expression word into the speech by the speech synthesizer; And Outputting the generated voice file through the audio unit; Emotional expression method using an audio device of a mobile communication terminal, characterized in that comprises a. The method according to any one of claims 4 to 6, The emotion expression string is further comprises a voice file playback repeat count information, In the outputting of the voice file, repeatedly outputting the voice file as many times as the voice file is repeated. An instant messenger module for transmitting and receiving instant messages between mobile communication terminals through a messenger server that provides an instant messaging service, and an emotional expression string included in the text of the instant message so that the emotional expression string is audible through voice output. A mobile communication terminal comprising a message processing module and an audio unit for voice input and output, which can be represented by The instant messenger module transfers the text of the instant message received through the messenger server to the message processing module. The message processing module, An emotion expression string recognition unit determining whether an emotion expression string is included in the received text when text is received from the instant messenger module; And An audio output controller for outputting a voice file for the emotion expression string through the audio unit; Mobile communication terminal, characterized in that comprises a. delete delete The method of claim 8, The message processing module, A voice file storage unit for storing a voice file for each emotion expression word; And A voice file retrieval unit for retrieving a voice file for the emotion expression string recognized by the emotion expression string recognition unit from the voice file storage unit; It is made, including more And the audio output control unit outputs the corresponding voice file searched by the voice file search unit through the audio unit. The method of claim 11, The message processing module may further include a voice synthesizer configured to synthesize a voice expression word into a voice to generate a voice file, and store the generated voice file in the voice file storage. The voice file search unit transmits the emotion expression word to the voice synthesis unit when there is no voice file for the emotion expression word to be searched in the voice file storage unit. The audio output control unit is a mobile communication terminal, characterized in that for outputting the voice file generated by the speech synthesis unit through the audio unit. The method of claim 11, The message processing module, And a voice file manager for allowing a user to input a voice for the emotion expression word and storing and managing the voice file input from the user with the emotion expression word specified by the user in the voice file storage. Mobile communication terminal, characterized in that. The method of claim 8, The message processing module, And a speech synthesizer configured to generate a speech file by synthesizing the emotion expression words included in the emotion expression string recognized by the emotion expression string recognizer into speech. The audio output control unit is a mobile communication terminal, characterized in that for outputting the voice file generated by the speech synthesis unit through the audio unit. The method of claim 8, The emotional expression string includes an emotional expression word and special characters arranged before and after the word to distinguish the emotional expression string from the received text. The voice file search unit, And extracting a word representing an emotion included in the emotion expression string, and searching for a voice file corresponding to the extracted word by referring to the voice file storage unit. The method of claim 15, The emotion expression string is further comprises a voice file playback repeat count information, And the audio output control unit repeatedly outputs the voice file as many times as the voice file is repeated.