KR20150084304A - Mobile terminal and operation method thereof - Google Patents

Abstract

The present invention relates to a method of controlling an operation of a mobile terminal, the method comprising: detecting a communication event to be transmitted / received to at least one other terminal; Analyzing contents of the detected communication event; And displaying a pop-up window supporting a schedule management function on an operation screen when content related to a schedule is detected in the communication event.

Description

[0001] MOBILE TERMINAL AND OPERATION METHOD THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile terminal and an operation control method thereof, and more particularly, to a mobile terminal supporting a schedule management function based on a communication event transmitted / received with another terminal and a method of controlling the operation thereof.

A mobile terminal is a portable device having one or more functions capable of carrying out voice and video communication, capable of inputting and outputting information, and storing data, while being portable. As these functions are diversified, the mobile terminal has complicated functions such as photographing and photographing, reproduction of music files and video files, games, broadcast reception, wireless Internet, and message transmission and reception. .

In order to implement complex functions, mobile terminals implemented in the form of multimedia devices are being applied variously in terms of hardware and software. For example, there is a user interface environment in which a user can easily and conveniently search for or select a function.

Meanwhile, recent mobile terminals provide various additional services such as a schedule management function, a memo function, a dictionary function, a location search function and the like for the convenience of users. In the case of the schedule management function among these additional services, in the conventional mobile terminal, the schedule is managed in such a manner that the user executes the calendar application and directly inputs the contents.

However, this method has a problem that the user has to execute the calendar application every time to manage the schedule. Accordingly, there is a desperate need for a method for managing the schedule in a more convenient and convenient manner without executing the calendar application.

The present invention provides a mobile terminal supporting a schedule management function, an alarm function, and a navigation function based on contents of communication events transmitted / received with other terminals and a method of controlling the operation thereof.

The present invention provides a display device comprising: a display unit displaying an operation screen; A wireless communication unit for detecting a communication event transmitted / received to / from at least one other terminal; And a controller for activating at least one of a voice recognition unit and a character recognition unit to analyze contents of the detected communication event and display a pop-up window supporting the schedule management function on the operation screen based on the analyzed contents do.

According to another aspect of the present invention, there is provided a method of detecting a communication event, the method comprising: detecting a communication event transmitted / received to / from at least one other terminal; Analyzing contents of the detected communication event; And displaying a pop-up window supporting a schedule management function on an operation screen when content related to a schedule is detected in the communication event.

According to the embodiment of the present invention, the mobile terminal supports the schedule management function based on communication events transmitted / received to / from other terminals, so that the user can automatically register the schedule, So that duplication can be prevented from occurring.

Meanwhile, various other effects will be directly or implicitly disclosed in the detailed description according to the embodiment of the present invention to be described later.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
FIG. 2 is a perspective view of a mobile terminal according to an embodiment of the present invention; FIG.
FIG. 3 is a rear perspective view of the mobile terminal shown in FIG. 2; FIG.
4 is a flowchart illustrating an operation of a mobile terminal according to an exemplary embodiment of the present invention;
5 is a diagram illustrating an operation of a mobile terminal that sets a smart assistant function;
6 to 8 are diagrams illustrating operations of a mobile terminal supporting a schedule management function and an alarm setting function when a message including date and time information is transmitted / received;
9 is a diagram illustrating an operation of a mobile terminal supporting a schedule management function and an alarm setting function when a message including a specific word is transmitted / received;
10 is a diagram illustrating an operation of a mobile terminal supporting a schedule management function and a navigation function when a message including location information is transmitted / received;
11 is a diagram illustrating an operation of a mobile terminal that detects overlapping schedules and provides feedback to a user when a message related to a schedule is transmitted / received;
12 and 13 are diagrams illustrating operations of a mobile terminal providing an auto response function when receiving a predetermined message;
FIGS. 14 to 16 are diagrams illustrating an operation of a mobile terminal supporting a schedule management function, an alarm function, and a navigation function based on contents of a call with another terminal;
17 is a diagram illustrating an operation of a mobile terminal supporting a schedule management function and an alarm function based on an SMS / MMS message transmitted / received to / from another terminal;
18 is a view for explaining an operation of a mobile terminal that displays information related to a communication event linked to a schedule in the calendar mode;

Hereinafter, the present invention will be described in detail with reference to the drawings.

Examples of the mobile terminal described in the present specification include a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a camera, tablet computers, e-book terminals, and the like. In addition, suffixes "module" and " part "for the components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 1, a mobile terminal according to an exemplary embodiment of the present invention will be described in terms of functional components.

1, a mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A controller 160, an interface 170, a controller 180, and a power supply 190. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module 113. Broadcast-related information can exist in various forms.

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcasting systems that provide broadcasting signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 115 is a module for wireless Internet access, and the wireless Internet module 115 can be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and Near Field Communication (NFC) may be used as the short distance communication technology.

A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

An A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone (not shown). The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

A microphone (not shown) receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. The microphone (not shown) may be used with various noise reduction algorithms to remove noise generated in receiving an external sound signal.

The user input unit 130 generates key input data that the user inputs to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, and a touch pad (static / static) capable of receiving commands or information by a user's pressing or touching operation. The user input unit 130 may be a jog wheel for rotating the key, a jog type or a joystick, or a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, Thereby generating a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is coupled to an external device, and the like can be handled.

The sensing unit 140 may include a proximity sensor 141, a pressure sensor 143, a motion sensor 145, and the like. The proximity sensor 141 can detect an object approaching the mobile terminal 100 or the presence or absence of an object in the vicinity of the mobile terminal 100 without mechanical contact. The proximity sensor 141 can detect a nearby object by using a change in the alternating magnetic field or a change in the static magnetic field, or a rate of change in capacitance. The proximity sensor 141 may be equipped with two or more sensors according to the configuration.

The pressure sensor 143 can detect whether or not pressure is applied to the mobile terminal 100, the magnitude of the pressure, and the like. The pressure sensor 143 may be installed at a portion where the pressure of the mobile terminal 100 is required according to the use environment. When the pressure sensor 143 is installed on the display unit 151, the touch input through the display unit 151 and the pressure applied by the touch input The pressure touch input can be identified. Also, the magnitude of the pressure applied to the display unit 151 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 143. [

The motion sensor 145 senses the position or movement of the mobile terminal 100 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used for the motion sensor 145 is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology.

The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various kinds. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 151 may be an input device capable of inputting information by a user's touch in addition to the output device Can also be used.

If the display unit 151 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel that is attached to the outside, and can be connected to the internal bus of the mobile terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display unit 151 may be formed of an e-paper. Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. The electronic paper (e-paper) can be implemented on any substrate such as plastic, metal, paper, and the image is maintained even after the power is shut off, and the battery life of the mobile terminal 100 is long Can be maintained. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three- (3D display). In addition, there may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may include an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, In addition, the sound output module 153 outputs sound signals related to functions performed in the mobile terminal 100, for example, call signal reception tones, message reception tones, and the like. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 include call signal reception, message reception, and key signal input. The alarm unit 155 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 155 can output a signal to notify when a call signal is received or a message is received. Also, when the key signal is inputted, the alarm unit 155 can output the signal as the feedback to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 155. A signal for notifying the occurrence of an event in the mobile terminal 100 may also be output through the display unit 151 or the sound output module 153. [

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 157 can be converted, and the different vibrations can be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 157 may be provided with a function of stimulating by a pin arrangement vertically moving with respect to the contact skin surface, an effect of stimulating air through the injection or suction force of the air through the injection port or the suction port, The effect of stimulation through contact of the electrode (eletrode), the effect of stimulation by the electrostatic force, and the effect of reproducing the cool / warm using the device capable of endothermic or exothermic can be generated. The haptic module 157 can be implemented not only to transmit the tactile effect through direct contact but also to feel the tactile effect through the muscular sense of the user's finger or arm. The haptic module 157 may include two or more haptic modules 157 according to the configuration of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input or output data (e.g., a phone book, a message, a still image, .

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM , And a ROM. ≪ / RTI > In addition, the mobile terminal 100 may operate a web storage for storing the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. Examples of the external device connected to the mobile terminal 100 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 170 may receive data from the external device or supply power to the respective components in the mobile terminal 100 and may transmit data in the mobile terminal 100 to the external device .

The interface unit 170 may be a path through which the power from the cradle connected to the mobile terminal 100 is connected to the cradle when the mobile terminal 100 is connected to the cradle, And may be a passage to be transmitted to the terminal 100.

The controller 180 typically controls the operation of the respective units to control the overall operation of the mobile terminal 100. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 180 or separately from software in the controller 180. [

The voice recognition unit 182 drives the voice recognition engine to which the voice recognition algorithm is applied to recognize the voice of the user input to the microphone 123. [

That is, the voice recognition unit 182 converts the voice of the user input through the microphone 122 into digital data, pre-emphasizes the converted digital data, The end point is detected.

Then, the voice recognition unit 182 extracts voice feature values for the voice between the detected start point and end point, and outputs the voice feature values matching the extracted voice feature values in the voice recognition database provided in the memory 160 And notifies the controller 180 of the operation of the mobile terminal 100. At this time, the voice feature values may include at least one of a waveform of a voice input from the microphone 123, a format of a voice, and a pitch of a voice.

For example, if the operation that matches the voice feature value extracted by the voice recognition unit 182 in the voice recognition database is the "telephone directory ", the control unit 180 executes the" Display the "Phonebook" menu on the screen. If the operation that matches the voice feature value extracted by the voice recognition unit 182 in the voice recognition database is "text", the control unit 180 displays "text" on the screen of the display unit 151.

The character recognition unit 183 drives the character recognition engine to which the character recognition algorithm is applied to recognize characters output to the display unit 151. [ At this time, as the character recognition algorithm, a pattern recognition technique using a known artificial intelligence (AI) technique can be used.

Particularly, in this embodiment, the voice recognition unit 182 and the character recognition unit 183 can be used for analyzing the contents of a communication event transmitted / received to / from another terminal, in order to support the schedule management function of the user .

The voice recognition unit 182 and the character recognition unit 183 may be provided in the mobile terminal 100 in the form of a single module or a unit, As shown in FIG. In this case, the control unit 180 controls the operation of the voice recognizing unit 182 and the character recognizing unit 183. The voice recognizing unit 182 and the character recognizing unit 183 may be included in the control unit 180, Can be performed in the same manner.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The mobile terminal 100 having such a configuration can be configured to be operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system. have.

FIG. 2 is a perspective view of a mobile terminal according to an embodiment of the present invention, and FIG. 3 is a rear perspective view of the mobile terminal shown in FIG. Hereinafter, with reference to FIG. 2 and FIG. 3, a mobile terminal according to the present invention will be described in terms of components according to the external appearance. Hereinafter, for convenience of description, a bar type mobile terminal having a front touch screen among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, etc. will be described as an example. However, the present invention is not limited to the bar-type mobile terminal but can be applied to all types of mobile terminals including the above-mentioned types.

Referring to FIG. 2, the case constituting the appearance of the mobile terminal 100 is formed by the front case 100-1 and the rear case 100-2. Various electronic components are incorporated in the space formed by the front case 100-1 and the rear case 100-2.

The display unit 151, the first sound output module 153a, the first camera 121a, and the first through third user input units 130a, 130b, and 130c are connected to the main body, specifically, the front case 100-1 . A fourth user input portion 130d may be disposed on a side surface of the rear case 100-2 and a microphone (not shown) may be disposed on a lower surface of the rear case 100-2.

The display unit 151 may be constructed such that the touch pad is overlapped with the layer structure so that the display unit 151 operates as a touch screen so that information can be input by a user's touch.

The first acoustic output module 153a may be implemented in the form of a receiver or a speaker. The first camera 121a may be implemented in a form suitable for capturing an image or a moving image of a user. The microphone (not shown) may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The first to fourth user input units 130a, 130b, 130c and 130d and the fifth user input unit 130e to be described later may collectively be referred to as a user input unit 130. The user input unit 130 may be a method tactile manner, any method can be employed.

For example, the user input unit 130 may be embodied as a dome switch or a touch pad capable of receiving a command or information by a user's pressing or touching operation, or may be a wheel, jog system, Or the like.

In a functional aspect, the first user input unit 130a is a menu key for inputting a command for calling a menu related to an application currently being executed, and the second user input unit 130b is a home key, The third user input unit 130c is for inputting a command for canceling the currently executing application as a back key.

Also, the fourth user input unit (i.e., the side key 130d) may operate as a key for switching between a sleep mode and a wake-up mode, or may operate as a special function within the mobile terminal 100 As a hot-key for activating the < / RTI > Here, the sleep mode indicates a state in which the backlight of the display unit 151 is turned off to save battery consumption of the mobile terminal, and the wake-up mode indicates a state in which the backlight of the display unit 151 is turned on.

3, a second camera 121b may be further mounted on the rear surface of the rear case 100-2, a fifth user input unit 130e may be disposed on a side surface of the rear case 100-2 And the interface unit 170 may be disposed on the lower surface of the rear case 100-2.

The second camera 121b has a photographing direction substantially opposite to that of the first camera 121a, and may have pixels different from those of the first camera 121a. A flash (not shown) and a mirror (not shown) may be additionally disposed adjacent to the second camera 121b. In addition, another camera may be installed adjacent to the second camera 121b to use it for shooting a three-dimensional stereoscopic image.

The flash illuminates the subject when the subject is photographed by the second camera 121b. The mirror enables the user to illuminate the user's own face or the like when the user intends to photograph (self-photograph) himself / herself using the second camera 121b.

A second sound output module (not shown) may be further disposed in the rear case 100-2. The second sound output module may implement the stereo function together with the first sound output module 153a, and may be used for talking in the speakerphone mode.

The interface unit 170 can be used as a path for exchanging data with an external device. An antenna for receiving broadcast signals (not shown) may be disposed in one area of the front case 100-1 and the rear case 100-2 in addition to the antenna for communication. The antenna may be installed to be capable of being drawn out from the rear case 100-2.

A power supply unit 190 for supplying power to the mobile terminal 100 may be mounted on the rear case 100-2. The power supply unit 190 may be a rechargeable battery, for example, and may be detachably coupled to the rear case 100-2 for charging or the like.

On the other hand, in the present embodiment, the second camera 121b and the like are disposed in the rear case 100-2, but the present invention is not limited thereto. Also, the first camera 121a may be rotatably formed so that the second camera 121b can be photographed up to the photographing direction, even if the second camera 121b is not separately provided.

In the foregoing, the configuration of the mobile terminal 100 according to the present invention has been described with reference to FIG. 1 to FIG. Hereinafter, a mobile terminal supporting a schedule management function, an alarm function, and a navigation function based on contents of a communication event transmitted / received to / from another terminal according to an embodiment of the present invention and its operation control method will be described in detail .

4 is a flowchart illustrating an operation of a mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 4, the controller 180 sets a smart assistant function in response to a user input through a setting menu or the like (S410). Here, the smart assistant function refers to an operation mode that supports a schedule management function, an alarm function, an address book function, and a navigation function based on contents of communication events transmitted / received to / from other terminals.

The controller 180 activates the voice recognition unit 182 and the character recognition unit 183 to enter the food recognition and character recognition mode at step S420.

In this state, if a communication event occurs with at least one other terminal at step S430, the control unit 180 analyzes the content of the communication event using at least one of the voice recognition unit 182 and the character recognition unit 183 (S440). At this time, communication events may include, but are not limited to, voice calls, video calls, SMS (Short Message Service) transmission / reception, MMS (Multimedia Message Service) transmission / reception, instant messages, messenger,

For example, when the communication event is a voice and a video call, the control unit 180 analyzes the content of the communication event using the voice recognition unit 182. If the communication event is an SMS, an MMS, an instant message, a messenger, an e-mail, etc., the control unit 180 analyzes the content of the communication event using the character recognition unit 183.

Through the analysis process, the controller 180 determines whether there is a schedule related to the content of the communication event (S450). Here, the content related to the schedule may be information on date, time, place, purpose, person, and the like.

If it is determined that the contents related to the schedule are detected, the control unit 180 extracts contents related to the schedule and displays a pop-up window for inducing schedule registration and / or alarm setting to the display unit 151 (S460). At this time, the pop-up window may be displayed as a transparent window or a semi-transparent window so that the contents of the operation window displayed thereafter can be seen.

When a schedule registration and / or an alarm setting request is received through the pop-up window, the controller 180 registers the schedule in a schedule management function (i.e., a calendar) or an alarm function (S480). At the same time, the mobile terminal 100 removes the pop-up window displayed on the display unit 151 from the operation screen.

Then, the control unit 180 determines whether the detected communication event is terminated. If it is determined that the communication event has ended, the control unit 180 ends the procedure according to the present invention. On the other hand, if it is determined that the communication event is not terminated, the controller 180 moves to step 440 and repeats the above-described processes.

5 is a view for explaining the operation of a mobile terminal for setting a smart secretarial function.

Referring to FIG. 5, the mobile terminal 100 displays a home screen (not shown) or a menu screen 510 on the display unit 151 according to a user command or the like.

When the setting menu 515 is selected in the state that the menu screen 510 is displayed, the mobile terminal displays the setting screen 520 as shown in FIG. 5B on the display unit 151. At this time, the general setting screen 520 includes an account and synchronization item, a cloud item, a guest mode item, a smart assistant item, a security item, a language item and an input item, a backup item and an initialization item. In the present exemplary embodiment, the smart secretary item 525 is included in the general setting screen 520, but the present invention is not limited thereto.

When the smart secretary item 525 is selected on the general setting screen 520, the mobile terminal 100 sets up a smart secretary function for supporting a schedule management function based on a communication event transmitted / received to / from another terminal.

6 to 13 are diagrams illustrating operations of a mobile terminal supporting a schedule management function, an alarm function, and a navigation function based on an instant message transmitted / received to / from another terminal. Hereinafter, in the present embodiment, it is assumed that the mobile terminal has a smart assistant function in a preset state.

6 to 8 illustrate operations of a mobile terminal supporting a schedule management function and an alarm setting function when a message including date and time information is transmitted / received.

Referring to FIG. 6, the mobile terminal 100 executes an instant message application according to a user command or the like, and then transmits / receives a message to / from the partner terminal. At this time, the mobile terminal 100 activates the character recognition unit 183 to analyze the content of a message transmitted / received to / from the partner terminal.

Through this analysis process, the mobile terminal 100 confirms whether there is a content related to a schedule among the contents of the transmitted / received message. As a result of checking, when a content related to a schedule is detected in the transmitted / received message, the mobile terminal 100 extracts contents related to the schedule and displays a pop-up window for inducing schedule registration and / ).

6 (a), when the message 620 including the date and time information is received, the mobile terminal 100 detects the date and time information and determines that the content is related to the schedule .

Accordingly, the mobile terminal 100 displays a first pop-up window 630 for guiding the contents of the received message 620 to be registered in a schedule, and a second pop-up window 640 for guiding an alarm setting for the schedule, On the operation screen 610 of FIG. At this time, the first and second pop-up windows 630 and 640 may be displayed as a transparent window or a semi-transparent window so that a message displayed thereafter can be seen.

When the user input 650 is received through the first pop-up window 630, the mobile terminal 100 registers the schedule related to the contents of the received message 620 in the calendar. Meanwhile, when a user input (not shown) is received through the second pop-up window 540, the mobile terminal 100 registers a schedule related to the contents of the received message 620 in an alarm.

Meanwhile, the first and second pop-up windows 630 and 640 displayed on the display unit 151 move together with the movement of the corresponding message 620.

7, when the message 620 related to the schedule moves up due to another message 650 being transmitted / received to / from the counterpart terminal, the mobile terminal 100 displays the first and second pop- (630, 640) to be moved as the corresponding message (620).

Also, the first and second pop-up windows 630 and 640 may be configured to be erasable according to a user's command.

8A, when the delete icon 670 displayed in one area of the second popup window 640 is selected, the mobile terminal 100 displays the second popup window 640 on the operation screen 640. [ Gt; 610 < / RTI >

8 (b), when a user input 680 is dragged in the boundary direction of the display unit 151 after touching the second pop-up window 640, The control unit 100 may cause the second pop-up window 640 to disappear from the operation screen 610.

9 is a diagram illustrating an operation of a mobile terminal supporting a schedule management function and an alarm setting function when a message including a specific word is transmitted / received.

Referring to FIG. 9, the mobile terminal 100 executes an instant message application according to a user command or the like, and then transmits / receives a message to / from the partner terminal. At this time, the mobile terminal 100 activates the character recognition unit 183 to analyze the content of a message transmitted / received to / from the partner terminal.

Through this analysis process, the mobile terminal 100 confirms whether there is a content related to a schedule among the contents of the transmitted / received message. As a result of checking, when a content related to a schedule is detected in the transmitted / received message, the mobile terminal 100 extracts contents related to the schedule and displays a pop-up window for inducing schedule registration and / ).

For example, if a message 920 is received that includes a specific word (tomorrow, mojo, wed, morning, afternoon, etc.) associated with a date, day of the week or time, as shown in Figure 9 (a) 100 automatically recognizes that the specific word and the current date and time are associated with the schedule.

Accordingly, the mobile terminal 100 displays a first pop-up window 930 for guiding the contents of the received message 920 to be registered in a schedule, and a second pop-up window 940 for guiding the alarm setting for the schedule, On the operation screen 910 of FIG.

When the user input 950 is received through the first pop-up window 930, the mobile terminal 100 registers the schedule related to the contents of the received message 920 in the calendar. Meanwhile, when a user input (not shown) is received through the second pop-up window 940, the mobile terminal 100 registers a schedule related to the contents of the received message 920 in an alarm.

10 is a diagram illustrating operations of a mobile terminal supporting a schedule management function and a navigation function when a message including location information is transmitted / received.

Referring to FIG. 10, the mobile terminal 100 executes an instant message application according to a user command or the like, and then transmits / receives a message to / from the partner terminal. At this time, the mobile terminal 100 activates the character recognition unit 183 to analyze the content of a message transmitted / received to / from the partner terminal.

Through this analysis process, the mobile terminal 100 confirms whether there is a content related to a schedule among the contents of the transmitted / received message. If it is determined that the content related to the schedule is detected in the transmitted / received message, the mobile terminal 100 extracts contents related to the schedule, and displays a pop-up window for guiding the schedule registration and navigation functions to the display unit 151 Display.

10 (a), when a message 1020 including words related to a specific place (reverse name, restaurant, bookstore, etc.) is received, the mobile terminal 100 transmits the message And then confirms whether or not there is a schedule with the current conversation partner.

As a result of the checking, if there is a schedule with the conversation partner, the mobile terminal 100 displays the first pop-up window 1030, which induces the place included in the received message 1020 to be additionally registered in the schedule, 1010). At this time, the first pop-up window 1030 may include a view icon 1031 and a delete icon 1033.

When the view icon 1031 is selected in the first pop-up window 1030, the mobile terminal 100 displays a second pop-up window 1040 for guiding the map to the corresponding place, And displays the third pop-up window 1050 on the operation screen 1010. [ In another embodiment, when the message 1020 is received, the first to third pop-up windows 1030, 1040, and 1050 may be displayed without first displaying the first pop-up window 1030 including the view icon 1031, Can be displayed on the operation screen 1010 directly.

In addition, the first to third pop-up windows 1030 can be displayed not only in a text format, but also in an icon format corresponding to a calendar, a map, navigation, or the like, or a format in which short text and icons are combined.

When the first pop-up window 1030 is selected, the mobile terminal 100 additionally registers the place information included in the received message 1020 in the existing schedule of the calendar. On the other hand, when the second pop-up window 1040 is selected, the mobile terminal 100 executes a pre-set map application and displays a map screen for the place (i.e., the addition region) on the display unit 151. If the third pop-up window 1050 is selected, the mobile terminal 100 automatically sets the corresponding place (i.e., the addition region) as a destination, and then executes the route search service.

11 is a diagram illustrating an operation of a mobile terminal that detects overlapping schedules and provides feedback to a user when a message related to a schedule is transmitted / received.

Referring to FIG. 11, the mobile terminal 100 executes an instant message application according to a user command or the like, and then transmits / receives a message to / from the partner terminal.

In this state, when the message 1120 including the date and time information is received from the conversation partner, the mobile terminal 100 detects the date and time information and automatically recognizes the content related to the schedule.

Then, the mobile terminal 100 compares the schedule included in the received message 1120 with the entire schedule of the calendar, and confirms whether or not there is a schedule that overlaps with the schedule.

If it is determined that there is an overlapping schedule, the mobile terminal 100 displays a popup window 1130 for informing the user of the overlapped schedule on the operation screen 1110 of the corresponding application. At this time, the pop-up window 1130 can be displayed only for a predetermined time.

At the same time, the mobile terminal 100 can output a predetermined vibration or output an alarm signal to call attention of the user. Accordingly, the user can easily identify whether or not there is an overlapping schedule in conversation with the other party on the schedule.

If it is determined that there is no overlapping schedule, the mobile terminal 100 displays a first pop-up window for guiding the contents of the received message 1120 to be registered in a schedule, and a second pop- 2 pop-up window is displayed on the operation screen 1110.

12 and 13 are diagrams illustrating operations of a mobile terminal providing an auto response function when receiving a predetermined message.

Referring to FIG. 12, the mobile terminal 100 executes an instant message application according to a user command or the like, and then transmits / receives a message to / from the partner terminal. At this time, the mobile terminal 100 activates the character recognition unit 183 to analyze the content of a message transmitted / received to / from the partner terminal.

In this state, when the mobile terminal 100 receives a preset message (e.g., Where ?, 1220) from the conversation partner, the mobile terminal 100 searches its current location using GPS or the like. Then, the mobile terminal 100 displays a popup window 1230 for inquiring whether or not to share its location with the conversation partner on the operation screen 1210 of the corresponding application.

When the user's sharing request command is received through the pop-up window 1230, the mobile terminal 100 transmits messages 1240 and 1250 including its own location information to the conversation partner. At this time, the message transmitted to the conversation partner may be at least one of a message 1240 including text and a message 1250 including map information.

In another embodiment, referring to FIG. 13, the mobile terminal 100 executes an instant message application according to a user command or the like, and then transmits / receives a message to / from the partner terminal. At this time, the mobile terminal 100 activates the character recognition unit 183 to analyze the content of a message transmitted / received to / from the partner terminal.

In this state, when receiving a predetermined message (e.g., informing a contact, 1320) from the conversation partner, the mobile terminal 100 searches the address book based on the name of the person included in the received message 1320 do. Then, the mobile terminal 100 displays a pop-up window 1330 on the operation screen 1310 of the corresponding application to inquire whether to share information about the searched contact with the conversation partner.

When the user's sharing request command is received through the pop-up window 1330, the mobile terminal 100 transmits a message 1340 containing the contact information of the person requested by the other party to the conversation partner.

On the other hand, in the present embodiment, an example of providing an automatic response function when receiving a message such as "Where to? &Quot; and" So, "What time is it?" Quot ;, or "Show me a picture of my child ", and the like can be provided to an automatic response function.

FIGS. 14 to 16 are diagrams for explaining the operation of the mobile terminal supporting the schedule management function, the alarm function, and the navigation function based on the contents of communication with the other terminal. Hereinafter, in the present embodiment, it is assumed that the mobile terminal has a smart assistant function in a preset state.

14 is a diagram illustrating operations of a mobile terminal supporting a schedule management function and an alarm setting function when date and time information is included in a call content with a counter party.

Referring to FIG. 14, the mobile terminal 100 performs a voice or video call with a partner terminal according to a user command or the like. At this time, the mobile terminal 100 activates the voice recognition unit 183 to analyze the call content with the third party.

Through this analysis process, the mobile terminal 100 confirms whether or not there is a content related to a schedule among the conversation contents. If it is determined that there is a content related to the schedule, the mobile terminal 100 extracts contents related to the schedule and displays a pop-up window for displaying a schedule and / or setting an alarm on the display unit 151 do.

For example, as shown in FIG. 14A, when date and time information is included in the call content 1415 with the third party, the mobile terminal 100 detects the date and time information, It automatically recognizes that it is relevant.

Thereafter, when the communication with the third party is terminated, the mobile terminal 100 displays a first pop-up window 1420 for guiding the call content 1415 to be registered at a predetermined time, a second pop-up window for guiding an alarm setting for the schedule, (1430) on the idle screen (1410). Meanwhile, in another embodiment, the mobile terminal 100 may display the first and second pop-up windows 1420 and 1430 in a call end screen (not shown) instead of the idle screen 1410.

When the user input 1440 is received through the first pop-up window 1420, the mobile terminal 100 registers the schedule related to the call content 1415 on the calendar. Meanwhile, when a user input (not shown) is received through the second pop-up window 1430, the mobile terminal 100 registers a schedule related to the call content 1415 in an alarm.

FIG. 15 is a diagram illustrating an operation of a mobile terminal that detects overlapping schedules during a call with a counterpart and provides feedback to a user.

Referring to FIG. 15, the mobile terminal 100 performs a voice or video call with a partner terminal according to a user command or the like. At this time, the mobile terminal 100 activates the voice recognition unit 183 to analyze the call content with the third party.

When the date and time information is included in the call content 1515 with the third party, the mobile terminal 100 detects the date and time information and automatically recognizes the content related to the schedule. Then, the mobile terminal 100 compares the calendars included in the call content 1515 with the calendars of the calendars to check whether there is a schedule that overlaps with the calendars.

If it is determined that there is an overlapping schedule, the mobile terminal 100 displays a popup window 1520 for informing the user of the overlapped schedule on the busy screen 1510. At this time, the pop-up window 1520 can be displayed only for a predetermined time.

At the same time, the mobile terminal 100 can output a predetermined vibration or output an alarm signal to call attention of the user. Accordingly, the user can immediately identify whether there is an overlapping schedule in the call with respect to the other party.

If it is determined that there is no overlapping schedule, the mobile terminal 100 displays a first pop-up window (not shown) to guide the user to register the call content 1515 at a predetermined time after the call is terminated, A second pop-up window (not shown) for guiding the setting is displayed on a standby screen (not shown).

FIG. 16 is a diagram illustrating an operation of a mobile terminal supporting a schedule management function, an address book function, a memo function, and a navigation function when a preset word is included in a conversation with a counter party.

Referring to FIG. 16, the mobile terminal 100 performs a voice or video call with a partner terminal according to a user command or the like. At this time, the mobile terminal 100 activates the voice recognition unit 183 to analyze the call content with the third party.

Through this analysis process, the mobile terminal 100 confirms whether or not a predetermined word is included in the call content 1615 with the third party. In the present embodiment, it is assumed that the predetermined word is "telephone number "," place ", and "address ".

If it is determined that the predetermined word is detected in the conversation content 1615, the mobile terminal 100 displays a pop-up window on the display unit 151 for performing an operation related to the detected word after the conversation ends .

For example, when "telephone number 1615_1" is detected in the communication content 1615 with the third party, the mobile terminal 100 transmits the telephone number included in the call content 1615 to the first And displays a popup window 1620 on the idle screen 1610. When the first popup window 1620 is selected, the mobile terminal 100 moves to the address book screen to register the telephone number in the contact.

On the other hand, when the "address 1615_2" is detected in the content 1615 with the third party, the mobile terminal 100 displays a second pop-up window for guiding the address included in the call content 1615 to be stored in the memo 1630 on the idle screen 1610. If the second popup window 1630 is selected, the mobile terminal 100 automatically stores the address in the memo.

When the "location 1615_3" is detected in the content 1615 with the third party, the mobile terminal 100 induces the place included in the content 1615 to be additionally registered in the existing schedule, And displays a third pop-up window 1640 on the idle screen 1610 to guide map interlocking and navigation interlocking to the place.

When the first item 1641 is selected in the third pop-up window 16400, the mobile terminal 100 additionally registers the place included in the call content 1615 in the existing schedule of the calendar. On the other hand, when the second item 1642 is selected, the mobile terminal 100 executes a predetermined map application and displays a map screen for the place (i.e., the additive station) on the display unit 151. [ If the third item 1643 is selected, the mobile terminal 100 executes the navigation application in which the corresponding place (i.e., the addition station) is automatically set as the destination.

17 is a diagram illustrating an operation of a mobile terminal supporting a schedule management function and an alarm function based on an SMS / MMS message transmitted / received to / from another terminal. Hereinafter, in the present embodiment, it is assumed that the mobile terminal has a smart assistant function in a preset state.

Referring to FIG. 17, the mobile terminal 100 executes an SMS or MMS application according to a user command, and then transmits / receives a message to / from the partner terminal. At this time, the mobile terminal 100 activates the character recognition unit 183 to analyze the content of a message transmitted / received to / from the partner terminal.

Through this analysis process, the mobile terminal 100 confirms whether there is a content related to a schedule among the contents of the transmitted / received message. If it is determined that the content related to the schedule is detected in the transmitted / received message, the mobile terminal 100 extracts contents related to the schedule and displays a pop-up window for inducing schedule registration and alarm setting on the display unit 151 Display.

17 (a), when the message 1720 including the date and time information is received, the mobile terminal 100 detects the date and time information and determines that the content is related to the schedule . Accordingly, the mobile terminal 100 displays a first pop-up window 1730 for guiding the contents of the received message 1720 to be registered on a schedule, and a second pop-up window 1740 for guiding the alarm setting for the schedule, On the operation screen 1710 of FIG.

When the user input 1750 is received through the first pop-up window 1730, the mobile terminal 100 registers the schedule related to the contents of the received message 1720 in the calendar. Meanwhile, when a user input (not shown) is received through the second pop-up window 1740, the mobile terminal 100 registers a schedule related to the contents of the received message 1720 in an alarm.

18 is a view for explaining an operation of a mobile terminal that displays information related to a communication event linked to a schedule in the calendar mode.

Referring to FIG. 18, the mobile terminal 100 executes a calendar application according to a user command or the like, and then enters a calendar mode.

Accordingly, the mobile terminal 100 includes a menu bar 1811 that lists menus related to the calendar function, a calendar window 1813 that displays a calendar on a week / month / year basis, a date selected by today or a user On the display unit 151, a calendar screen 1810 including a schedule window 1815 for displaying corresponding schedule information.

The schedule window 1815 includes an identification icon 1817 indicating that a communication event related to the smart assistant function is linked to the schedule. Accordingly, the user of the mobile terminal 100 can confirm that the corresponding schedule is registered through the smart assistant function.

When the corresponding item 1816 of the schedule window 1815 is selected, the mobile terminal 100 displays a detailed schedule screen 1820 including information 1825 on the communication event linked to the selected schedule 1816, (151).

When the detailed event schedule screen 720 is displayed and the communication event item 1825 linked to the schedule is selected, the mobile terminal 100 executes the application corresponding to the linked communication event. In addition, the mobile terminal 100 displays an operation screen 1830 including a message related to the schedule registration on the display unit 151. Accordingly, the user of the mobile terminal 100 can directly check the content of the communication event linked to the schedule without having to separately execute the application corresponding to the communication event.

As described above, according to the present invention, the mobile terminal supports the schedule management function based on the communication event transmitted / received to / from other terminals, so that the user can automatically register the schedule, Or to prevent duplication of schedule.

Meanwhile, the present invention can be implemented as a code readable by a processor in a processor-readable recording medium provided in a mobile terminal. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium readable by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also a carrier wave such as transmission over the Internet. In addition, the processor readable recording medium may be distributed over networked computer systems so that code readable by the processor in a distributed manner can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

100: mobile terminal 110: wireless communication unit
120: A / V input unit 130: user input unit
140: sensing unit 150: output unit
151: display unit 160: memory
170: interface unit 180: control unit

Claims (12)

Detecting a communication event transmitted / received to / from at least one other terminal;
Analyzing contents of the detected communication event; And
And displaying a pop-up window supporting a schedule management function on an operation screen when content related to a schedule is detected in the communication event. The method according to claim 1,
And providing a menu for setting a smart assistant function. The method according to claim 1,
Wherein the communication event is one of an instant message, an SMS message, an MMS message, and an e-mail message transmitted / received to / from the other terminal. The method according to claim 1,
Wherein the communication event is a call transmitted / received to / from the other terminal. 4. The method of claim 3,
And analyzing contents of a message transmitted / received to / from the counterpart terminal using a character recognition algorithm. 5. The method of claim 4,
And analyzing a call content with a counterpart terminal using a speech recognition algorithm. The method of claim 3,
And moving the pop-up window together with the movement of the message displayed on the operation screen. The method of claim 3,
And deleting the pop-up window corresponding to a predetermined user input. The method of claim 3,
And automatically retrieving an answer message corresponding to the received message when the mobile terminal receives a message including a predetermined keyword. The method according to claim 1,
Further comprising the step of displaying a notification window including information on the overlapping schedule on the operation screen when there is a schedule overlapping the schedule detected in the communication event. The method according to claim 1,
Wherein the pop-up window is displayed as a transparent window or a semi-transparent window. A display unit for displaying an operation screen;
A wireless communication unit for detecting a communication event transmitted / received to / from at least one other terminal; And
And a controller for activating at least one of the voice recognition unit and the character recognition unit to analyze the contents of the detected communication event and display a pop-up window supporting the schedule management function on the operation screen.

Images