KR20150084485A - Mobile terminal and controlling method thereof - Google Patents

Abstract

According to another aspect of the present invention, there is provided a mobile terminal including a display unit for displaying information, a sensing unit for sensing movement of the mobile terminal, and a controller for controlling the information to be displayed in accordance with a first reference position, Wherein the control unit changes the first reference position to a second reference position in accordance with the movement of the mobile terminal and controls the display position of the information to be adjusted according to the second reference position .
According to another aspect of the present invention, there is provided a mobile terminal which is wearable on a user's body. The mobile terminal may further include a camera for capturing an image, wherein the information is a preview image of the image. Wherein the controller controls the photographing angle of the camera to be adjusted corresponding to the inclination so that the same image as the preview image displayed in accordance with the first reference position is sensed when the inclination of the mobile terminal is sensed. .

Description

[0001] MOBILE TERMINAL AND CONTROLLING METHOD THEREOF [0002]

The present invention relates to a mobile terminal that can determine a mobile terminal that outputs an alarm for the event among a plurality of mobile terminals when an event occurs, and a control method thereof.

A terminal can be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal according to whether the terminal can be moved. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

Particularly, due to the improvement of the structural part, mobile terminals of various sizes or shapes are being developed or popularized. Description of the Related Art [0002] In recent years, mobile terminals, i.e., wearable devices, which can be worn on a user's body have been popular. For example, a mobile terminal is also implemented in a glass type that a user wears as glasses.

However, in the case of such a glass-type mobile terminal, there is a problem that the wearing state of the glass-type mobile terminal changes when a predetermined time elapses after wearing the same. That is, since the user and the glass-type mobile terminal are not mechanically fixedly connected, a certain time has elapsed after wearing the glass-type mobile terminal, or the position where the mobile terminal is worn is changed .

When the user views the information through the display unit due to the change of the wearing position, the front view of the user may change. Particularly, when the user is moving while wearing the glass type mobile terminal, . In addition, as a user, it may be inconvenient to adjust the wearing state of the glass type mobile terminal every predetermined time to correct the changed wearing position of the glass type mobile terminal.

SUMMARY OF THE INVENTION The present invention has been proposed in order to satisfy the above-mentioned need, and it is an object of the present invention to provide a mobile terminal and a control method thereof that can view information on a display unit and secure a front view without changing the wearing state, .

More specifically, according to the present invention, the position and angle of information displayed on the display unit are adjusted according to the wearing state of the mobile terminal, thereby viewing the same type of information as before the wearing state is changed, The present invention relates to a mobile terminal capable of performing mobile communication.

The present invention also provides a mobile terminal capable of photographing an object to be photographed in the same direction as before the wearing state is changed by adjusting the photographing angle of the camera according to the wearing state of the mobile terminal.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided an image display apparatus including a camera for capturing an image, a display unit for displaying a preview image of the image, a sensing unit for sensing movement of the mobile terminal, The control unit changes the first reference position to a second reference position in accordance with the movement of the mobile terminal, and when the movement of the mobile terminal is detected, the control unit changes the first reference position to the second reference position, And controls the display position of the mobile terminal to be adjusted.

In addition, the mobile terminal of the present invention is a glass-type mobile terminal that can be worn on the user's body. When the wear of the mobile terminal is detected, the position of the mobile terminal contacting the user's body, And information on the wearing state of the mobile terminal, including at least one of the degree of wear of the user and the visual information of the user.

The technical solutions obtained by the present invention are not limited to the above-mentioned solutions, and other solutions not mentioned are clearly described to those skilled in the art from the following description. It can be understood.

Effects of the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, the user can use the mobile terminal without correcting the wearing state, even if the wearing state of the worn mobile terminal is changed as the user moves while wearing the mobile terminal. That is, according to the mobile terminal of the present invention, even if the wearing state of the mobile terminal is changed, the position where the information is displayed on the display unit is automatically adjusted, thereby maximizing convenience for viewing information of the user.

In addition, according to at least one embodiment of the present invention, since the position of information displayed on the display unit of the mobile terminal can be adjusted, even if the wearing state of the mobile terminal is changed, . Therefore, it is possible to secure safety in using the mobile terminal while the user wears the mobile terminal while moving.

In addition, according to at least one embodiment of the present invention, even if the wearing state of the mobile terminal is changed, the user can adjust the camera angle of the mobile terminal without correcting the wearing state directly.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram illustrating a mobile terminal according to the present invention.
FIG. 2 and FIG. 3 are conceptual diagrams illustrating an example of a mobile terminal according to the present invention in different directions.
4 is a conceptual diagram for explaining a case where the mobile terminal of the present invention is a wearable device.
5 is an operational flowchart of a mobile terminal according to an embodiment of the present invention.
FIG. 6 is an exemplary view for explaining a wearing state of a mobile terminal according to an embodiment of the present invention; FIG.
FIG. 7 is an exemplary view for explaining a case where a wear state of a mobile terminal is changed according to an embodiment of the present invention; FIG.
FIG. 8 is an exemplary view for explaining an effect of a change of a wearing state of a mobile terminal according to another embodiment of the present invention on a user's view. FIG.
9 is an exemplary diagram for explaining display position change of information according to an embodiment of the present invention;
10 is an exemplary diagram for explaining a relationship between a motion of a mobile terminal and a display position changing operation of information according to an embodiment of the present invention;
11 is a flowchart illustrating an operation of a mobile terminal for determining a display position of information according to an embodiment of the present invention.
FIG. 12 is an exemplary view for explaining a limit value of displacement of a mobile terminal according to an embodiment of the present invention; FIG.
13 is an exemplary view for explaining information displayed when a displacement of a mobile terminal exceeds a threshold value according to an embodiment of the present invention;
14 is an exemplary view for explaining an interface displayed when a displacement of a mobile terminal exceeds a threshold value according to an embodiment of the present invention;
15 is an exemplary view for explaining a change in camera angle of a mobile terminal according to an embodiment of the present invention;
16 is an exemplary view for explaining an effect of correcting a photographing angle of a camera according to the degree of tilting of a mobile terminal according to an embodiment of the present invention.
17 is an exemplary view for explaining a correction range of a camera photographing angle according to the tilt of the mobile terminal according to the embodiment of the present invention.
18 is an exemplary view for explaining a change in display angle of information when the mobile terminal according to the embodiment of the present invention is down.
19 is an exemplary view for explaining a change in display angle of information when the mobile terminal according to the embodiment of the present invention is put on the mobile terminal.
20 is an exemplary diagram for explaining display angle correction of information of a mobile terminal according to an embodiment of the present invention;
FIG. 21 is an exemplary view for explaining display of information according to display angle correction according to the embodiment of the present invention; FIG.
22 is an exemplary view for explaining a range of display angle correction according to an embodiment of the present invention;
23 is an exemplary view for explaining a limit value of the display angle correction according to the embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

However, it will be appreciated by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, will be.

FIG. 1 is a block diagram for explaining a mobile terminal according to the present invention, and FIGS. 2 and 3 are conceptual diagrams showing an example of a mobile terminal related to the present invention from different directions.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, ), And the like. The components shown in FIG. 1 are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 110 may be connected to the wireless communication system 100 between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and another mobile terminal 100. [ And one or more modules that enable wireless communication between the network in which the terminal 100, or an external server, is located.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, An optical sensor (e.g., a camera 121, a microphone 122, a battery gage, an environmental sensor (e.g., a barometer, a hygrometer, a thermometer, (E.g., a sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.) Lt; RTI ID = 0.0 > Combined can be used.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions of the mobile terminal 100 (e.g., call incoming, outgoing, message reception, and origination functions) . Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1 in order to drive an application program stored in the memory 170. FIG. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the components listed above will be described in more detail with reference to FIG. 1 before explaining various embodiments implemented through the mobile terminal 100 as described above.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may be a mobile communication module or a mobile communication module capable of communicating with a plurality of mobile communication devices in accordance with technical standards or communication standards for mobile communication (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Wideband CDMA (WCDMA) A terminal, or a server on a mobile communication network constructed according to a mobile communication network (e.g.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Examples of the wireless Internet technology include a wireless LAN (WLAN), a wireless fidelity (WiFi) direct, a digital living network alliance (DLNA), a wireless broadband (WIBRO), a wimax (World Interoperability for Microwave Access) Packet Access, and Long Term Evolution (LTE). The wireless Internet module 113 transmits and receives data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112).

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), and Wi-Fi Direct technology. The short-range communication module 114 may communicate with the mobile terminal 100 through a wireless personal area network (Wireless Personal Area Networks) between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, The mobile terminal 100 may support wireless communication between the mobile terminal 100 and the network where the other mobile terminal 100 or the external server is located.

Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module.

The input unit 120 is for inputting image information (or a signal), audio information (or a signal), or information input from a user. The input unit 120 may input image information The mobile terminal 100 may include one or a plurality of cameras 121. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity of the detection surface without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor senses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, do.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, etc. of a touch object to be touched on the touch screen on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object, which touches the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera 121, a photosensor, and a laser sensor. The camera 121 is a kind of camera sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to the vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- And may include a storage medium of at least one type of disk and optical disk. The mobile terminal 100 may operate in association with a web storage that performs the storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the control unit 180 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Referring to FIGS. 2 and 3, the disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto and can be applied to various structures such as a folder type, a flip type, a slide type, a swing type, and a swivel type in which a watch type, a clip type, a glass type or two or more bodies are relatively movably coupled .

Meanwhile, the mobile terminal can be extended to a wearable device that can be worn on the body beyond the dimension that the user mainly grasps and uses. These wearable devices include smart watch, smart glass, and head mounted display (HMD). Hereinafter, examples of a mobile terminal extended to a wearable device will be described.

The wearable device can be made to be able to exchange (or interlock) data with another mobile terminal 100. The short range communication module 114 can detect (or recognize) a wearable device capable of communicating with the mobile terminal 100. If the detected wearable device is a device authenticated to communicate with the mobile terminal 100, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the wearable device 100 via the short- Lt; / RTI > Accordingly, the user can use the data processed by the mobile terminal 100 through the wearable device. For example, when a telephone is received in the mobile terminal 100, it is possible to perform a telephone conversation via the wearable device or to confirm the received message via the wearable device when a message is received in the mobile terminal 100 .

4 is a perspective view illustrating an example of a glass-type mobile terminal 400 according to another embodiment of the present invention.

The glass-type mobile terminal 400 is configured to be worn on the head of a human body, and a frame unit (case, housing, etc.) for the mobile terminal 400 may be provided. The frame portion may be formed of a flexible material to facilitate wearing. This figure illustrates that the frame portion includes a first frame 401 and a second frame 402 of different materials.

The frame portion is supported on the head portion, and a space for mounting various components is provided. As shown in the figure, electronic parts such as the control module 480, the sound output module 452, and the like may be mounted on the frame part. Further, a lens 403 covering at least one of the left eye and the right eye may be detachably mounted on the frame portion.

The control module 480 controls various electronic components included in the mobile terminal 400. The control module 480 can be understood as a configuration corresponding to the control unit 180 described above. This figure illustrates that the control module 480 is provided in the frame portion on one side of the head. However, the position of the control module 480 is not limited thereto.

The display unit 451 may be implemented as a head mounted display (HMD). The HMD type refers to a display method that is mounted on a head and displays an image directly in front of the user's eyes. When the user wears the glass-type mobile terminal 400, the display unit 451 may be arranged to correspond to at least one of the left and right eyes so that the user can directly provide an image in front of the user's eyes. In this figure, the display unit 451 is located at a portion corresponding to the right eye so that an image can be output toward the user's right eye.

The display unit 451 can project an image to the user's eyes using a prism. Further, the prism may be formed to be transmissive so that the user can view the projected image and the general view of the front (the range that the user views through the eyes) together.

As described above, the image output through the display unit 451 may be overlapped with the general view. The mobile terminal 400 can provide an Augmented Reality (AR) in which a virtual image is superimposed on a real image or a background and displayed as a single image using the characteristics of the display.

The camera 421 is disposed adjacent to at least one of the left eye and the right eye, and is configured to photograph a forward image. Since the camera 421 is positioned adjacent to the eyes, the camera 421 can acquire a scene viewed by the user as an image.

Although the camera 421 is provided in the control module 480 in this figure, it is not limited thereto. The camera 421 may be installed in the frame portion, or may be provided in a plurality of ways to obtain a stereoscopic image.

The glass-type mobile terminal 400 may include user input units 423a and 423b operated to receive control commands. The user input units 423a and 423b can be employed in any manner as long as the user operates in a tactile manner such as a touch or a push. This figure illustrates that the frame unit and the control module 480 are provided with user input units 423a and 423b of a push and touch input method, respectively.

In addition, the glass-type mobile terminal 400 may be provided with a microphone (not shown) for receiving sound and processing it as electrical voice data and an acoustic output module 452 for outputting sound. The sound output module 452 may be configured to transmit sound in a general sound output mode or a bone conduction mode. When the sound output module 452 is implemented in a bone conduction manner, when the user wears the mobile terminal 400, the sound output module 452 is brought into close contact with the head and vibrates the skull to transmit sound.

In addition, according to the embodiment of the present invention, the glass-type mobile terminal 400 may include various components of the mobile terminal 100 as a component. The sensing unit 140 of the mobile terminal 100 may be extended through at least one of the first frame 401 and the second frame 402 so that the control module 480 of the glass- Can detect the wearing state of the glass-type mobile terminal (400). That is, when the user wears a glass-type mobile terminal, the control module 480 controls the sensing unit 140 to display the position of the glass-type mobile terminal 400 at which point of the user's head, The degree of wear of the glass-type mobile terminal 400, and the like. Here, the wearing angle refers to an angle of inclination due to wearing of the state that the display portion 452 of the glass-type mobile terminal 400 is placed on the floor while facing the front.

When the sensing unit 140 is extended to at least one of the first frame 401 and the second frame 402, the control unit 480 controls the temperature, the pressure, the capacitance change, and the like of the at least one frame The sensing unit 140 senses the state of the user and determines whether the glass-type mobile terminal 400 is worn on the user's head.

The objects to be sensed by the temperature, pressure, electrostatic capacity, and the like are merely examples, and various sensors can be applied to the glass-type mobile terminal 400 to determine the wearing state of the glass-type mobile terminal 400. The glass type mobile terminal 400 may be used only when the sensing unit 140 is extended to at least one of the first frame 401 and the second frame 402 The control module 480 may be provided with various sensors (for example, an acceleration sensor and a geomagnetic sensor) in the control module 480 to detect changes in pressure, temperature, electrostatic capacity, It is possible to determine the wearing state of the battery 400.

Hereinafter, the glass-type mobile terminal 400 described herein will be referred to as a mobile terminal 400 for convenience of explanation. Also, the control module 480 will be referred to as a control unit 480. Although it is assumed herein that the mobile terminal 400 operates independently, it is obvious that the mobile terminal 400 can communicate with and perform various operations in cooperation with the mobile terminal shown in FIG.

The information may be stored in a memory (not shown) of the mobile terminal 400 or the control unit 480 or may be display information according to the execution of various programs and applications received through the wireless communication unit 110. [ In addition, the schedule information and memo of the user may correspond to the information of the present invention. Various multimedia data stored in advance in the mobile terminal 400 or downloaded while using the mobile terminal 400 may also be included in the information of the present invention. Furthermore, when a video call is performed through the mobile terminal 400, the received image information and the preview image of the subject to be photographed through the camera 421 may be included in the information of the present invention.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal configured as above will be described with reference to the accompanying drawings.

5 is a flowchart illustrating an operation of a mobile terminal according to an exemplary embodiment of the present invention. 6 is an exemplary view for explaining the wearing state of the mobile terminal according to the embodiment of the present invention, and FIG. 7 is an exemplary view for explaining a case where the wearing state of the mobile terminal is changed according to the embodiment of the present invention to be. 6 and 7 illustrate an example for explaining the effect of the wearing state change of the mobile terminal 400 on the user's view when the wearing state of the mobile terminal 400 is changed.

Referring to FIG. 5, the controller 480 may control the information to be displayed on the display unit 451 according to the first criterion (501). Before describing the first reference position and the display method, reference will be made to FIGS. 6 to 8 to describe the relationship of display positions according to the wearing state of the mobile terminal 400. FIG.

6 (a) is an exemplary view of a state in which the user 600 first wears the mobile terminal 400, and FIG. 6 (b) illustrates a state in which after the user wears the mobile terminal 400, And the terminal 400 is written down. 6 (c) is an example of a case where the user writes the mobile terminal 400 up. 6 (b) or 6 (c) when the user moves while the mobile terminal 400 is worn, as shown in FIG. 6 (a) The wearing state of the terminal 400 can be changed.

7 (a), the mobile terminal 400 can be moved in the left-right direction 701 or the up-down direction 702 while being worn on the user's head. Or the mobile terminal 400 may be moved in any direction in which the directions are combined. In this case, the control unit 480 can detect the wearing position, wearing angle, and the like of the mobile terminal 400 as described above.

Referring to FIG. 7 (b), the user's line of sight 700 is shown when the mobile terminal 400 is worn. A case where the user is looking forward while wearing the mobile terminal 400 will be described as an example. When the movement (or shake) of the mobile terminal 400 described with reference to FIG. 7A is detected, the user's line of sight 700 is shifted in the vertical direction 711 or the left and right direction 712 with respect to the mobile terminal 400 . Or the user's line of sight 700 may be moved in any direction in which the respective directions are combined. That is, it is assumed that the mobile terminal 400 is actually moved. On the basis of the mobile terminal 400, it is assumed that the user's line of sight 700 is moved in the directions 711 and 712 in FIG. 7B can do.

Referring to FIG. 8, when the wearable state of the mobile terminal 400 is changed as described in FIGS. 6 and 7, when the mobile terminal 400 is moved, the user's line of sight 700, .

6 (a), when the user 600 senses wearing of the mobile terminal 400, the controller 480 can control the wear state information of the mobile terminal 400 to be sensed. The worn state information of the mobile terminal 400 may include at least one of a position where the mobile terminal 400 contacts the body of the user 600, a degree of tilting of the mobile terminal 400, It refers to the information to be included. In order to detect the various types of information, the mobile terminal 400 may include various sensors as described above. In particular, the mobile terminal 400 may be provided with a sensor for recognizing the user's iris, eyes, or the like, in order to detect the user's view information.

 In this case, the sensor may be provided in a direction toward the user's pupil to recognize the user's iris or eyeball. The control unit 480 may detect that the mobile terminal 400 additionally includes a camera that directs the user's iris or eyeball to the user's pupil.

The control unit 480 may detect the position of the mobile terminal 400 contacting the user's body and the degree of tilting of the mobile terminal 400 and consider the position of the display unit 451, The visual field information of the user 600 can be estimated. For the estimation, the mobile terminal 400 may store various data for estimating the user's view information such as an average eye position according to a face of a person or a position of an eye according to a wear angle.

Various information included in the wear state information of the mobile terminal 400 and a method of sensing the various information are not limited to the above embodiments.

The control unit 480 can control the first reference position to be determined by sensing the wear state information. Here, the first reference position refers to a reference position at which the information 800 is displayed on the display unit 451 while the user 600 wears the mobile terminal 400 as shown in FIG. 6 (a). Although not shown, the first reference position may be located in the middle of the displayed information 800. That is, when the user wears the mobile terminal 400, the control unit 480 determines the first reference position through various information, and accordingly, the information 800 is displayed on the display unit 451 as shown in FIG. 8 (a) On a certain area of the display device.

8A, when the user 600 looks at the display unit 451 while the user 800 does not cover the forward line of sight 700, the control unit 480 displays the information 800 To be displayed at a position optimized for confirming the position of the object.

The control unit 480 controls the information 800 to be displayed according to the first reference position so that the mobile terminal 400 can provide the optimized display environment to the user, The user may be inconvenienced in using the mobile terminal 400. In this case,

That is, if the user wears the mobile terminal 400 as shown in FIG. 6 (b), the position of the user's sight line 700 is increased as shown in FIG. 8 (b) 800 may cover the user's eyes. In this case, since it is difficult to secure the front view, there is a risk that the user may not recognize the surrounding environment when moving while wearing the mobile terminal 400.

If the user wears the mobile terminal 400 as shown in FIG. 6 (c), the position of the user's eyes 700 will be lowered as shown in FIG. 8 (c) 800) is too far away from the user's gaze. In this case, it is easy for the user to secure the front view, but it may be difficult to confirm the information 800. In the case of FIGS. 8B and 8C, when the wear state of the mobile terminal 400 is changed as shown in FIG. 7B, It is assumed that the user's line of sight 700 is moved.

6 to 8, the controller 480 can detect the worn state of the mobile terminal 400 when the worn state of the mobile terminal 400 is changed based on the worn state information of the terminal 400. FIG. 5, the controller 480 may detect the motion of the mobile terminal 400 (503).

The controller 480 may control the first reference position to change to the second reference position according to the movement of the mobile terminal 400 in step 505, 800 may be controlled to be displayed (507). An embodiment in which the second reference position and the display position of the information 800 are adjusted will now be described in detail with reference to FIGS. 9 and 10. FIG.

FIG. 9 is a view for explaining display position change of information according to an embodiment of the present invention, FIG. 10 is a view for explaining a relation between a motion of a mobile terminal and a display position changing operation of information according to an embodiment of the present invention Fig.

9A, since the information 800 is displayed in accordance with the first reference position, the information 800 is displayed on the display unit 451 of the mobile terminal 400 according to the movement of the mobile terminal 400 Information 800 will cover the user's line of sight 700. The control unit 480 may control the first reference position to be changed to the second reference position.

Referring to FIG. 9 (b), the displayed information 900 has been changed based on the changed second reference position. The control unit 480 may control the information 900 to be displayed in accordance with the second reference position. Although not shown, the second reference position may be located in the middle of the displayed information 900.

In addition, the information 900 may be the same information as the information 800 of FIG. 8, and in some cases, the information 800 may be in a modified form. A detailed description thereof will be given later with reference to FIG. 12 and FIG.

The control unit 480 may control the second reference position to be determined to a position corresponding to the displacement of the mobile terminal 400. Particularly, the information 900 shown in FIG. 9 (b) is displayed on the display 800 in a direction opposite to the displacement of the mobile terminal 400 by a predetermined distance 910, And is moved and displayed from the position where it is displayed.

At this time, the predetermined distance at which the first reference position is moved to the second reference position does not necessarily coincide with the distance corresponding to the movement of the mobile terminal 400. That is, the distance between the first reference position and the second reference position does not necessarily correspond to the distance corresponding to the movement of the mobile terminal 400, and may be a distance corresponding to a predetermined magnification of the distance according to the movement of the mobile terminal 400 .

The predetermined magnification may be determined according to the setting of the user or manufacturer in consideration of the size of the display unit 451, the size of the displayed information, the distance between the display unit 451 and the user's eye, and the like.

10 (a) is a conceptual diagram of a case where information 800 is displayed according to a first reference position as shown in FIG. 8 (a). The control unit 480 can control the information 800 to be displayed on a partial area of the display unit 451 and recognize that the user's sight line 700 secures the field of view 1000 outside the mobile terminal 400 . Referring to FIG. 10B, when the mobile terminal 400 descends by the displacement 710 according to the movement of the mobile terminal 400, as shown in FIG. 8B, Is clogged with information 800. [ Therefore, it is difficult for the user to secure the external field of view 1000.

Referring to FIG. 10 (c), the controller 480 may control the second reference position to a position corresponding to the displacement of the mobile terminal 400, So that the information 900 can be controlled to be displayed. Accordingly, the information 900 has moved in a direction opposite to the movement displacement 710 of the mobile terminal by a predetermined distance 910 as compared with the information 800. Thus, the user's line of sight 700 can secure the field of view 1000 outside the mobile terminal 400.

Meanwhile, although the case where the second reference position is determined by the control unit 480 in the above embodiment, the control unit 480 may determine the second reference position according to the setting through the user's input units 423a and 423b . That is, the user may set the second reference position to secure an optimal field of view through the operation of the input units 423a and 423b, and display information on the display unit 451 according to the set second reference position. The setting of the second reference position may be input while the user wears the mobile terminal 400 while the mobile terminal 400 is wearing, but may be inputted when the mobile terminal 400 is first worn.

In the above-described embodiment, the second reference position is determined as a position corresponding to the displacement of the mobile terminal 400 according to the movement, or is determined according to user setting. However, according to another embodiment of the present invention, The position may be determined according to the wear state information of the mobile terminal 400 in the same manner as the method of determining the first reference position. This will be described in detail with reference to FIG.

11 is an operational flowchart of a mobile terminal for determining a display position of information according to an embodiment of the present invention. Referring to FIG. 11, the controller 480 may detect wearing of the mobile terminal 400 (1101). In addition, the controller 480 may detect wearable state information of the mobile terminal including at least one of a position where the mobile terminal 400 contacts the user's body, a degree of tilting of the mobile terminal, and a user's view information (1103 ). Thereby, the control unit 480 can determine the first reference position (1105). A detailed description thereof has been described above with reference to FIG. 8, and will be omitted.

Thereafter, the controller 480 can sense the movement of the mobile terminal 400 through the sensing unit 140 (1107). If the movement of the mobile terminal 400 is sensed, the controller 480 may control the wearer to be newly sensed, and may determine that the second reference position is determined based on the newly sensed wearing condition information, (1109). The controller 480 may control the information to be displayed in accordance with the determined second reference position. That is, the controller 480 can determine the second reference position in the same manner as the first reference position determination method.

If the movement of the mobile terminal 400 is not detected, the first reference position determined in advance is maintained, so that the controller 480 can control information to be displayed in accordance with the first reference position.

FIG. 12 is an exemplary view for explaining a limit value of displacement of a mobile terminal according to an embodiment of the present invention, and FIG. 13 is a view for explaining a limit value of a displacement when the displacement of the mobile terminal exceeds a limit value according to an embodiment of the present invention. Fig. FIG. 14 is an exemplary view for explaining an interface displayed when the displacement of the mobile terminal exceeds a threshold value according to an embodiment of the present invention. FIG.

FIG. 12A is an exemplary diagram showing a case where the control unit 480 displays the information 800 when the first reference position is determined as shown in FIG. 8A. The preview image is shown in FIG. 13 (a) as an example of the information displayed in accordance with the first reference position.

When the mobile terminal 400 is moved and is worn as shown in FIG. 6 (b), the controller 480 determines that the information 900 is transmitted to the mobile terminal 400 as shown in FIG. 12 (b) So that the display can be controlled to be displayed at a predetermined distance 910 in the opposite direction.

In this case, the control unit 480 controls the second reference position to be determined to a position corresponding to the displacement of the mobile terminal 400, and when the displacement exceeds the preset limit value, It is possible to control the second reference position to be determined to the corresponding position.

That is, when the controller 480 determines the second reference position in response to the movement displacement of the mobile terminal 400 exceeding a predetermined distance, the control unit 480 controls the display area of the display unit 451 according to the size or shape of the information. It may happen that all the information can not be displayed. In order to prevent this, according to the present embodiment, when the information is displayed in accordance with the first reference position, the size and shape of the information are taken into consideration, and even if the display position of the information is changed, The limit value of the displacement can be set to the displacement according to the motion of the mobile terminal 400 that maintains the shape.

Accordingly, even if the displacement due to the motion of the mobile terminal 400 exceeds the preset limit value, the controller 480 determines that there is a motion displacement corresponding to the limit value, You can decide.

In addition, the controller 480 may control at least one of the size and the shape of the displayed information 900 according to the second reference position as shown in FIG. 12B. In this case, when the information 800 is displayed in accordance with the first reference position in FIG. 12A, the controller 480 determines the attribute of the information 800, and if it can adjust at least one of the size and the shape And control information such that at least one of the size and the shape of the information 800 may be displayed as the information 900 according to the second reference position. In this case, the rate at which the size of the information is adjusted may be determined according to the setting of the user or the manufacturer.

The control unit 480 determines the second reference position and adjusts the information according to the movement of the mobile terminal 400 so that the information can be displayed on the display unit 451 in accordance with the ratio The displacement can be set to the limit value of the displacement. Accordingly, even if the displacement due to the motion of the mobile terminal 400 exceeds the preset limit value, the controller 480 determines that there is a motion displacement corresponding to the limit value, So that the second reference position can be determined.

An example of the case where the size of the information 900 is adjusted and displayed according to the second reference position is shown in FIG. 13 (b). As in Fig. 13A, a preview image is shown as an example of information.

12B, the control unit 480 maintains the same size and shape as the information 800 on the basis of the second reference position as the mobile terminal 400 moves, Of a mobile terminal 400 that can display information 900 by reducing a predetermined ratio or changing its shape.

The control unit 480 may control the information 1200 to be displayed by being moved by a predetermined distance 1210 in a small size according to the attribute of the information 1200 displayed by the control unit 480 as shown in FIG.

For example, when the information 1200 is text, the control unit 480 may control to sequentially display a part of the information in accordance with the displayed area. That is, the control unit 480 determines the type of information, and when the information is text of one paragraph, it may control the displayed information 1200 to sequentially display one line of text constituting the paragraph . In Fig. 13C, a line of text is shown as information 1200 according to the above example. That is, when the displacement of the mobile terminal 400 exceeds the threshold value, the controller 480 may determine that there is a displacement of only the threshold value, and if it is determined that there is a displacement, If it is displayable, it is possible to divide the information so that some of the information is sequentially displayed. Here, the second reference position refers to a position on the display unit that allows information to be divided and displayed in a minimum unit, and the controller 480 can set the displacement of the corresponding mobile terminal to the limit value.

If the displacement of the mobile terminal 400 due to the motion exceeds a preset limit value, the control unit 480 outputs the information 1300 displayed in FIG. 14 (a) to the information shown in FIG. 14 (b) (1400), and may be controlled to disappear entirely on the display unit (451). This allows the front view of the user to be secured.

Alternatively, the control unit 480 may control the display unit 1410 to display an interface 1410 that provides a notification of requesting a change of the wearing state of the mobile terminal 400, as shown in (c) of FIG. The control unit 480 may control the display setting change input from the user through the interface. The user may turn off the display through the interface or change the information displayed in the other kind.

Meanwhile, the mobile terminal 400 may further include a camera 421 for capturing an image. Hereinafter, the case where the information is a preview image of an image photographed through the camera 421 will be described with reference to FIG. 15 to FIG.

15 is an exemplary view for explaining a change in camera angle of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 15A, the control unit 480 may control the shooting object 1500 to be photographed in the direction 1510 through the camera 421. At this time, the control unit 480 may control the display unit 451 to display a preview image of the shooting target 1500. The control unit 480 may control the preview image to be displayed according to the first reference position as described above.

However, if the mobile terminal 400 is tilted according to the movement of the mobile terminal 400 as shown in FIG. 15B, the direction in which the mobile terminal 400 faces the camera 421 is the direction 1520 ). In this case, the user may not be able to shoot the desired shooting object 1500 as the preview image displayed according to the first reference.

According to an embodiment of the present invention, the controller 480 may control the photographing angle of the camera 421 to be adjusted to correct the tilted angle. That is, the control unit 480 controls the photographing angle of the camera to be adjusted by an angle 1530 corresponding to the tilt so that the same image as the preview image displayed in accordance with the first reference position is captured. The control of the photographing angle may mean that the angle of the camera 421 itself is changed by the control unit 480. In addition to this, the control unit 480 may control the photographing target among the photographing objects sensed through the camera 421 And controlling the camera so that the same image as the preview image displayed in accordance with the first reference position is photographed.

16 is an exemplary view for explaining an effect of correcting a photographing angle of a camera according to the degree of tilting of a mobile terminal according to an embodiment of the present invention. 17 is an exemplary view for explaining a correction range of the camera photographing angle according to the tilt of the mobile terminal according to the embodiment of the present invention.

As shown in FIGS. 16A and 17A, the control unit 480 may set a limit value 1600 capable of adjusting the photographing angle of the camera 421 in advance. 12, even if the mobile terminal 400 is inclined, the control unit 480 controls the camera 421 to capture the same image as the preview image displayed in accordance with the first criterion The threshold value of the inclination change of the mobile terminal 400. The control unit 480 may set the limit value in consideration of the size and shape of the preview image displayed in accordance with the first reference.

16A is an example of a case in which the tilting degree of the mobile terminal 400 is equal to or less than the preset threshold value 1600. [ 16B is an exemplary view for explaining the effect of the controller 480 on adjusting the photographing angle. The control unit 480 may control the preview image 1610 to be displayed in accordance with the first reference position. The photographing object 1620 is changed in the direction 1520 in which the camera 421 is oriented as the mobile terminal 400 is tilted but the control unit 480 changes the photographing angle so that the same image as the preview image 1510 is taken .

FIG. 17A is an example of a case where the tilting degree of the mobile terminal 400 exceeds the preset threshold value 1600. FIG. Exceeding the preset limit value 1600, the camera 421 is pointing in the direction 1700. 17B, the preview image 1610 is the same as that shown in FIG. 16B, but the shooting object 1630 is changed in the direction 1700 toward the camera 421, The control unit 480 can not adjust the photographing angle of the camera 421. [ In this case, the control unit 480 may control the display unit 451 to display an interface for requesting the user to select whether the photographing state progresses. The user can stop shooting the camera 421 and change the wearing state of the mobile terminal 400 and continue shooting the same image as the preview image 1610. [

18 is an exemplary view for explaining a change in display angle of information when the mobile terminal according to the embodiment of the present invention is down. FIG. 19 is an exemplary view for explaining a change in display angle of information when a mobile terminal according to an embodiment of the present invention is put up. FIG. In the case of Figs. 18A and 19A, since the information 800 is displayed in accordance with the first reference position as shown in Fig. 8A, the description thereof will be omitted.

When the mobile terminal 400 is tilted according to the movement of the mobile terminal 400, for example, when the user writes down the mobile terminal 400 as shown in FIG. 18 (b) , The information displayed on the actual display unit 451 may be distorted due to inclination of the image of the information recognized by the user even though the information is the same. According to the embodiment of the present invention, when the user writes down the mobile terminal 400 as shown in (b) of FIG. 18, the controller 480 corrects the distortion so that the display angle of the information 1800 becomes c). That is, when the tilting of the mobile terminal 400 is detected, the controller 480 controls the display angle of the information to be adjusted in response to the tilting. Similarly, when the user has loaded the mobile terminal 400 as shown in FIG. 19 (b), the controller 480 can control the display angle of the information 1900 to be adjusted as shown in FIG. 19 (c). Specifically, the control unit 480 may control the information displayed three-dimensionally rotated by an inclined angle so as to correct the skew of the image. That is, the controller 480 processes and displays the information with the image rotated three-dimensionally by an inclined angle, so that the mobile terminal 400 can display the image to the user as shown in FIGS. 18 (a) and 19 It is possible to provide the same shape as the information 800 that is provided.

In addition to the three-dimensional rotation method, the control unit 480 controls the display angle of the information to be controlled by controlling the length of one side of the upper side or the lower side of the information to be displayed longer than the length of one side of the other side It is possible.

FIG. 20 is an exemplary view for explaining display angle correction of information of a mobile terminal according to an embodiment of the present invention, FIG. 21 is an exemplary view for explaining display of information according to display angle correction according to an embodiment of the present invention to be.

20A, the information 800 is displayed on the straight line 2003 at a slant by the inclination 2010 based on the straight line 2001 perpendicular to the direction of the user's line of sight 700. The control unit 480 can preset a threshold value 2005 that can correct the angle at which the information 800 is displayed.

12, the control unit 480 controls the display unit 451 to display the same information as the information 800 displayed in accordance with the first reference, even if the mobile terminal 400 is inclined as described above Means a threshold of tilting of the mobile terminal 400 that adjusts the display angle of information so that the user can recognize the information.

The controller 480 may set the threshold value in consideration of the size and shape of information displayed according to the first criterion. Particularly, FIG. 20A is an example of a case in which the inclination of the mobile terminal 200 is equal to or less than the predetermined threshold value 2005. FIG. Referring to FIG. 20 (b), the controller 480 may control the information 800 to be displayed on a straight line 2007 parallel to the straight line 2001. In this case, the control unit 480 can actually produce the same effect as the display angle is adjusted by modifying the information on the display unit 451 as described above.

Referring to FIG. 21A, when there is no inclination of the mobile terminal 400, the controller 480 can control the information 800 to be displayed according to the first reference position. However, when the mobile terminal 400 is tilted as shown in FIG. 20 (b), in response to the tilting, the controller 480 controls the display angle of the information to be controlled as described in FIG. 20 (c) And an example thereof is shown in Fig. 21 (b). Referring to FIG. 21B, the information 1800 is rotated and displayed in three dimensions in order to correct the tilting. Accordingly, the user can recognize the information as shown in FIG. 21 (b) and recognize it as shown in FIG. 21 (a).

FIG. 22 is an exemplary view for explaining a range of display angle correction according to an embodiment of the present invention, and FIG. 23 is an exemplary view for explaining a display angle correction limit value according to an embodiment of the present invention.

22A is an example of a case where the inclination 2210 of the mobile terminal 400 exceeds the preset threshold value 2005. In this case, In this case, the controller 480 may control the display angle of the information to be adjusted only to the extent that the mobile terminal 400 determines that the mobile terminal 400 is inclined by the threshold value and can correct a preset threshold value. Referring to FIG. 22B, the control unit 480 may transform the information so that the information is recognized as being displayed on the straight line 2007 parallel to the straight line 2001.

The description of FIG. 23A is the same as that of FIG. 22A, and therefore, the description is omitted. Referring to FIG. 23 (b), the controller 400 may control the information 1800 to be three-dimensionally rotated and displayed so as to correct the tilting of the mobile terminal 400 by the preset threshold value 2005 . However, since the display angle is adjusted only to correspond to the limit value, the user can not recognize that the information is displayed as in the case of the information 800 shown in Fig. 23A in this case.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be implemented as computer readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Also, the computer may include a control unit 180 of the terminal.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

400: mobile terminal
140: sensing unit
480:
451:

Claims (18)

A display unit for displaying information;
A sensing unit for sensing movement of the mobile terminal; And
And a controller for controlling the information to be displayed in accordance with the first reference position,
When the movement of the mobile terminal is detected, the controller changes the first reference position to a second reference position according to the movement of the mobile terminal, and controls the display position of the information to be adjusted according to the second reference position Wherein the mobile terminal is a mobile terminal. The mobile terminal of claim 1,
Wherein the mobile terminal is a glass-type mobile terminal that can be worn on the user's body. 3. The apparatus of claim 2,
When the wearing of the mobile terminal is sensed, information on the wearing state of the mobile terminal including at least one of a position at which the mobile terminal contacts the user's body, a degree of inclination of the mobile terminal, And controlling the mobile terminal. The apparatus of claim 3,
And controls the first reference position to be determined based on the wear state information. The apparatus of claim 3,
When the movement of the mobile terminal is detected, the wear state information is newly detected,
And controls the second reference position to be determined based on the newly sensed wearing state information. The apparatus of claim 1,
The second reference position is determined to be a position corresponding to the displacement of the mobile terminal when the displacement exceeds a preset limit value, And controls the mobile terminal to be determined. 7. The apparatus of claim 6,
And controls at least one of a size and a shape of the displayed information according to the second reference position. 7. The apparatus of claim 6,
And controls the information to disappear on the display unit according to the second reference position. 7. The apparatus of claim 6,
And controls to display an interface for providing a notification of requesting a change of the wearing state of the mobile terminal according to the second reference position. The apparatus of claim 1,
And controls the display angle of the information to be adjusted in response to the inclination when the inclination of the mobile terminal is detected. 11. The apparatus according to claim 10,
Controls the display angle of the information to be controlled by controlling the display so that the length of any one of the upper side and the lower side of the information is longer than the length of the other side. 11. The apparatus according to claim 10,
And controls the display angle of the information to be adjusted according to the preset limit value when the inclination exceeds a predetermined limit value. The method of claim 1, wherein the mobile terminal
Further comprising a camera for capturing an image, wherein the information is a preview image for the image. 14. The apparatus of claim 13,
Wherein the controller controls the photographing angle of the camera to be adjusted corresponding to the inclination so that the same image as the preview image displayed in accordance with the first reference position is sensed when the inclination of the mobile terminal is sensed. 15. The apparatus of claim 14,
And controls the display unit to display an interface for requesting selection of progress of the photographing state if the degree of inclination exceeds a preset limit value. Displaying the information at a first reference position;
Changing a first reference position to a second reference position in accordance with movement of the mobile terminal when motion detection of the mobile terminal is detected; And
And adjusting a display position of the information in accordance with a second reference position. 17. The mobile terminal of claim 16,
Wherein the mobile terminal is a glass-type mobile terminal that can be worn on the user's body. 18. The method of claim 17,
When the wear of the mobile terminal is detected, the wearable state information of the mobile terminal including at least one of a position at which the mobile terminal contacts the user's body, a degree of inclination of the mobile terminal, and visual information of the user is sensed And determining the first reference position based on the first reference position.

Images